2024-03-30T12:53:46.953 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-30T12:53:46.953 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/uninlining} --name mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi --owner scheduled_mchangir@teuthology --archive /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144 -- /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144/orig.config.yaml 2024-03-30T12:53:47.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T12:53:47.098 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144 branch: wip-mchangir-testing1-main-20240328-072412 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/uninlining} email: mchangir@redhat.com first_in_suite: false job_id: '7629144' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-mchangir-testing1-main-20240328-072412 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing1-main-20240328-072412 sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 owner: scheduled_mchangir@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 364 sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-mchangir-testing1-main-20240328-072412 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQncMjdkmL0Ut+RMDCYwSEvn24cR8fWRRWTz8K1umSOkBYIE51wXn7pl5RwzpxAEY0pWqsydHCuujicnV+RJHg= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6Jqlo9d8WP5l1R2CMXUOnRdFXhCejeX8yB25T08KHYEYmSpmyU4ZhtZbCU8idUf5sAmoE8u1jhUmhNQLrfol8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_uninlining teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-29_13:38:54 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-30T12:53:47.099 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa; will attempt to use it 2024-03-30T12:53:47.099 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks 2024-03-30T12:53:47.100 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-30T12:53:47.101 INFO:teuthology.task.internal:Checking packages... 2024-03-30T12:53:47.126 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7' 2024-03-30T12:53:47.126 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T12:53:47.126 INFO:teuthology.packaging:ref: None 2024-03-30T12:53:47.126 INFO:teuthology.packaging:tag: None 2024-03-30T12:53:47.126 INFO:teuthology.packaging:branch: wip-mchangir-testing1-main-20240328-072412 2024-03-30T12:53:47.126 INFO:teuthology.packaging:sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T12:53:47.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-mchangir-testing1-main-20240328-072412 2024-03-30T12:53:47.364 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2519-gac171039-1jammy 2024-03-30T12:53:47.366 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-30T12:53:47.370 INFO:teuthology.task.internal:no buildpackages task found 2024-03-30T12:53:47.370 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-30T12:53:47.383 INFO:teuthology.task.internal:Saving configuration 2024-03-30T12:53:47.400 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-30T12:53:47.406 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T12:53:47.431 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 12:47:58.926345', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJxpAA434Lg4G/EvP70cZRmGYm1XjFmiPrzGjs5mMS+Y'} 2024-03-30T12:53:47.457 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 12:47:58.925318', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIA5+iktR1UdGnB1AZKyYcl8kSHtVNKiDEqvwou2nRr9O'} 2024-03-30T12:53:47.458 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-30T12:53:47.464 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-30T12:53:47.464 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-30T12:53:47.464 INFO:teuthology.run_tasks:Running task console_log... 2024-03-30T12:53:47.537 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5245b843a0>, signals=[15]) 2024-03-30T12:53:47.537 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-30T12:53:47.543 INFO:teuthology.task.internal:Opening connections... 2024-03-30T12:53:47.544 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T12:53:47.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:53:47.625 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T12:53:47.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:53:47.711 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-30T12:53:47.717 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2024-03-30T12:53:47.722 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2024-03-30T12:53:47.722 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-03-30T12:53:47.768 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-30T12:53:47.768 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu" 2024-03-30T12:53:47.768 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="22.04" 2024-03-30T12:53:47.768 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-30T12:53:47.768 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=jammy 2024-03-30T12:53:47.768 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu 2024-03-30T12:53:47.768 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian 2024-03-30T12:53:47.768 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-30T12:53:47.768 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-30T12:53:47.769 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-30T12:53:47.769 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-30T12:53:47.769 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=jammy 2024-03-30T12:53:47.769 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-03-30T12:53:47.795 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-03-30T12:53:47.800 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-03-30T12:53:47.800 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-03-30T12:53:47.844 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-30T12:53:47.845 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2024-03-30T12:53:47.845 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04" 2024-03-30T12:53:47.845 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-30T12:53:47.845 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy 2024-03-30T12:53:47.845 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2024-03-30T12:53:47.845 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2024-03-30T12:53:47.845 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-30T12:53:47.845 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-30T12:53:47.845 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-30T12:53:47.845 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-30T12:53:47.845 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy 2024-03-30T12:53:47.846 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-03-30T12:53:47.878 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-30T12:53:47.888 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-30T12:53:47.968 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-30T12:53:47.969 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2024-03-30T12:53:47.971 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-03-30T12:53:47.976 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-30T12:53:47.982 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-30T12:53:47.982 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2024-03-30T12:53:48.018 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-03-30T12:53:48.025 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-30T12:53:48.077 INFO:teuthology.run_tasks:Running task kernel... 2024-03-30T12:53:48.092 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-30T12:53:48.093 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-30T12:53:48.093 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T12:53:48.093 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T12:53:48.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:53:48.098 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-03-30T12:53:48.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:53:48.099 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-03-30T12:53:48.144 INFO:teuthology.orchestra.run.smithi083.stdout:5.15.0-56-generic 2024-03-30T12:53:48.145 INFO:teuthology.task.kernel:Running kernel on smithi083: 5.15.0-56-generic 2024-03-30T12:53:48.145 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get clean 2024-03-30T12:53:48.146 INFO:teuthology.orchestra.run.smithi153.stdout:5.15.0-56-generic 2024-03-30T12:53:48.146 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.15.0-56-generic 2024-03-30T12:53:48.146 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-03-30T12:53:48.269 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-03-30T12:53:48.413 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get update 2024-03-30T12:53:48.430 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-30T12:53:48.510 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-30T12:53:48.549 INFO:teuthology.orchestra.run.smithi083.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-30T12:53:48.592 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-30T12:53:48.654 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-30T12:53:48.676 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [436 kB] 2024-03-30T12:53:48.736 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-30T12:53:48.776 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,303 kB] 2024-03-30T12:53:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,303 kB] 2024-03-30T12:53:48.919 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [233 kB] 2024-03-30T12:53:48.926 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-30T12:53:48.927 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,616 kB] 2024-03-30T12:53:48.943 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-30T12:53:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-30T12:53:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [271 kB] 2024-03-30T12:53:48.961 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [436 kB] 2024-03-30T12:53:48.965 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-30T12:53:48.966 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-03-30T12:53:48.979 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [233 kB] 2024-03-30T12:53:48.989 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-30T12:53:48.990 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-30T12:53:48.992 INFO:teuthology.orchestra.run.smithi083.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,616 kB] 2024-03-30T12:53:49.015 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-03-30T12:53:49.032 INFO:teuthology.orchestra.run.smithi083.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [271 kB] 2024-03-30T12:53:49.037 INFO:teuthology.orchestra.run.smithi083.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-30T12:53:49.038 INFO:teuthology.orchestra.run.smithi083.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-03-30T12:53:49.043 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-03-30T12:53:49.045 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-30T12:53:49.046 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-30T12:53:49.047 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-30T12:53:49.047 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-30T12:53:49.047 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-30T12:53:49.050 INFO:teuthology.orchestra.run.smithi083.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-03-30T12:53:49.057 INFO:teuthology.orchestra.run.smithi083.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-03-30T12:53:49.082 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,519 kB] 2024-03-30T12:53:49.090 INFO:teuthology.orchestra.run.smithi083.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-30T12:53:49.091 INFO:teuthology.orchestra.run.smithi083.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-30T12:53:49.091 INFO:teuthology.orchestra.run.smithi083.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-30T12:53:49.091 INFO:teuthology.orchestra.run.smithi083.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-30T12:53:49.091 INFO:teuthology.orchestra.run.smithi083.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-30T12:53:49.099 INFO:teuthology.orchestra.run.smithi083.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-30T12:53:49.238 INFO:teuthology.orchestra.run.smithi083.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,519 kB] 2024-03-30T12:53:49.387 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [602 kB] 2024-03-30T12:53:49.427 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [293 kB] 2024-03-30T12:53:49.446 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-30T12:53:49.451 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,644 kB] 2024-03-30T12:53:49.502 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-30T12:53:49.503 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [274 kB] 2024-03-30T12:53:49.510 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-30T12:53:49.541 INFO:teuthology.orchestra.run.smithi083.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [602 kB] 2024-03-30T12:53:49.580 INFO:teuthology.orchestra.run.smithi083.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [293 kB] 2024-03-30T12:53:49.596 INFO:teuthology.orchestra.run.smithi083.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-30T12:53:49.596 INFO:teuthology.orchestra.run.smithi083.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-30T12:53:49.598 INFO:teuthology.orchestra.run.smithi083.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,644 kB] 2024-03-30T12:53:49.657 INFO:teuthology.orchestra.run.smithi083.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [274 kB] 2024-03-30T12:53:49.664 INFO:teuthology.orchestra.run.smithi083.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-30T12:53:49.674 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,060 kB] 2024-03-30T12:53:49.828 INFO:teuthology.orchestra.run.smithi083.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [698 kB] 2024-03-30T12:53:50.301 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [698 kB] 2024-03-30T12:53:50.339 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [241 kB] 2024-03-30T12:53:50.352 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-30T12:53:50.353 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-03-30T12:53:50.354 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.6 kB] 2024-03-30T12:53:50.356 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.0 kB] 2024-03-30T12:53:50.356 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-30T12:53:50.357 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-03-30T12:53:50.383 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-03-30T12:53:50.386 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-03-30T12:53:50.412 INFO:teuthology.orchestra.run.smithi083.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,060 kB] 2024-03-30T12:53:50.524 INFO:teuthology.orchestra.run.smithi083.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [241 kB] 2024-03-30T12:53:50.543 INFO:teuthology.orchestra.run.smithi083.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-30T12:53:50.544 INFO:teuthology.orchestra.run.smithi083.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-03-30T12:53:50.545 INFO:teuthology.orchestra.run.smithi083.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.6 kB] 2024-03-30T12:53:50.549 INFO:teuthology.orchestra.run.smithi083.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.0 kB] 2024-03-30T12:53:50.550 INFO:teuthology.orchestra.run.smithi083.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-30T12:53:50.550 INFO:teuthology.orchestra.run.smithi083.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-03-30T12:53:50.551 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-30T12:53:50.554 INFO:teuthology.orchestra.run.smithi083.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-03-30T12:53:50.559 INFO:teuthology.orchestra.run.smithi083.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-03-30T12:53:50.635 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-03-30T12:53:50.723 INFO:teuthology.orchestra.run.smithi083.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-30T12:53:50.736 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-03-30T12:53:50.798 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-03-30T12:53:50.805 INFO:teuthology.orchestra.run.smithi083.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-03-30T12:53:50.828 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-30T12:53:50.912 INFO:teuthology.orchestra.run.smithi083.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-03-30T12:53:50.971 INFO:teuthology.orchestra.run.smithi083.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-03-30T12:53:51.005 INFO:teuthology.orchestra.run.smithi083.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-30T12:53:55.054 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 12.6 MB in 2s (5,041 kB/s) 2024-03-30T12:53:55.237 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 12.6 MB in 3s (4,967 kB/s) 2024-03-30T12:53:56.376 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-03-30T12:53:56.394 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-30T12:53:56.454 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-03-30T12:53:56.651 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-03-30T12:53:56.652 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-03-30T12:53:56.659 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-03-30T12:53:56.676 DEBUG:teuthology.orchestra.run.smithi083:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-30T12:53:56.779 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-03-30T12:53:56.825 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T12:53:56.825 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T12:53:56.825 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T12:53:56.825 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T12:53:56.826 INFO:teuthology.orchestra.run.smithi153.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-30T12:53:56.826 INFO:teuthology.orchestra.run.smithi153.stdout: python2.7-minimal 2024-03-30T12:53:56.826 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T12:53:56.827 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-03-30T12:53:56.827 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-30T12:53:56.827 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-generic linux-image-5.15.0-101-generic 2024-03-30T12:53:56.827 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-5.15.0-101-generic linux-modules-extra-5.15.0-101-generic 2024-03-30T12:53:56.828 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-03-30T12:53:56.829 INFO:teuthology.orchestra.run.smithi153.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-30T12:53:56.829 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-03-30T12:53:56.829 INFO:teuthology.orchestra.run.smithi153.stdout: thermald 2024-03-30T12:53:56.874 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-03-30T12:53:56.875 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-30T12:53:56.875 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.15.0-101-generic linux-modules-5.15.0-101-generic 2024-03-30T12:53:56.875 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-extra-5.15.0-101-generic 2024-03-30T12:53:56.878 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-03-30T12:53:56.878 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-30T12:53:56.957 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2024-03-30T12:53:56.957 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2024-03-30T12:53:57.056 INFO:teuthology.orchestra.run.smithi153.stdout:3 upgraded, 5 newly installed, 0 to remove and 311 not upgraded. 2024-03-30T12:53:57.056 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 113 MB of archives. 2024-03-30T12:53:57.056 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-30T12:53:57.056 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-101-generic amd64 5.15.0-101.111 [22.6 MB] 2024-03-30T12:53:57.110 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T12:53:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T12:53:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T12:53:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T12:53:57.111 INFO:teuthology.orchestra.run.smithi083.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-30T12:53:57.111 INFO:teuthology.orchestra.run.smithi083.stdout: python2.7-minimal 2024-03-30T12:53:57.111 INFO:teuthology.orchestra.run.smithi083.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T12:53:57.112 INFO:teuthology.orchestra.run.smithi083.stdout:The following additional packages will be installed: 2024-03-30T12:53:57.112 INFO:teuthology.orchestra.run.smithi083.stdout: linux-generic linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-30T12:53:57.112 INFO:teuthology.orchestra.run.smithi083.stdout: linux-headers-generic linux-image-5.15.0-101-generic 2024-03-30T12:53:57.112 INFO:teuthology.orchestra.run.smithi083.stdout: linux-modules-5.15.0-101-generic linux-modules-extra-5.15.0-101-generic 2024-03-30T12:53:57.113 INFO:teuthology.orchestra.run.smithi083.stdout:Suggested packages: 2024-03-30T12:53:57.113 INFO:teuthology.orchestra.run.smithi083.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-30T12:53:57.113 INFO:teuthology.orchestra.run.smithi083.stdout:Recommended packages: 2024-03-30T12:53:57.113 INFO:teuthology.orchestra.run.smithi083.stdout: thermald 2024-03-30T12:53:57.163 INFO:teuthology.orchestra.run.smithi083.stdout:The following NEW packages will be installed: 2024-03-30T12:53:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-30T12:53:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: linux-image-5.15.0-101-generic linux-modules-5.15.0-101-generic 2024-03-30T12:53:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: linux-modules-extra-5.15.0-101-generic 2024-03-30T12:53:57.164 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages will be upgraded: 2024-03-30T12:53:57.165 INFO:teuthology.orchestra.run.smithi083.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-30T12:53:57.344 INFO:teuthology.orchestra.run.smithi083.stdout:3 upgraded, 5 newly installed, 0 to remove and 311 not upgraded. 2024-03-30T12:53:57.344 INFO:teuthology.orchestra.run.smithi083.stdout:Need to get 113 MB of archives. 2024-03-30T12:53:57.344 INFO:teuthology.orchestra.run.smithi083.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-30T12:53:57.344 INFO:teuthology.orchestra.run.smithi083.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-101-generic amd64 5.15.0-101.111 [22.6 MB] 2024-03-30T12:53:58.441 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-101-generic amd64 5.15.0-101.111 [11.5 MB] 2024-03-30T12:53:58.743 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-101-generic amd64 5.15.0-101.111 [11.5 MB] 2024-03-30T12:53:58.791 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-101-generic amd64 5.15.0-101.111 [63.9 MB] 2024-03-30T12:53:59.148 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-101-generic amd64 5.15.0-101.111 [63.9 MB] 2024-03-30T12:54:00.910 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.101.98 [1,698 B] 2024-03-30T12:54:00.910 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.101.98 [2,486 B] 2024-03-30T12:54:00.911 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101 all 5.15.0-101.111 [12.3 MB] 2024-03-30T12:54:01.353 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.101.98 [1,698 B] 2024-03-30T12:54:01.353 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.101.98 [2,486 B] 2024-03-30T12:54:01.353 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101 all 5.15.0-101.111 [12.3 MB] 2024-03-30T12:54:01.495 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101-generic amd64 5.15.0-101.111 [2,876 kB] 2024-03-30T12:54:01.554 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.101.98 [2,332 B] 2024-03-30T12:54:01.949 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 113 MB in 5s (24.2 MB/s) 2024-03-30T12:54:02.109 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-5.15.0-101-generic. 2024-03-30T12:54:02.491 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101-generic amd64 5.15.0-101.111 [2,876 kB] 2024-03-30T12:54:02.655 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.101.98 [2,332 B] 2024-03-30T12:54:03.081 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 113 MB in 5s (20.6 MB/s) 2024-03-30T12:54:03.264 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-modules-5.15.0-101-generic. 2024-03-30T12:54:04.073 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-30T12:54:04.077 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../0-linux-modules-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T12:54:04.156 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:05.374 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-30T12:54:05.378 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../0-linux-modules-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T12:54:05.654 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:06.491 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-image-5.15.0-101-generic. 2024-03-30T12:54:06.507 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../1-linux-image-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T12:54:06.596 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:07.069 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-101-generic. 2024-03-30T12:54:07.090 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T12:54:07.194 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:07.796 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-image-5.15.0-101-generic. 2024-03-30T12:54:07.818 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../1-linux-image-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T12:54:07.913 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:08.391 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-101-generic. 2024-03-30T12:54:08.412 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T12:54:08.449 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:13.679 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../3-linux-generic_5.15.0.101.98_amd64.deb ... 2024-03-30T12:54:13.804 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-30T12:54:14.131 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.101.98_amd64.deb ... 2024-03-30T12:54:14.243 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-30T12:54:14.579 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.15.0-101. 2024-03-30T12:54:14.601 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../5-linux-headers-5.15.0-101_5.15.0-101.111_all.deb ... 2024-03-30T12:54:14.646 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-30T12:54:15.387 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../3-linux-generic_5.15.0.101.98_amd64.deb ... 2024-03-30T12:54:15.512 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-30T12:54:15.836 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.101.98_amd64.deb ... 2024-03-30T12:54:15.941 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-image-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-30T12:54:16.202 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-headers-5.15.0-101. 2024-03-30T12:54:16.225 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../5-linux-headers-5.15.0-101_5.15.0-101.111_all.deb ... 2024-03-30T12:54:16.268 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-30T12:54:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.15.0-101-generic. 2024-03-30T12:54:20.874 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../6-linux-headers-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T12:54:20.912 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:22.297 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-headers-5.15.0-101-generic. 2024-03-30T12:54:22.321 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../6-linux-headers-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T12:54:22.363 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:23.509 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.101.98_amd64.deb ... 2024-03-30T12:54:23.631 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-30T12:54:23.988 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-30T12:54:24.827 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:24.945 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-generic (5.15.0.101.98) ... 2024-03-30T12:54:25.074 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:25.838 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.101.98_amd64.deb ... 2024-03-30T12:54:25.953 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-headers-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-30T12:54:26.311 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-30T12:54:26.374 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-30T12:54:26.374 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-30T12:54:26.374 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-101-generic 2024-03-30T12:54:26.374 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-101-generic 2024-03-30T12:54:26.424 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:26.550 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-headers-generic (5.15.0.101.98) ... 2024-03-30T12:54:26.561 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:26.670 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:27.978 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:28.005 INFO:teuthology.orchestra.run.smithi083.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-30T12:54:28.005 INFO:teuthology.orchestra.run.smithi083.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-30T12:54:28.006 INFO:teuthology.orchestra.run.smithi083.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-101-generic 2024-03-30T12:54:28.006 INFO:teuthology.orchestra.run.smithi083.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-101-generic 2024-03-30T12:54:28.165 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:29.354 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-generic (5.15.0.101.98) ... 2024-03-30T12:54:29.480 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-generic (5.15.0.101.98) ... 2024-03-30T12:54:29.599 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:29.615 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:29.681 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-30T12:54:29.681 INFO:teuthology.orchestra.run.smithi153.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-101-generic 2024-03-30T12:54:31.176 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-image-generic (5.15.0.101.98) ... 2024-03-30T12:54:31.293 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-generic (5.15.0.101.98) ... 2024-03-30T12:54:31.419 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T12:54:31.482 INFO:teuthology.orchestra.run.smithi083.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-30T12:54:31.482 INFO:teuthology.orchestra.run.smithi083.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-101-generic 2024-03-30T12:54:43.663 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-30T12:54:43.663 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub' 2024-03-30T12:54:43.682 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-30T12:54:43.696 INFO:teuthology.orchestra.run.smithi153.stdout:Generating grub configuration file ... 2024-03-30T12:54:43.945 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-30T12:54:43.961 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-30T12:54:44.268 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-30T12:54:44.274 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-30T12:54:44.353 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-30T12:54:44.358 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-30T12:54:44.500 INFO:teuthology.orchestra.run.smithi153.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-30T12:54:44.501 INFO:teuthology.orchestra.run.smithi153.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-30T12:54:44.501 INFO:teuthology.orchestra.run.smithi153.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-30T12:54:44.536 INFO:teuthology.orchestra.run.smithi153.stdout:done 2024-03-30T12:54:44.996 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-03-30T12:54:45.013 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 21 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.15.0.101.98 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-03-30T12:54:45.014 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-03-30T12:54:45.015 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-03-30T12:54:45.015 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-101-generic 2024-03-30T12:54:45.015 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-30T12:54:45.015 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-30T12:54:45.015 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-30T12:54:45.015 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2024-03-30T12:54:45.015 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-03-30T12:54:45.179 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-03-30T12:54:45.289 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-30T12:54:45.308 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-30T12:54:45.329 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-30T12:54:45.350 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-30T12:54:45.600 INFO:teuthology.orchestra.run.smithi083.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-30T12:54:45.601 INFO:teuthology.orchestra.run.smithi083.stdout:Sourcing file `/etc/default/grub' 2024-03-30T12:54:45.620 INFO:teuthology.orchestra.run.smithi083.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-30T12:54:45.646 INFO:teuthology.orchestra.run.smithi083.stdout:Generating grub configuration file ... 2024-03-30T12:54:45.911 INFO:teuthology.orchestra.run.smithi083.stdout:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-30T12:54:45.936 INFO:teuthology.orchestra.run.smithi083.stdout:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-30T12:54:46.229 INFO:teuthology.orchestra.run.smithi083.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-30T12:54:46.235 INFO:teuthology.orchestra.run.smithi083.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-30T12:54:46.305 INFO:teuthology.orchestra.run.smithi083.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-30T12:54:46.310 INFO:teuthology.orchestra.run.smithi083.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-30T12:54:46.474 INFO:teuthology.orchestra.run.smithi083.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-30T12:54:46.474 INFO:teuthology.orchestra.run.smithi083.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-30T12:54:46.474 INFO:teuthology.orchestra.run.smithi083.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-30T12:54:46.523 INFO:teuthology.orchestra.run.smithi083.stdout:done 2024-03-30T12:54:46.561 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-03-30T12:54:46.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-30T12:54:46.630 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-03-30T12:54:46.822 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-03-30T12:54:46.823 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-03-30T12:54:46.982 INFO:teuthology.orchestra.run.smithi153.stdout:linux-image-generic is already the newest version (5.15.0.101.98). 2024-03-30T12:54:46.982 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T12:54:46.982 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T12:54:46.982 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T12:54:46.982 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T12:54:46.983 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-30T12:54:46.983 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-30T12:54:46.983 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T12:54:46.987 DEBUG:teuthology.orchestra.run.smithi083:> dpkg -s linux-image-generic 2024-03-30T12:54:47.010 INFO:teuthology.orchestra.run.smithi083.stdout:Package: linux-image-generic 2024-03-30T12:54:47.010 INFO:teuthology.orchestra.run.smithi083.stdout:Status: install ok installed 2024-03-30T12:54:47.010 INFO:teuthology.orchestra.run.smithi083.stdout:Priority: optional 2024-03-30T12:54:47.010 INFO:teuthology.orchestra.run.smithi083.stdout:Section: kernel 2024-03-30T12:54:47.011 INFO:teuthology.orchestra.run.smithi083.stdout:Installed-Size: 21 2024-03-30T12:54:47.011 INFO:teuthology.orchestra.run.smithi083.stdout:Maintainer: Ubuntu Kernel Team 2024-03-30T12:54:47.011 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: amd64 2024-03-30T12:54:47.011 INFO:teuthology.orchestra.run.smithi083.stdout:Source: linux-meta 2024-03-30T12:54:47.011 INFO:teuthology.orchestra.run.smithi083.stdout:Version: 5.15.0.101.98 2024-03-30T12:54:47.011 INFO:teuthology.orchestra.run.smithi083.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-30T12:54:47.011 INFO:teuthology.orchestra.run.smithi083.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-30T12:54:47.011 INFO:teuthology.orchestra.run.smithi083.stdout:Recommends: thermald 2024-03-30T12:54:47.011 INFO:teuthology.orchestra.run.smithi083.stdout:Description: Generic Linux kernel image 2024-03-30T12:54:47.011 INFO:teuthology.orchestra.run.smithi083.stdout: This package will always depend on the latest generic kernel image 2024-03-30T12:54:47.011 INFO:teuthology.orchestra.run.smithi083.stdout: available. 2024-03-30T12:54:47.011 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-101-generic 2024-03-30T12:54:47.012 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-30T12:54:47.012 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-30T12:54:47.012 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-30T12:54:47.012 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi083.front.sepia.ceph.com, path=None, version=distro) 2024-03-30T12:54:47.012 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get clean 2024-03-30T12:54:47.022 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 0 newly installed, 0 to remove and 311 not upgraded. 2024-03-30T12:54:47.026 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-03-30T12:54:47.083 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-03-30T12:54:47.083 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-03-30T12:54:47.083 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-03-30T12:54:47.083 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-03-30T12:54:47.083 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 21 2024-03-30T12:54:47.084 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-03-30T12:54:47.084 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-03-30T12:54:47.084 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-03-30T12:54:47.084 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.15.0.101.98 2024-03-30T12:54:47.084 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-30T12:54:47.084 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-30T12:54:47.084 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-03-30T12:54:47.084 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-03-30T12:54:47.084 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-03-30T12:54:47.084 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-03-30T12:54:47.084 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-03-30T12:54:47.129 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.lZdkAuATIa 2024-03-30T12:54:47.129 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub/grub.cfg /tmp/tmp.lZdkAuATIa 2024-03-30T12:54:47.183 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.lZdkAuATIa 2024-03-30T12:54:47.196 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get update 2024-03-30T12:54:47.299 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.lZdkAuATIa is 10KB 2024-03-30T12:54:47.312 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.lZdkAuATIa 2024-03-30T12:54:47.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-30T12:54:47.320 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-30T12:54:47.332 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-30T12:54:47.353 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-30T12:54:47.373 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T12:54:47.373 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-30T12:54:47.373 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-30T12:54:47.434 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-30T12:54:47.441 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-101-generic 2024-03-30T12:54:47.441 DEBUG:teuthology.orchestra.run.smithi153:> sudo update-grub 2024-03-30T12:54:48.587 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-03-30T12:54:48.605 DEBUG:teuthology.orchestra.run.smithi083:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-30T12:54:48.654 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub' 2024-03-30T12:54:48.655 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-03-30T12:54:48.656 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-30T12:54:48.658 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-03-30T12:54:48.830 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2024-03-30T12:54:48.830 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2024-03-30T12:54:48.843 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-30T12:54:48.849 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-30T12:54:48.984 INFO:teuthology.orchestra.run.smithi083.stdout:linux-image-generic is already the newest version (5.15.0.101.98). 2024-03-30T12:54:48.984 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T12:54:48.984 INFO:teuthology.orchestra.run.smithi083.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T12:54:48.984 INFO:teuthology.orchestra.run.smithi083.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T12:54:48.984 INFO:teuthology.orchestra.run.smithi083.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T12:54:48.984 INFO:teuthology.orchestra.run.smithi083.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-30T12:54:48.985 INFO:teuthology.orchestra.run.smithi083.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-30T12:54:48.985 INFO:teuthology.orchestra.run.smithi083.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T12:54:49.022 INFO:teuthology.orchestra.run.smithi083.stdout:0 upgraded, 0 newly installed, 0 to remove and 311 not upgraded. 2024-03-30T12:54:49.024 DEBUG:teuthology.orchestra.run.smithi083:> dpkg -s linux-image-generic 2024-03-30T12:54:49.084 INFO:teuthology.orchestra.run.smithi083.stdout:Package: linux-image-generic 2024-03-30T12:54:49.084 INFO:teuthology.orchestra.run.smithi083.stdout:Status: install ok installed 2024-03-30T12:54:49.084 INFO:teuthology.orchestra.run.smithi083.stdout:Priority: optional 2024-03-30T12:54:49.084 INFO:teuthology.orchestra.run.smithi083.stdout:Section: kernel 2024-03-30T12:54:49.085 INFO:teuthology.orchestra.run.smithi083.stdout:Installed-Size: 21 2024-03-30T12:54:49.085 INFO:teuthology.orchestra.run.smithi083.stdout:Maintainer: Ubuntu Kernel Team 2024-03-30T12:54:49.085 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: amd64 2024-03-30T12:54:49.085 INFO:teuthology.orchestra.run.smithi083.stdout:Source: linux-meta 2024-03-30T12:54:49.085 INFO:teuthology.orchestra.run.smithi083.stdout:Version: 5.15.0.101.98 2024-03-30T12:54:49.085 INFO:teuthology.orchestra.run.smithi083.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-30T12:54:49.085 INFO:teuthology.orchestra.run.smithi083.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-30T12:54:49.085 INFO:teuthology.orchestra.run.smithi083.stdout:Recommends: thermald 2024-03-30T12:54:49.085 INFO:teuthology.orchestra.run.smithi083.stdout:Description: Generic Linux kernel image 2024-03-30T12:54:49.085 INFO:teuthology.orchestra.run.smithi083.stdout: This package will always depend on the latest generic kernel image 2024-03-30T12:54:49.086 INFO:teuthology.orchestra.run.smithi083.stdout: available. 2024-03-30T12:54:49.086 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-03-30T12:54:49.087 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-30T12:54:49.090 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-30T12:54:49.132 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-30T12:54:49.133 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.KzRy6rPGJt 2024-03-30T12:54:49.134 DEBUG:teuthology.orchestra.run.smithi083:> sudo cp /boot/grub/grub.cfg /tmp/tmp.KzRy6rPGJt 2024-03-30T12:54:49.135 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-30T12:54:49.188 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.KzRy6rPGJt 2024-03-30T12:54:49.241 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-30T12:54:49.241 INFO:teuthology.orchestra.run.smithi153.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-30T12:54:49.241 INFO:teuthology.orchestra.run.smithi153.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-30T12:54:49.261 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-03-30T12:54:49.273 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-03-30T12:54:49.310 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.KzRy6rPGJt is 10KB 2024-03-30T12:54:49.323 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.KzRy6rPGJt 2024-03-30T12:54:49.329 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-30T12:54:49.384 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T12:54:49.560 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-30T12:54:49.561 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-30T12:54:49.587 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-101-generic 2024-03-30T12:54:49.587 DEBUG:teuthology.orchestra.run.smithi083:> sudo update-grub 2024-03-30T12:54:50.875 INFO:teuthology.orchestra.run.smithi083.stderr:Sourcing file `/etc/default/grub' 2024-03-30T12:54:50.876 INFO:teuthology.orchestra.run.smithi083.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-30T12:54:50.882 INFO:teuthology.orchestra.run.smithi083.stderr:Generating grub configuration file ... 2024-03-30T12:54:51.075 INFO:teuthology.orchestra.run.smithi083.stderr:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-30T12:54:51.082 INFO:teuthology.orchestra.run.smithi083.stderr:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-30T12:54:51.318 INFO:teuthology.orchestra.run.smithi083.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-30T12:54:51.324 INFO:teuthology.orchestra.run.smithi083.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-30T12:54:51.365 INFO:teuthology.orchestra.run.smithi083.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-30T12:54:51.370 INFO:teuthology.orchestra.run.smithi083.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-30T12:54:51.483 INFO:teuthology.orchestra.run.smithi083.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-30T12:54:51.483 INFO:teuthology.orchestra.run.smithi083.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-30T12:54:51.483 INFO:teuthology.orchestra.run.smithi083.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-30T12:54:51.506 INFO:teuthology.orchestra.run.smithi083.stderr:done 2024-03-30T12:54:51.515 DEBUG:teuthology.orchestra.run.smithi083:> sudo shutdown -r now 2024-03-30T12:55:19.302 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-30T12:55:19.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-30T12:55:19.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:55:21.518 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-30T12:55:21.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-03-30T12:55:21.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:55:53.891 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-03-30T12:55:56.194 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-03-30T12:56:02.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-30T12:56:02.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:56:05.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-03-30T12:56:05.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:56:23.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-03-30T12:56:35.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-03-30T12:56:35.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:56:35.598 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-03-30T12:56:50.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-03-30T12:56:50.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:56:50.816 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-03-30T12:56:51.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-03-30T12:56:51.376 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-101-generic"... 2024-03-30T12:56:51.376 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-03-30T12:56:51.422 INFO:teuthology.orchestra.run.smithi083.stdout:5.15.0-101-generic 2024-03-30T12:56:51.423 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-101-generic vs 5.15.0-101-generic 2024-03-30T12:56:51.423 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T12:56:51.423 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-30T12:56:52.424 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-30T12:56:52.424 DEBUG:teuthology.orchestra.run.smithi083:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-30T12:56:52.509 INFO:teuthology.orchestra.run.smithi083.stdout:ttyS1 2024-03-30T12:56:52.532 DEBUG:teuthology.parallel:result is None 2024-03-30T12:57:02.902 DEBUG:teuthology.orchestra.remote:timed out 2024-03-30T12:57:14.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-30T12:57:14.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:57:15.336 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-03-30T12:57:15.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-30T12:57:15.921 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-101-generic"... 2024-03-30T12:57:15.921 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-03-30T12:57:15.967 INFO:teuthology.orchestra.run.smithi153.stdout:5.15.0-101-generic 2024-03-30T12:57:15.967 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-101-generic vs 5.15.0-101-generic 2024-03-30T12:57:15.967 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T12:57:15.967 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-30T12:57:16.968 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-30T12:57:16.969 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-30T12:57:17.285 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-03-30T12:57:17.309 DEBUG:teuthology.parallel:result is None 2024-03-30T12:57:17.309 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-30T12:57:17.317 INFO:teuthology.task.internal:Creating test directory... 2024-03-30T12:57:17.317 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T12:57:17.320 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T12:57:17.325 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-30T12:57:17.353 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-30T12:57:17.389 INFO:teuthology.task.internal:Creating archive directory... 2024-03-30T12:57:17.390 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T12:57:17.392 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T12:57:17.501 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-30T12:57:17.508 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-30T12:57:17.509 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T12:57:17.511 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T12:57:17.533 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T12:57:17.543 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T12:57:17.543 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T12:57:17.551 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T12:57:17.552 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-30T12:57:17.560 INFO:teuthology.task.internal:Configuring sudo... 2024-03-30T12:57:17.561 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T12:57:17.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T12:57:17.607 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-30T12:57:17.616 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-30T12:57:17.616 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T12:57:17.644 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T12:57:17.655 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T12:57:17.694 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T12:57:17.743 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T12:57:17.743 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T12:57:17.821 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T12:57:17.826 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T12:57:17.875 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T12:57:17.876 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T12:57:17.949 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2024-03-30T12:57:17.952 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-03-30T12:57:18.018 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-30T12:57:18.025 INFO:teuthology.task.internal:Starting timer... 2024-03-30T12:57:18.026 INFO:teuthology.run_tasks:Running task pcp... 2024-03-30T12:57:18.083 INFO:teuthology.run_tasks:Running task selinux... 2024-03-30T12:57:18.091 DEBUG:teuthology.task.selinux:Excluding smithi083: OS 'ubuntu' does not support SELinux 2024-03-30T12:57:18.091 DEBUG:teuthology.task.selinux:Excluding smithi153: OS 'ubuntu' does not support SELinux 2024-03-30T12:57:18.092 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-30T12:57:18.092 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-30T12:57:18.092 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-30T12:57:18.092 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-30T12:57:18.100 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-30T12:57:18.116 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-30T12:57:18.118 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi083.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-30T13:04:22.652 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi083.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-03-30T13:04:22.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-03-30T13:04:22.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:04:22.740 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-03-30T13:04:22.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-03-30T13:04:22.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-30T13:04:22.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:04:22.895 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-03-30T13:04:22.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-30T13:04:22.975 INFO:teuthology.run_tasks:Running task clock... 2024-03-30T13:04:22.987 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-30T13:04:22.987 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T13:04:22.987 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:04:22.990 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T13:04:22.990 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:04:23.018 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-30T13:04:23.019 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: Command line: ntpd -gq 2024-03-30T13:04:23.019 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: ---------------------------------------------------- 2024-03-30T13:04:23.019 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: ntp-4 is maintained by Network Time Foundation, 2024-03-30T13:04:23.019 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-30T13:04:23.019 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: corporation. Support and training for ntp-4 are 2024-03-30T13:04:23.019 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: available at https://www.nwtime.org/support 2024-03-30T13:04:23.019 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: ---------------------------------------------------- 2024-03-30T13:04:23.020 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: proto: precision = 0.046 usec (-24) 2024-03-30T13:04:23.021 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: basedate set to 2022-02-04 2024-03-30T13:04:23.021 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: gps base set to 2022-02-06 (week 2196) 2024-03-30T13:04:23.021 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-30T13:04:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-30T13:04:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-30T13:04:23.022 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: restrict ::: KOD does nothing without LIMITED. 2024-03-30T13:04:23.022 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: Listen and drop on 0 v6wildcard [::]:123 2024-03-30T13:04:23.022 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-30T13:04:23.023 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: Listen normally on 2 lo 127.0.0.1:123 2024-03-30T13:04:23.023 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: Listen normally on 3 enp3s0f1 172.21.15.83:123 2024-03-30T13:04:23.023 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: Listen normally on 4 lo [::1]:123 2024-03-30T13:04:23.023 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce91%5]:123 2024-03-30T13:04:23.023 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:23 ntpd[17206]: Listening on routing socket on fd #22 for interface updates 2024-03-30T13:04:23.044 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-30T13:04:23.044 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: Command line: ntpd -gq 2024-03-30T13:04:23.044 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: ---------------------------------------------------- 2024-03-30T13:04:23.044 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: ntp-4 is maintained by Network Time Foundation, 2024-03-30T13:04:23.045 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-30T13:04:23.045 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: corporation. Support and training for ntp-4 are 2024-03-30T13:04:23.045 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: available at https://www.nwtime.org/support 2024-03-30T13:04:23.045 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: ---------------------------------------------------- 2024-03-30T13:04:23.045 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: proto: precision = 0.044 usec (-24) 2024-03-30T13:04:23.045 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: basedate set to 2022-02-04 2024-03-30T13:04:23.045 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: gps base set to 2022-02-06 (week 2196) 2024-03-30T13:04:23.045 INFO:teuthology.orchestra.run.smithi153.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-30T13:04:23.046 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-30T13:04:23.046 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: restrict ::: KOD does nothing without LIMITED. 2024-03-30T13:04:23.046 INFO:teuthology.orchestra.run.smithi153.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-30T13:04:23.047 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: Listen and drop on 0 v6wildcard [::]:123 2024-03-30T13:04:23.048 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-30T13:04:23.048 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: Listen normally on 2 lo 127.0.0.1:123 2024-03-30T13:04:23.048 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: Listen normally on 3 enp3s0f1 172.21.15.153:123 2024-03-30T13:04:23.048 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: Listen normally on 4 lo [::1]:123 2024-03-30T13:04:23.048 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6deb%5]:123 2024-03-30T13:04:23.048 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:23 ntpd[17164]: Listening on routing socket on fd #22 for interface updates 2024-03-30T13:04:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:24 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:24 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:24 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:24 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:24 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:24 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:24 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:24 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:25.019 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:25 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:25.019 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:25 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:25.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:25 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:25.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:25 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:25.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:25 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:25.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:25 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:25.044 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:25 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:25.044 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:25 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:25.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:25 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:25.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:25 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:25.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:25 ntpd[17164]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:25.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:25 ntpd[17164]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:26.019 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:26 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:26.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:26 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:26.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:26 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:26.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:26 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:26.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:26 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:26.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:26 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:26.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:26 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:26.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:26 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:26.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:26 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:26.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:26 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:26.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:26 ntpd[17164]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:26.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:26 ntpd[17164]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:27 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:27 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:27 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:27 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:27 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:27 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:27 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:27.021 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:27 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:27.021 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:27 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:27.021 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:27 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:27.021 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:27 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:27.021 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:27 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:27.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:27 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:27.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:27 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:27.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:27 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:27.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:27 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:27.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:27 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:27.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:27 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:27.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:27 ntpd[17164]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:27.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:27 ntpd[17164]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:28.019 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:28 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:28.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:28 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:28.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:28 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:28.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:28 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:28.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:28 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:28.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:28 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:28.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:28 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:28.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:28 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:28.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:28 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:28.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:28 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:28.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:28 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:28.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:28 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:28.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:28 ntpd[17164]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:28.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:28 ntpd[17164]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:28.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:28 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:28.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:28 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:28.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:28 ntpd[17164]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:28.046 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:28 ntpd[17164]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:29.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:29 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:29.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:29 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:29.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:29 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:29.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:29 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:29.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:29 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:29.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:29 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:29.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:29 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:29.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:29 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:29 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:29 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:29 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:29 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:29.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:29 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:29.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:29 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:29.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:29 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:29.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:29 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:29.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:29 ntpd[17164]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:29.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:29 ntpd[17164]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:30.019 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:30 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:30 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:30 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:30 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:30 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:30 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:30.020 INFO:teuthology.orchestra.run.smithi083.stdout:30 Mar 13:04:30 ntpd[17206]: ntpd: time slew -0.001051 s 2024-03-30T13:04:30.020 INFO:teuthology.orchestra.run.smithi083.stdout:ntpd: time slew -0.001051s 2024-03-30T13:04:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:30 ntpd[17206]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-30T13:04:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:30 Mar 13:04:30 ntpd[17206]: can't open /var/log/ntpstats/loopstats.20240330: Permission denied 2024-03-30T13:04:30.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:30 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:30.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:30 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:30.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:30 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:30.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:30 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:30.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:30 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:30.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:30 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:30.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:30 ntpd[17164]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:30.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:30 ntpd[17164]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:30 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:30 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:30 ntpd[17164]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:30 ntpd[17164]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:30.081 INFO:teuthology.orchestra.run.smithi083.stdout: remote refid st t when poll reach delay offset jitter 2024-03-30T13:04:30.082 INFO:teuthology.orchestra.run.smithi083.stdout:============================================================================== 2024-03-30T13:04:30.082 INFO:teuthology.orchestra.run.smithi083.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T13:04:30.082 INFO:teuthology.orchestra.run.smithi083.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T13:04:30.082 INFO:teuthology.orchestra.run.smithi083.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T13:04:30.082 INFO:teuthology.orchestra.run.smithi083.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T13:04:31.044 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:31 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:31.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:31 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:31.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:31 ntpd[17164]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T13:04:31.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:31 ntpd[17164]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T13:04:31.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:31 ntpd[17164]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T13:04:31.045 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:31 ntpd[17164]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T13:04:31.045 INFO:teuthology.orchestra.run.smithi153.stdout:30 Mar 13:04:31 ntpd[17164]: ntpd: time slew -0.000916 s 2024-03-30T13:04:31.045 INFO:teuthology.orchestra.run.smithi153.stdout:ntpd: time slew -0.000916s 2024-03-30T13:04:31.046 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:31 ntpd[17164]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-30T13:04:31.046 INFO:teuthology.orchestra.run.smithi153.stderr:30 Mar 13:04:31 ntpd[17164]: can't open /var/log/ntpstats/loopstats.20240330: Permission denied 2024-03-30T13:04:31.091 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-03-30T13:04:31.092 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-03-30T13:04:31.092 INFO:teuthology.orchestra.run.smithi153.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T13:04:31.092 INFO:teuthology.orchestra.run.smithi153.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T13:04:31.092 INFO:teuthology.orchestra.run.smithi153.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T13:04:31.092 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T13:04:31.093 INFO:teuthology.run_tasks:Running task install... 2024-03-30T13:04:31.101 DEBUG:teuthology.task.install:project ceph 2024-03-30T13:04:31.101 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}} 2024-03-30T13:04:31.102 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'} 2024-03-30T13:04:31.102 INFO:teuthology.task.install:Using flavor: default 2024-03-30T13:04:31.108 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-30T13:04:31.108 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-30T13:04:31.108 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-key list | grep Ceph 2024-03-30T13:04:31.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-key list | grep Ceph 2024-03-30T13:04:31.171 INFO:teuthology.orchestra.run.smithi083.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-30T13:04:31.188 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-30T13:04:31.199 INFO:teuthology.orchestra.run.smithi083.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-30T13:04:31.199 INFO:teuthology.orchestra.run.smithi083.stdout:uid [ unknown] Ceph.com (release key) 2024-03-30T13:04:31.199 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-30T13:04:31.199 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-30T13:04:31.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T13:04:31.215 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-30T13:04:31.215 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph.com (release key) 2024-03-30T13:04:31.216 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-30T13:04:31.216 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-30T13:04:31.216 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T13:04:31.361 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default/ 2024-03-30T13:04:31.362 INFO:teuthology.task.install.deb:Package version is 19.0.0-2519-gac171039-1jammy 2024-03-30T13:04:31.436 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default/ 2024-03-30T13:04:31.436 INFO:teuthology.task.install.deb:Package version is 19.0.0-2519-gac171039-1jammy 2024-03-30T13:04:31.534 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:04:31.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-30T13:04:31.549 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-03-30T13:04:31.565 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:04:31.565 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-30T13:04:31.579 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get update 2024-03-30T13:04:31.724 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-30T13:04:31.738 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-30T13:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-30T13:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-30T13:04:31.759 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-30T13:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-30T13:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-30T13:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy InRelease 2024-03-30T13:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-30T13:04:31.840 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-30T13:04:31.841 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy InRelease 2024-03-30T13:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-30T13:04:31.873 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,415 B] 2024-03-30T13:04:31.877 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-30T13:04:31.914 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-30T13:04:31.984 INFO:teuthology.orchestra.run.smithi083.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-03-30T13:04:31.999 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,415 B] 2024-03-30T13:04:32.042 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-03-30T13:04:32.076 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 29.2 kB in 0s (90.5 kB/s) 2024-03-30T13:04:32.115 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 29.2 kB in 0s (75.3 kB/s) 2024-03-30T13:04:33.009 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-03-30T13:04:33.025 DEBUG:teuthology.orchestra.run.smithi083:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2519-gac171039-1jammy cephadm=19.0.0-2519-gac171039-1jammy ceph-mds=19.0.0-2519-gac171039-1jammy ceph-mgr=19.0.0-2519-gac171039-1jammy ceph-common=19.0.0-2519-gac171039-1jammy ceph-fuse=19.0.0-2519-gac171039-1jammy ceph-test=19.0.0-2519-gac171039-1jammy ceph-volume=19.0.0-2519-gac171039-1jammy radosgw=19.0.0-2519-gac171039-1jammy python3-rados=19.0.0-2519-gac171039-1jammy python3-rgw=19.0.0-2519-gac171039-1jammy python3-cephfs=19.0.0-2519-gac171039-1jammy python3-rbd=19.0.0-2519-gac171039-1jammy libcephfs2=19.0.0-2519-gac171039-1jammy libcephfs-dev=19.0.0-2519-gac171039-1jammy librados2=19.0.0-2519-gac171039-1jammy librbd1=19.0.0-2519-gac171039-1jammy rbd-fuse=19.0.0-2519-gac171039-1jammy python3-cephfs=19.0.0-2519-gac171039-1jammy cephfs-shell=19.0.0-2519-gac171039-1jammy cephfs-top=19.0.0-2519-gac171039-1jammy cephfs-mirror=19.0.0-2519-gac171039-1jammy 2024-03-30T13:04:33.033 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-03-30T13:04:33.051 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2519-gac171039-1jammy cephadm=19.0.0-2519-gac171039-1jammy ceph-mds=19.0.0-2519-gac171039-1jammy ceph-mgr=19.0.0-2519-gac171039-1jammy ceph-common=19.0.0-2519-gac171039-1jammy ceph-fuse=19.0.0-2519-gac171039-1jammy ceph-test=19.0.0-2519-gac171039-1jammy ceph-volume=19.0.0-2519-gac171039-1jammy radosgw=19.0.0-2519-gac171039-1jammy python3-rados=19.0.0-2519-gac171039-1jammy python3-rgw=19.0.0-2519-gac171039-1jammy python3-cephfs=19.0.0-2519-gac171039-1jammy python3-rbd=19.0.0-2519-gac171039-1jammy libcephfs2=19.0.0-2519-gac171039-1jammy libcephfs-dev=19.0.0-2519-gac171039-1jammy librados2=19.0.0-2519-gac171039-1jammy librbd1=19.0.0-2519-gac171039-1jammy rbd-fuse=19.0.0-2519-gac171039-1jammy python3-cephfs=19.0.0-2519-gac171039-1jammy cephfs-shell=19.0.0-2519-gac171039-1jammy cephfs-top=19.0.0-2519-gac171039-1jammy cephfs-mirror=19.0.0-2519-gac171039-1jammy 2024-03-30T13:04:33.087 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-03-30T13:04:33.102 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-03-30T13:04:33.287 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2024-03-30T13:04:33.287 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2024-03-30T13:04:33.287 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-03-30T13:04:33.287 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-03-30T13:04:33.458 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T13:04:33.458 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T13:04:33.458 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T13:04:33.458 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T13:04:33.458 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-30T13:04:33.459 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-30T13:04:33.459 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T13:04:33.459 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-03-30T13:04:33.459 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-30T13:04:33.460 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-30T13:04:33.460 INFO:teuthology.orchestra.run.smithi153.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-30T13:04:33.460 INFO:teuthology.orchestra.run.smithi153.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-30T13:04:33.461 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-30T13:04:33.461 INFO:teuthology.orchestra.run.smithi153.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-30T13:04:33.461 INFO:teuthology.orchestra.run.smithi153.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-30T13:04:33.461 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-30T13:04:33.461 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-30T13:04:33.461 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-30T13:04:33.461 INFO:teuthology.orchestra.run.smithi153.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-30T13:04:33.461 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-30T13:04:33.461 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-30T13:04:33.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-30T13:04:33.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-30T13:04:33.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-30T13:04:33.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-30T13:04:33.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-30T13:04:33.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-30T13:04:33.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-30T13:04:33.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-30T13:04:33.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-30T13:04:33.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-30T13:04:33.462 INFO:teuthology.orchestra.run.smithi153.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-03-30T13:04:33.463 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-03-30T13:04:33.463 INFO:teuthology.orchestra.run.smithi153.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-30T13:04:33.463 INFO:teuthology.orchestra.run.smithi153.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-30T13:04:33.463 INFO:teuthology.orchestra.run.smithi153.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-30T13:04:33.463 INFO:teuthology.orchestra.run.smithi153.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-30T13:04:33.463 INFO:teuthology.orchestra.run.smithi153.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-30T13:04:33.463 INFO:teuthology.orchestra.run.smithi153.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-30T13:04:33.463 INFO:teuthology.orchestra.run.smithi153.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-30T13:04:33.463 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-03-30T13:04:33.463 INFO:teuthology.orchestra.run.smithi153.stdout: btrfs-tools 2024-03-30T13:04:33.479 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T13:04:33.479 INFO:teuthology.orchestra.run.smithi083.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T13:04:33.479 INFO:teuthology.orchestra.run.smithi083.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T13:04:33.479 INFO:teuthology.orchestra.run.smithi083.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T13:04:33.480 INFO:teuthology.orchestra.run.smithi083.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-30T13:04:33.480 INFO:teuthology.orchestra.run.smithi083.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-30T13:04:33.480 INFO:teuthology.orchestra.run.smithi083.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T13:04:33.481 INFO:teuthology.orchestra.run.smithi083.stdout:The following additional packages will be installed: 2024-03-30T13:04:33.481 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-30T13:04:33.481 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-30T13:04:33.481 INFO:teuthology.orchestra.run.smithi083.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-30T13:04:33.481 INFO:teuthology.orchestra.run.smithi083.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-30T13:04:33.482 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-30T13:04:33.482 INFO:teuthology.orchestra.run.smithi083.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-30T13:04:33.482 INFO:teuthology.orchestra.run.smithi083.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-30T13:04:33.482 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-30T13:04:33.482 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-30T13:04:33.482 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-30T13:04:33.483 INFO:teuthology.orchestra.run.smithi083.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-03-30T13:04:33.484 INFO:teuthology.orchestra.run.smithi083.stdout:Suggested packages: 2024-03-30T13:04:33.484 INFO:teuthology.orchestra.run.smithi083.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-30T13:04:33.484 INFO:teuthology.orchestra.run.smithi083.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-30T13:04:33.484 INFO:teuthology.orchestra.run.smithi083.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-30T13:04:33.484 INFO:teuthology.orchestra.run.smithi083.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-30T13:04:33.484 INFO:teuthology.orchestra.run.smithi083.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-30T13:04:33.484 INFO:teuthology.orchestra.run.smithi083.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-30T13:04:33.484 INFO:teuthology.orchestra.run.smithi083.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-30T13:04:33.484 INFO:teuthology.orchestra.run.smithi083.stdout:Recommended packages: 2024-03-30T13:04:33.484 INFO:teuthology.orchestra.run.smithi083.stdout: btrfs-tools 2024-03-30T13:04:33.568 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-03-30T13:04:33.568 INFO:teuthology.orchestra.run.smithi153.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-30T13:04:33.568 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-30T13:04:33.568 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-30T13:04:33.568 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-03-30T13:04:33.568 INFO:teuthology.orchestra.run.smithi153.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-30T13:04:33.569 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-30T13:04:33.570 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-30T13:04:33.570 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-30T13:04:33.570 INFO:teuthology.orchestra.run.smithi153.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-30T13:04:33.570 INFO:teuthology.orchestra.run.smithi153.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-30T13:04:33.570 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-30T13:04:33.570 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-03-30T13:04:33.570 INFO:teuthology.orchestra.run.smithi153.stdout: socat unzip xmlstarlet zip 2024-03-30T13:04:33.588 INFO:teuthology.orchestra.run.smithi083.stdout:The following NEW packages will be installed: 2024-03-30T13:04:33.588 INFO:teuthology.orchestra.run.smithi083.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-30T13:04:33.588 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-30T13:04:33.589 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-30T13:04:33.589 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-03-30T13:04:33.589 INFO:teuthology.orchestra.run.smithi083.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-30T13:04:33.589 INFO:teuthology.orchestra.run.smithi083.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-03-30T13:04:33.589 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-03-30T13:04:33.589 INFO:teuthology.orchestra.run.smithi083.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-30T13:04:33.590 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-30T13:04:33.590 INFO:teuthology.orchestra.run.smithi083.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-30T13:04:33.590 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-30T13:04:33.590 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-30T13:04:33.590 INFO:teuthology.orchestra.run.smithi083.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-30T13:04:33.590 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-30T13:04:33.590 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-30T13:04:33.590 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-30T13:04:33.591 INFO:teuthology.orchestra.run.smithi083.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-30T13:04:33.591 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-30T13:04:33.591 INFO:teuthology.orchestra.run.smithi083.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-30T13:04:33.591 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-30T13:04:33.591 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-30T13:04:33.591 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-30T13:04:33.591 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-30T13:04:33.591 INFO:teuthology.orchestra.run.smithi083.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-30T13:04:33.591 INFO:teuthology.orchestra.run.smithi083.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-30T13:04:33.591 INFO:teuthology.orchestra.run.smithi083.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-30T13:04:33.591 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-03-30T13:04:33.591 INFO:teuthology.orchestra.run.smithi083.stdout: socat unzip xmlstarlet zip 2024-03-30T13:04:33.631 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 124 newly installed, 0 to remove and 298 not upgraded. 2024-03-30T13:04:33.631 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 179 MB of archives. 2024-03-30T13:04:33.631 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 821 MB of additional disk space will be used. 2024-03-30T13:04:33.631 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-30T13:04:33.651 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-30T13:04:33.656 INFO:teuthology.orchestra.run.smithi083.stdout:0 upgraded, 124 newly installed, 0 to remove and 298 not upgraded. 2024-03-30T13:04:33.656 INFO:teuthology.orchestra.run.smithi083.stdout:Need to get 179 MB of archives. 2024-03-30T13:04:33.656 INFO:teuthology.orchestra.run.smithi083.stdout:After this operation, 821 MB of additional disk space will be used. 2024-03-30T13:04:33.656 INFO:teuthology.orchestra.run.smithi083.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-30T13:04:33.662 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-30T13:04:33.677 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-30T13:04:33.687 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-30T13:04:33.710 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-30T13:04:33.736 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2519-gac171039-1jammy [3,556 kB] 2024-03-30T13:04:33.737 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-30T13:04:33.738 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-30T13:04:33.741 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-30T13:04:33.753 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-30T13:04:33.762 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-30T13:04:33.767 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-30T13:04:33.782 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-30T13:04:33.810 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-30T13:04:33.813 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-30T13:04:33.820 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-30T13:04:33.824 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-30T13:04:33.824 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-30T13:04:33.831 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2519-gac171039-1jammy [3,556 kB] 2024-03-30T13:04:33.831 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-30T13:04:33.833 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-30T13:04:33.835 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-30T13:04:33.836 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-30T13:04:33.839 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-30T13:04:33.842 INFO:teuthology.orchestra.run.smithi083.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-30T13:04:33.847 INFO:teuthology.orchestra.run.smithi083.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-30T13:04:33.856 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-30T13:04:33.859 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-30T13:04:33.861 INFO:teuthology.orchestra.run.smithi083.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-30T13:04:33.861 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-30T13:04:33.862 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-30T13:04:33.862 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-30T13:04:33.863 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-30T13:04:33.863 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-30T13:04:33.864 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-30T13:04:33.864 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-30T13:04:33.866 INFO:teuthology.orchestra.run.smithi083.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-30T13:04:33.866 INFO:teuthology.orchestra.run.smithi083.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-30T13:04:33.875 INFO:teuthology.orchestra.run.smithi083.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-30T13:04:33.877 INFO:teuthology.orchestra.run.smithi083.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-30T13:04:33.879 INFO:teuthology.orchestra.run.smithi083.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-30T13:04:33.881 INFO:teuthology.orchestra.run.smithi083.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-30T13:04:33.881 INFO:teuthology.orchestra.run.smithi083.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-30T13:04:33.883 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-30T13:04:33.883 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-30T13:04:33.883 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-30T13:04:33.886 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-30T13:04:33.888 INFO:teuthology.orchestra.run.smithi083.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-30T13:04:33.891 INFO:teuthology.orchestra.run.smithi083.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-30T13:04:33.902 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-30T13:04:33.903 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-30T13:04:33.903 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-30T13:04:33.904 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-30T13:04:33.905 INFO:teuthology.orchestra.run.smithi083.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-30T13:04:33.905 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-30T13:04:33.905 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-30T13:04:33.906 INFO:teuthology.orchestra.run.smithi083.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-30T13:04:33.906 INFO:teuthology.orchestra.run.smithi083.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-30T13:04:33.906 INFO:teuthology.orchestra.run.smithi083.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-30T13:04:33.907 INFO:teuthology.orchestra.run.smithi083.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-30T13:04:33.908 INFO:teuthology.orchestra.run.smithi083.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-30T13:04:33.908 INFO:teuthology.orchestra.run.smithi083.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-30T13:04:33.909 INFO:teuthology.orchestra.run.smithi083.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-30T13:04:33.922 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-30T13:04:33.923 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-30T13:04:33.923 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-30T13:04:33.928 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-30T13:04:33.929 INFO:teuthology.orchestra.run.smithi083.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-30T13:04:33.929 INFO:teuthology.orchestra.run.smithi083.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-30T13:04:33.932 INFO:teuthology.orchestra.run.smithi083.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-30T13:04:33.933 INFO:teuthology.orchestra.run.smithi083.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-30T13:04:33.934 INFO:teuthology.orchestra.run.smithi083.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-30T13:04:33.934 INFO:teuthology.orchestra.run.smithi083.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-30T13:04:33.935 INFO:teuthology.orchestra.run.smithi083.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-30T13:04:33.935 INFO:teuthology.orchestra.run.smithi083.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-30T13:04:33.935 INFO:teuthology.orchestra.run.smithi083.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-30T13:04:33.942 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-30T13:04:33.942 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-30T13:04:33.944 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-30T13:04:33.944 INFO:teuthology.orchestra.run.smithi153.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-30T13:04:33.946 INFO:teuthology.orchestra.run.smithi153.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-30T13:04:33.946 INFO:teuthology.orchestra.run.smithi153.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-30T13:04:33.952 INFO:teuthology.orchestra.run.smithi083.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-30T13:04:33.957 INFO:teuthology.orchestra.run.smithi083.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-30T13:04:33.958 INFO:teuthology.orchestra.run.smithi083.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-30T13:04:33.963 INFO:teuthology.orchestra.run.smithi083.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-30T13:04:33.964 INFO:teuthology.orchestra.run.smithi083.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-30T13:04:33.964 INFO:teuthology.orchestra.run.smithi153.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-30T13:04:33.964 INFO:teuthology.orchestra.run.smithi083.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-30T13:04:33.965 INFO:teuthology.orchestra.run.smithi083.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-30T13:04:33.965 INFO:teuthology.orchestra.run.smithi153.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-30T13:04:33.966 INFO:teuthology.orchestra.run.smithi083.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-30T13:04:33.967 INFO:teuthology.orchestra.run.smithi153.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-30T13:04:33.968 INFO:teuthology.orchestra.run.smithi153.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-30T13:04:33.968 INFO:teuthology.orchestra.run.smithi083.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-30T13:04:33.973 INFO:teuthology.orchestra.run.smithi083.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-30T13:04:33.984 INFO:teuthology.orchestra.run.smithi153.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-30T13:04:33.986 INFO:teuthology.orchestra.run.smithi153.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-30T13:04:33.996 INFO:teuthology.orchestra.run.smithi083.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-30T13:04:33.998 INFO:teuthology.orchestra.run.smithi083.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-30T13:04:34.002 INFO:teuthology.orchestra.run.smithi083.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-30T13:04:34.003 INFO:teuthology.orchestra.run.smithi083.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-30T13:04:34.004 INFO:teuthology.orchestra.run.smithi083.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-30T13:04:34.009 INFO:teuthology.orchestra.run.smithi083.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-30T13:04:34.140 INFO:teuthology.orchestra.run.smithi153.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-30T13:04:34.142 INFO:teuthology.orchestra.run.smithi153.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-30T13:04:34.145 INFO:teuthology.orchestra.run.smithi153.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-30T13:04:34.145 INFO:teuthology.orchestra.run.smithi153.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-30T13:04:34.147 INFO:teuthology.orchestra.run.smithi153.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-30T13:04:34.151 INFO:teuthology.orchestra.run.smithi083.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-30T13:04:34.153 INFO:teuthology.orchestra.run.smithi083.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-30T13:04:34.155 INFO:teuthology.orchestra.run.smithi083.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-30T13:04:34.155 INFO:teuthology.orchestra.run.smithi083.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-30T13:04:34.157 INFO:teuthology.orchestra.run.smithi153.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2519-gac171039-1jammy [3,226 kB] 2024-03-30T13:04:34.157 INFO:teuthology.orchestra.run.smithi083.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-30T13:04:34.174 INFO:teuthology.orchestra.run.smithi153.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-30T13:04:34.176 INFO:teuthology.orchestra.run.smithi153.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-30T13:04:34.176 INFO:teuthology.orchestra.run.smithi153.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-30T13:04:34.182 INFO:teuthology.orchestra.run.smithi083.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-30T13:04:34.184 INFO:teuthology.orchestra.run.smithi083.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-30T13:04:34.185 INFO:teuthology.orchestra.run.smithi083.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-30T13:04:34.194 INFO:teuthology.orchestra.run.smithi153.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-30T13:04:34.194 INFO:teuthology.orchestra.run.smithi153.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-30T13:04:34.197 INFO:teuthology.orchestra.run.smithi153.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-30T13:04:34.198 INFO:teuthology.orchestra.run.smithi153.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-30T13:04:34.198 INFO:teuthology.orchestra.run.smithi153.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-30T13:04:34.198 INFO:teuthology.orchestra.run.smithi153.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-30T13:04:34.199 INFO:teuthology.orchestra.run.smithi153.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-30T13:04:34.202 INFO:teuthology.orchestra.run.smithi083.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-30T13:04:34.202 INFO:teuthology.orchestra.run.smithi083.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-30T13:04:34.209 INFO:teuthology.orchestra.run.smithi083.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-30T13:04:34.209 INFO:teuthology.orchestra.run.smithi083.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-30T13:04:34.209 INFO:teuthology.orchestra.run.smithi083.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-30T13:04:34.210 INFO:teuthology.orchestra.run.smithi083.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-30T13:04:34.210 INFO:teuthology.orchestra.run.smithi083.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-30T13:04:34.211 INFO:teuthology.orchestra.run.smithi083.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-30T13:04:34.214 INFO:teuthology.orchestra.run.smithi083.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-30T13:04:34.217 INFO:teuthology.orchestra.run.smithi153.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-30T13:04:34.221 INFO:teuthology.orchestra.run.smithi153.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-30T13:04:34.223 INFO:teuthology.orchestra.run.smithi153.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-30T13:04:34.225 INFO:teuthology.orchestra.run.smithi153.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-30T13:04:34.226 INFO:teuthology.orchestra.run.smithi153.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-30T13:04:34.230 INFO:teuthology.orchestra.run.smithi083.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-30T13:04:34.231 INFO:teuthology.orchestra.run.smithi083.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-30T13:04:34.231 INFO:teuthology.orchestra.run.smithi083.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-30T13:04:34.236 INFO:teuthology.orchestra.run.smithi153.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-30T13:04:34.240 INFO:teuthology.orchestra.run.smithi153.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-30T13:04:34.240 INFO:teuthology.orchestra.run.smithi153.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-30T13:04:34.241 INFO:teuthology.orchestra.run.smithi153.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-30T13:04:34.241 INFO:teuthology.orchestra.run.smithi153.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-30T13:04:34.250 INFO:teuthology.orchestra.run.smithi083.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-30T13:04:34.253 INFO:teuthology.orchestra.run.smithi083.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-30T13:04:34.253 INFO:teuthology.orchestra.run.smithi083.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-30T13:04:34.254 INFO:teuthology.orchestra.run.smithi083.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-30T13:04:34.254 INFO:teuthology.orchestra.run.smithi083.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-30T13:04:34.259 INFO:teuthology.orchestra.run.smithi083.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-30T13:04:34.259 INFO:teuthology.orchestra.run.smithi083.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-30T13:04:34.261 INFO:teuthology.orchestra.run.smithi153.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-30T13:04:34.262 INFO:teuthology.orchestra.run.smithi153.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-30T13:04:34.265 INFO:teuthology.orchestra.run.smithi153.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-30T13:04:34.265 INFO:teuthology.orchestra.run.smithi153.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-30T13:04:34.266 INFO:teuthology.orchestra.run.smithi153.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-30T13:04:34.271 INFO:teuthology.orchestra.run.smithi083.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-30T13:04:34.271 INFO:teuthology.orchestra.run.smithi083.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-30T13:04:34.272 INFO:teuthology.orchestra.run.smithi083.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-30T13:04:34.283 INFO:teuthology.orchestra.run.smithi153.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-30T13:04:34.284 INFO:teuthology.orchestra.run.smithi153.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-30T13:04:34.285 INFO:teuthology.orchestra.run.smithi153.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-30T13:04:34.292 INFO:teuthology.orchestra.run.smithi083.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-30T13:04:34.294 INFO:teuthology.orchestra.run.smithi083.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-30T13:04:34.297 INFO:teuthology.orchestra.run.smithi083.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-30T13:04:34.298 INFO:teuthology.orchestra.run.smithi153.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-30T13:04:34.298 INFO:teuthology.orchestra.run.smithi153.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-30T13:04:34.304 INFO:teuthology.orchestra.run.smithi153.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-30T13:04:34.306 INFO:teuthology.orchestra.run.smithi083.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-30T13:04:34.307 INFO:teuthology.orchestra.run.smithi083.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-30T13:04:34.308 INFO:teuthology.orchestra.run.smithi083.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-30T13:04:34.308 INFO:teuthology.orchestra.run.smithi153.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-30T13:04:34.308 INFO:teuthology.orchestra.run.smithi153.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-30T13:04:34.310 INFO:teuthology.orchestra.run.smithi083.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-30T13:04:34.315 INFO:teuthology.orchestra.run.smithi083.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-30T13:04:34.330 INFO:teuthology.orchestra.run.smithi153.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2519-gac171039-1jammy [712 kB] 2024-03-30T13:04:34.360 INFO:teuthology.orchestra.run.smithi153.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2519-gac171039-1jammy [356 kB] 2024-03-30T13:04:34.454 INFO:teuthology.orchestra.run.smithi153.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2519-gac171039-1jammy [32.8 kB] 2024-03-30T13:04:34.474 INFO:teuthology.orchestra.run.smithi153.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2519-gac171039-1jammy [180 kB] 2024-03-30T13:04:34.479 INFO:teuthology.orchestra.run.smithi153.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2519-gac171039-1jammy [66.7 kB] 2024-03-30T13:04:34.494 INFO:teuthology.orchestra.run.smithi153.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2519-gac171039-1jammy [330 kB] 2024-03-30T13:04:34.518 INFO:teuthology.orchestra.run.smithi153.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2519-gac171039-1jammy [6,660 kB] 2024-03-30T13:04:34.965 INFO:teuthology.orchestra.run.smithi153.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2519-gac171039-1jammy [112 kB] 2024-03-30T13:04:34.968 INFO:teuthology.orchestra.run.smithi153.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2519-gac171039-1jammy [466 kB] 2024-03-30T13:04:34.983 INFO:teuthology.orchestra.run.smithi153.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2519-gac171039-1jammy [25.4 MB] 2024-03-30T13:04:35.432 INFO:teuthology.orchestra.run.smithi083.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2519-gac171039-1jammy [3,226 kB] 2024-03-30T13:04:35.975 INFO:teuthology.orchestra.run.smithi153.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2519-gac171039-1jammy [5,086 kB] 2024-03-30T13:04:36.098 INFO:teuthology.orchestra.run.smithi153.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2519-gac171039-1jammy [244 kB] 2024-03-30T13:04:36.108 INFO:teuthology.orchestra.run.smithi153.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2519-gac171039-1jammy [124 kB] 2024-03-30T13:04:36.114 INFO:teuthology.orchestra.run.smithi153.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2519-gac171039-1jammy [1,526 kB] 2024-03-30T13:04:36.164 INFO:teuthology.orchestra.run.smithi153.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2519-gac171039-1jammy [6,259 kB] 2024-03-30T13:04:36.391 INFO:teuthology.orchestra.run.smithi153.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2519-gac171039-1jammy [22.8 MB] 2024-03-30T13:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2519-gac171039-1jammy [712 kB] 2024-03-30T13:04:37.028 INFO:teuthology.orchestra.run.smithi083.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2519-gac171039-1jammy [356 kB] 2024-03-30T13:04:37.703 INFO:teuthology.orchestra.run.smithi153.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2519-gac171039-1jammy [14.0 kB] 2024-03-30T13:04:37.704 INFO:teuthology.orchestra.run.smithi153.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2519-gac171039-1jammy [870 kB] 2024-03-30T13:04:37.721 INFO:teuthology.orchestra.run.smithi153.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2519-gac171039-1jammy [2,451 kB] 2024-03-30T13:04:37.762 INFO:teuthology.orchestra.run.smithi153.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2519-gac171039-1jammy [790 kB] 2024-03-30T13:04:37.772 INFO:teuthology.orchestra.run.smithi153.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2519-gac171039-1jammy [147 kB] 2024-03-30T13:04:37.774 INFO:teuthology.orchestra.run.smithi153.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2519-gac171039-1jammy [2,242 kB] 2024-03-30T13:04:37.824 INFO:teuthology.orchestra.run.smithi083.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2519-gac171039-1jammy [32.8 kB] 2024-03-30T13:04:37.826 INFO:teuthology.orchestra.run.smithi083.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2519-gac171039-1jammy [180 kB] 2024-03-30T13:04:37.840 INFO:teuthology.orchestra.run.smithi153.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2519-gac171039-1jammy [8,625 kB] 2024-03-30T13:04:37.977 INFO:teuthology.orchestra.run.smithi083.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2519-gac171039-1jammy [66.7 kB] 2024-03-30T13:04:37.980 INFO:teuthology.orchestra.run.smithi083.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2519-gac171039-1jammy [330 kB] 2024-03-30T13:04:38.139 INFO:teuthology.orchestra.run.smithi083.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2519-gac171039-1jammy [6,660 kB] 2024-03-30T13:04:38.145 INFO:teuthology.orchestra.run.smithi153.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2519-gac171039-1jammy [14.2 kB] 2024-03-30T13:04:38.146 INFO:teuthology.orchestra.run.smithi153.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2519-gac171039-1jammy [50.3 MB] 2024-03-30T13:04:40.676 INFO:teuthology.orchestra.run.smithi153.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2519-gac171039-1jammy [121 kB] 2024-03-30T13:04:40.678 INFO:teuthology.orchestra.run.smithi153.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2519-gac171039-1jammy [229 kB] 2024-03-30T13:04:40.683 INFO:teuthology.orchestra.run.smithi153.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2519-gac171039-1jammy [34.0 kB] 2024-03-30T13:04:40.684 INFO:teuthology.orchestra.run.smithi153.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2519-gac171039-1jammy [23.4 kB] 2024-03-30T13:04:40.685 INFO:teuthology.orchestra.run.smithi153.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2519-gac171039-1jammy [38.9 kB] 2024-03-30T13:04:40.686 INFO:teuthology.orchestra.run.smithi153.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2519-gac171039-1jammy [13.2 MB] 2024-03-30T13:04:41.031 INFO:teuthology.orchestra.run.smithi153.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2519-gac171039-1jammy [91.2 kB] 2024-03-30T13:04:41.192 INFO:teuthology.orchestra.run.smithi083.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2519-gac171039-1jammy [112 kB] 2024-03-30T13:04:41.223 INFO:teuthology.orchestra.run.smithi083.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2519-gac171039-1jammy [466 kB] 2024-03-30T13:04:41.299 INFO:teuthology.orchestra.run.smithi083.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2519-gac171039-1jammy [25.4 MB] 2024-03-30T13:04:41.645 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 179 MB in 7s (24.0 MB/s) 2024-03-30T13:04:41.837 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-30T13:04:41.939 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-03-30T13:04:41.944 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-30T13:04:41.984 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-30T13:04:42.287 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-30T13:04:42.314 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-30T13:04:42.354 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-30T13:04:42.657 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cmd2. 2024-03-30T13:04:42.684 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-30T13:04:42.723 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-30T13:04:43.076 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-30T13:04:43.103 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-30T13:04:43.193 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-30T13:04:43.605 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-30T13:04:43.632 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-30T13:04:43.680 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-30T13:04:44.041 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-30T13:04:44.068 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-30T13:04:44.108 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-30T13:04:44.553 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-30T13:04:44.580 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-30T13:04:44.628 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T13:04:45.115 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-30T13:04:45.142 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-30T13:04:45.190 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T13:04:45.383 INFO:teuthology.orchestra.run.smithi083.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2519-gac171039-1jammy [5,086 kB] 2024-03-30T13:04:45.560 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-30T13:04:45.586 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-30T13:04:45.626 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T13:04:45.979 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-30T13:04:45.992 INFO:teuthology.orchestra.run.smithi083.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2519-gac171039-1jammy [244 kB] 2024-03-30T13:04:46.007 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-30T13:04:46.025 INFO:teuthology.orchestra.run.smithi083.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2519-gac171039-1jammy [124 kB] 2024-03-30T13:04:46.030 INFO:teuthology.orchestra.run.smithi083.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2519-gac171039-1jammy [1,526 kB] 2024-03-30T13:04:46.046 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-30T13:04:46.238 INFO:teuthology.orchestra.run.smithi083.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2519-gac171039-1jammy [6,259 kB] 2024-03-30T13:04:46.374 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librados2. 2024-03-30T13:04:46.401 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../010-librados2_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:46.440 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librados2 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:46.851 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librbd1. 2024-03-30T13:04:46.867 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../011-librbd1_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:46.901 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librbd1 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:46.950 INFO:teuthology.orchestra.run.smithi083.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2519-gac171039-1jammy [22.8 MB] 2024-03-30T13:04:47.271 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs2. 2024-03-30T13:04:47.297 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:47.337 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs2 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:47.632 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rados. 2024-03-30T13:04:47.647 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:47.690 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rados (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:48.034 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-30T13:04:48.061 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:04:48.101 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-argparse (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:48.354 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cephfs. 2024-03-30T13:04:48.369 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:48.403 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cephfs (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:48.690 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-30T13:04:48.716 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:04:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-common (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:49.085 INFO:teuthology.orchestra.run.smithi083.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2519-gac171039-1jammy [14.0 kB] 2024-03-30T13:04:49.085 INFO:teuthology.orchestra.run.smithi083.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2519-gac171039-1jammy [870 kB] 2024-03-30T13:04:49.101 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-prettytable. 2024-03-30T13:04:49.102 INFO:teuthology.orchestra.run.smithi083.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2519-gac171039-1jammy [2,451 kB] 2024-03-30T13:04:49.128 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-30T13:04:49.167 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-30T13:04:49.239 INFO:teuthology.orchestra.run.smithi083.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2519-gac171039-1jammy [790 kB] 2024-03-30T13:04:49.303 INFO:teuthology.orchestra.run.smithi083.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2519-gac171039-1jammy [147 kB] 2024-03-30T13:04:49.306 INFO:teuthology.orchestra.run.smithi083.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2519-gac171039-1jammy [2,242 kB] 2024-03-30T13:04:49.411 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rbd. 2024-03-30T13:04:49.427 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:49.447 INFO:teuthology.orchestra.run.smithi083.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2519-gac171039-1jammy [8,625 kB] 2024-03-30T13:04:49.470 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rbd (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:49.798 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-30T13:04:49.825 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-30T13:04:49.864 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-30T13:04:49.943 INFO:teuthology.orchestra.run.smithi083.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2519-gac171039-1jammy [14.2 kB] 2024-03-30T13:04:49.970 INFO:teuthology.orchestra.run.smithi083.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2519-gac171039-1jammy [50.3 MB] 2024-03-30T13:04:50.109 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-30T13:04:50.124 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-30T13:04:50.158 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-30T13:04:50.461 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-30T13:04:50.477 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-30T13:04:50.520 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-30T13:04:50.865 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua5.1. 2024-03-30T13:04:50.892 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-30T13:04:50.931 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-30T13:04:51.226 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-any. 2024-03-30T13:04:51.253 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-30T13:04:51.284 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-30T13:04:51.512 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package zip. 2024-03-30T13:04:51.536 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-30T13:04:51.578 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking zip (3.0-12build2) ... 2024-03-30T13:04:51.907 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package unzip. 2024-03-30T13:04:51.933 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-30T13:04:51.974 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-30T13:04:52.330 INFO:teuthology.orchestra.run.smithi083.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2519-gac171039-1jammy [121 kB] 2024-03-30T13:04:52.332 INFO:teuthology.orchestra.run.smithi083.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2519-gac171039-1jammy [229 kB] 2024-03-30T13:04:52.337 INFO:teuthology.orchestra.run.smithi083.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2519-gac171039-1jammy [34.0 kB] 2024-03-30T13:04:52.338 INFO:teuthology.orchestra.run.smithi083.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2519-gac171039-1jammy [23.4 kB] 2024-03-30T13:04:52.339 INFO:teuthology.orchestra.run.smithi083.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2519-gac171039-1jammy [38.9 kB] 2024-03-30T13:04:52.340 INFO:teuthology.orchestra.run.smithi083.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2519-gac171039-1jammy [13.2 MB] 2024-03-30T13:04:52.369 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package luarocks. 2024-03-30T13:04:52.396 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-30T13:04:52.427 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-30T13:04:52.680 INFO:teuthology.orchestra.run.smithi083.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2519-gac171039-1jammy [91.2 kB] 2024-03-30T13:04:52.827 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librgw2. 2024-03-30T13:04:52.854 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../027-librgw2_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:52.893 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librgw2 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:53.296 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 179 MB in 19s (9,377 kB/s) 2024-03-30T13:04:53.410 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-30T13:04:53.429 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rgw. 2024-03-30T13:04:53.456 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:53.495 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rgw (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:53.506 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-03-30T13:04:53.511 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-30T13:04:53.549 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-30T13:04:53.836 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-30T13:04:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-30T13:04:53.862 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-30T13:04:53.867 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-30T13:04:53.902 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-30T13:04:53.923 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-30T13:04:54.193 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libradosstriper1. 2024-03-30T13:04:54.209 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:54.247 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cmd2. 2024-03-30T13:04:54.251 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libradosstriper1 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:54.273 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-30T13:04:54.313 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-30T13:04:54.683 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-30T13:04:54.688 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-common. 2024-03-30T13:04:54.709 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-30T13:04:54.714 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:54.754 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-common (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:54.791 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-30T13:04:55.087 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-30T13:04:55.113 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-30T13:04:55.153 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-30T13:04:55.464 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-30T13:04:55.491 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-30T13:04:55.531 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-30T13:04:56.001 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-30T13:04:56.028 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-30T13:04:56.076 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T13:04:56.234 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-base. 2024-03-30T13:04:56.262 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:56.310 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-base (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:56.429 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-30T13:04:56.967 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-30T13:04:56.967 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-30T13:04:56.967 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-30T13:04:56.968 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-30T13:04:56.968 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T13:04:56.968 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-30T13:04:56.968 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-30T13:04:56.968 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T13:04:57.200 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cheroot. 2024-03-30T13:04:57.227 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-30T13:04:57.266 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-30T13:04:57.277 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-30T13:04:57.304 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-30T13:04:57.344 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-30T13:04:57.594 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-30T13:04:57.621 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-30T13:04:57.622 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package librados2. 2024-03-30T13:04:57.648 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../010-librados2_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:57.661 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-30T13:04:57.688 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librados2 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:57.966 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-30T13:04:57.993 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-30T13:04:58.024 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-30T13:04:58.141 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package librbd1. 2024-03-30T13:04:58.167 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../011-librbd1_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:58.327 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-30T13:04:58.354 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-30T13:04:58.393 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-30T13:04:58.441 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librbd1 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:58.696 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempora. 2024-03-30T13:04:58.723 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-30T13:04:58.763 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-30T13:04:58.877 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libcephfs2. 2024-03-30T13:04:58.903 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:58.944 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libcephfs2 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:59.040 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-portend. 2024-03-30T13:04:59.067 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-30T13:04:59.107 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-30T13:04:59.230 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-rados. 2024-03-30T13:04:59.256 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:59.296 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-rados (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:59.385 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-30T13:04:59.412 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-30T13:04:59.451 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-30T13:04:59.632 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-30T13:04:59.658 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:04:59.699 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-ceph-argparse (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-30T13:04:59.806 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-30T13:04:59.846 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-30T13:04:59.935 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cephfs. 2024-03-30T13:04:59.961 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:04:59.993 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cephfs (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:00.296 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-30T13:05:00.302 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-natsort. 2024-03-30T13:05:00.322 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:00.328 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-30T13:05:00.362 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-ceph-common (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:00.399 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-30T13:05:00.690 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-prettytable. 2024-03-30T13:05:00.711 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-logutils. 2024-03-30T13:05:00.717 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-30T13:05:00.737 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-30T13:05:00.757 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-30T13:05:00.777 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-30T13:05:01.026 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-rbd. 2024-03-30T13:05:01.042 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:01.054 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-30T13:05:01.070 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-30T13:05:01.084 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-rbd (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:01.104 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-30T13:05:01.383 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-mako. 2024-03-30T13:05:01.410 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-30T13:05:01.412 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-30T13:05:01.439 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-30T13:05:01.457 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-30T13:05:01.479 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-30T13:05:01.723 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-30T13:05:01.738 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-30T13:05:01.773 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-30T13:05:01.802 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-30T13:05:01.829 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-30T13:05:01.869 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-30T13:05:02.093 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-30T13:05:02.120 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-30T13:05:02.160 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-30T13:05:02.172 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-30T13:05:02.198 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-30T13:05:02.238 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-30T13:05:02.474 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package lua5.1. 2024-03-30T13:05:02.500 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-30T13:05:02.515 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webob. 2024-03-30T13:05:02.531 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-30T13:05:02.554 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-30T13:05:02.574 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-30T13:05:02.869 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package lua-any. 2024-03-30T13:05:02.885 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-waitress. 2024-03-30T13:05:02.895 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-30T13:05:02.912 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-30T13:05:02.935 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-30T13:05:02.947 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-30T13:05:03.188 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package zip. 2024-03-30T13:05:03.203 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-30T13:05:03.246 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking zip (3.0-12build2) ... 2024-03-30T13:05:03.255 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempita. 2024-03-30T13:05:03.281 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-30T13:05:03.330 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-30T13:05:03.541 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package unzip. 2024-03-30T13:05:03.570 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-30T13:05:03.616 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-paste. 2024-03-30T13:05:03.642 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-30T13:05:03.682 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-30T13:05:03.724 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-30T13:05:04.002 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-30T13:05:04.018 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-30T13:05:04.060 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-30T13:05:04.137 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package luarocks. 2024-03-30T13:05:04.163 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-30T13:05:04.203 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-30T13:05:04.363 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-30T13:05:04.390 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-30T13:05:04.429 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-30T13:05:04.578 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package librgw2. 2024-03-30T13:05:04.607 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../027-librgw2_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:04.644 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librgw2 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:04.699 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webtest. 2024-03-30T13:05:04.714 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-30T13:05:04.749 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-30T13:05:05.044 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pecan. 2024-03-30T13:05:05.070 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-30T13:05:05.110 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-30T13:05:05.197 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-rgw. 2024-03-30T13:05:05.212 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:05.247 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-rgw (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:05.473 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-certifi. 2024-03-30T13:05:05.500 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-30T13:05:05.539 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-30T13:05:05.575 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-30T13:05:05.601 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-30T13:05:05.642 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-30T13:05:05.859 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-idna. 2024-03-30T13:05:05.886 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-30T13:05:05.926 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-30T13:05:06.237 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-urllib3. 2024-03-30T13:05:06.264 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-30T13:05:06.303 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-30T13:05:06.631 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests. 2024-03-30T13:05:06.658 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-30T13:05:06.698 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-30T13:05:06.779 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libradosstriper1. 2024-03-30T13:05:06.807 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:06.845 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libradosstriper1 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:07.324 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-common. 2024-03-30T13:05:07.351 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:07.391 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-common (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:07.752 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-30T13:05:07.779 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-30T13:05:07.809 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-30T13:05:08.104 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-30T13:05:08.120 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:08.154 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:08.542 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-30T13:05:08.569 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:08.609 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:08.754 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-base. 2024-03-30T13:05:08.781 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:08.839 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-base (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:08.928 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-30T13:05:08.955 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-30T13:05:08.994 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-30T13:05:09.272 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-openssl. 2024-03-30T13:05:09.300 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-30T13:05:09.330 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-30T13:05:09.417 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-30T13:05:09.444 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-30T13:05:09.484 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-30T13:05:09.658 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr. 2024-03-30T13:05:09.686 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:09.725 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:09.762 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cheroot. 2024-03-30T13:05:09.788 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-30T13:05:09.820 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-30T13:05:10.073 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-30T13:05:10.088 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-30T13:05:10.128 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mon. 2024-03-30T13:05:10.131 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-30T13:05:10.156 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:10.194 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mon (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:10.434 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-30T13:05:10.461 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-30T13:05:10.501 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-30T13:05:10.787 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-30T13:05:10.814 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-30T13:05:10.831 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-osd. 2024-03-30T13:05:10.854 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-30T13:05:10.858 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:10.897 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-osd (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:11.157 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-tempora. 2024-03-30T13:05:11.183 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-30T13:05:11.215 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-30T13:05:11.518 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-portend. 2024-03-30T13:05:11.545 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-30T13:05:11.585 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-30T13:05:11.888 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-30T13:05:11.914 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-30T13:05:11.943 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph. 2024-03-30T13:05:11.954 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-30T13:05:11.958 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../068-ceph_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:12.000 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:12.241 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-30T13:05:12.267 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-30T13:05:12.295 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-fuse. 2024-03-30T13:05:12.299 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-30T13:05:12.321 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:12.361 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-fuse (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:12.645 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-natsort. 2024-03-30T13:05:12.671 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-30T13:05:12.706 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mds. 2024-03-30T13:05:12.711 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-30T13:05:12.733 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:12.790 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mds (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:13.081 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-logutils. 2024-03-30T13:05:13.108 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-30T13:05:13.156 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-30T13:05:13.209 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephadm. 2024-03-30T13:05:13.235 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../071-cephadm_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:13.275 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephadm (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:13.526 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-30T13:05:13.552 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-30T13:05:13.594 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-30T13:05:13.600 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-30T13:05:13.621 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-30T13:05:13.661 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-30T13:05:13.989 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-30T13:05:14.016 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-30T13:05:14.080 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-30T13:05:14.179 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-mako. 2024-03-30T13:05:14.205 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-30T13:05:14.245 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-30T13:05:14.591 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-30T13:05:14.617 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-30T13:05:14.657 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-30T13:05:14.985 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-30T13:05:15.001 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-30T13:05:15.051 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-30T13:05:15.127 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-babel. 2024-03-30T13:05:15.154 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-30T13:05:15.193 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-30T13:05:15.413 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-webob. 2024-03-30T13:05:15.444 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-30T13:05:15.488 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-30T13:05:15.521 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jinja2. 2024-03-30T13:05:15.548 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-30T13:05:15.612 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-30T13:05:15.908 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-waitress. 2024-03-30T13:05:15.934 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-30T13:05:15.940 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-30T13:05:15.968 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:15.978 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-30T13:05:16.007 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:16.302 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-tempita. 2024-03-30T13:05:16.329 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-30T13:05:16.352 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-30T13:05:16.369 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-30T13:05:16.379 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-30T13:05:16.418 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-30T13:05:16.721 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-routes. 2024-03-30T13:05:16.730 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-paste. 2024-03-30T13:05:16.748 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-30T13:05:16.757 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-30T13:05:16.787 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-30T13:05:16.814 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-30T13:05:17.124 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-30T13:05:17.150 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-30T13:05:17.151 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:17.165 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-30T13:05:17.190 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:17.200 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-30T13:05:17.470 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-30T13:05:17.496 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-30T13:05:17.536 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-30T13:05:17.840 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-webtest. 2024-03-30T13:05:17.866 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-30T13:05:17.906 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-30T13:05:18.217 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pecan. 2024-03-30T13:05:18.244 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-30T13:05:18.284 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-30T13:05:18.495 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-30T13:05:18.511 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-30T13:05:18.554 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-30T13:05:18.639 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-certifi. 2024-03-30T13:05:18.654 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-30T13:05:18.697 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-30T13:05:19.018 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-idna. 2024-03-30T13:05:19.044 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-30T13:05:19.084 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-30T13:05:19.090 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-joblib. 2024-03-30T13:05:19.106 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-30T13:05:19.149 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-30T13:05:19.403 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-urllib3. 2024-03-30T13:05:19.430 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-30T13:05:19.485 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-30T13:05:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-30T13:05:19.501 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-30T13:05:19.612 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-30T13:05:19.807 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-requests. 2024-03-30T13:05:19.834 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-30T13:05:19.873 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-30T13:05:19.915 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn. 2024-03-30T13:05:19.943 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-30T13:05:19.981 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-30T13:05:20.185 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-30T13:05:20.212 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-30T13:05:20.251 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-30T13:05:20.521 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-30T13:05:20.537 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:20.571 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:20.707 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-30T13:05:20.723 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:20.756 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-30T13:05:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:21.017 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:21.312 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-30T13:05:21.339 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-30T13:05:21.395 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-30T13:05:21.665 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-openssl. 2024-03-30T13:05:21.692 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-30T13:05:21.726 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cachetools. 2024-03-30T13:05:21.731 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-30T13:05:21.742 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-30T13:05:21.776 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-30T13:05:22.071 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-30T13:05:22.076 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr. 2024-03-30T13:05:22.098 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-30T13:05:22.103 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:22.137 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-30T13:05:22.142 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:22.474 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-30T13:05:22.502 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-30T13:05:22.540 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-30T13:05:22.554 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mon. 2024-03-30T13:05:22.581 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:22.621 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mon (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:22.835 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rsa. 2024-03-30T13:05:22.863 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-30T13:05:22.893 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-30T13:05:23.180 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-google-auth. 2024-03-30T13:05:23.208 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-30T13:05:23.217 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-osd. 2024-03-30T13:05:23.243 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:23.246 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-30T13:05:23.283 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-osd (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:23.566 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-30T13:05:23.594 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-30T13:05:23.633 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-30T13:05:23.953 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-websocket. 2024-03-30T13:05:23.980 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-30T13:05:24.019 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-30T13:05:24.331 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-30T13:05:24.358 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-30T13:05:24.397 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-30T13:05:24.495 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph. 2024-03-30T13:05:24.522 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../068-ceph_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:24.561 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:24.881 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-fuse. 2024-03-30T13:05:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:24.947 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-fuse (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:25.086 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-30T13:05:25.102 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:25.135 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:25.326 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mds. 2024-03-30T13:05:25.352 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:25.384 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mds (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-30T13:05:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-30T13:05:25.505 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-30T13:05:25.770 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package cephadm. 2024-03-30T13:05:25.797 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../071-cephadm_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:25.837 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking cephadm (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:25.841 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-30T13:05:25.868 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-30T13:05:25.907 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-30T13:05:26.156 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-30T13:05:26.160 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package jq. 2024-03-30T13:05:26.176 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-30T13:05:26.183 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-30T13:05:26.210 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-30T13:05:26.231 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-30T13:05:26.437 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package socat. 2024-03-30T13:05:26.453 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-30T13:05:26.487 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-30T13:05:26.551 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-30T13:05:26.566 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-30T13:05:26.609 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-30T13:05:26.757 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package xmlstarlet. 2024-03-30T13:05:26.770 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-30T13:05:26.815 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-30T13:05:27.153 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-test. 2024-03-30T13:05:27.180 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:27.211 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-test (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:27.831 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-babel. 2024-03-30T13:05:27.858 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-30T13:05:27.914 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-30T13:05:28.209 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-jinja2. 2024-03-30T13:05:28.224 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-30T13:05:28.259 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-30T13:05:28.554 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-30T13:05:28.569 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:28.604 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:28.924 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-30T13:05:28.940 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-30T13:05:28.974 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-30T13:05:29.243 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-routes. 2024-03-30T13:05:29.270 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-30T13:05:29.310 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-30T13:05:29.465 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-volume. 2024-03-30T13:05:29.493 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:29.531 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-volume (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:29.647 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-30T13:05:29.674 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:29.713 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:29.927 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-30T13:05:29.955 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:30.002 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-mirror (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:30.296 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-colorama. 2024-03-30T13:05:30.324 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-30T13:05:30.363 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-30T13:05:30.632 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-shell. 2024-03-30T13:05:30.648 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:30.690 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-shell (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:30.985 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-30T13:05:31.001 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-30T13:05:31.035 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-30T13:05:31.204 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-top. 2024-03-30T13:05:31.232 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:31.284 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-top (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:31.520 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-30T13:05:31.547 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-joblib. 2024-03-30T13:05:31.548 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:31.574 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-30T13:05:31.578 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs-dev (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:31.613 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-30T13:05:31.889 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-30T13:05:31.905 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-30T13:05:31.984 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-30T13:05:32.011 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-30T13:05:32.058 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-30T13:05:32.144 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-30T13:05:32.414 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-sklearn. 2024-03-30T13:05:32.418 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-30T13:05:32.441 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-30T13:05:32.446 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-30T13:05:32.480 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-30T13:05:32.485 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-30T13:05:32.839 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package nvme-cli. 2024-03-30T13:05:32.867 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-30T13:05:32.905 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-30T13:05:33.165 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-30T13:05:33.193 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:33.240 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:33.344 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package pkg-config. 2024-03-30T13:05:33.372 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-30T13:05:33.410 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-30T13:05:33.638 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-30T13:05:33.654 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-30T13:05:33.687 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-30T13:05:34.058 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-30T13:05:34.085 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-30T13:05:34.124 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-30T13:05:34.218 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cachetools. 2024-03-30T13:05:34.246 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-30T13:05:34.285 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-30T13:05:34.418 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastescript. 2024-03-30T13:05:34.446 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-30T13:05:34.485 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-30T13:05:34.588 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-30T13:05:34.615 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-30T13:05:34.654 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-30T13:05:34.779 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pluggy. 2024-03-30T13:05:34.807 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-30T13:05:34.846 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-30T13:05:35.115 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-psutil. 2024-03-30T13:05:35.144 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-30T13:05:35.173 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-30T13:05:35.191 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-30T13:05:35.219 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-30T13:05:35.258 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-30T13:05:35.554 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-py. 2024-03-30T13:05:35.569 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-rsa. 2024-03-30T13:05:35.582 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-30T13:05:35.596 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-30T13:05:35.620 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-30T13:05:35.635 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-30T13:05:35.889 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-google-auth. 2024-03-30T13:05:35.905 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-30T13:05:35.939 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-30T13:05:35.940 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pygments. 2024-03-30T13:05:35.968 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-30T13:05:36.006 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-30T13:05:36.251 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-30T13:05:36.279 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-30T13:05:36.340 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-30T13:05:36.402 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-30T13:05:36.430 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-30T13:05:36.460 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-30T13:05:36.654 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-websocket. 2024-03-30T13:05:36.682 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-30T13:05:36.721 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-30T13:05:36.771 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-toml. 2024-03-30T13:05:36.799 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-30T13:05:36.837 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-30T13:05:37.049 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-30T13:05:37.077 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-30T13:05:37.116 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-30T13:05:37.140 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pytest. 2024-03-30T13:05:37.168 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-30T13:05:37.206 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-30T13:05:37.560 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplejson. 2024-03-30T13:05:37.588 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-30T13:05:37.626 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-30T13:05:37.838 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-30T13:05:37.855 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:37.899 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:37.921 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-30T13:05:37.951 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-30T13:05:37.987 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-30T13:05:38.191 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-30T13:05:38.219 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-30T13:05:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-30T13:05:38.586 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-30T13:05:38.614 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-30T13:05:38.652 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-30T13:05:38.733 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package radosgw. 2024-03-30T13:05:38.761 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../122-radosgw_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:38.799 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking radosgw (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:38.913 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package jq. 2024-03-30T13:05:38.930 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-30T13:05:38.963 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-30T13:05:39.216 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package socat. 2024-03-30T13:05:39.244 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-30T13:05:39.283 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-30T13:05:39.560 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package rbd-fuse. 2024-03-30T13:05:39.577 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:39.594 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package xmlstarlet. 2024-03-30T13:05:39.618 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking rbd-fuse (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:39.622 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-30T13:05:39.661 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-30T13:05:39.932 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-30T13:05:40.082 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-test. 2024-03-30T13:05:40.110 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:40.148 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-test (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:40.174 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-30T13:05:40.300 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-30T13:05:40.559 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-30T13:05:40.886 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-30T13:05:41.317 INFO:teuthology.orchestra.run.smithi153.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-30T13:05:41.461 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephadm (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:42.287 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user cephadm....done 2024-03-30T13:05:42.430 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-volume. 2024-03-30T13:05:42.457 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:42.496 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-volume (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:42.523 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-30T13:05:42.859 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-30T13:05:42.884 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-30T13:05:42.911 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:42.950 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking cephfs-mirror (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:43.095 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-30T13:05:43.212 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-colorama. 2024-03-30T13:05:43.212 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-30T13:05:43.228 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-30T13:05:43.270 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-30T13:05:43.463 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-30T13:05:43.506 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package cephfs-shell. 2024-03-30T13:05:43.522 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:43.564 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking cephfs-shell (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:43.714 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-30T13:05:43.833 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package cephfs-top. 2024-03-30T13:05:43.840 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-30T13:05:43.857 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2519-gac171039-1jammy_all.deb ... 2024-03-30T13:05:43.900 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking cephfs-top (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:44.144 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-30T13:05:44.158 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-30T13:05:44.160 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:44.203 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libcephfs-dev (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:44.505 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-30T13:05:44.528 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-30T13:05:44.533 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-30T13:05:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-30T13:05:44.778 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-30T13:05:44.885 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-30T13:05:44.913 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-30T13:05:44.952 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-30T13:05:45.029 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-30T13:05:45.297 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-30T13:05:45.323 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package nvme-cli. 2024-03-30T13:05:45.350 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-30T13:05:45.389 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-30T13:05:45.540 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-30T13:05:45.800 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-30T13:05:45.803 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package pkg-config. 2024-03-30T13:05:45.830 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-30T13:05:45.869 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-30T13:05:46.050 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-30T13:05:46.114 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-30T13:05:46.139 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-30T13:05:46.180 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-30T13:05:46.310 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-argparse (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:46.575 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-30T13:05:46.586 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-30T13:05:46.603 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-30T13:05:46.633 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-30T13:05:46.712 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-30T13:05:46.838 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-30T13:05:46.936 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pastescript. 2024-03-30T13:05:46.964 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-30T13:05:47.003 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-30T13:05:47.097 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-30T13:05:47.224 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-30T13:05:47.323 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pluggy. 2024-03-30T13:05:47.351 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-30T13:05:47.390 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-30T13:05:47.483 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-30T13:05:47.718 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-psutil. 2024-03-30T13:05:47.745 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-30T13:05:47.786 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-30T13:05:47.862 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-30T13:05:47.897 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-30T13:05:47.978 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-30T13:05:48.105 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-30T13:05:48.138 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-py. 2024-03-30T13:05:48.166 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-30T13:05:48.221 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-30T13:05:48.463 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-30T13:05:48.541 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pygments. 2024-03-30T13:05:48.569 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-30T13:05:48.589 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-30T13:05:48.607 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-30T13:05:48.865 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-30T13:05:49.078 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-30T13:05:49.106 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-30T13:05:49.133 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-30T13:05:49.144 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-30T13:05:49.439 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-toml. 2024-03-30T13:05:49.450 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up zip (3.0-12build2) ... 2024-03-30T13:05:49.465 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-30T13:05:49.497 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-30T13:05:49.551 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-30T13:05:49.767 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pytest. 2024-03-30T13:05:49.795 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-30T13:05:49.833 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-30T13:05:50.162 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-simplejson. 2024-03-30T13:05:50.190 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-30T13:05:50.229 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-30T13:05:50.245 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-30T13:05:50.504 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-30T13:05:50.630 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-30T13:05:50.756 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-30T13:05:50.782 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-30T13:05:50.809 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-30T13:05:50.848 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-30T13:05:51.066 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-30T13:05:51.466 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-30T13:05:51.603 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package radosgw. 2024-03-30T13:05:51.630 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../122-radosgw_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:51.669 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking radosgw (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:51.976 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-30T13:05:52.386 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-30T13:05:52.413 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package rbd-fuse. 2024-03-30T13:05:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2519-gac171039-1jammy_amd64.deb ... 2024-03-30T13:05:52.463 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking rbd-fuse (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:52.747 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-30T13:05:52.777 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-30T13:05:53.036 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-30T13:05:53.063 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-30T13:05:53.137 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-30T13:05:53.398 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-30T13:05:53.416 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-30T13:05:53.674 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-30T13:05:53.730 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-30T13:05:53.800 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-common (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:54.093 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-idna (3.3-1) ... 2024-03-30T13:05:54.150 INFO:teuthology.orchestra.run.smithi083.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-30T13:05:54.213 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up cephadm (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:54.402 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-30T13:05:54.722 INFO:teuthology.orchestra.run.smithi083.stdout:Adding system user cephadm....done 2024-03-30T13:05:54.878 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-30T13:05:55.154 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-30T13:05:55.397 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-30T13:05:55.499 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-30T13:05:55.591 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-30T13:05:55.742 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-30T13:05:55.834 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T13:05:55.960 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-30T13:05:56.001 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-30T13:05:56.203 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-30T13:05:56.219 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-30T13:05:56.329 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-30T13:05:56.455 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-30T13:05:56.554 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-30T13:05:56.739 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-30T13:05:56.914 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-30T13:05:56.990 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-30T13:05:57.166 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-30T13:05:57.275 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T13:05:57.376 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-30T13:05:57.425 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-30T13:05:57.661 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-30T13:05:57.701 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-30T13:05:57.936 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-30T13:05:57.937 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-30T13:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-30T13:05:58.196 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-30T13:05:58.449 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-30T13:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-30T13:05:58.699 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-30T13:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-ceph-argparse (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:05:58.968 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-30T13:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-30T13:05:59.075 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-30T13:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-30T13:05:59.227 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-30T13:05:59.334 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-30T13:05:59.453 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-30T13:05:59.469 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-30T13:05:59.595 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-30T13:05:59.738 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-30T13:05:59.847 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-30T13:06:00.038 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-30T13:06:00.241 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-30T13:06:00.270 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-30T13:06:00.289 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-30T13:06:00.325 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-30T13:06:00.415 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-30T13:06:00.451 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-30T13:06:00.541 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-30T13:06:00.647 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-30T13:06:00.811 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-30T13:06:00.876 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-30T13:06:00.911 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-30T13:06:00.985 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-30T13:06:01.171 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-30T13:06:01.387 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-30T13:06:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-30T13:06:01.646 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-30T13:06:01.748 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up zip (3.0-12build2) ... 2024-03-30T13:06:01.772 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-30T13:06:01.858 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-30T13:06:02.031 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T13:06:02.254 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-30T13:06:02.560 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-30T13:06:02.641 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-30T13:06:02.803 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-30T13:06:02.912 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-30T13:06:02.942 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-30T13:06:03.038 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-30T13:06:03.202 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-30T13:06:03.331 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-30T13:06:03.413 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-30T13:06:03.689 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-30T13:06:03.690 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-30T13:06:03.942 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-30T13:06:03.965 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-30T13:06:04.250 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-30T13:06:04.326 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-30T13:06:04.611 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-30T13:06:04.618 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-30T13:06:04.904 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-30T13:06:04.914 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-30T13:06:05.222 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-30T13:06:05.247 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-30T13:06:05.348 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librados2 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:05.474 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:05.498 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-30T13:06:05.592 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-30T13:06:05.627 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-ceph-common (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:05.886 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs2 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:05.917 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-idna (3.3-1) ... 2024-03-30T13:06:06.012 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libradosstriper1 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:06.138 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-30T13:06:06.311 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-30T13:06:06.415 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librbd1 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:06.541 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-modules-core (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:06.667 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-fuse (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:06.882 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-30T13:06:06.883 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-30T13:06:07.385 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs-dev (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:07.450 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-30T13:06:07.511 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rados (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:07.612 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librgw2 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:07.701 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T13:06:07.713 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-top (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:07.836 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-30T13:06:07.864 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-30T13:06:08.095 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-30T13:06:08.222 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-30T13:06:08.322 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-30T13:06:08.599 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-30T13:06:08.850 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-30T13:06:09.067 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rbd (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:09.101 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T13:06:09.168 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up rbd-fuse (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:09.219 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-30T13:06:09.286 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rgw (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:09.412 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cephfs (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:09.495 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-30T13:06:09.538 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-shell (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:09.663 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-common (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:09.755 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-30T13:06:09.998 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-30T13:06:10.173 INFO:teuthology.orchestra.run.smithi153.stdout:Adding group ceph....done 2024-03-30T13:06:10.249 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-30T13:06:10.500 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-30T13:06:10.533 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user ceph....done 2024-03-30T13:06:10.676 INFO:teuthology.orchestra.run.smithi153.stdout:Setting system user ceph properties....done 2024-03-30T13:06:10.694 INFO:teuthology.orchestra.run.smithi153.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-30T13:06:10.759 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-30T13:06:10.832 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-30T13:06:10.869 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-30T13:06:11.145 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-30T13:06:11.204 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-30T13:06:11.263 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-30T13:06:11.581 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-30T13:06:11.656 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-mirror (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:11.860 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-30T13:06:11.860 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-30T13:06:11.890 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-30T13:06:12.133 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-30T13:06:12.259 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-30T13:06:12.357 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-test (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:12.385 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-30T13:06:12.482 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-30T13:06:12.483 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up radosgw (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:12.695 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-30T13:06:12.813 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-30T13:06:12.930 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-30T13:06:12.930 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-30T13:06:13.214 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-30T13:06:13.394 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-base (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:13.457 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-30T13:06:13.583 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-30T13:06:13.740 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-30T13:06:13.843 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T13:06:13.985 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-30T13:06:14.195 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mds (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:14.303 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-30T13:06:14.422 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-30T13:06:14.422 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-30T13:06:14.588 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-30T13:06:14.856 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-30T13:06:14.938 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:15.067 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-30T13:06:15.182 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-30T13:06:15.182 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-30T13:06:15.343 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-30T13:06:15.612 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-30T13:06:15.623 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-osd (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:15.880 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-30T13:06:15.905 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-30T13:06:15.905 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-30T13:06:16.352 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-30T13:06:16.383 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:16.500 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:16.634 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mon (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:16.708 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-30T13:06:16.854 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-30T13:06:16.854 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-30T13:06:17.044 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-30T13:06:17.145 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librados2 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:17.263 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:17.311 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-cephadm (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:17.389 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-30T13:06:17.453 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:17.563 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-dashboard (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:17.689 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-volume (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:17.725 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libcephfs2 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:17.851 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libradosstriper1 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:17.969 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-30T13:06:18.229 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librbd1 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:18.280 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-30T13:06:18.339 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-modules-core (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:18.388 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-30T13:06:18.440 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-fuse (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:18.551 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-30T13:06:18.636 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-30T13:06:18.636 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-30T13:06:19.141 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libcephfs-dev (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:19.310 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-rados (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:19.429 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librgw2 (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:19.557 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-30T13:06:19.944 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up cephfs-top (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:20.064 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-30T13:06:20.165 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-30T13:06:20.168 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-30T13:06:20.271 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-03-30T13:06:20.468 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-03-30T13:06:20.469 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-03-30T13:06:20.654 INFO:teuthology.orchestra.run.smithi153.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-30T13:06:20.654 INFO:teuthology.orchestra.run.smithi153.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-30T13:06:20.654 INFO:teuthology.orchestra.run.smithi153.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-30T13:06:20.654 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T13:06:20.655 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T13:06:20.655 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T13:06:20.655 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T13:06:20.656 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-30T13:06:20.656 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-30T13:06:20.657 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T13:06:20.657 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-03-30T13:06:20.657 INFO:teuthology.orchestra.run.smithi153.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-30T13:06:20.657 INFO:teuthology.orchestra.run.smithi153.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-30T13:06:20.657 INFO:teuthology.orchestra.run.smithi153.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-03-30T13:06:20.657 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-30T13:06:20.658 INFO:teuthology.orchestra.run.smithi153.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-30T13:06:20.658 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-03-30T13:06:20.658 INFO:teuthology.orchestra.run.smithi153.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-30T13:06:20.659 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-03-30T13:06:20.659 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-03-30T13:06:20.693 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-03-30T13:06:20.693 INFO:teuthology.orchestra.run.smithi153.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-30T13:06:20.694 INFO:teuthology.orchestra.run.smithi153.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-30T13:06:20.694 INFO:teuthology.orchestra.run.smithi153.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-30T13:06:20.694 INFO:teuthology.orchestra.run.smithi153.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-30T13:06:20.694 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-30T13:06:20.695 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-30T13:06:20.695 INFO:teuthology.orchestra.run.smithi153.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-30T13:06:20.695 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-03-30T13:06:20.696 INFO:teuthology.orchestra.run.smithi153.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-03-30T13:06:20.875 INFO:teuthology.orchestra.run.smithi153.stdout:4 upgraded, 39 newly installed, 0 to remove and 294 not upgraded. 2024-03-30T13:06:20.875 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 55.7 MB of archives. 2024-03-30T13:06:20.876 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-30T13:06:20.876 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.3 [1,063 kB] 2024-03-30T13:06:21.284 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-rbd (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:21.427 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up rbd-fuse (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:21.502 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-30T13:06:21.518 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-30T13:06:21.553 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-rgw (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:21.643 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.3 [33.1 kB] 2024-03-30T13:06:21.644 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.3 [24.4 kB] 2024-03-30T13:06:21.645 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-30T13:06:21.674 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-30T13:06:21.675 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-30T13:06:21.679 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-30T13:06:21.681 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-30T13:06:21.682 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-30T13:06:21.831 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cephfs (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:21.848 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-30T13:06:21.957 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up cephfs-shell (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:22.083 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-common (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:22.141 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-30T13:06:22.151 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-30T13:06:22.156 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-30T13:06:22.241 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-30T13:06:22.552 INFO:teuthology.orchestra.run.smithi083.stdout:Adding group ceph....done 2024-03-30T13:06:22.911 INFO:teuthology.orchestra.run.smithi083.stdout:Adding system user ceph....done 2024-03-30T13:06:23.080 INFO:teuthology.orchestra.run.smithi083.stdout:Setting system user ceph properties....done 2024-03-30T13:06:23.098 INFO:teuthology.orchestra.run.smithi083.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-30T13:06:23.232 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-30T13:06:23.332 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-30T13:06:23.336 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-30T13:06:23.337 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-30T13:06:23.343 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-30T13:06:23.344 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-30T13:06:23.355 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-30T13:06:23.522 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-30T13:06:23.548 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-30T13:06:24.018 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up cephfs-mirror (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:24.121 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-30T13:06:24.121 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-30T13:06:24.230 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-30T13:06:24.230 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-30T13:06:24.302 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-30T13:06:24.302 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-30T13:06:24.342 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-30T13:06:24.403 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-30T13:06:24.410 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-30T13:06:24.411 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-30T13:06:24.412 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-30T13:06:24.412 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-30T13:06:24.621 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-30T13:06:24.678 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-test (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:24.804 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up radosgw (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:25.034 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-30T13:06:25.239 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-30T13:06:25.239 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-30T13:06:25.677 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-base (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:25.858 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-30T13:06:25.858 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-30T13:06:25.858 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-30T13:06:25.859 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-30T13:06:25.860 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-30T13:06:25.860 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-30T13:06:25.886 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-30T13:06:25.887 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-30T13:06:26.159 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-30T13:06:26.293 INFO:teuthology.orchestra.run.smithi153.stdout:Preconfiguring packages ... 2024-03-30T13:06:26.450 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 55.7 MB in 5s (10.7 MB/s) 2024-03-30T13:06:26.625 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mds (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:26.770 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173988 files and directories currently installed.) 2024-03-30T13:06:26.776 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.3_amd64.deb ... 2024-03-30T13:06:26.848 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-30T13:06:26.848 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-30T13:06:26.921 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking util-linux (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-03-30T13:06:27.508 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up util-linux (2.37.2-4ubuntu3.3) ... 2024-03-30T13:06:27.606 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:27.823 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-30T13:06:27.823 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-30T13:06:28.274 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-osd (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:28.420 INFO:teuthology.orchestra.run.smithi153.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-03-30T13:06:28.539 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-30T13:06:28.539 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-30T13:06:28.650 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package flex. 2024-03-30T13:06:28.743 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173988 files and directories currently installed.) 2024-03-30T13:06:28.748 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-30T13:06:28.790 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-30T13:06:29.042 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:29.168 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:29.330 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mon (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:29.342 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-30T13:06:29.515 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-30T13:06:29.540 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-30T13:06:29.540 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-30T13:06:29.934 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-30T13:06:29.989 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-cephadm (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:30.107 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:30.208 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-dashboard (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:30.359 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-volume (19.0.0-2519-gac171039-1jammy) ... 2024-03-30T13:06:30.462 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174061 files and directories currently installed.) 2024-03-30T13:06:30.467 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.3_amd64.deb ... 2024-03-30T13:06:30.572 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-03-30T13:06:30.728 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-30T13:06:30.846 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-30T13:06:30.981 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.3_amd64.deb ... 2024-03-30T13:06:30.990 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-30T13:06:31.121 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-03-30T13:06:31.448 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.3) ... 2024-03-30T13:06:31.780 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package bison. 2024-03-30T13:06:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-30T13:06:31.882 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174061 files and directories currently installed.) 2024-03-30T13:06:31.887 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-30T13:06:31.932 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-30T13:06:32.341 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-30T13:06:32.369 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-30T13:06:32.408 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-30T13:06:32.424 INFO:teuthology.orchestra.run.smithi083.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-30T13:06:32.427 DEBUG:teuthology.orchestra.run.smithi083:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-30T13:06:32.484 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-03-30T13:06:32.682 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2024-03-30T13:06:32.683 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2024-03-30T13:06:32.710 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package dump. 2024-03-30T13:06:32.727 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-30T13:06:32.769 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking dump (0.4b47-3) ... 2024-03-30T13:06:32.865 INFO:teuthology.orchestra.run.smithi083.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-30T13:06:32.866 INFO:teuthology.orchestra.run.smithi083.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-30T13:06:32.866 INFO:teuthology.orchestra.run.smithi083.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-30T13:06:32.866 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T13:06:32.866 INFO:teuthology.orchestra.run.smithi083.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T13:06:32.866 INFO:teuthology.orchestra.run.smithi083.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T13:06:32.866 INFO:teuthology.orchestra.run.smithi083.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T13:06:32.866 INFO:teuthology.orchestra.run.smithi083.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-30T13:06:32.867 INFO:teuthology.orchestra.run.smithi083.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-30T13:06:32.867 INFO:teuthology.orchestra.run.smithi083.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T13:06:32.867 INFO:teuthology.orchestra.run.smithi083.stdout:The following additional packages will be installed: 2024-03-30T13:06:32.867 INFO:teuthology.orchestra.run.smithi083.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-30T13:06:32.867 INFO:teuthology.orchestra.run.smithi083.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-30T13:06:32.868 INFO:teuthology.orchestra.run.smithi083.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-03-30T13:06:32.868 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-30T13:06:32.868 INFO:teuthology.orchestra.run.smithi083.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-30T13:06:32.869 INFO:teuthology.orchestra.run.smithi083.stdout:Suggested packages: 2024-03-30T13:06:32.869 INFO:teuthology.orchestra.run.smithi083.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-30T13:06:32.869 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-03-30T13:06:32.870 INFO:teuthology.orchestra.run.smithi083.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-03-30T13:06:32.908 INFO:teuthology.orchestra.run.smithi083.stdout:The following NEW packages will be installed: 2024-03-30T13:06:32.908 INFO:teuthology.orchestra.run.smithi083.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-30T13:06:32.909 INFO:teuthology.orchestra.run.smithi083.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-30T13:06:32.909 INFO:teuthology.orchestra.run.smithi083.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-30T13:06:32.909 INFO:teuthology.orchestra.run.smithi083.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-30T13:06:32.909 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-30T13:06:32.910 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-30T13:06:32.910 INFO:teuthology.orchestra.run.smithi083.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-30T13:06:32.910 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages will be upgraded: 2024-03-30T13:06:32.911 INFO:teuthology.orchestra.run.smithi083.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-03-30T13:06:33.081 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package indent. 2024-03-30T13:06:33.091 INFO:teuthology.orchestra.run.smithi083.stdout:4 upgraded, 39 newly installed, 0 to remove and 294 not upgraded. 2024-03-30T13:06:33.091 INFO:teuthology.orchestra.run.smithi083.stdout:Need to get 55.7 MB of archives. 2024-03-30T13:06:33.091 INFO:teuthology.orchestra.run.smithi083.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-30T13:06:33.091 INFO:teuthology.orchestra.run.smithi083.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.3 [1,063 kB] 2024-03-30T13:06:33.098 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-30T13:06:33.139 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-30T13:06:33.400 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-30T13:06:33.417 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-30T13:06:33.459 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-30T13:06:33.721 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-30T13:06:33.737 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-30T13:06:33.754 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-30T13:06:33.783 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-30T13:06:33.821 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-30T13:06:33.863 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.3 [33.1 kB] 2024-03-30T13:06:33.864 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.3 [24.4 kB] 2024-03-30T13:06:33.865 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-30T13:06:33.894 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-30T13:06:33.895 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-30T13:06:33.899 INFO:teuthology.orchestra.run.smithi083.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-30T13:06:33.901 INFO:teuthology.orchestra.run.smithi083.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-30T13:06:33.902 INFO:teuthology.orchestra.run.smithi083.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-30T13:06:34.069 INFO:teuthology.orchestra.run.smithi083.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-30T13:06:34.091 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-30T13:06:34.119 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-30T13:06:34.157 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-30T13:06:34.362 INFO:teuthology.orchestra.run.smithi083.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-30T13:06:34.372 INFO:teuthology.orchestra.run.smithi083.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-30T13:06:34.377 INFO:teuthology.orchestra.run.smithi083.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-30T13:06:34.462 INFO:teuthology.orchestra.run.smithi083.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-30T13:06:34.502 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-30T13:06:34.530 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-30T13:06:34.568 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-30T13:06:34.821 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-30T13:06:34.837 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-30T13:06:34.871 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-30T13:06:35.074 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjson-perl. 2024-03-30T13:06:35.090 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-30T13:06:35.132 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-30T13:06:35.444 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-30T13:06:35.471 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-30T13:06:35.510 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-30T13:06:35.585 INFO:teuthology.orchestra.run.smithi083.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-30T13:06:35.589 INFO:teuthology.orchestra.run.smithi083.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-30T13:06:35.590 INFO:teuthology.orchestra.run.smithi083.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-30T13:06:35.596 INFO:teuthology.orchestra.run.smithi083.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-30T13:06:35.597 INFO:teuthology.orchestra.run.smithi083.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-30T13:06:35.607 INFO:teuthology.orchestra.run.smithi083.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-30T13:06:35.775 INFO:teuthology.orchestra.run.smithi083.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-30T13:06:36.371 INFO:teuthology.orchestra.run.smithi083.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-30T13:06:36.371 INFO:teuthology.orchestra.run.smithi083.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-30T13:06:36.553 INFO:teuthology.orchestra.run.smithi083.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-30T13:06:36.554 INFO:teuthology.orchestra.run.smithi083.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-30T13:06:36.591 INFO:teuthology.orchestra.run.smithi083.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-30T13:06:36.653 INFO:teuthology.orchestra.run.smithi083.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-30T13:06:36.661 INFO:teuthology.orchestra.run.smithi083.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-30T13:06:36.662 INFO:teuthology.orchestra.run.smithi083.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-30T13:06:36.663 INFO:teuthology.orchestra.run.smithi083.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-30T13:06:36.664 INFO:teuthology.orchestra.run.smithi083.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-30T13:06:36.868 INFO:teuthology.orchestra.run.smithi083.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-30T13:06:37.188 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-30T13:06:37.216 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-30T13:06:37.255 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-30T13:06:37.270 INFO:teuthology.orchestra.run.smithi083.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-30T13:06:37.499 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-30T13:06:37.516 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-30T13:06:37.549 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-30T13:06:37.844 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-30T13:06:37.871 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-30T13:06:37.910 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-30T13:06:38.075 INFO:teuthology.orchestra.run.smithi083.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-30T13:06:38.075 INFO:teuthology.orchestra.run.smithi083.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-30T13:06:38.075 INFO:teuthology.orchestra.run.smithi083.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-30T13:06:38.075 INFO:teuthology.orchestra.run.smithi083.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-30T13:06:38.113 INFO:teuthology.orchestra.run.smithi083.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-30T13:06:38.113 INFO:teuthology.orchestra.run.smithi083.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-30T13:06:38.143 INFO:teuthology.orchestra.run.smithi083.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-30T13:06:38.144 INFO:teuthology.orchestra.run.smithi083.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-30T13:06:38.389 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-30T13:06:38.416 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-30T13:06:38.455 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-30T13:06:38.549 INFO:teuthology.orchestra.run.smithi083.stdout:Preconfiguring packages ... 2024-03-30T13:06:38.707 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 55.7 MB in 5s (10.7 MB/s) 2024-03-30T13:06:38.783 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-30T13:06:38.810 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-30T13:06:38.849 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-30T13:06:39.029 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173988 files and directories currently installed.) 2024-03-30T13:06:39.034 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.3_amd64.deb ... 2024-03-30T13:06:39.188 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking util-linux (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-03-30T13:06:39.202 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-30T13:06:39.230 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-30T13:06:39.269 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-30T13:06:39.580 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-30T13:06:39.609 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-30T13:06:39.638 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-30T13:06:39.851 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up util-linux (2.37.2-4ubuntu3.3) ... 2024-03-30T13:06:39.941 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-30T13:06:39.957 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-30T13:06:40.000 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-30T13:06:40.285 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-30T13:06:40.314 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-30T13:06:40.352 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-30T13:06:40.816 INFO:teuthology.orchestra.run.smithi083.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-03-30T13:06:40.864 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-30T13:06:40.892 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-30T13:06:40.931 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-30T13:06:41.112 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package flex. 2024-03-30T13:06:41.215 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173988 files and directories currently installed.) 2024-03-30T13:06:41.221 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-30T13:06:41.242 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package modemmanager. 2024-03-30T13:06:41.258 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-30T13:06:41.259 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-30T13:06:41.300 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-30T13:06:41.792 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-30T13:06:41.899 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package network-manager. 2024-03-30T13:06:41.927 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-30T13:06:41.973 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-30T13:06:41.974 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-30T13:06:42.425 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-30T13:06:42.605 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ppp. 2024-03-30T13:06:42.633 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-30T13:06:42.910 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-30T13:06:42.952 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174061 files and directories currently installed.) 2024-03-30T13:06:42.957 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.3_amd64.deb ... 2024-03-30T13:06:43.090 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-03-30T13:06:43.211 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package pptp-linux. 2024-03-30T13:06:43.228 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-30T13:06:43.269 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-30T13:06:43.514 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.3_amd64.deb ... 2024-03-30T13:06:43.606 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-30T13:06:43.634 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-30T13:06:43.636 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-03-30T13:06:43.681 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-30T13:06:43.981 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.3) ... 2024-03-30T13:06:44.000 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-30T13:06:44.028 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-30T13:06:44.067 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-client-common (238) ... 2024-03-30T13:06:44.321 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-30T13:06:44.349 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-30T13:06:44.354 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package bison. 2024-03-30T13:06:44.387 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-30T13:06:44.458 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174061 files and directories currently installed.) 2024-03-30T13:06:44.464 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-30T13:06:44.514 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-30T13:06:44.949 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-30T13:06:44.977 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-30T13:06:45.016 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-30T13:06:45.017 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-common. 2024-03-30T13:06:45.046 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-30T13:06:45.102 INFO:teuthology.orchestra.run.smithi153.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-30T13:06:45.123 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-common (238) ... 2024-03-30T13:06:45.327 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package dump. 2024-03-30T13:06:45.354 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-30T13:06:45.385 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking dump (0.4b47-3) ... 2024-03-30T13:06:45.600 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-14. 2024-03-30T13:06:45.628 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-30T13:06:45.670 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-30T13:06:45.781 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package indent. 2024-03-30T13:06:45.809 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-30T13:06:45.848 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-30T13:06:46.108 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-30T13:06:46.124 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-30T13:06:46.167 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-30T13:06:46.479 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-30T13:06:46.495 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-30T13:06:46.537 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-30T13:06:46.807 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-30T13:06:46.835 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-30T13:06:46.874 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-30T13:06:46.894 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql. 2024-03-30T13:06:46.910 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-30T13:06:46.944 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql (14+238) ... 2024-03-30T13:06:47.171 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-client. 2024-03-30T13:06:47.187 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-30T13:06:47.219 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-30T13:06:47.246 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-30T13:06:47.263 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-client (14+238) ... 2024-03-30T13:06:47.285 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-30T13:06:47.539 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-30T13:06:47.554 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-30T13:06:47.596 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-30T13:06:47.649 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-30T13:06:47.665 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-30T13:06:47.707 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-30T13:06:47.799 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libjson-perl. 2024-03-30T13:06:47.815 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-30T13:06:47.857 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-30T13:06:48.009 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package tcl8.6. 2024-03-30T13:06:48.038 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-30T13:06:48.076 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-30T13:06:48.169 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-30T13:06:48.197 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-30T13:06:48.235 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-30T13:06:48.328 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package tcl. 2024-03-30T13:06:48.357 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-30T13:06:48.392 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-30T13:06:48.723 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package wpasupplicant. 2024-03-30T13:06:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-30T13:06:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-30T13:06:49.161 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-30T13:06:49.190 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-30T13:06:49.219 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-30T13:06:49.556 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-30T13:06:49.585 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-30T13:06:49.630 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-30T13:06:49.927 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-client-common (238) ... 2024-03-30T13:06:49.963 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-30T13:06:49.991 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-30T13:06:50.030 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-30T13:06:50.111 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-30T13:06:50.212 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-30T13:06:50.274 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-30T13:06:50.290 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-30T13:06:50.324 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-30T13:06:50.339 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-30T13:06:50.465 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-30T13:06:50.591 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-30T13:06:50.717 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-30T13:06:50.718 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-30T13:06:50.718 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-30T13:06:50.718 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-30T13:06:51.046 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-30T13:06:51.075 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-30T13:06:51.113 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-30T13:06:51.283 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-30T13:06:51.364 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-30T13:06:51.450 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-30T13:06:51.478 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-30T13:06:51.516 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-30T13:06:51.745 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-30T13:06:51.745 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-30T13:06:51.836 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-30T13:06:51.864 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-30T13:06:51.903 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-30T13:06:52.222 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-30T13:06:52.250 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-30T13:06:52.267 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.3) ... 2024-03-30T13:06:52.288 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-30T13:06:52.401 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-30T13:06:52.527 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-30T13:06:52.625 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-30T13:06:52.641 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-30T13:06:52.683 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-30T13:06:52.935 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-30T13:06:52.952 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-30T13:06:52.993 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-30T13:06:52.994 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-30T13:06:53.498 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-30T13:06:53.526 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-30T13:06:53.564 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-30T13:06:53.596 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-30T13:06:53.714 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-30T13:06:53.815 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-30T13:06:53.924 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-30T13:06:53.934 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package modemmanager. 2024-03-30T13:06:53.962 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-30T13:06:54.001 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-30T13:06:54.596 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-30T13:06:54.641 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package network-manager. 2024-03-30T13:06:54.669 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-30T13:06:54.716 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-30T13:06:54.722 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up dump (0.4b47-3) ... 2024-03-30T13:06:54.816 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-30T13:06:54.882 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-30T13:06:55.000 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-30T13:06:55.101 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-30T13:06:55.227 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-30T13:06:55.353 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-30T13:06:55.390 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ppp. 2024-03-30T13:06:55.419 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-30T13:06:55.444 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-30T13:06:55.513 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-30T13:06:55.639 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-30T13:06:55.682 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-30T13:06:55.823 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-30T13:06:55.941 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-30T13:06:55.995 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package pptp-linux. 2024-03-30T13:06:56.023 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-30T13:06:56.050 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-30T13:06:56.061 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-30T13:06:56.193 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-client (14+238) ... 2024-03-30T13:06:56.314 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-30T13:06:56.319 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-30T13:06:56.342 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-30T13:06:56.389 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-30T13:06:56.668 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-30T13:06:56.696 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-30T13:06:56.792 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:06:56.792 INFO:teuthology.orchestra.run.smithi153.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-30T13:06:56.792 INFO:teuthology.orchestra.run.smithi153.stdout:which means they are currently configured by ifupdown: 2024-03-30T13:06:56.792 INFO:teuthology.orchestra.run.smithi153.stdout:- enp3s0f1 2024-03-30T13:06:56.792 INFO:teuthology.orchestra.run.smithi153.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-30T13:06:56.792 INFO:teuthology.orchestra.run.smithi153.stdout:remove their configuration from /etc/network/interfaces. 2024-03-30T13:06:56.793 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:06:56.834 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking postgresql-client-common (238) ... 2024-03-30T13:06:56.914 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-30T13:06:57.138 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-30T13:06:57.166 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-30T13:06:57.204 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-30T13:06:57.239 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-30T13:06:57.562 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-30T13:06:57.809 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package postgresql-common. 2024-03-30T13:06:57.838 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-30T13:06:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-30T13:06:57.924 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking postgresql-common (238) ... 2024-03-30T13:06:58.047 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-30T13:06:58.190 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-30T13:06:58.316 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-30T13:06:58.425 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-common (238) ... 2024-03-30T13:06:58.883 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package postgresql-14. 2024-03-30T13:06:58.911 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-30T13:06:58.953 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-30T13:06:59.311 INFO:teuthology.orchestra.run.smithi153.stdout:Adding user postgres to group ssl-cert 2024-03-30T13:06:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:06:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-30T13:06:59.699 INFO:teuthology.orchestra.run.smithi153.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-30T13:06:59.699 INFO:teuthology.orchestra.run.smithi153.stdout:Removing obsolete dictionary files: 2024-03-30T13:07:00.272 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-30T13:07:00.303 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package postgresql. 2024-03-30T13:07:00.319 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-30T13:07:00.352 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking postgresql (14+238) ... 2024-03-30T13:07:00.596 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package postgresql-client. 2024-03-30T13:07:00.625 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-30T13:07:00.663 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking postgresql-client (14+238) ... 2024-03-30T13:07:00.677 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-30T13:07:00.932 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-30T13:07:00.960 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-30T13:07:00.998 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-30T13:07:01.009 INFO:teuthology.orchestra.run.smithi153.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-30T13:07:01.021 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-30T13:07:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-30T13:07:01.078 INFO:teuthology.orchestra.run.smithi153.stdout:This user must also own the server process. 2024-03-30T13:07:01.078 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:01.078 INFO:teuthology.orchestra.run.smithi153.stdout:The database cluster will be initialized with locale "en_US". 2024-03-30T13:07:01.078 INFO:teuthology.orchestra.run.smithi153.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-30T13:07:01.078 INFO:teuthology.orchestra.run.smithi153.stdout:The default text search configuration will be set to "english". 2024-03-30T13:07:01.078 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:01.078 INFO:teuthology.orchestra.run.smithi153.stdout:Data page checksums are disabled. 2024-03-30T13:07:01.078 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:01.078 INFO:teuthology.orchestra.run.smithi153.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-30T13:07:01.078 INFO:teuthology.orchestra.run.smithi153.stdout:creating subdirectories ... ok 2024-03-30T13:07:01.078 INFO:teuthology.orchestra.run.smithi153.stdout:selecting dynamic shared memory implementation ... posix 2024-03-30T13:07:01.094 INFO:teuthology.orchestra.run.smithi153.stdout:selecting default max_connections ... 100 2024-03-30T13:07:01.116 INFO:teuthology.orchestra.run.smithi153.stdout:selecting default shared_buffers ... 128MB 2024-03-30T13:07:01.126 INFO:teuthology.orchestra.run.smithi153.stdout:selecting default time zone ... Etc/UTC 2024-03-30T13:07:01.127 INFO:teuthology.orchestra.run.smithi153.stdout:creating configuration files ... ok 2024-03-30T13:07:01.242 INFO:teuthology.orchestra.run.smithi153.stdout:running bootstrap script ... ok 2024-03-30T13:07:01.318 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package tcl8.6. 2024-03-30T13:07:01.346 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-30T13:07:01.384 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-30T13:07:01.628 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package tcl. 2024-03-30T13:07:01.653 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-30T13:07:01.692 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-30T13:07:01.886 INFO:teuthology.orchestra.run.smithi153.stdout:performing post-bootstrap initialization ... ok 2024-03-30T13:07:02.040 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package wpasupplicant. 2024-03-30T13:07:02.068 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-30T13:07:02.106 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-30T13:07:02.469 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-30T13:07:02.498 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-30T13:07:02.535 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-30T13:07:02.539 INFO:teuthology.orchestra.run.smithi153.stdout:syncing data to disk ... ok 2024-03-30T13:07:02.872 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-30T13:07:02.901 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-30T13:07:02.927 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-30T13:07:02.939 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-30T13:07:03.243 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up postgresql-client-common (238) ... 2024-03-30T13:07:03.411 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-30T13:07:03.537 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-30T13:07:04.097 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-30T13:07:04.223 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-30T13:07:04.349 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-30T13:07:04.475 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-30T13:07:04.967 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-30T13:07:05.056 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-30T13:07:05.506 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-30T13:07:05.506 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-30T13:07:05.725 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-30T13:07:05.834 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-30T13:07:05.943 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql (14+238) ... 2024-03-30T13:07:06.001 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.3) ... 2024-03-30T13:07:06.069 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-30T13:07:06.127 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-30T13:07:06.196 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-30T13:07:06.253 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-30T13:07:06.379 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-30T13:07:06.449 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-30T13:07:06.449 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-30T13:07:06.539 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-30T13:07:06.689 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-30T13:07:06.849 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-30T13:07:06.956 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-30T13:07:07.000 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-30T13:07:07.057 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-30T13:07:07.343 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-30T13:07:07.486 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-30T13:07:07.797 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-30T13:07:07.948 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up dump (0.4b47-3) ... 2024-03-30T13:07:08.067 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-30T13:07:08.142 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-30T13:07:08.293 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-30T13:07:08.427 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-30T13:07:08.553 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-30T13:07:08.679 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-30T13:07:08.770 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-30T13:07:08.839 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-30T13:07:08.864 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-30T13:07:08.972 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-30T13:07:08.990 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-30T13:07:09.208 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-30T13:07:09.385 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-30T13:07:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-30T13:07:09.470 DEBUG:teuthology.parallel:result is None 2024-03-30T13:07:09.527 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-30T13:07:09.695 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up postgresql-client (14+238) ... 2024-03-30T13:07:09.821 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-30T13:07:10.300 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:10.301 INFO:teuthology.orchestra.run.smithi083.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-30T13:07:10.301 INFO:teuthology.orchestra.run.smithi083.stdout:which means they are currently configured by ifupdown: 2024-03-30T13:07:10.301 INFO:teuthology.orchestra.run.smithi083.stdout:- enp3s0f1 2024-03-30T13:07:10.301 INFO:teuthology.orchestra.run.smithi083.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-30T13:07:10.301 INFO:teuthology.orchestra.run.smithi083.stdout:remove their configuration from /etc/network/interfaces. 2024-03-30T13:07:10.301 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:10.420 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-30T13:07:10.726 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-30T13:07:11.028 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-30T13:07:11.515 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-30T13:07:11.675 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-30T13:07:11.826 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-30T13:07:11.961 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up postgresql-common (238) ... 2024-03-30T13:07:12.967 INFO:teuthology.orchestra.run.smithi083.stdout:Adding user postgres to group ssl-cert 2024-03-30T13:07:13.202 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:13.202 INFO:teuthology.orchestra.run.smithi083.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-30T13:07:13.372 INFO:teuthology.orchestra.run.smithi083.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-30T13:07:13.372 INFO:teuthology.orchestra.run.smithi083.stdout:Removing obsolete dictionary files: 2024-03-30T13:07:13.897 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-30T13:07:14.265 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-30T13:07:14.595 INFO:teuthology.orchestra.run.smithi083.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-30T13:07:14.618 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-30T13:07:14.658 INFO:teuthology.orchestra.run.smithi083.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-30T13:07:14.658 INFO:teuthology.orchestra.run.smithi083.stdout:This user must also own the server process. 2024-03-30T13:07:14.658 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:14.658 INFO:teuthology.orchestra.run.smithi083.stdout:The database cluster will be initialized with locale "en_US". 2024-03-30T13:07:14.658 INFO:teuthology.orchestra.run.smithi083.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-30T13:07:14.658 INFO:teuthology.orchestra.run.smithi083.stdout:The default text search configuration will be set to "english". 2024-03-30T13:07:14.659 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:14.659 INFO:teuthology.orchestra.run.smithi083.stdout:Data page checksums are disabled. 2024-03-30T13:07:14.659 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:14.659 INFO:teuthology.orchestra.run.smithi083.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-30T13:07:14.659 INFO:teuthology.orchestra.run.smithi083.stdout:creating subdirectories ... ok 2024-03-30T13:07:14.659 INFO:teuthology.orchestra.run.smithi083.stdout:selecting dynamic shared memory implementation ... posix 2024-03-30T13:07:14.673 INFO:teuthology.orchestra.run.smithi083.stdout:selecting default max_connections ... 100 2024-03-30T13:07:14.691 INFO:teuthology.orchestra.run.smithi083.stdout:selecting default shared_buffers ... 128MB 2024-03-30T13:07:14.700 INFO:teuthology.orchestra.run.smithi083.stdout:selecting default time zone ... Etc/UTC 2024-03-30T13:07:14.701 INFO:teuthology.orchestra.run.smithi083.stdout:creating configuration files ... ok 2024-03-30T13:07:14.810 INFO:teuthology.orchestra.run.smithi083.stdout:running bootstrap script ... ok 2024-03-30T13:07:15.535 INFO:teuthology.orchestra.run.smithi083.stdout:performing post-bootstrap initialization ... ok 2024-03-30T13:07:16.263 INFO:teuthology.orchestra.run.smithi083.stdout:syncing data to disk ... ok 2024-03-30T13:07:16.646 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-30T13:07:19.397 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-30T13:07:19.523 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-30T13:07:19.649 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up postgresql (14+238) ... 2024-03-30T13:07:19.767 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-30T13:07:19.868 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-30T13:07:20.118 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-30T13:07:20.118 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-30T13:07:20.729 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-30T13:07:20.822 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-30T13:07:21.140 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-30T13:07:21.292 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-30T13:07:22.657 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-30T13:07:22.754 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-30T13:07:23.255 INFO:teuthology.orchestra.run.smithi083.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-30T13:07:23.261 DEBUG:teuthology.parallel:result is None 2024-03-30T13:07:23.261 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T13:07:23.538 DEBUG:teuthology.orchestra.run.smithi083:> dpkg-query -W -f '${Version}' ceph 2024-03-30T13:07:23.557 INFO:teuthology.orchestra.run.smithi083.stdout:19.0.0-2519-gac171039-1jammy 2024-03-30T13:07:23.558 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2519-gac171039-1jammy 2024-03-30T13:07:23.558 INFO:teuthology.task.install:The correct ceph version 19.0.0-2519-gac171039-1jammy is installed. 2024-03-30T13:07:23.560 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T13:07:23.699 DEBUG:teuthology.orchestra.run.smithi153:> dpkg-query -W -f '${Version}' ceph 2024-03-30T13:07:23.718 INFO:teuthology.orchestra.run.smithi153.stdout:19.0.0-2519-gac171039-1jammy 2024-03-30T13:07:23.719 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2519-gac171039-1jammy 2024-03-30T13:07:23.719 INFO:teuthology.task.install:The correct ceph version 19.0.0-2519-gac171039-1jammy is installed. 2024-03-30T13:07:23.721 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-30T13:07:23.721 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:23.721 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-30T13:07:23.736 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:23.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-30T13:07:23.774 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-30T13:07:23.774 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:23.774 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2024-03-30T13:07:23.791 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-30T13:07:23.848 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:23.848 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-03-30T13:07:23.860 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-30T13:07:23.912 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-30T13:07:23.912 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:23.913 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-30T13:07:23.925 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-30T13:07:23.979 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:23.979 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-30T13:07:23.992 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-30T13:07:24.046 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-30T13:07:24.046 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:24.046 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2024-03-30T13:07:24.060 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-30T13:07:24.116 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:24.116 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-03-30T13:07:24.129 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-30T13:07:24.181 INFO:teuthology.run_tasks:Running task ceph... 2024-03-30T13:07:24.275 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-30T13:07:24.275 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /var/log/ceph 2024-03-30T13:07:24.277 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-03-30T13:07:24.290 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-30T13:07:24.290 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-30T13:07:24.333 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-30T13:07:24.345 INFO:tasks.ceph:Creating extra log directories... 2024-03-30T13:07:24.345 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-30T13:07:24.389 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-30T13:07:24.412 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-30T13:07:24.412 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-30T13:07:24.413 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-30T13:07:24.413 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:24.413 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-30T13:07:24.448 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-30T13:07:24.523 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:24.523 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-30T13:07:24.528 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-30T13:07:24.607 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-30T13:07:24.608 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-30T13:07:24.608 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144', 'branch': 'wip-mchangir-testing1-main-20240328-072412', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/uninlining}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7629144', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-testing1-main-20240328-072412'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-testing1-main-20240328-072412', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 364, 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-mchangir-testing1-main-20240328-072412', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi083.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQncMjdkmL0Ut+RMDCYwSEvn24cR8fWRRWTz8K1umSOkBYIE51wXn7pl5RwzpxAEY0pWqsydHCuujicnV+RJHg=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6Jqlo9d8WP5l1R2CMXUOnRdFXhCejeX8yB25T08KHYEYmSpmyU4ZhtZbCU8idUf5sAmoE8u1jhUmhNQLrfol8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_uninlining']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-29_13:38:54', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-30T13:07:24.608 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-30T13:07:24.611 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-30T13:07:24.652 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/run/ceph 2024-03-30T13:07:24.661 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-03-30T13:07:24.706 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:24.706 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T13:07:24.720 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T13:07:24.720 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2024-03-30T13:07:24.768 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T13:07:24.769 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:07:24.769 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-03-30T13:07:24.769 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:07:24.769 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-03-30 13:01:06.932052043 +0000 2024-03-30T13:07:24.769 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-03-30 13:01:06.640054651 +0000 2024-03-30T13:07:24.769 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-03-30 13:01:06.640054651 +0000 2024-03-30T13:07:24.769 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-03-30T13:07:24.769 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T13:07:24.824 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-03-30T13:07:24.825 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-03-30T13:07:24.825 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000470066 s, 1.1 MB/s 2024-03-30T13:07:24.826 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T13:07:24.873 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2024-03-30T13:07:24.920 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T13:07:24.920 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:07:24.920 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-03-30T13:07:24.920 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:07:24.920 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-03-30 13:01:07.436047541 +0000 2024-03-30T13:07:24.920 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-03-30 13:01:07.184049793 +0000 2024-03-30T13:07:24.920 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-03-30 13:01:07.184049793 +0000 2024-03-30T13:07:24.920 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-03-30T13:07:24.921 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T13:07:24.973 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-03-30T13:07:24.974 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-03-30T13:07:24.974 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000335103 s, 1.5 MB/s 2024-03-30T13:07:24.975 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T13:07:25.021 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2024-03-30T13:07:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T13:07:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:07:25.069 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-03-30T13:07:25.069 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:07:25.069 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-03-30 13:01:07.968042790 +0000 2024-03-30T13:07:25.069 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-03-30 13:01:07.684045326 +0000 2024-03-30T13:07:25.069 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-03-30 13:01:07.684045326 +0000 2024-03-30T13:07:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-03-30T13:07:25.069 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T13:07:25.123 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-03-30T13:07:25.123 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-03-30T13:07:25.123 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000309137 s, 1.7 MB/s 2024-03-30T13:07:25.124 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T13:07:25.173 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2024-03-30T13:07:25.220 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T13:07:25.221 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:07:25.221 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-03-30T13:07:25.221 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:07:25.221 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-03-30 13:01:08.464038360 +0000 2024-03-30T13:07:25.221 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-03-30 13:01:08.216040575 +0000 2024-03-30T13:07:25.221 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-03-30 13:01:08.216040575 +0000 2024-03-30T13:07:25.221 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-03-30T13:07:25.221 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T13:07:25.274 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-03-30T13:07:25.274 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-03-30T13:07:25.274 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000327834 s, 1.6 MB/s 2024-03-30T13:07:25.276 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T13:07:25.326 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:07:25.326 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:25.327 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T13:07:25.333 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T13:07:25.333 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-03-30T13:07:25.379 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T13:07:25.380 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:07:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-03-30T13:07:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:07:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-30 13:01:04.069592293 +0000 2024-03-30T13:07:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-30 13:01:03.797594722 +0000 2024-03-30T13:07:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-30 13:01:03.797594722 +0000 2024-03-30T13:07:25.381 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-03-30T13:07:25.381 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T13:07:25.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-30T13:07:25.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-30T13:07:25.433 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00044983 s, 1.1 MB/s 2024-03-30T13:07:25.434 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T13:07:25.484 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-03-30T13:07:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T13:07:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:07:25.530 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-03-30T13:07:25.530 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:07:25.531 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-30 13:01:04.533588149 +0000 2024-03-30T13:07:25.531 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-30 13:01:04.297590257 +0000 2024-03-30T13:07:25.531 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-30 13:01:04.297590257 +0000 2024-03-30T13:07:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-03-30T13:07:25.531 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T13:07:25.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-30T13:07:25.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-30T13:07:25.585 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000364233 s, 1.4 MB/s 2024-03-30T13:07:25.586 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T13:07:25.636 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-03-30T13:07:25.683 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T13:07:25.683 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:07:25.683 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-03-30T13:07:25.684 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:07:25.684 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-30 13:01:05.005583933 +0000 2024-03-30T13:07:25.684 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-30 13:01:04.753586184 +0000 2024-03-30T13:07:25.684 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-30 13:01:04.753586184 +0000 2024-03-30T13:07:25.684 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-03-30T13:07:25.684 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T13:07:25.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-30T13:07:25.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-30T13:07:25.737 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000432604 s, 1.2 MB/s 2024-03-30T13:07:25.737 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T13:07:25.788 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-03-30T13:07:25.835 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T13:07:25.835 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:07:25.835 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-03-30T13:07:25.835 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:07:25.835 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-30 13:01:05.477579717 +0000 2024-03-30T13:07:25.835 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-30 13:01:05.245581788 +0000 2024-03-30T13:07:25.835 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-30 13:01:05.245581788 +0000 2024-03-30T13:07:25.835 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-03-30T13:07:25.835 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T13:07:25.889 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-30T13:07:25.890 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-30T13:07:25.890 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000322263 s, 1.6 MB/s 2024-03-30T13:07:25.891 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T13:07:25.939 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:07:25.939 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-30T13:07:25.939 INFO:tasks.ceph:Generating config... 2024-03-30T13:07:25.941 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-30T13:07:25.941 INFO:tasks.ceph:[client] debug client = 20 2024-03-30T13:07:25.941 INFO:tasks.ceph:[client] debug ms = 1 2024-03-30T13:07:25.941 INFO:tasks.ceph:[client] pid file = 2024-03-30T13:07:25.941 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-30T13:07:25.941 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-30T13:07:25.941 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-30T13:07:25.941 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-30T13:07:25.941 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-30T13:07:25.941 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-30T13:07:25.941 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-30T13:07:25.941 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-30T13:07:25.941 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-30T13:07:25.941 INFO:tasks.ceph:[mds] mds_bal_replicate_threshold = 1 2024-03-30T13:07:25.942 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-30T13:07:25.942 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-30T13:07:25.942 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-30T13:07:25.942 INFO:tasks.ceph:[mgr] debug client = 20 2024-03-30T13:07:25.942 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-03-30T13:07:25.942 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-30T13:07:25.942 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-30T13:07:25.942 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-30T13:07:25.942 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-30T13:07:25.942 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-30T13:07:25.942 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-03-30T13:07:25.942 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-30T13:07:25.942 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-30T13:07:25.942 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-30T13:07:25.942 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-30T13:07:25.943 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-30T13:07:25.944 INFO:tasks.ceph:Setting up mon.a... 2024-03-30T13:07:25.944 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-30T13:07:25.978 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.keyring 2024-03-30T13:07:26.000 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-30T13:07:26.080 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-30T13:07:26.135 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.83'), ('mon.b', '172.21.15.153'), ('mon.c', '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]')] 2024-03-30T13:07:26.136 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.83,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-30T13:07:26.137 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:26.137 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-30T13:07:26.184 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.83 --add b 172.21.15.153 --addv c '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:07:26.270 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:07:26.270 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool: generated fsid 7979f39b-f62b-4bbb-8ee9-a3dd267196bf 2024-03-30T13:07:26.270 INFO:teuthology.orchestra.run.smithi083.stdout:setting min_mon_release = quincy 2024-03-30T13:07:26.270 INFO:teuthology.orchestra.run.smithi083.stdout:epoch 0 2024-03-30T13:07:26.271 INFO:teuthology.orchestra.run.smithi083.stdout:fsid 7979f39b-f62b-4bbb-8ee9-a3dd267196bf 2024-03-30T13:07:26.271 INFO:teuthology.orchestra.run.smithi083.stdout:last_changed 2024-03-30T13:07:26.270866+0000 2024-03-30T13:07:26.271 INFO:teuthology.orchestra.run.smithi083.stdout:created 2024-03-30T13:07:26.270866+0000 2024-03-30T13:07:26.271 INFO:teuthology.orchestra.run.smithi083.stdout:min_mon_release 17 (quincy) 2024-03-30T13:07:26.271 INFO:teuthology.orchestra.run.smithi083.stdout:election_strategy: 1 2024-03-30T13:07:26.271 INFO:teuthology.orchestra.run.smithi083.stdout:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-03-30T13:07:26.271 INFO:teuthology.orchestra.run.smithi083.stdout:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-03-30T13:07:26.271 INFO:teuthology.orchestra.run.smithi083.stdout:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-03-30T13:07:26.271 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-30T13:07:26.272 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-30T13:07:26.320 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7979f39b-f62b-4bbb-8ee9-a3dd267196bf... 2024-03-30T13:07:26.321 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-30T13:07:26.365 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-30T13:07:26.393 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2024-03-30T13:07:26.393 INFO:teuthology.orchestra.run.smithi083.stdout: chdir = "" 2024-03-30T13:07:26.393 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-30T13:07:26.393 INFO:teuthology.orchestra.run.smithi083.stdout: auth supported = cephx 2024-03-30T13:07:26.393 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: filestore xattr use omap = true 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: mon clock drift allowed = 1.000 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: osd crush chooseleaf type = 0 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: auth debug = true 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on old message = true 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on bug = true 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: mon pg warn max object skew = 0 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: # disable pg_autoscaler by default for new pools 2024-03-30T13:07:26.394 INFO:teuthology.orchestra.run.smithi083.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default size = 2 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow primary affinity = true 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow pg remap = true 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on legacy crush tunables = false 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on crush straw calc version zero = false 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on no sortbitwise = false 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on osd down out interval zero = false 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on too few osds = false 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: mon_allow_pool_size_one = true 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-30T13:07:26.395 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: osd default data pool replay window = 5 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: mon allow pool delete = true 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: mon cluster log file level = debug 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: debug asserts on shutdown = true 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: mon health detail to clog = false 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: mon host = "172.21.15.83,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]" 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = 7979f39b-f62b-4bbb-8ee9-a3dd267196bf 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout:[osd] 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: osd journal size = 100 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub load threshold = 5.0 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub max interval = 600 2024-03-30T13:07:26.396 INFO:teuthology.orchestra.run.smithi083.stdout: osd mclock profile = high_recovery_ops 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: osd recover clone overlap = true 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: osd recovery max chunk = 1048576 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug shutdown = true 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug op order = true 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug verify stray on activate = true 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug trim objects = true 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: osd open classes on start = true 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug pg log writeout = true 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: osd deep scrub update digest min age = 30 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: osd map max advance = 10 2024-03-30T13:07:26.397 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: journal zero on create = true 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: filestore ondisk finisher threads = 3 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: filestore apply finisher threads = 3 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: bdev debug aio = true 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug misdirected ops = true 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: bdev async discard = True 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: bdev enable discard = True 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore allocator = bitmap 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore block size = 96636764160 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore fsck on mount = True 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluefs = 1/20 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluestore = 1/20 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-03-30T13:07:26.398 INFO:teuthology.orchestra.run.smithi083.stdout: debug osd = 20 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: debug rocksdb = 4/10 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd backfillfull_ratio = 0.85 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd full ratio = 0.9 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd nearfull ratio = 0.8 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: osd failsafe full ratio = 0.95 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: osd objectstore = bluestore 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr] 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: debug mgr = 20 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2024-03-30T13:07:26.399 INFO:teuthology.orchestra.run.smithi083.stdout: mgr/telemetry/nag = false 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: debug client = 20 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: debug finisher = 20 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout:[mon] 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: debug paxos = 20 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: mon data avail warn = 5 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: mon mgr mkfs grace = 240 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd reporter subtree level = osd 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd prime pg temp = true 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.400 INFO:teuthology.orchestra.run.smithi083.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: auth mon ticket ttl = 660 # 11m 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: auth service ticket ttl = 240 # 4m 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: # don't complain about insecure global_id in the test suite 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: # 1m isn't quite enough 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: mon_down_mkfs_grace = 2m 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_filestore_osds = false 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: mon down mkfs grace = 300 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: mon op complaint time = 120 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout:[client] 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: rgw cache enabled = true 2024-03-30T13:07:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable ops log = true 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable usage log = true 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout: client mount timeout = 600 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout: debug client = 20 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = "" 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.a] 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.b] 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.c] 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2024-03-30T13:07:26.402 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout:[mds] 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout: debug mds = 20 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout: debug mds balancer = 20 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug frag = True 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug scatterstat = True 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout: mds op complaint time = 180 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout: mds verify scatter = True 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout: mds_bal_replicate_threshold = 1 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2024-03-30T13:07:26.403 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2024-03-30T13:07:26.404 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-03-30T13:07:26.404 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-03-30T13:07:26.404 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-30T13:07:26.404 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-03-30T13:07:26.404 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.404 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-03-30T13:07:26.404 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.404 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.405 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-03-30T13:07:26.406 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.83,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]" 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 7979f39b-f62b-4bbb-8ee9-a3dd267196bf 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-03-30T13:07:26.407 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.408 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-03-30T13:07:26.409 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: debug finisher = 20 2024-03-30T13:07:26.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-03-30T13:07:26.411 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: mon down mkfs grace = 300 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-03-30T13:07:26.412 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-03-30T13:07:26.413 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2024-03-30T13:07:26.414 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2024-03-30T13:07:26.414 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds balancer = 20 2024-03-30T13:07:26.414 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-30T13:07:26.414 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2024-03-30T13:07:26.414 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2024-03-30T13:07:26.414 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2024-03-30T13:07:26.414 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = True 2024-03-30T13:07:26.414 INFO:teuthology.orchestra.run.smithi153.stdout: mds_bal_replicate_threshold = 1 2024-03-30T13:07:26.414 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-03-30T13:07:26.414 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-03-30T13:07:26.414 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-03-30T13:07:26.416 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-30T13:07:26.416 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-30T13:07:26.508 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-30T13:07:26.509 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:26.509 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-30T13:07:26.514 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:26.514 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-30T13:07:26.560 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:07:26.560 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:26.561 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-30T13:07:26.561 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-30T13:07:26.627 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:26.628 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:07:26.676 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:07:26.676 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:26.676 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-30T13:07:26.676 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-30T13:07:26.701 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:26.701 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:07:26.746 INFO:tasks.ceph:Setting up mon nodes... 2024-03-30T13:07:26.747 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-30T13:07:26.747 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-30T13:07:26.789 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-30T13:07:26.792 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-30T13:07:26.834 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-30T13:07:26.844 INFO:tasks.ceph:Setting up mds nodes... 2024-03-30T13:07:26.844 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-30T13:07:26.885 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-30T13:07:26.888 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-30T13:07:26.943 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-30T13:07:27.027 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-30T13:07:27.030 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-30T13:07:27.087 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-30T13:07:27.131 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-30T13:07:27.134 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-30T13:07:27.191 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-30T13:07:27.277 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-30T13:07:27.278 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-30T13:07:27.332 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-30T13:07:27.333 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-30T13:07:27.368 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-30T13:07:27.380 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-30T13:07:27.462 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-30T13:07:27.473 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-30T13:07:27.510 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-30T13:07:27.521 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-30T13:07:27.594 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-30T13:07:27.604 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-30T13:07:27.605 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-30T13:07:27.605 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-30T13:07:27.619 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:07:27.619 INFO:tasks.ceph:role: osd.0 2024-03-30T13:07:27.619 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:07:27.619 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-30T13:07:27.680 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:07:27.681 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:07:27.681 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:07:27.681 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-30T13:07:27.681 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:07:27.681 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:07:27.681 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:07:27.681 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-30T13:07:27.681 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:07:27.681 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:07:28.135 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-03-30T13:07:28.137 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-03-30T13:07:28.137 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-30T13:07:28.229 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-30T13:07:28.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:07:28.239 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: /sbin/restorecon: command not found 2024-03-30T13:07:28.239 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-30T13:07:28.296 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:07:28.296 INFO:tasks.ceph:role: osd.1 2024-03-30T13:07:28.296 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:07:28.296 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-30T13:07:28.360 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:07:28.360 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:07:28.360 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:07:28.360 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-30T13:07:28.361 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:07:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:07:28.361 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:07:28.361 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-30T13:07:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:07:28.361 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:07:28.839 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-03-30T13:07:28.842 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-03-30T13:07:28.842 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-30T13:07:28.988 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-30T13:07:29.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:07:29.001 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: /sbin/restorecon: command not found 2024-03-30T13:07:29.001 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-30T13:07:29.055 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:07:29.056 INFO:tasks.ceph:role: osd.2 2024-03-30T13:07:29.056 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:07:29.056 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-30T13:07:29.119 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:07:29.119 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:07:29.119 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:07:29.119 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-30T13:07:29.119 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:07:29.119 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:07:29.119 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:07:29.119 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-30T13:07:29.120 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:07:29.120 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:07:29.584 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-03-30T13:07:29.587 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-03-30T13:07:29.587 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-30T13:07:29.732 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-30T13:07:29.744 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: /sbin/restorecon: command not found 2024-03-30T13:07:29.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:07:29.745 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-30T13:07:29.800 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:07:29.800 INFO:tasks.ceph:role: osd.3 2024-03-30T13:07:29.800 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:07:29.800 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-30T13:07:29.864 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:07:29.864 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:07:29.864 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:07:29.864 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-30T13:07:29.864 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:07:29.864 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:07:29.864 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:07:29.864 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-30T13:07:29.864 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:07:29.864 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:07:30.289 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-03-30T13:07:30.291 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-03-30T13:07:30.291 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-30T13:07:30.376 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-30T13:07:30.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:07:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: /sbin/restorecon: command not found 2024-03-30T13:07:30.429 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:07:30.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:30.536+0000 7fe8e965d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-30T13:07:30.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:30.540+0000 7fe8e965d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-30T13:07:30.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:30.540+0000 7fe8e965d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-30T13:07:30.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:30.540+0000 7fe8e965d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-30T13:07:30.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:30.540+0000 7fe8e965d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-30T13:07:30.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:30.544+0000 7fe8e965d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-30T13:07:33.537 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-30T13:07:33.551 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:07:33.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:33.636+0000 7f79114027c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-30T13:07:33.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:33.640+0000 7f79114027c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-30T13:07:33.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:33.640+0000 7f79114027c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-30T13:07:33.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:33.640+0000 7f79114027c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-30T13:07:33.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:33.640+0000 7f79114027c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-30T13:07:33.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:33.640+0000 7f79114027c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-30T13:07:36.618 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-30T13:07:36.673 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:07:36.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:36.756+0000 7f7e6ad887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-30T13:07:36.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:36.756+0000 7f7e6ad887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-30T13:07:36.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:36.756+0000 7f7e6ad887c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-30T13:07:36.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:36.756+0000 7f7e6ad887c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-30T13:07:36.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:36.756+0000 7f7e6ad887c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-30T13:07:36.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:36.756+0000 7f7e6ad887c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-30T13:07:39.731 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-30T13:07:39.789 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:07:39.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:39.868+0000 7eff92cd77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-30T13:07:39.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:39.868+0000 7eff92cd77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-30T13:07:39.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:39.868+0000 7eff92cd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-30T13:07:39.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:39.868+0000 7eff92cd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-30T13:07:39.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:39.868+0000 7eff92cd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-30T13:07:39.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:07:39.872+0000 7eff92cd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-30T13:07:42.838 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-30T13:07:42.892 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-30T13:07:42.907 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:07:42.907 INFO:tasks.ceph:role: osd.4 2024-03-30T13:07:42.907 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:07:42.907 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-30T13:07:42.970 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:07:42.970 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:07:42.970 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:07:42.970 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-30T13:07:42.970 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:07:42.970 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:07:42.970 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:07:42.971 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-30T13:07:42.971 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:07:42.971 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:07:43.440 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-03-30T13:07:43.442 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-03-30T13:07:43.446 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-30T13:07:43.551 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-30T13:07:43.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:07:43.561 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-03-30T13:07:43.561 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-30T13:07:43.616 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:07:43.616 INFO:tasks.ceph:role: osd.5 2024-03-30T13:07:43.616 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:07:43.616 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-30T13:07:43.678 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:07:43.679 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:07:43.679 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:07:43.679 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-30T13:07:43.679 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:07:43.679 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:07:43.679 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:07:43.679 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-30T13:07:43.679 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:07:43.679 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:07:44.150 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-03-30T13:07:44.152 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-03-30T13:07:44.153 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-30T13:07:44.284 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-30T13:07:44.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:07:44.297 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-03-30T13:07:44.297 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-30T13:07:44.355 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:07:44.355 INFO:tasks.ceph:role: osd.6 2024-03-30T13:07:44.355 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:07:44.355 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-30T13:07:44.417 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:07:44.417 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:07:44.417 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:07:44.417 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-30T13:07:44.418 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:07:44.418 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:07:44.418 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:07:44.418 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-30T13:07:44.418 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:07:44.418 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:07:44.901 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-03-30T13:07:44.903 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-03-30T13:07:44.904 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-30T13:07:45.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-30T13:07:45.068 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-03-30T13:07:45.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:07:45.070 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-30T13:07:45.126 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:07:45.126 INFO:tasks.ceph:role: osd.7 2024-03-30T13:07:45.126 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:07:45.127 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-30T13:07:45.191 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:07:45.191 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:07:45.191 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:07:45.191 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-30T13:07:45.191 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:07:45.191 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:07:45.191 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:07:45.191 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-30T13:07:45.191 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:07:45.191 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:07:45.655 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-03-30T13:07:45.657 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-03-30T13:07:45.657 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-30T13:07:45.759 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-30T13:07:45.768 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-03-30T13:07:45.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:07:45.769 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:07:45.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:45.883+0000 7fa03a25d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-30T13:07:45.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:45.883+0000 7fa03a25d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-30T13:07:45.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:45.883+0000 7fa03a25d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-30T13:07:45.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:45.883+0000 7fa03a25d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-30T13:07:45.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:45.883+0000 7fa03a25d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-30T13:07:45.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:45.887+0000 7fa03a25d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-30T13:07:48.881 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-30T13:07:48.896 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:07:48.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:48.975+0000 7f67e3e2f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-30T13:07:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:48.975+0000 7f67e3e2f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-30T13:07:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:48.975+0000 7f67e3e2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-30T13:07:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:48.975+0000 7f67e3e2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-30T13:07:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:48.975+0000 7f67e3e2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-30T13:07:48.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:48.979+0000 7f67e3e2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-30T13:07:51.954 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-30T13:07:52.011 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:07:52.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:52.091+0000 7f1c192277c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-30T13:07:52.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:52.091+0000 7f1c192277c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-30T13:07:52.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:52.091+0000 7f1c192277c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-30T13:07:52.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:52.091+0000 7f1c192277c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-30T13:07:52.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:52.091+0000 7f1c192277c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-30T13:07:52.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:52.095+0000 7f1c192277c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-30T13:07:54.609 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:07:54.613 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:07:55.092 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-30T13:07:55.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:07:55.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:55.179+0000 7f5e58cb87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-30T13:07:55.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:55.179+0000 7f5e58cb87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-30T13:07:55.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:55.179+0000 7f5e58cb87c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-30T13:07:55.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:55.179+0000 7f5e58cb87c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-30T13:07:55.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:55.179+0000 7f5e58cb87c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-30T13:07:55.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:07:55.179+0000 7f5e58cb87c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-30T13:07:58.171 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-30T13:07:58.227 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-30T13:07:58.227 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:58.227 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-30T13:07:58.241 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:58.242 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-30T13:07:58.297 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:58.297 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-30T13:07:58.351 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:58.351 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-30T13:07:58.403 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:58.404 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-30T13:07:58.455 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:58.456 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-30T13:07:58.512 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:58.512 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-30T13:07:58.567 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:58.568 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-30T13:07:58.582 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:58.582 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-30T13:07:58.638 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:58.638 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-30T13:07:58.693 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:58.693 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-30T13:07:58.745 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:58.745 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-30T13:07:58.797 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:58.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-30T13:07:58.849 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:58.849 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-30T13:07:58.901 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:58.901 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-30T13:07:58.907 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:07:58.907 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-30T13:07:58.954 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:58.954 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-30T13:07:58.960 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:07:58.960 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-30T13:07:59.006 INFO:tasks.ceph:Adding keys to all mons... 2024-03-30T13:07:59.007 DEBUG:teuthology.orchestra.run.smithi083:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-30T13:07:59.009 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-30T13:07:59.053 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.y] 2024-03-30T13:07:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCODghmMfkcLxAAovtfOXEsLKCy2XJ0Nxc9Dw== 2024-03-30T13:07:59.053 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2024-03-30T13:07:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCODghmHSTSNBAAhKj5kioNy0yLfO4IWMSfow== 2024-03-30T13:07:59.053 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2024-03-30T13:07:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPDghmEcevARAAlf+RR10P98cUbUd4VKZiaA== 2024-03-30T13:07:59.053 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.0] 2024-03-30T13:07:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCSDghmauUkIBAA2tW3hxSGNe3a4L2eBKbU5g== 2024-03-30T13:07:59.053 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.1] 2024-03-30T13:07:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCVDghmyD8lJhAAx3CpRry38qsgslzl/qw5eg== 2024-03-30T13:07:59.054 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.2] 2024-03-30T13:07:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCYDghma94WLRAAYnscIJLG0U780LXtElksjw== 2024-03-30T13:07:59.054 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.3] 2024-03-30T13:07:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCbDghmkzLyMxAAQKPntWgwDJBeKnXk3uK6GQ== 2024-03-30T13:07:59.054 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.x] 2024-03-30T13:07:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCODghmbGW3MRAAxVOMst8eRfhO+U4eIYM+xw== 2024-03-30T13:07:59.054 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2024-03-30T13:07:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPDghmYWHSBxAAImo2q+219n+RM++M9aysiQ== 2024-03-30T13:07:59.054 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPDghmk1pcEBAA0ji2FeMmizTNjpWWSr8PGg== 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.4] 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQChDghmXQXINBAAfqY8CZ+nMOPd2WHxp6+xew== 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.5] 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCkDghm/DduOhAAvs6Rk6F9+VFhC0yt6d7ccQ== 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.6] 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCoDghmHYHABRAA2evRLfti5kky7GxUiTr73w== 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.7] 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCrDghmcFHgChAA07TctKJbNHxywTu4OX635w== 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPDghmyhIFFhAAN45m5XmwvXOH8BGl9v+GGw== 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout:[client.2] 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPDghmm9CdGxAA05K8JRo/sntLYe7ZAq1Mmw== 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout:[client.1] 2024-03-30T13:07:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPDghmR1BZHhAAD5WM5Vv/x0aoS3i1pRvDcw== 2024-03-30T13:07:59.056 INFO:teuthology.orchestra.run.smithi083.stdout:[client.3] 2024-03-30T13:07:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPDghmM6BgIxAAM9crxgoX+t6iUnshEHV/PQ== 2024-03-30T13:07:59.063 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2024-03-30T13:07:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCODghmMfkcLxAAovtfOXEsLKCy2XJ0Nxc9Dw== 2024-03-30T13:07:59.063 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-03-30T13:07:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCODghmHSTSNBAAhKj5kioNy0yLfO4IWMSfow== 2024-03-30T13:07:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-03-30T13:07:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCPDghmEcevARAAlf+RR10P98cUbUd4VKZiaA== 2024-03-30T13:07:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2024-03-30T13:07:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCSDghmauUkIBAA2tW3hxSGNe3a4L2eBKbU5g== 2024-03-30T13:07:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2024-03-30T13:07:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCVDghmyD8lJhAAx3CpRry38qsgslzl/qw5eg== 2024-03-30T13:07:59.065 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2024-03-30T13:07:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCYDghma94WLRAAYnscIJLG0U780LXtElksjw== 2024-03-30T13:07:59.065 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2024-03-30T13:07:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCbDghmkzLyMxAAQKPntWgwDJBeKnXk3uK6GQ== 2024-03-30T13:07:59.066 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2024-03-30T13:07:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCODghmbGW3MRAAxVOMst8eRfhO+U4eIYM+xw== 2024-03-30T13:07:59.066 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-03-30T13:07:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCPDghmYWHSBxAAImo2q+219n+RM++M9aysiQ== 2024-03-30T13:07:59.066 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-03-30T13:07:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCPDghmk1pcEBAA0ji2FeMmizTNjpWWSr8PGg== 2024-03-30T13:07:59.067 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2024-03-30T13:07:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQChDghmXQXINBAAfqY8CZ+nMOPd2WHxp6+xew== 2024-03-30T13:07:59.067 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2024-03-30T13:07:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCkDghm/DduOhAAvs6Rk6F9+VFhC0yt6d7ccQ== 2024-03-30T13:07:59.067 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2024-03-30T13:07:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCoDghmHYHABRAA2evRLfti5kky7GxUiTr73w== 2024-03-30T13:07:59.068 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2024-03-30T13:07:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCrDghmcFHgChAA07TctKJbNHxywTu4OX635w== 2024-03-30T13:07:59.068 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-03-30T13:07:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCPDghmyhIFFhAAN45m5XmwvXOH8BGl9v+GGw== 2024-03-30T13:07:59.068 INFO:teuthology.orchestra.run.smithi153.stdout:[client.2] 2024-03-30T13:07:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCPDghmm9CdGxAA05K8JRo/sntLYe7ZAq1Mmw== 2024-03-30T13:07:59.069 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-03-30T13:07:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCPDghmR1BZHhAAD5WM5Vv/x0aoS3i1pRvDcw== 2024-03-30T13:07:59.069 INFO:teuthology.orchestra.run.smithi153.stdout:[client.3] 2024-03-30T13:07:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCPDghmM6BgIxAAM9crxgoX+t6iUnshEHV/PQ== 2024-03-30T13:07:59.069 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T13:07:59.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T13:07:59.151 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:07:59.190 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:07:59.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:07:59.240 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:07:59.322 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:07:59.325 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:07:59.403 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:07:59.413 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:07:59.485 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:07:59.494 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:07:59.564 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:07:59.582 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:07:59.650 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T13:07:59.666 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T13:07:59.708 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:07:59.750 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:07:59.797 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:07:59.838 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:07:59.883 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:07:59.885 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:07:59.965 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:07:59.969 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:08:00.051 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:08:00.053 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:08:00.136 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:08:00.139 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:08:00.221 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:08:00.224 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:08:00.313 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:08:00.316 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:08:00.359 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:08:00.402 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:08:00.449 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:08:00.486 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:08:00.534 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-30T13:08:00.534 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-30T13:08:00.579 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-30T13:08:00.669 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-30T13:08:00.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-30T13:08:00.693 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-30T13:08:00.789 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-30T13:08:00.802 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-30T13:08:00.861 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-30T13:08:00.958 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-30T13:08:00.969 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:08:00.971 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:08:01.014 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-30T13:08:01.014 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-30T13:08:01.014 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-30T13:08:01.017 INFO:tasks.ceph.mon.a:Started 2024-03-30T13:08:01.018 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-30T13:08:01.018 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-30T13:08:01.060 INFO:tasks.ceph.mon.b:Started 2024-03-30T13:08:01.060 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-30T13:08:01.060 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-30T13:08:01.063 INFO:tasks.ceph.mon.c:Started 2024-03-30T13:08:01.063 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-30T13:08:01.063 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-30T13:08:01.063 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-30T13:08:01.066 INFO:tasks.ceph.mgr.y:Started 2024-03-30T13:08:01.066 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-30T13:08:01.066 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-30T13:08:01.068 INFO:tasks.ceph.mgr.x:Started 2024-03-30T13:08:01.069 INFO:tasks.ceph:Setting crush tunables to default 2024-03-30T13:08:01.069 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd crush tunables default 2024-03-30T13:08:01.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.178+0000 7fe0c2833640 1 Processor -- start 2024-03-30T13:08:01.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.178+0000 7fe0c2833640 1 -- start start 2024-03-30T13:08:01.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.178+0000 7fe0c2833640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 0x7fe0bc06eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:01.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.178+0000 7fe0c2833640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0bc163e40 con 0x7fe0bc071f80 2024-03-30T13:08:01.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.178+0000 7fe0c2833640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0bc06e3c0 con 0x7fe0bc1637d0 2024-03-30T13:08:01.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.178+0000 7fe0c2833640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe0bc06f3e0 con 0x7fe0bc0cf1f0 2024-03-30T13:08:01.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.178+0000 7fe0bb7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fe0bc071f80 0x7fe0bc1630c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36220/0 (socket says 172.21.15.83:36220) 2024-03-30T13:08:01.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.178+0000 7fe0bb7fe640 1 -- 172.21.15.83:0/2020800975 learned_addr learned my addr 172.21.15.83:0/2020800975 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:01.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.182+0000 7fe0bbfff640 1 --2- 172.21.15.83:0/2020800975 >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 0x7fe0bc06eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:01.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.182+0000 7fe0bbfff640 1 -- 172.21.15.83:0/2020800975 >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 msgr2=0x7fe0bc06eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:08:01.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.182+0000 7fe0bbfff640 1 -- 172.21.15.83:0/2020800975 >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 msgr2=0x7fe0bc06eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:08:01.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.182+0000 7fe0bbfff640 1 --2- 172.21.15.83:0/2020800975 >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 0x7fe0bc06eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:08:01.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.182+0000 7fe0bbfff640 1 --2- 172.21.15.83:0/2020800975 >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 0x7fe0bc06eea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T13:08:01.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.386+0000 7fe0bbfff640 1 --2- 172.21.15.83:0/2020800975 >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 0x7fe0bc06eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:01.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.386+0000 7fe0bbfff640 1 -- 172.21.15.83:0/2020800975 >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 msgr2=0x7fe0bc06eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:08:01.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.386+0000 7fe0bbfff640 1 -- 172.21.15.83:0/2020800975 >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 msgr2=0x7fe0bc06eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:08:01.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.386+0000 7fe0bbfff640 1 --2- 172.21.15.83:0/2020800975 >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 0x7fe0bc06eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:08:01.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.386+0000 7fe0bbfff640 1 --2- 172.21.15.83:0/2020800975 >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 0x7fe0bc06eea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T13:08:01.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132345899 0 0) 0x7fe0bc163e40 con 0x7fe0bc071f80 2024-03-30T13:08:01.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0a4003530 con 0x7fe0bc071f80 2024-03-30T13:08:01.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1689184475 0 0) 0x7fe0bc06e3c0 con 0x7fe0bc1637d0 2024-03-30T13:08:01.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0bc163e40 con 0x7fe0bc1637d0 2024-03-30T13:08:01.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2818099330 0 0) 0x7fe0a4003530 con 0x7fe0bc071f80 2024-03-30T13:08:01.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 msgr2=0x7fe0bc06eea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:08:01.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 --2- 172.21.15.83:0/2020800975 >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cf1f0 0x7fe0bc06eea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:01.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 >> v1:172.21.15.153:6789/0 conn(0x7fe0bc1637d0 legacy=0x7fe0bc0b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:01.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0bc06e6a0 con 0x7fe0bc071f80 2024-03-30T13:08:01.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fe0b0001680 con 0x7fe0bc071f80 2024-03-30T13:08:01.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 >> v1:172.21.15.83:6789/0 conn(0x7fe0bc071f80 legacy=0x7fe0bc1630c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:01.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 --2- 172.21.15.83:0/2020800975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0a4003ba0 0x7fe0a4003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:01.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 --2- 172.21.15.83:0/2020800975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0a4004810 0x7fe0a4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:01.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 --2- 172.21.15.83:0/2020800975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a4005220 0x7fe0a400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:01.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.414+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc06f3e0 con 0x7fe0a4003ba0 2024-03-30T13:08:01.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.418+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a400c150 con 0x7fe0a4005220 2024-03-30T13:08:01.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.418+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a400c350 con 0x7fe0a4004810 2024-03-30T13:08:01.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.418+0000 7fe0bbfff640 1 --2- 172.21.15.83:0/2020800975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0a4003ba0 0x7fe0a4003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:01.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.418+0000 7fe0c0dd0640 1 --2- 172.21.15.83:0/2020800975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a4005220 0x7fe0a400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:01.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.418+0000 7fe0bb7fe640 1 --2- 172.21.15.83:0/2020800975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0a4004810 0x7fe0a4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:01.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.418+0000 7fe0bbfff640 1 -- 172.21.15.83:0/2020800975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0a4004810 msgr2=0x7fe0a4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:01.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.418+0000 7fe0bbfff640 1 --2- 172.21.15.83:0/2020800975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0a4004810 0x7fe0a4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:01.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.418+0000 7fe0bbfff640 1 -- 172.21.15.83:0/2020800975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a4005220 msgr2=0x7fe0a400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:01.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.418+0000 7fe0bbfff640 1 --2- 172.21.15.83:0/2020800975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a4005220 0x7fe0a400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:01.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.418+0000 7fe0c0dd0640 1 -- 172.21.15.83:0/2020800975 reap_dead start 2024-03-30T13:08:01.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.418+0000 7fe0bbfff640 1 -- 172.21.15.83:0/2020800975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a4003530 con 0x7fe0a4003ba0 2024-03-30T13:08:01.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.422+0000 7fe0bbfff640 1 --2- 172.21.15.83:0/2020800975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0a4003ba0 0x7fe0a4003fa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4000ee0 tx=0x7fe0b401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd171d2ffca9457 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:01.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.426+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b400f040 con 0x7fe0a4003ba0 2024-03-30T13:08:01.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.426+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b40b0070 con 0x7fe0a4003ba0 2024-03-30T13:08:01.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.426+0000 7fe0baffd640 1 -- 172.21.15.83:0/2020800975 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40ab8b0 con 0x7fe0a4003ba0 2024-03-30T13:08:01.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.426+0000 7fe0c2833640 1 -- 172.21.15.83:0/2020800975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0a4003ba0 msgr2=0x7fe0a4003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:01.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.426+0000 7fe0c2833640 1 --2- 172.21.15.83:0/2020800975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0a4003ba0 0x7fe0a4003fa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4000ee0 tx=0x7fe0b401c830 comp rx=0 tx=0).stop 2024-03-30T13:08:01.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.426+0000 7fe0c2833640 1 -- 172.21.15.83:0/2020800975 shutdown_connections 2024-03-30T13:08:01.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.426+0000 7fe0c2833640 1 --2- 172.21.15.83:0/2020800975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0a4003ba0 0x7fe0a4003fa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:01.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.426+0000 7fe0c2833640 1 -- 172.21.15.83:0/2020800975 >> 172.21.15.83:0/2020800975 conn(0x7fe0bc0b28e0 msgr2=0x7fe0bc0b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:01.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.426+0000 7fe0c2833640 1 -- 172.21.15.83:0/2020800975 shutdown_connections 2024-03-30T13:08:01.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.426+0000 7fe0c2833640 1 -- 172.21.15.83:0/2020800975 wait complete. 2024-03-30T13:08:01.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.426+0000 7fe0c2833640 1 Processor -- start 2024-03-30T13:08:01.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.426+0000 7fe0c2833640 1 -- start start 2024-03-30T13:08:01.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0c2833640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1fbe70 0x7fe0bc2006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:01.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0c2833640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0bc1fc250 0x7fe0bc1486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:01.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0c2833640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0bc148bf0 0x7fe0bc164710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:01.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0c2833640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1630c0 con 0x7fe0bc1fc250 2024-03-30T13:08:01.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0c2833640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc163be0 con 0x7fe0bc1fbe70 2024-03-30T13:08:01.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0c2833640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe0bc163240 con 0x7fe0bc148bf0 2024-03-30T13:08:01.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0bc1fc250 0x7fe0bc1486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:01.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0bc1fc250 0x7fe0bc1486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35394/0 (socket says 172.21.15.83:35394) 2024-03-30T13:08:01.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0bb7fe640 1 -- 172.21.15.83:0/1037010548 learned_addr learned my addr 172.21.15.83:0/1037010548 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:01.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0bbfff640 1 --2- 172.21.15.83:0/1037010548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1fbe70 0x7fe0bc2006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:01.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0c0dd0640 1 --2- 172.21.15.83:0/1037010548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0bc148bf0 0x7fe0bc164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0bb7fe640 1 -- 172.21.15.83:0/1037010548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0bc148bf0 msgr2=0x7fe0bc164710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0bb7fe640 1 --2- 172.21.15.83:0/1037010548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0bc148bf0 0x7fe0bc164710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0bb7fe640 1 -- 172.21.15.83:0/1037010548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1fbe70 msgr2=0x7fe0bc2006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0bb7fe640 1 --2- 172.21.15.83:0/1037010548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1fbe70 0x7fe0bc2006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0bb7fe640 1 -- 172.21.15.83:0/1037010548 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0bc14c960 con 0x7fe0bc1fc250 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0bbfff640 1 --2- 172.21.15.83:0/1037010548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1fbe70 0x7fe0bc2006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0bb7fe640 1 --2- 172.21.15.83:0/1037010548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0bc1fc250 0x7fe0bc1486b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0004f80 tx=0x7fe0b00074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0b8ff9640 1 -- 172.21.15.83:0/1037010548 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b001a070 con 0x7fe0bc1fc250 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0b8ff9640 1 -- 172.21.15.83:0/1037010548 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b0007740 con 0x7fe0bc1fc250 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0b8ff9640 1 -- 172.21.15.83:0/1037010548 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000fb80 con 0x7fe0bc1fc250 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0c2833640 1 -- 172.21.15.83:0/1037010548 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0bc149220 con 0x7fe0bc1fc250 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0c2833640 1 -- 172.21.15.83:0/1037010548 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0bc1ffbe0 con 0x7fe0bc1fc250 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0b8ff9640 1 -- 172.21.15.83:0/1037010548 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe0b000fd20 con 0x7fe0bc1fc250 2024-03-30T13:08:01.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.430+0000 7fe0b8ff9640 1 -- 172.21.15.83:0/1037010548 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe0b001e620 con 0x7fe0bc1fc250 2024-03-30T13:08:01.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.434+0000 7fe0c2833640 1 -- 172.21.15.83:0/1037010548 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0bc04f9e0 con 0x7fe0bc1fc250 2024-03-30T13:08:01.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.434+0000 7fe0b8ff9640 1 -- 172.21.15.83:0/1037010548 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe0b0014590 con 0x7fe0bc1fc250 2024-03-30T13:08:01.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.502+0000 7fe0c2833640 1 -- 172.21.15.83:0/1037010548 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe0bc072c60 con 0x7fe0bc1fc250 2024-03-30T13:08:01.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.506+0000 7fe0b8ff9640 1 -- 172.21.15.83:0/1037010548 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe0b001e8d0 con 0x7fe0bc1fc250 2024-03-30T13:08:01.509 INFO:teuthology.orchestra.run.smithi083.stderr:adjusted tunables profile to default 2024-03-30T13:08:01.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.506+0000 7fe0c2833640 1 -- 172.21.15.83:0/1037010548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0bc1fc250 msgr2=0x7fe0bc1486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:01.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.506+0000 7fe0c2833640 1 --2- 172.21.15.83:0/1037010548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0bc1fc250 0x7fe0bc1486b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0004f80 tx=0x7fe0b00074f0 comp rx=0 tx=0).stop 2024-03-30T13:08:01.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.506+0000 7fe0c2833640 1 -- 172.21.15.83:0/1037010548 shutdown_connections 2024-03-30T13:08:01.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.506+0000 7fe0c2833640 1 --2- 172.21.15.83:0/1037010548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0bc148bf0 0x7fe0bc164710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:01.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.506+0000 7fe0c2833640 1 --2- 172.21.15.83:0/1037010548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0bc1fc250 0x7fe0bc1486b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:01.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.506+0000 7fe0c2833640 1 --2- 172.21.15.83:0/1037010548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1fbe70 0x7fe0bc2006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:01.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.506+0000 7fe0c2833640 1 -- 172.21.15.83:0/1037010548 >> 172.21.15.83:0/1037010548 conn(0x7fe0bc0b28e0 msgr2=0x7fe0bc156ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:01.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.506+0000 7fe0c2833640 1 -- 172.21.15.83:0/1037010548 shutdown_connections 2024-03-30T13:08:01.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:01.506+0000 7fe0c2833640 1 -- 172.21.15.83:0/1037010548 wait complete. 2024-03-30T13:08:01.530 INFO:tasks.ceph:check_enable_crimson: False 2024-03-30T13:08:01.530 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-30T13:08:01.530 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:08:01.530 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-30T13:08:01.540 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:08:01.540 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-30T13:08:01.594 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:08:01.594 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-30T13:08:01.647 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:08:01.647 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-30T13:08:01.664 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:01.658+0000 7f741d789180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:08:01.690 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:01.686+0000 7f55592dd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:08:01.698 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:08:01.698 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-30T13:08:01.711 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:08:01.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-30T13:08:01.766 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:08:01.766 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-30T13:08:01.821 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:08:01.821 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-30T13:08:01.874 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 5f4b62fd-e4b8-4990-ac0a-d75d844e8146 0 2024-03-30T13:08:02.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.038+0000 7fd75f8a8640 1 Processor -- start 2024-03-30T13:08:02.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.038+0000 7fd75f8a8640 1 -- start start 2024-03-30T13:08:02.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75f8a8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 0x7fd7580ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75f8a8640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd7580b5080 0x7fd7580b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75f8a8640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7580b37a0 con 0x7fd7580aec70 2024-03-30T13:08:02.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75f8a8640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fd7580b5a50 con 0x7fd7580b5080 2024-03-30T13:08:02.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75f8a8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd7580b0af0 con 0x7fd75815b570 2024-03-30T13:08:02.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75d644640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 0x7fd7580ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75ce43640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd7580aec70 0x7fd7580b0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:51182/0 (socket says 172.21.15.153:51182) 2024-03-30T13:08:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75ce43640 1 -- 172.21.15.153:0/2258788162 learned_addr learned my addr 172.21.15.153:0/2258788162 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-30T13:08:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75de45640 1 --2- 172.21.15.153:0/2258788162 >> v2:172.21.15.83:3300/0 conn(0x7fd7580b5080 0x7fd7580b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd74ffff640 1 -- 172.21.15.153:0/2258788162 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3823467680 0 0) 0x7fd7580b37a0 con 0x7fd7580aec70 2024-03-30T13:08:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd74ffff640 1 -- 172.21.15.153:0/2258788162 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd744003530 con 0x7fd7580aec70 2024-03-30T13:08:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75d644640 1 -- 172.21.15.153:0/2258788162 >> v2:172.21.15.83:3300/0 conn(0x7fd7580b5080 msgr2=0x7fd7580b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75d644640 1 --2- 172.21.15.153:0/2258788162 >> v2:172.21.15.83:3300/0 conn(0x7fd7580b5080 0x7fd7580b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75d644640 1 -- 172.21.15.153:0/2258788162 >> v1:172.21.15.153:6789/0 conn(0x7fd7580aec70 legacy=0x7fd7580b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75d644640 1 -- 172.21.15.153:0/2258788162 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75815b950 con 0x7fd75815b570 2024-03-30T13:08:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75de45640 1 --2- 172.21.15.153:0/2258788162 >> v2:172.21.15.83:3300/0 conn(0x7fd7580b5080 0x7fd7580b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:02.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd75d644640 1 --2- 172.21.15.153:0/2258788162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 0x7fd7580ae730 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd754009d90 tx=0x7fd75401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5abd877fb7210ead server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:02.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd74ffff640 1 -- 172.21.15.153:0/2258788162 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7540b2070 con 0x7fd75815b570 2024-03-30T13:08:02.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd74ffff640 1 -- 172.21.15.153:0/2258788162 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7540a5a00 con 0x7fd75815b570 2024-03-30T13:08:02.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.042+0000 7fd74ffff640 1 -- 172.21.15.153:0/2258788162 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7540a5dd0 con 0x7fd75815b570 2024-03-30T13:08:02.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 -- 172.21.15.153:0/2258788162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 msgr2=0x7fd7580ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 --2- 172.21.15.153:0/2258788162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 0x7fd7580ae730 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd754009d90 tx=0x7fd75401c940 comp rx=0 tx=0).stop 2024-03-30T13:08:02.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 -- 172.21.15.153:0/2258788162 shutdown_connections 2024-03-30T13:08:02.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 --2- 172.21.15.153:0/2258788162 >> v2:172.21.15.83:3300/0 conn(0x7fd7580b5080 0x7fd7580b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 --2- 172.21.15.153:0/2258788162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 0x7fd7580ae730 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 -- 172.21.15.153:0/2258788162 >> 172.21.15.153:0/2258788162 conn(0x7fd758072d30 msgr2=0x7fd7580b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:02.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 -- 172.21.15.153:0/2258788162 shutdown_connections 2024-03-30T13:08:02.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 -- 172.21.15.153:0/2258788162 wait complete. 2024-03-30T13:08:02.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 Processor -- start 2024-03-30T13:08:02.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 -- start start 2024-03-30T13:08:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7580aec70 0x7fd7581490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7580b5080 0x7fd7581498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 0x7fd75813a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd7580af050 con 0x7fd7580b5080 2024-03-30T13:08:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd7580afd30 con 0x7fd7580aec70 2024-03-30T13:08:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd7580af1d0 con 0x7fd75815b570 2024-03-30T13:08:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75d644640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7580aec70 0x7fd7581490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75de45640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 0x7fd75813a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75de45640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 0x7fd75813a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:39414/0 (socket says 172.21.15.153:39414) 2024-03-30T13:08:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75de45640 1 -- 172.21.15.153:0/1350981232 learned_addr learned my addr 172.21.15.153:0/1350981232 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75d644640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7580aec70 0x7fd7581490d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34426/0 (socket says 172.21.15.153:34426) 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75ce43640 1 --2- 172.21.15.153:0/1350981232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7580b5080 0x7fd7581498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75de45640 1 -- 172.21.15.153:0/1350981232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7580aec70 msgr2=0x7fd7581490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75de45640 1 --2- 172.21.15.153:0/1350981232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7580aec70 0x7fd7581490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75de45640 1 -- 172.21.15.153:0/1350981232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7580b5080 msgr2=0x7fd7581498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75de45640 1 --2- 172.21.15.153:0/1350981232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7580b5080 0x7fd7581498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75de45640 1 -- 172.21.15.153:0/1350981232 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75815d220 con 0x7fd75815b570 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75de45640 1 --2- 172.21.15.153:0/1350981232 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 0x7fd75813a9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c7f0 tx=0x7fd75000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd74dffb640 1 -- 172.21.15.153:0/1350981232 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750015070 con 0x7fd75815b570 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd74dffb640 1 -- 172.21.15.153:0/1350981232 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd750007860 con 0x7fd75815b570 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd74dffb640 1 -- 172.21.15.153:0/1350981232 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750007c50 con 0x7fd75815b570 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 -- 172.21.15.153:0/1350981232 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75815d500 con 0x7fd75815b570 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd75f8a8640 1 -- 172.21.15.153:0/1350981232 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd75815dac0 con 0x7fd75815b570 2024-03-30T13:08:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd74dffb640 1 -- 172.21.15.153:0/1350981232 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd750018070 con 0x7fd75815b570 2024-03-30T13:08:02.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.046+0000 7fd74dffb640 1 -- 172.21.15.153:0/1350981232 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fd750011ac0 con 0x7fd75815b570 2024-03-30T13:08:02.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.050+0000 7fd75f8a8640 1 -- 172.21.15.153:0/1350981232 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75809f3d0 con 0x7fd75815b570 2024-03-30T13:08:02.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.058+0000 7fd74dffb640 1 -- 172.21.15.153:0/1350981232 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd750011d10 con 0x7fd75815b570 2024-03-30T13:08:02.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.126+0000 7fd75f8a8640 1 -- 172.21.15.153:0/1350981232 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5f4b62fd-e4b8-4990-ac0a-d75d844e8146", "id": 0} v 0) -- 0x7fd75804f9e0 con 0x7fd75815b570 2024-03-30T13:08:02.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.134+0000 7fd74dffb640 1 -- 172.21.15.153:0/1350981232 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f4b62fd-e4b8-4990-ac0a-d75d844e8146", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fd75001a660 con 0x7fd75815b570 2024-03-30T13:08:02.139 INFO:teuthology.orchestra.run.smithi153.stdout:0 2024-03-30T13:08:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.134+0000 7fd75f8a8640 1 -- 172.21.15.153:0/1350981232 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 msgr2=0x7fd75813a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.134+0000 7fd75f8a8640 1 --2- 172.21.15.153:0/1350981232 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 0x7fd75813a9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c7f0 tx=0x7fd75000ccb0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.134+0000 7fd75f8a8640 1 -- 172.21.15.153:0/1350981232 shutdown_connections 2024-03-30T13:08:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.134+0000 7fd75f8a8640 1 --2- 172.21.15.153:0/1350981232 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd75815b570 0x7fd75813a9d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.134+0000 7fd75f8a8640 1 --2- 172.21.15.153:0/1350981232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7580b5080 0x7fd7581498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.134+0000 7fd75f8a8640 1 --2- 172.21.15.153:0/1350981232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7580aec70 0x7fd7581490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.134+0000 7fd75f8a8640 1 -- 172.21.15.153:0/1350981232 >> 172.21.15.153:0/1350981232 conn(0x7fd758072d30 msgr2=0x7fd75806ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.134+0000 7fd75f8a8640 1 -- 172.21.15.153:0/1350981232 shutdown_connections 2024-03-30T13:08:02.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.134+0000 7fd75f8a8640 1 -- 172.21.15.153:0/1350981232 wait complete. 2024-03-30T13:08:02.150 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:02.142+0000 7f741d789180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:08:02.158 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 06572364-7263-4434-bda6-0e1edc421e32 1 2024-03-30T13:08:02.172 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:02.166+0000 7f55592dd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:08:02.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.266+0000 7f8c3b6cc640 1 Processor -- start 2024-03-30T13:08:02.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.266+0000 7f8c3b6cc640 1 -- start start 2024-03-30T13:08:02.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c34156ad0 0x7f8c340b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8c340b2e50 0x7f8c3415fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c340b0320 con 0x7f8c3406f280 2024-03-30T13:08:02.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8c340b6530 con 0x7f8c340b2e50 2024-03-30T13:08:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8c3415cc10 con 0x7f8c34156ad0 2024-03-30T13:08:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c39468640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c34156ad0 0x7f8c340b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c39c69640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8c340b2e50 0x7f8c3415fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c39c69640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8c340b2e50 0x7f8c3415fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34430/0 (socket says 172.21.15.153:34430) 2024-03-30T13:08:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c39468640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c34156ad0 0x7f8c340b5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:39418/0 (socket says 172.21.15.153:39418) 2024-03-30T13:08:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c39c69640 1 -- 172.21.15.153:0/1060435445 learned_addr learned my addr 172.21.15.153:0/1060435445 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-30T13:08:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c39c69640 1 -- 172.21.15.153:0/1060435445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c34156ad0 msgr2=0x7f8c340b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c39c69640 1 --2- 172.21.15.153:0/1060435445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c34156ad0 0x7f8c340b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c39c69640 1 -- 172.21.15.153:0/1060435445 >> v1:172.21.15.83:6789/0 conn(0x7f8c3406f280 legacy=0x7f8c340b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c39c69640 1 -- 172.21.15.153:0/1060435445 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3415cef0 con 0x7f8c340b2e50 2024-03-30T13:08:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c39468640 1 --2- 172.21.15.153:0/1060435445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c34156ad0 0x7f8c340b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:02.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c39c69640 1 --2- 172.21.15.153:0/1060435445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c340b2e50 0x7f8c3415fed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009e50 tx=0x7f8c2c01c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55a6f3fc311e1af2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:02.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c2bfff640 1 -- 172.21.15.153:0/1060435445 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0a5890 con 0x7f8c340b2e50 2024-03-30T13:08:02.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c2bfff640 1 -- 172.21.15.153:0/1060435445 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2c0a5a30 con 0x7f8c340b2e50 2024-03-30T13:08:02.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c2bfff640 1 -- 172.21.15.153:0/1060435445 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0a5e00 con 0x7f8c340b2e50 2024-03-30T13:08:02.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1060435445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c340b2e50 msgr2=0x7f8c3415fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 --2- 172.21.15.153:0/1060435445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c340b2e50 0x7f8c3415fed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009e50 tx=0x7f8c2c01c9f0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1060435445 shutdown_connections 2024-03-30T13:08:02.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 --2- 172.21.15.153:0/1060435445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c340b2e50 0x7f8c3415fed0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 --2- 172.21.15.153:0/1060435445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c34156ad0 0x7f8c340b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1060435445 >> 172.21.15.153:0/1060435445 conn(0x7f8c3406b660 msgr2=0x7f8c3406ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:02.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1060435445 shutdown_connections 2024-03-30T13:08:02.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.270+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1060435445 wait complete. 2024-03-30T13:08:02.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c3b6cc640 1 Processor -- start 2024-03-30T13:08:02.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c3b6cc640 1 -- start start 2024-03-30T13:08:02.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c3b6cc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c3406f280 0x7f8c34155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c3b6cc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c340b2e50 0x7f8c3415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c3b6cc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c34156ad0 0x7f8c3415b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c3b6cc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8c341691a0 con 0x7f8c34156ad0 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c3b6cc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c34169020 con 0x7f8c340b2e50 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c3b6cc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8c34169320 con 0x7f8c3406f280 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c39468640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c3406f280 0x7f8c34155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c39468640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c3406f280 0x7f8c34155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:39420/0 (socket says 172.21.15.153:39420) 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c39468640 1 -- 172.21.15.153:0/1186756394 learned_addr learned my addr 172.21.15.153:0/1186756394 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c38c67640 1 --2- 172.21.15.153:0/1186756394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c340b2e50 0x7f8c3415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c39c69640 1 --2- 172.21.15.153:0/1186756394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c34156ad0 0x7f8c3415b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c39468640 1 -- 172.21.15.153:0/1186756394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c340b2e50 msgr2=0x7f8c3415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c39468640 1 --2- 172.21.15.153:0/1186756394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c340b2e50 0x7f8c3415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c39468640 1 -- 172.21.15.153:0/1186756394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c34156ad0 msgr2=0x7f8c3415b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c39468640 1 --2- 172.21.15.153:0/1186756394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c34156ad0 0x7f8c3415b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c39468640 1 -- 172.21.15.153:0/1186756394 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3415f6e0 con 0x7f8c3406f280 2024-03-30T13:08:02.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c39c69640 1 --2- 172.21.15.153:0/1186756394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c34156ad0 0x7f8c3415b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c39468640 1 --2- 172.21.15.153:0/1186756394 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c3406f280 0x7f8c34155210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000e9b0 tx=0x7f8c3000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c29ffb640 1 -- 172.21.15.153:0/1186756394 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30017070 con 0x7f8c3406f280 2024-03-30T13:08:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c29ffb640 1 -- 172.21.15.153:0/1186756394 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c3000ca00 con 0x7f8c3406f280 2024-03-30T13:08:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1186756394 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c3415e100 con 0x7f8c3406f280 2024-03-30T13:08:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c29ffb640 1 -- 172.21.15.153:0/1186756394 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000cdd0 con 0x7f8c3406f280 2024-03-30T13:08:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1186756394 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c3415e6c0 con 0x7f8c3406f280 2024-03-30T13:08:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c29ffb640 1 -- 172.21.15.153:0/1186756394 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8c3001a070 con 0x7f8c3406f280 2024-03-30T13:08:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1186756394 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c34073570 con 0x7f8c3406f280 2024-03-30T13:08:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.274+0000 7f8c29ffb640 1 -- 172.21.15.153:0/1186756394 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8c30013470 con 0x7f8c3406f280 2024-03-30T13:08:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.278+0000 7f8c29ffb640 1 -- 172.21.15.153:0/1186756394 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8c30009400 con 0x7f8c3406f280 2024-03-30T13:08:02.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.346+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1186756394 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "06572364-7263-4434-bda6-0e1edc421e32", "id": 1} v 0) -- 0x7f8c3404f9e0 con 0x7f8c3406f280 2024-03-30T13:08:02.353 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:02.346+0000 7f741d789180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:08:02.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.354+0000 7f8c29ffb640 1 -- 172.21.15.153:0/1186756394 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "06572364-7263-4434-bda6-0e1edc421e32", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8c30006020 con 0x7f8c3406f280 2024-03-30T13:08:02.360 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-03-30T13:08:02.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.354+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1186756394 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c3406f280 msgr2=0x7f8c34155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.354+0000 7f8c3b6cc640 1 --2- 172.21.15.153:0/1186756394 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c3406f280 0x7f8c34155210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000e9b0 tx=0x7f8c3000ee70 comp rx=0 tx=0).stop 2024-03-30T13:08:02.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.354+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1186756394 shutdown_connections 2024-03-30T13:08:02.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.354+0000 7f8c3b6cc640 1 --2- 172.21.15.153:0/1186756394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c34156ad0 0x7f8c3415b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.354+0000 7f8c3b6cc640 1 --2- 172.21.15.153:0/1186756394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c340b2e50 0x7f8c3415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.354+0000 7f8c3b6cc640 1 --2- 172.21.15.153:0/1186756394 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c3406f280 0x7f8c34155210 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.354+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1186756394 >> 172.21.15.153:0/1186756394 conn(0x7f8c3406b660 msgr2=0x7f8c340b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:02.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.354+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1186756394 shutdown_connections 2024-03-30T13:08:02.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.354+0000 7f8c3b6cc640 1 -- 172.21.15.153:0/1186756394 wait complete. 2024-03-30T13:08:02.378 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 85aa5927-8ebb-4656-b91d-bde732b70aaf 2 2024-03-30T13:08:02.391 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:02.386+0000 7f55592dd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:08:02.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.490+0000 7f6187876640 1 Processor -- start 2024-03-30T13:08:02.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.490+0000 7f6187876640 1 -- start start 2024-03-30T13:08:02.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.490+0000 7f6187876640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f250 0x7f6180160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.490+0000 7f6187876640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6180160b40 0x7f61800b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.490+0000 7f6187876640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f618013f630 0x7f61800b6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.490+0000 7f6187876640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f618006f310 con 0x7f618013f630 2024-03-30T13:08:02.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.490+0000 7f6187876640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f618006f5f0 con 0x7f6180160b40 2024-03-30T13:08:02.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.490+0000 7f6187876640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f618006f8d0 con 0x7f618013f250 2024-03-30T13:08:02.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.490+0000 7f6184e11640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6180160b40 0x7f61800b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.490+0000 7f6184e11640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6180160b40 0x7f61800b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34446/0 (socket says 172.21.15.153:34446) 2024-03-30T13:08:02.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.490+0000 7f6185612640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f250 0x7f6180160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6184e11640 1 -- 172.21.15.153:0/1446454393 learned_addr learned my addr 172.21.15.153:0/1446454393 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-30T13:08:02.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6185e13640 1 --2- 172.21.15.153:0/1446454393 >> v2:172.21.15.83:3300/0 conn(0x7f618013f630 0x7f61800b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6184e11640 1 -- 172.21.15.153:0/1446454393 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f250 msgr2=0x7f6180160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:02.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6184e11640 1 --2- 172.21.15.153:0/1446454393 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f250 0x7f6180160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6184e11640 1 -- 172.21.15.153:0/1446454393 >> v2:172.21.15.83:3300/0 conn(0x7f618013f630 msgr2=0x7f61800b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:02.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6184e11640 1 --2- 172.21.15.153:0/1446454393 >> v2:172.21.15.83:3300/0 conn(0x7f618013f630 0x7f61800b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6184e11640 1 -- 172.21.15.153:0/1446454393 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618006fbb0 con 0x7f6180160b40 2024-03-30T13:08:02.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6185612640 1 --2- 172.21.15.153:0/1446454393 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f250 0x7f6180160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:02.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6185e13640 1 --2- 172.21.15.153:0/1446454393 >> v2:172.21.15.83:3300/0 conn(0x7f618013f630 0x7f61800b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:02.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6184e11640 1 --2- 172.21.15.153:0/1446454393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6180160b40 0x7f61800b5e00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f618006cef0 tx=0x7f617001c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f69ccd41065f66e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6177fff640 1 -- 172.21.15.153:0/1446454393 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61700ab640 con 0x7f6180160b40 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6177fff640 1 -- 172.21.15.153:0/1446454393 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61700b0070 con 0x7f6180160b40 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6177fff640 1 -- 172.21.15.153:0/1446454393 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61700aba00 con 0x7f6180160b40 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6187876640 1 -- 172.21.15.153:0/1446454393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6180160b40 msgr2=0x7f61800b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6187876640 1 --2- 172.21.15.153:0/1446454393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6180160b40 0x7f61800b5e00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f618006cef0 tx=0x7f617001c4f0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6187876640 1 -- 172.21.15.153:0/1446454393 shutdown_connections 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6187876640 1 --2- 172.21.15.153:0/1446454393 >> v2:172.21.15.83:3300/0 conn(0x7f618013f630 0x7f61800b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6187876640 1 --2- 172.21.15.153:0/1446454393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6180160b40 0x7f61800b5e00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6187876640 1 --2- 172.21.15.153:0/1446454393 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f250 0x7f6180160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6187876640 1 -- 172.21.15.153:0/1446454393 >> 172.21.15.153:0/1446454393 conn(0x7f6180072ec0 msgr2=0x7f618006b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6187876640 1 -- 172.21.15.153:0/1446454393 shutdown_connections 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.494+0000 7f6187876640 1 -- 172.21.15.153:0/1446454393 wait complete. 2024-03-30T13:08:02.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6187876640 1 Processor -- start 2024-03-30T13:08:02.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6187876640 1 -- start start 2024-03-30T13:08:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6187876640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f618013f250 0x7f618013de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6187876640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f630 0x7f6180159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6187876640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6180160b40 0x7f6180138520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6187876640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f618006ead0 con 0x7f618013f250 2024-03-30T13:08:02.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6187876640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f618006e950 con 0x7f6180160b40 2024-03-30T13:08:02.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6187876640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f618006ec50 con 0x7f618013f630 2024-03-30T13:08:02.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6185e13640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6180160b40 0x7f6180138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6184e11640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f630 0x7f6180159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6184e11640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f630 0x7f6180159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:39448/0 (socket says 172.21.15.153:39448) 2024-03-30T13:08:02.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6185e13640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6180160b40 0x7f6180138520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34458/0 (socket says 172.21.15.153:34458) 2024-03-30T13:08:02.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6184e11640 1 -- 172.21.15.153:0/706750585 learned_addr learned my addr 172.21.15.153:0/706750585 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-30T13:08:02.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6185612640 1 --2- 172.21.15.153:0/706750585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f618013f250 0x7f618013de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6184e11640 1 -- 172.21.15.153:0/706750585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6180160b40 msgr2=0x7f6180138520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6184e11640 1 --2- 172.21.15.153:0/706750585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6180160b40 0x7f6180138520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6184e11640 1 -- 172.21.15.153:0/706750585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f618013f250 msgr2=0x7f618013de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6184e11640 1 --2- 172.21.15.153:0/706750585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f618013f250 0x7f618013de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6184e11640 1 -- 172.21.15.153:0/706750585 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618013e500 con 0x7f618013f630 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6185612640 1 --2- 172.21.15.153:0/706750585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f618013f250 0x7f618013de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6184e11640 1 --2- 172.21.15.153:0/706750585 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f630 0x7f6180159660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f61700ad040 tx=0x7f617001ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6175ffb640 1 -- 172.21.15.153:0/706750585 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61700be3f0 con 0x7f618013f630 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6175ffb640 1 -- 172.21.15.153:0/706750585 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61700be590 con 0x7f618013f630 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6175ffb640 1 -- 172.21.15.153:0/706750585 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61700be980 con 0x7f618013f630 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6187876640 1 -- 172.21.15.153:0/706750585 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618013e7e0 con 0x7f618013f630 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6187876640 1 -- 172.21.15.153:0/706750585 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6180154950 con 0x7f618013f630 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6175ffb640 1 -- 172.21.15.153:0/706750585 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f61700c7440 con 0x7f618013f630 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6175ffb640 1 -- 172.21.15.153:0/706750585 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f61700c7b50 con 0x7f618013f630 2024-03-30T13:08:02.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.498+0000 7f6187876640 1 -- 172.21.15.153:0/706750585 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6180073790 con 0x7f618013f630 2024-03-30T13:08:02.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.502+0000 7f6175ffb640 1 -- 172.21.15.153:0/706750585 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f61700cc080 con 0x7f618013f630 2024-03-30T13:08:02.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.570+0000 7f6187876640 1 -- 172.21.15.153:0/706750585 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "85aa5927-8ebb-4656-b91d-bde732b70aaf", "id": 2} v 0) -- 0x7f618004f9e0 con 0x7f618013f630 2024-03-30T13:08:02.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.578+0000 7f6175ffb640 1 -- 172.21.15.153:0/706750585 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "85aa5927-8ebb-4656-b91d-bde732b70aaf", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f6170016110 con 0x7f618013f630 2024-03-30T13:08:02.583 INFO:teuthology.orchestra.run.smithi153.stdout:2 2024-03-30T13:08:02.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.578+0000 7f6187876640 1 -- 172.21.15.153:0/706750585 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f630 msgr2=0x7f6180159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.578+0000 7f6187876640 1 --2- 172.21.15.153:0/706750585 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f630 0x7f6180159660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f61700ad040 tx=0x7f617001ad30 comp rx=0 tx=0).stop 2024-03-30T13:08:02.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.578+0000 7f6187876640 1 -- 172.21.15.153:0/706750585 shutdown_connections 2024-03-30T13:08:02.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.578+0000 7f6187876640 1 --2- 172.21.15.153:0/706750585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6180160b40 0x7f6180138520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.578+0000 7f6187876640 1 --2- 172.21.15.153:0/706750585 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f618013f630 0x7f6180159660 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.578+0000 7f6187876640 1 --2- 172.21.15.153:0/706750585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f618013f250 0x7f618013de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.578+0000 7f6187876640 1 -- 172.21.15.153:0/706750585 >> 172.21.15.153:0/706750585 conn(0x7f6180072ec0 msgr2=0x7f618015b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:02.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.578+0000 7f6187876640 1 -- 172.21.15.153:0/706750585 shutdown_connections 2024-03-30T13:08:02.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.578+0000 7f6187876640 1 -- 172.21.15.153:0/706750585 wait complete. 2024-03-30T13:08:02.600 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 4383c8a6-0444-41db-8822-cce69ccf3d01 3 2024-03-30T13:08:02.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.706+0000 7fcf060c9640 1 Processor -- start 2024-03-30T13:08:02.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fcf060c9640 1 -- start start 2024-03-30T13:08:02.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fcf060c9640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcf0015c640 0x7fcf000d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fcf060c9640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf000b1a40 con 0x7fcf001607f0 2024-03-30T13:08:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fcf060c9640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf000b1d20 con 0x7fcf000b2dc0 2024-03-30T13:08:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fcf060c9640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcf000b2930 con 0x7fcf0015c640 2024-03-30T13:08:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fceff7fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcf0015c640 0x7fcf000d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fceff7fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcf0015c640 0x7fcf000d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34460/0 (socket says 172.21.15.153:34460) 2024-03-30T13:08:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fceff7fe640 1 -- 172.21.15.153:0/17873546 learned_addr learned my addr 172.21.15.153:0/17873546 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-30T13:08:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fceff7fe640 1 -- 172.21.15.153:0/17873546 >> v1:172.21.15.153:6789/0 conn(0x7fcf000b2dc0 legacy=0x7fcf001600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fceff7fe640 1 -- 172.21.15.153:0/17873546 >> v1:172.21.15.83:6789/0 conn(0x7fcf001607f0 legacy=0x7fcf000af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:02.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fceff7fe640 1 -- 172.21.15.153:0/17873546 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf000b2000 con 0x7fcf0015c640 2024-03-30T13:08:02.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fceff7fe640 1 --2- 172.21.15.153:0/17873546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf0015c640 0x7fcf000d19a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009e50 tx=0x7fcef801c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb06aa45192c932 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:02.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fcefe7fc640 1 -- 172.21.15.153:0/17873546 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef80a57d0 con 0x7fcf0015c640 2024-03-30T13:08:02.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fcefe7fc640 1 -- 172.21.15.153:0/17873546 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef80a5970 con 0x7fcf0015c640 2024-03-30T13:08:02.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.710+0000 7fcefe7fc640 1 -- 172.21.15.153:0/17873546 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef80a5d40 con 0x7fcf0015c640 2024-03-30T13:08:02.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 -- 172.21.15.153:0/17873546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf0015c640 msgr2=0x7fcf000d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 --2- 172.21.15.153:0/17873546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf0015c640 0x7fcf000d19a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009e50 tx=0x7fcef801c9f0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 -- 172.21.15.153:0/17873546 shutdown_connections 2024-03-30T13:08:02.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 --2- 172.21.15.153:0/17873546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf0015c640 0x7fcf000d19a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 -- 172.21.15.153:0/17873546 >> 172.21.15.153:0/17873546 conn(0x7fcf000b3e70 msgr2=0x7fcf000b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:02.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 -- 172.21.15.153:0/17873546 shutdown_connections 2024-03-30T13:08:02.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 -- 172.21.15.153:0/17873546 wait complete. 2024-03-30T13:08:02.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 Processor -- start 2024-03-30T13:08:02.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 -- start start 2024-03-30T13:08:02.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2dc0 0x7fcf001507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf0015c640 0x7fcf0013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf001607f0 0x7fcf00159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcf00160ee0 con 0x7fcf001607f0 2024-03-30T13:08:02.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcf00160d60 con 0x7fcf000b2dc0 2024-03-30T13:08:02.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcf060c9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcf0016a490 con 0x7fcf0015c640 2024-03-30T13:08:02.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fceff7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2dc0 0x7fcf001507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fceff7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2dc0 0x7fcf001507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34464/0 (socket says 172.21.15.153:34464) 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fceff7fe640 1 -- 172.21.15.153:0/1516276220 learned_addr learned my addr 172.21.15.153:0/1516276220 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fcefeffd640 1 --2- 172.21.15.153:0/1516276220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf0015c640 0x7fcf0013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.714+0000 7fceff7fe640 1 -- 172.21.15.153:0/1516276220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf0015c640 msgr2=0x7fcf0013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fceff7fe640 1 --2- 172.21.15.153:0/1516276220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf0015c640 0x7fcf0013b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fceff7fe640 1 -- 172.21.15.153:0/1516276220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf001607f0 msgr2=0x7fcf00159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fcefffff640 1 --2- 172.21.15.153:0/1516276220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf001607f0 0x7fcf00159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fceff7fe640 1 --2- 172.21.15.153:0/1516276220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf001607f0 0x7fcf00159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fceff7fe640 1 -- 172.21.15.153:0/1516276220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0009d900 con 0x7fcf000b2dc0 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fceff7fe640 1 --2- 172.21.15.153:0/1516276220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2dc0 0x7fcf001507b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcef80af040 tx=0x7fcf000b0070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fcef7fff640 1 -- 172.21.15.153:0/1516276220 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef80b8470 con 0x7fcf000b2dc0 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fcef7fff640 1 -- 172.21.15.153:0/1516276220 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef80b8670 con 0x7fcf000b2dc0 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fcf060c9640 1 -- 172.21.15.153:0/1516276220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf0013bef0 con 0x7fcf000b2dc0 2024-03-30T13:08:02.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fcef7fff640 1 -- 172.21.15.153:0/1516276220 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef80b8a60 con 0x7fcf000b2dc0 2024-03-30T13:08:02.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fcf060c9640 1 -- 172.21.15.153:0/1516276220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf0013c730 con 0x7fcf000b2dc0 2024-03-30T13:08:02.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fcef7fff640 1 -- 172.21.15.153:0/1516276220 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcef80c0020 con 0x7fcf000b2dc0 2024-03-30T13:08:02.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fcef7fff640 1 -- 172.21.15.153:0/1516276220 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fcef80c2dc0 con 0x7fcf000b2dc0 2024-03-30T13:08:02.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.718+0000 7fcf060c9640 1 -- 172.21.15.153:0/1516276220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf000a04d0 con 0x7fcf000b2dc0 2024-03-30T13:08:02.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.722+0000 7fcef7fff640 1 -- 172.21.15.153:0/1516276220 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcf0013bef0 con 0x7fcf000b2dc0 2024-03-30T13:08:02.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.790+0000 7fcf060c9640 1 -- 172.21.15.153:0/1516276220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4383c8a6-0444-41db-8822-cce69ccf3d01", "id": 3} v 0) -- 0x7fcf000b1610 con 0x7fcf000b2dc0 2024-03-30T13:08:02.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.794+0000 7fcef7fff640 1 -- 172.21.15.153:0/1516276220 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4383c8a6-0444-41db-8822-cce69ccf3d01", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fcf0009d900 con 0x7fcf000b2dc0 2024-03-30T13:08:02.802 INFO:teuthology.orchestra.run.smithi153.stdout:3 2024-03-30T13:08:02.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.798+0000 7fcf060c9640 1 -- 172.21.15.153:0/1516276220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2dc0 msgr2=0x7fcf001507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.798+0000 7fcf060c9640 1 --2- 172.21.15.153:0/1516276220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2dc0 0x7fcf001507b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcef80af040 tx=0x7fcf000b0070 comp rx=0 tx=0).stop 2024-03-30T13:08:02.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.798+0000 7fcf060c9640 1 -- 172.21.15.153:0/1516276220 shutdown_connections 2024-03-30T13:08:02.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.798+0000 7fcf060c9640 1 --2- 172.21.15.153:0/1516276220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf001607f0 0x7fcf00159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.798+0000 7fcf060c9640 1 --2- 172.21.15.153:0/1516276220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf0015c640 0x7fcf0013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.798+0000 7fcf060c9640 1 --2- 172.21.15.153:0/1516276220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf000b2dc0 0x7fcf001507b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.798+0000 7fcf060c9640 1 -- 172.21.15.153:0/1516276220 >> 172.21.15.153:0/1516276220 conn(0x7fcf000b3e70 msgr2=0x7fcf0009b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:02.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.798+0000 7fcf060c9640 1 -- 172.21.15.153:0/1516276220 shutdown_connections 2024-03-30T13:08:02.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.798+0000 7fcf060c9640 1 -- 172.21.15.153:0/1516276220 wait complete. 2024-03-30T13:08:02.818 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new af22fa24-f711-47fb-b881-bc286aee1fea 4 2024-03-30T13:08:02.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.918+0000 7fccb6667640 1 Processor -- start 2024-03-30T13:08:02.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.918+0000 7fccb6667640 1 -- start start 2024-03-30T13:08:02.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccb6667640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb015c640 0x7fccb00d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccb6667640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fccb00b2dc0 0x7fccb01600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccb6667640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb00b1a40 con 0x7fccb0160620 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccb6667640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fccb00b2930 con 0x7fccb00b2dc0 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccb6667640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fccb00b1d20 con 0x7fccb015c640 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaffff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb015c640 0x7fccb00d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaf7fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fccb00b2dc0 0x7fccb01600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaf7fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fccb00b2dc0 0x7fccb01600e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34470/0 (socket says 172.21.15.153:34470) 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccb4c04640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fccb0160620 0x7fccb00af150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:51196/0 (socket says 172.21.15.153:51196) 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaffff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb015c640 0x7fccb00d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:39462/0 (socket says 172.21.15.153:39462) 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaf7fe640 1 -- 172.21.15.153:0/3696582173 learned_addr learned my addr 172.21.15.153:0/3696582173 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaf7fe640 1 -- 172.21.15.153:0/3696582173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb015c640 msgr2=0x7fccb00d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaf7fe640 1 --2- 172.21.15.153:0/3696582173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb015c640 0x7fccb00d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaf7fe640 1 -- 172.21.15.153:0/3696582173 >> v1:172.21.15.153:6789/0 conn(0x7fccb0160620 legacy=0x7fccb00af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaf7fe640 1 -- 172.21.15.153:0/3696582173 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb00b2000 con 0x7fccb00b2dc0 2024-03-30T13:08:02.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaffff640 1 --2- 172.21.15.153:0/3696582173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb015c640 0x7fccb00d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:02.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaf7fe640 1 --2- 172.21.15.153:0/3696582173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb00b2dc0 0x7fccb01600e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009870 tx=0x7fcca401c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2c82306f7ca6fc8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:02.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaeffd640 1 -- 172.21.15.153:0/3696582173 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40b2070 con 0x7fccb00b2dc0 2024-03-30T13:08:02.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaeffd640 1 -- 172.21.15.153:0/3696582173 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca40a9070 con 0x7fccb00b2dc0 2024-03-30T13:08:02.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.922+0000 7fccaeffd640 1 -- 172.21.15.153:0/3696582173 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40ad880 con 0x7fccb00b2dc0 2024-03-30T13:08:02.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 -- 172.21.15.153:0/3696582173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb00b2dc0 msgr2=0x7fccb01600e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 --2- 172.21.15.153:0/3696582173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb00b2dc0 0x7fccb01600e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009870 tx=0x7fcca401c560 comp rx=0 tx=0).stop 2024-03-30T13:08:02.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 -- 172.21.15.153:0/3696582173 shutdown_connections 2024-03-30T13:08:02.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 --2- 172.21.15.153:0/3696582173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb00b2dc0 0x7fccb01600e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 --2- 172.21.15.153:0/3696582173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb015c640 0x7fccb00d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 -- 172.21.15.153:0/3696582173 >> 172.21.15.153:0/3696582173 conn(0x7fccb00b3e70 msgr2=0x7fccb00b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:02.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 -- 172.21.15.153:0/3696582173 shutdown_connections 2024-03-30T13:08:02.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 -- 172.21.15.153:0/3696582173 wait complete. 2024-03-30T13:08:02.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 Processor -- start 2024-03-30T13:08:02.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 -- start start 2024-03-30T13:08:02.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb00b2dc0 0x7fccb015d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb015c640 0x7fccb015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb0160620 0x7fccb01418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:02.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0160ee0 con 0x7fccb0160620 2024-03-30T13:08:02.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0160d60 con 0x7fccb015c640 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fccb0169480 con 0x7fccb00b2dc0 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccaf7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb015c640 0x7fccb015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccaffff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb00b2dc0 0x7fccb015d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccaffff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb00b2dc0 0x7fccb015d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:39472/0 (socket says 172.21.15.153:39472) 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccaf7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb015c640 0x7fccb015e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34472/0 (socket says 172.21.15.153:34472) 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccaffff640 1 -- 172.21.15.153:0/1156253548 learned_addr learned my addr 172.21.15.153:0/1156253548 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccaf7fe640 1 -- 172.21.15.153:0/1156253548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb00b2dc0 msgr2=0x7fccb015d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccaf7fe640 1 --2- 172.21.15.153:0/1156253548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb00b2dc0 0x7fccb015d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccaf7fe640 1 -- 172.21.15.153:0/1156253548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb0160620 msgr2=0x7fccb01418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb4c04640 1 --2- 172.21.15.153:0/1156253548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb0160620 0x7fccb01418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccaf7fe640 1 --2- 172.21.15.153:0/1156253548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb0160620 0x7fccb01418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccaf7fe640 1 -- 172.21.15.153:0/1156253548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb015dfa0 con 0x7fccb015c640 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccaf7fe640 1 --2- 172.21.15.153:0/1156253548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb015c640 0x7fccb015e420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcca40ac000 tx=0x7fccb00b0070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:02.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccacff9640 1 -- 172.21.15.153:0/1156253548 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40b2040 con 0x7fccb015c640 2024-03-30T13:08:02.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccacff9640 1 -- 172.21.15.153:0/1156253548 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca40adb20 con 0x7fccb015c640 2024-03-30T13:08:02.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccacff9640 1 -- 172.21.15.153:0/1156253548 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40b6440 con 0x7fccb015c640 2024-03-30T13:08:02.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 -- 172.21.15.153:0/1156253548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb015dcc0 con 0x7fccb015c640 2024-03-30T13:08:02.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.926+0000 7fccb6667640 1 -- 172.21.15.153:0/1156253548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb01569b0 con 0x7fccb015c640 2024-03-30T13:08:02.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.930+0000 7fccacff9640 1 -- 172.21.15.153:0/1156253548 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcca40bd020 con 0x7fccb015c640 2024-03-30T13:08:02.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.930+0000 7fccacff9640 1 -- 172.21.15.153:0/1156253548 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fcca40bf920 con 0x7fccb015c640 2024-03-30T13:08:02.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.930+0000 7fccb6667640 1 -- 172.21.15.153:0/1156253548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb00a04d0 con 0x7fccb015c640 2024-03-30T13:08:02.938 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:02.930+0000 7f741d789180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:08:02.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:02.934+0000 7fccacff9640 1 -- 172.21.15.153:0/1156253548 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcca40c4020 con 0x7fccb015c640 2024-03-30T13:08:02.940 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:02.934+0000 7f55592dd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:08:02.993 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:02.986+0000 7f741d789180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:08:02.993 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:02.990+0000 7f55592dd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:08:03.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.002+0000 7fccb6667640 1 -- 172.21.15.153:0/1156253548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "af22fa24-f711-47fb-b881-bc286aee1fea", "id": 4} v 0) -- 0x7fccb00cf370 con 0x7fccb015c640 2024-03-30T13:08:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.006+0000 7fccacff9640 1 -- 172.21.15.153:0/1156253548 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af22fa24-f711-47fb-b881-bc286aee1fea", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fcca4016150 con 0x7fccb015c640 2024-03-30T13:08:03.014 INFO:teuthology.orchestra.run.smithi153.stdout:4 2024-03-30T13:08:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.010+0000 7fccb6667640 1 -- 172.21.15.153:0/1156253548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb015c640 msgr2=0x7fccb015e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.010+0000 7fccb6667640 1 --2- 172.21.15.153:0/1156253548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb015c640 0x7fccb015e420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcca40ac000 tx=0x7fccb00b0070 comp rx=0 tx=0).stop 2024-03-30T13:08:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.010+0000 7fccb6667640 1 -- 172.21.15.153:0/1156253548 shutdown_connections 2024-03-30T13:08:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.010+0000 7fccb6667640 1 --2- 172.21.15.153:0/1156253548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb0160620 0x7fccb01418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.010+0000 7fccb6667640 1 --2- 172.21.15.153:0/1156253548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb015c640 0x7fccb015e420 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.010+0000 7fccb6667640 1 --2- 172.21.15.153:0/1156253548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb00b2dc0 0x7fccb015d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.010+0000 7fccb6667640 1 -- 172.21.15.153:0/1156253548 >> 172.21.15.153:0/1156253548 conn(0x7fccb00b3e70 msgr2=0x7fccb0070bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.010+0000 7fccb6667640 1 -- 172.21.15.153:0/1156253548 shutdown_connections 2024-03-30T13:08:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.010+0000 7fccb6667640 1 -- 172.21.15.153:0/1156253548 wait complete. 2024-03-30T13:08:03.031 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 128453ed-4f4c-4eb0-b707-c287024cb5d6 5 2024-03-30T13:08:03.046 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:03.042+0000 7f55592dd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:08:03.049 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:03.042+0000 7f741d789180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:08:03.122 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:03.118+0000 7f55592dd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:08:03.129 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:03.122+0000 7f741d789180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:08:03.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.138+0000 7fc077657640 1 Processor -- start 2024-03-30T13:08:03.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.138+0000 7fc077657640 1 -- start start 2024-03-30T13:08:03.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc077657640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc070161d30 0x7fc07015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc077657640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc07006bd70 0x7fc070147620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc077657640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc070146580 con 0x7fc0700b2430 2024-03-30T13:08:03.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc077657640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc070146860 con 0x7fc070161d30 2024-03-30T13:08:03.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc077657640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc070146b40 con 0x7fc07006bd70 2024-03-30T13:08:03.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc075bf4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc07006bd70 0x7fc070147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc074bf2640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc0700b2430 0x7fc07006b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:51202/0 (socket says 172.21.15.153:51202) 2024-03-30T13:08:03.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc075bf4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc07006bd70 0x7fc070147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34480/0 (socket says 172.21.15.153:34480) 2024-03-30T13:08:03.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc074bf2640 1 -- 172.21.15.153:0/1724068863 learned_addr learned my addr 172.21.15.153:0/1724068863 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-30T13:08:03.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc0753f3640 1 --2- 172.21.15.153:0/1724068863 >> v2:172.21.15.83:3300/0 conn(0x7fc070161d30 0x7fc07015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc075bf4640 1 -- 172.21.15.153:0/1724068863 >> v2:172.21.15.83:3300/0 conn(0x7fc070161d30 msgr2=0x7fc07015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:03.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc075bf4640 1 --2- 172.21.15.153:0/1724068863 >> v2:172.21.15.83:3300/0 conn(0x7fc070161d30 0x7fc07015ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc075bf4640 1 -- 172.21.15.153:0/1724068863 >> v1:172.21.15.153:6789/0 conn(0x7fc0700b2430 legacy=0x7fc07006b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc075bf4640 1 -- 172.21.15.153:0/1724068863 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc070146e20 con 0x7fc07006bd70 2024-03-30T13:08:03.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc067fff640 1 -- 172.21.15.153:0/1724068863 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4213050214 0 0) 0x7fc070146580 con 0x7fc0700b2430 2024-03-30T13:08:03.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.142+0000 7fc075bf4640 1 --2- 172.21.15.153:0/1724068863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07006bd70 0x7fc070147620 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc0700b6590 tx=0x7fc06801c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b080fc6c0676fd75 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:03.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc067fff640 1 -- 172.21.15.153:0/1724068863 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0680b2070 con 0x7fc07006bd70 2024-03-30T13:08:03.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc067fff640 1 -- 172.21.15.153:0/1724068863 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0680a5840 con 0x7fc07006bd70 2024-03-30T13:08:03.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc067fff640 1 -- 172.21.15.153:0/1724068863 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0680a5c10 con 0x7fc07006bd70 2024-03-30T13:08:03.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 -- 172.21.15.153:0/1724068863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07006bd70 msgr2=0x7fc070147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 --2- 172.21.15.153:0/1724068863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07006bd70 0x7fc070147620 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc0700b6590 tx=0x7fc06801c870 comp rx=0 tx=0).stop 2024-03-30T13:08:03.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 -- 172.21.15.153:0/1724068863 shutdown_connections 2024-03-30T13:08:03.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 --2- 172.21.15.153:0/1724068863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07006bd70 0x7fc070147620 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 --2- 172.21.15.153:0/1724068863 >> v2:172.21.15.83:3300/0 conn(0x7fc070161d30 0x7fc07015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 -- 172.21.15.153:0/1724068863 >> 172.21.15.153:0/1724068863 conn(0x7fc07009aa50 msgr2=0x7fc0700b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:03.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 -- 172.21.15.153:0/1724068863 shutdown_connections 2024-03-30T13:08:03.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 -- 172.21.15.153:0/1724068863 wait complete. 2024-03-30T13:08:03.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 Processor -- start 2024-03-30T13:08:03.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 -- start start 2024-03-30T13:08:03.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc07006bd70 0x7fc07013e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0700b2430 0x7fc0701417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc070161d30 0x7fc070141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc07016b600 con 0x7fc07006bd70 2024-03-30T13:08:03.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc07016b480 con 0x7fc0700b2430 2024-03-30T13:08:03.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc07016b780 con 0x7fc070161d30 2024-03-30T13:08:03.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc074bf2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0700b2430 0x7fc0701417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc074bf2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0700b2430 0x7fc0701417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34488/0 (socket says 172.21.15.153:34488) 2024-03-30T13:08:03.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc074bf2640 1 -- 172.21.15.153:0/4204631848 learned_addr learned my addr 172.21.15.153:0/4204631848 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-30T13:08:03.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc075bf4640 1 --2- 172.21.15.153:0/4204631848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc070161d30 0x7fc070141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc0753f3640 1 --2- 172.21.15.153:0/4204631848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc07006bd70 0x7fc07013e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc074bf2640 1 -- 172.21.15.153:0/4204631848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc070161d30 msgr2=0x7fc070141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc074bf2640 1 --2- 172.21.15.153:0/4204631848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc070161d30 0x7fc070141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc074bf2640 1 -- 172.21.15.153:0/4204631848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc07006bd70 msgr2=0x7fc07013e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc074bf2640 1 --2- 172.21.15.153:0/4204631848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc07006bd70 0x7fc07013e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc074bf2640 1 -- 172.21.15.153:0/4204631848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07013fbf0 con 0x7fc0700b2430 2024-03-30T13:08:03.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc0753f3640 1 --2- 172.21.15.153:0/4204631848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc07006bd70 0x7fc07013e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:03.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc074bf2640 1 --2- 172.21.15.153:0/4204631848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0700b2430 0x7fc0701417a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc0600011f0 tx=0x7fc06000c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:03.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc065ffb640 1 -- 172.21.15.153:0/4204631848 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060018070 con 0x7fc0700b2430 2024-03-30T13:08:03.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc065ffb640 1 -- 172.21.15.153:0/4204631848 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0600074e0 con 0x7fc0700b2430 2024-03-30T13:08:03.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 -- 172.21.15.153:0/4204631848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07013fed0 con 0x7fc0700b2430 2024-03-30T13:08:03.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc065ffb640 1 -- 172.21.15.153:0/4204631848 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060004a10 con 0x7fc0700b2430 2024-03-30T13:08:03.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc077657640 1 -- 172.21.15.153:0/4204631848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc070159e10 con 0x7fc0700b2430 2024-03-30T13:08:03.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc065ffb640 1 -- 172.21.15.153:0/4204631848 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc06001b070 con 0x7fc0700b2430 2024-03-30T13:08:03.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.146+0000 7fc065ffb640 1 -- 172.21.15.153:0/4204631848 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc060012980 con 0x7fc0700b2430 2024-03-30T13:08:03.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.150+0000 7fc077657640 1 -- 172.21.15.153:0/4204631848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc07015a010 con 0x7fc0700b2430 2024-03-30T13:08:03.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.150+0000 7fc065ffb640 1 -- 172.21.15.153:0/4204631848 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc07015a010 con 0x7fc0700b2430 2024-03-30T13:08:03.174 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:03.170+0000 7f55592dd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:08:03.185 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:03.178+0000 7f741d789180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:08:03.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.218+0000 7fc077657640 1 -- 172.21.15.153:0/4204631848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "128453ed-4f4c-4eb0-b707-c287024cb5d6", "id": 5} v 0) -- 0x7fc07004f9e0 con 0x7fc0700b2430 2024-03-30T13:08:03.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.222+0000 7fc065ffb640 1 -- 172.21.15.153:0/4204631848 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "128453ed-4f4c-4eb0-b707-c287024cb5d6", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc060004d60 con 0x7fc0700b2430 2024-03-30T13:08:03.229 INFO:teuthology.orchestra.run.smithi153.stdout:5 2024-03-30T13:08:03.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.226+0000 7fc077657640 1 -- 172.21.15.153:0/4204631848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0700b2430 msgr2=0x7fc0701417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.226+0000 7fc077657640 1 --2- 172.21.15.153:0/4204631848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0700b2430 0x7fc0701417a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc0600011f0 tx=0x7fc06000c9b0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.226+0000 7fc077657640 1 -- 172.21.15.153:0/4204631848 shutdown_connections 2024-03-30T13:08:03.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.226+0000 7fc077657640 1 --2- 172.21.15.153:0/4204631848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc070161d30 0x7fc070141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.226+0000 7fc077657640 1 --2- 172.21.15.153:0/4204631848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0700b2430 0x7fc0701417a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.226+0000 7fc077657640 1 --2- 172.21.15.153:0/4204631848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc07006bd70 0x7fc07013e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.226+0000 7fc077657640 1 -- 172.21.15.153:0/4204631848 >> 172.21.15.153:0/4204631848 conn(0x7fc07009aa50 msgr2=0x7fc070145af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:03.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.226+0000 7fc077657640 1 -- 172.21.15.153:0/4204631848 shutdown_connections 2024-03-30T13:08:03.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.226+0000 7fc077657640 1 -- 172.21.15.153:0/4204631848 wait complete. 2024-03-30T13:08:03.246 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 8b13f094-13cf-47c4-ad57-a47e1e3ce236 6 2024-03-30T13:08:03.250 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:03.246+0000 7f55592dd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:08:03.265 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:03.258+0000 7f741d789180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:08:03.303 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:03.298+0000 7f55592dd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:08:03.320 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:03.314+0000 7f741d789180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:08:03.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.374+0000 7f3d562d5640 1 Processor -- start 2024-03-30T13:08:03.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.374+0000 7f3d562d5640 1 -- start start 2024-03-30T13:08:03.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.374+0000 7f3d562d5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3d5013f250 0x7f3d50160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.374+0000 7f3d562d5640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5006f310 con 0x7f3d5013f630 2024-03-30T13:08:03.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.374+0000 7f3d562d5640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5006f5f0 con 0x7f3d50160b40 2024-03-30T13:08:03.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.374+0000 7f3d562d5640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f3d5006f8d0 con 0x7f3d5013f250 2024-03-30T13:08:03.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.374+0000 7f3d4f7fe640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3d50160b40 0x7f3d500b5e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:51214/0 (socket says 172.21.15.153:51214) 2024-03-30T13:08:03.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.374+0000 7f3d4f7fe640 1 -- 172.21.15.153:0/2338077889 learned_addr learned my addr 172.21.15.153:0/2338077889 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-30T13:08:03.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4ffff640 1 --2- 172.21.15.153:0/2338077889 >> v2:172.21.15.83:3300/0 conn(0x7f3d5013f250 0x7f3d50160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2588246163 0 0) 0x7f3d5006f5f0 con 0x7f3d50160b40 2024-03-30T13:08:03.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d38003530 con 0x7f3d50160b40 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1037476788 0 0) 0x7f3d5006f310 con 0x7f3d5013f630 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d5006f5f0 con 0x7f3d5013f630 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3473333660 0 0) 0x7f3d38003530 con 0x7f3d50160b40 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 >> v2:172.21.15.83:3300/0 conn(0x7f3d5013f250 msgr2=0x7f3d50160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 --2- 172.21.15.153:0/2338077889 >> v2:172.21.15.83:3300/0 conn(0x7f3d5013f250 0x7f3d50160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 >> v1:172.21.15.83:6789/0 conn(0x7f3d5013f630 legacy=0x7f3d5015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5006fbb0 con 0x7f3d50160b40 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f3d44001600 con 0x7f3d50160b40 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 >> v1:172.21.15.153:6789/0 conn(0x7f3d50160b40 legacy=0x7f3d500b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 --2- 172.21.15.153:0/2338077889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d38003ba0 0x7f3d38003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 --2- 172.21.15.153:0/2338077889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d38004810 0x7f3d38004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 --2- 172.21.15.153:0/2338077889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d38005220 0x7f3d3800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5006f8d0 con 0x7f3d38004810 2024-03-30T13:08:03.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3800c150 con 0x7f3d38005220 2024-03-30T13:08:03.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3800c350 con 0x7f3d38003ba0 2024-03-30T13:08:03.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d54872640 1 --2- 172.21.15.153:0/2338077889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d38005220 0x7f3d3800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4ffff640 1 --2- 172.21.15.153:0/2338077889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d38003ba0 0x7f3d38003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4f7fe640 1 --2- 172.21.15.153:0/2338077889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d38004810 0x7f3d38004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4ffff640 1 -- 172.21.15.153:0/2338077889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d38005220 msgr2=0x7f3d3800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:03.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4ffff640 1 --2- 172.21.15.153:0/2338077889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d38005220 0x7f3d3800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4ffff640 1 -- 172.21.15.153:0/2338077889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d38004810 msgr2=0x7f3d38004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:03.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4ffff640 1 --2- 172.21.15.153:0/2338077889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d38004810 0x7f3d38004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4ffff640 1 -- 172.21.15.153:0/2338077889 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d38003530 con 0x7f3d38003ba0 2024-03-30T13:08:03.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d54872640 1 --2- 172.21.15.153:0/2338077889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d38005220 0x7f3d3800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:03.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d54872640 1 -- 172.21.15.153:0/2338077889 reap_dead start 2024-03-30T13:08:03.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4ffff640 1 --2- 172.21.15.153:0/2338077889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d38003ba0 0x7f3d38003fa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009ae0 tx=0x7f3d4801ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cf2c474f8b5fe59 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:03.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d480b2070 con 0x7f3d38003ba0 2024-03-30T13:08:03.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d480a55b0 con 0x7f3d38003ba0 2024-03-30T13:08:03.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.378+0000 7f3d4effd640 1 -- 172.21.15.153:0/2338077889 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d480096b0 con 0x7f3d38003ba0 2024-03-30T13:08:03.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 -- 172.21.15.153:0/2338077889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d38003ba0 msgr2=0x7f3d38003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 --2- 172.21.15.153:0/2338077889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d38003ba0 0x7f3d38003fa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009ae0 tx=0x7f3d4801ca40 comp rx=0 tx=0).stop 2024-03-30T13:08:03.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 -- 172.21.15.153:0/2338077889 shutdown_connections 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 --2- 172.21.15.153:0/2338077889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d38003ba0 0x7f3d38003fa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 -- 172.21.15.153:0/2338077889 >> 172.21.15.153:0/2338077889 conn(0x7f3d50072ec0 msgr2=0x7f3d5006b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 -- 172.21.15.153:0/2338077889 shutdown_connections 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 -- 172.21.15.153:0/2338077889 wait complete. 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 Processor -- start 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 -- start start 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d38003ba0 0x7f3d501f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d500cd850 0x7f3d500cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d500b4350 0x7f3d500b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5006e2c0 con 0x7f3d500cd850 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5006e140 con 0x7f3d38003ba0 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5006e440 con 0x7f3d500b4350 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d54872640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d500b4350 0x7f3d500b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d4ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d38003ba0 0x7f3d501f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d54872640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d500b4350 0x7f3d500b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:39492/0 (socket says 172.21.15.153:39492) 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d54872640 1 -- 172.21.15.153:0/2793550469 learned_addr learned my addr 172.21.15.153:0/2793550469 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d4f7fe640 1 --2- 172.21.15.153:0/2793550469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d500cd850 0x7f3d500cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d54872640 1 -- 172.21.15.153:0/2793550469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d38003ba0 msgr2=0x7f3d501f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d54872640 1 --2- 172.21.15.153:0/2793550469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d38003ba0 0x7f3d501f76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d54872640 1 -- 172.21.15.153:0/2793550469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d500cd850 msgr2=0x7f3d500cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d54872640 1 --2- 172.21.15.153:0/2793550469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d500cd850 0x7f3d500cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d54872640 1 -- 172.21.15.153:0/2793550469 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d500b5040 con 0x7f3d500b4350 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d4ffff640 1 --2- 172.21.15.153:0/2793550469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d38003ba0 0x7f3d501f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d4f7fe640 1 --2- 172.21.15.153:0/2793550469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d500cd850 0x7f3d500cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d54872640 1 --2- 172.21.15.153:0/2793550469 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d500b4350 0x7f3d500b47d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d500cf440 tx=0x7f3d4000d150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d4cff9640 1 -- 172.21.15.153:0/2793550469 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40001c20 con 0x7f3d500b4350 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d4cff9640 1 -- 172.21.15.153:0/2793550469 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d40003b90 con 0x7f3d500b4350 2024-03-30T13:08:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d4cff9640 1 -- 172.21.15.153:0/2793550469 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40003d80 con 0x7f3d500b4350 2024-03-30T13:08:03.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 -- 172.21.15.153:0/2793550469 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d500b5320 con 0x7f3d500b4350 2024-03-30T13:08:03.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d562d5640 1 -- 172.21.15.153:0/2793550469 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d500b58e0 con 0x7f3d500b4350 2024-03-30T13:08:03.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d4cff9640 1 -- 172.21.15.153:0/2793550469 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3d4001b020 con 0x7f3d500b4350 2024-03-30T13:08:03.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.382+0000 7f3d4cff9640 1 -- 172.21.15.153:0/2793550469 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f3d40005580 con 0x7f3d500b4350 2024-03-30T13:08:03.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.386+0000 7f3d562d5640 1 -- 172.21.15.153:0/2793550469 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d50073790 con 0x7f3d500b4350 2024-03-30T13:08:03.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.386+0000 7f3d4cff9640 1 -- 172.21.15.153:0/2793550469 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3d40005070 con 0x7f3d500b4350 2024-03-30T13:08:03.452 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:03.446+0000 7f55592dd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:08:03.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.454+0000 7f3d562d5640 1 -- 172.21.15.153:0/2793550469 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8b13f094-13cf-47c4-ad57-a47e1e3ce236", "id": 6} v 0) -- 0x7f3d5004f9e0 con 0x7f3d500b4350 2024-03-30T13:08:03.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.466+0000 7f3d4cff9640 1 -- 172.21.15.153:0/2793550469 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b13f094-13cf-47c4-ad57-a47e1e3ce236", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f3d4000d900 con 0x7f3d500b4350 2024-03-30T13:08:03.474 INFO:teuthology.orchestra.run.smithi153.stdout:6 2024-03-30T13:08:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.470+0000 7f3d562d5640 1 -- 172.21.15.153:0/2793550469 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d500b4350 msgr2=0x7f3d500b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.470+0000 7f3d562d5640 1 --2- 172.21.15.153:0/2793550469 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d500b4350 0x7f3d500b47d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d500cf440 tx=0x7f3d4000d150 comp rx=0 tx=0).stop 2024-03-30T13:08:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.470+0000 7f3d562d5640 1 -- 172.21.15.153:0/2793550469 shutdown_connections 2024-03-30T13:08:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.470+0000 7f3d562d5640 1 --2- 172.21.15.153:0/2793550469 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d500b4350 0x7f3d500b47d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.470+0000 7f3d562d5640 1 --2- 172.21.15.153:0/2793550469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d500cd850 0x7f3d500cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.470+0000 7f3d562d5640 1 --2- 172.21.15.153:0/2793550469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d38003ba0 0x7f3d501f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.470+0000 7f3d562d5640 1 -- 172.21.15.153:0/2793550469 >> 172.21.15.153:0/2793550469 conn(0x7f3d50072ec0 msgr2=0x7f3d500b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.470+0000 7f3d562d5640 1 -- 172.21.15.153:0/2793550469 shutdown_connections 2024-03-30T13:08:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.470+0000 7f3d562d5640 1 -- 172.21.15.153:0/2793550469 wait complete. 2024-03-30T13:08:03.478 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:03.470+0000 7f741d789180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:08:03.490 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new a37635eb-ed0e-4c95-9d84-557cd88d1c29 7 2024-03-30T13:08:03.513 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:03.510+0000 7f55592dd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:08:03.542 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:03.538+0000 7f741d789180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:08:03.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8bf72640 1 Processor -- start 2024-03-30T13:08:03.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8bf72640 1 -- start start 2024-03-30T13:08:03.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8bf72640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8e8415b570 0x7f8e840ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8bf72640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e840b37a0 con 0x7f8e840aec70 2024-03-30T13:08:03.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8bf72640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e840b0af0 con 0x7f8e840b5080 2024-03-30T13:08:03.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8bf72640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f8e8415b950 con 0x7f8e8415b570 2024-03-30T13:08:03.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8a50f640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8e840b5080 0x7f8e840b54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:51220/0 (socket says 172.21.15.153:51220) 2024-03-30T13:08:03.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8a50f640 1 -- 172.21.15.153:0/1832288122 learned_addr learned my addr 172.21.15.153:0/1832288122 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-30T13:08:03.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e89d0e640 1 --2- 172.21.15.153:0/1832288122 >> v2:172.21.15.83:3300/0 conn(0x7f8e8415b570 0x7f8e840ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464733218 0 0) 0x7f8e840b0af0 con 0x7f8e840b5080 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e70003530 con 0x7f8e840b5080 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4199391203 0 0) 0x7f8e70003530 con 0x7f8e840b5080 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 >> v2:172.21.15.83:3300/0 conn(0x7f8e8415b570 msgr2=0x7f8e840ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 --2- 172.21.15.153:0/1832288122 >> v2:172.21.15.83:3300/0 conn(0x7f8e8415b570 0x7f8e840ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 >> v1:172.21.15.83:6789/0 conn(0x7f8e840aec70 legacy=0x7f8e840b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e840af490 con 0x7f8e840b5080 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f8e7c001a00 con 0x7f8e840b5080 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 >> v1:172.21.15.153:6789/0 conn(0x7f8e840b5080 legacy=0x7f8e840b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 --2- 172.21.15.153:0/1832288122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e700039c0 0x7f8e70003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 --2- 172.21.15.153:0/1832288122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e70004810 0x7f8e70004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 --2- 172.21.15.153:0/1832288122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e700051d0 0x7f8e7000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8415b950 con 0x7f8e70004810 2024-03-30T13:08:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7000c070 con 0x7f8e700039c0 2024-03-30T13:08:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8e7000c270 con 0x7f8e700051d0 2024-03-30T13:08:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8a50f640 1 --2- 172.21.15.153:0/1832288122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e700051d0 0x7f8e7000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e89d0e640 1 --2- 172.21.15.153:0/1832288122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e700039c0 0x7f8e70003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8950d640 1 --2- 172.21.15.153:0/1832288122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e70004810 0x7f8e70004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8a50f640 1 -- 172.21.15.153:0/1832288122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e700039c0 msgr2=0x7f8e70003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8a50f640 1 --2- 172.21.15.153:0/1832288122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e700039c0 0x7f8e70003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8a50f640 1 -- 172.21.15.153:0/1832288122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e70004810 msgr2=0x7f8e70004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8a50f640 1 --2- 172.21.15.153:0/1832288122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e70004810 0x7f8e70004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.602+0000 7f8e8a50f640 1 -- 172.21.15.153:0/1832288122 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e70003530 con 0x7f8e700051d0 2024-03-30T13:08:03.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e8a50f640 1 -- 172.21.15.153:0/1832288122 reap_dead start 2024-03-30T13:08:03.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e8a50f640 1 --2- 172.21.15.153:0/1832288122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e700051d0 0x7f8e7000b9d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8e840b5bc0 tx=0x7f8e7c01fb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b8c99fa4971caf3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:03.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c00a4a0 con 0x7f8e700051d0 2024-03-30T13:08:03.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7c0aa6e0 con 0x7f8e700051d0 2024-03-30T13:08:03.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e88d0c640 1 -- 172.21.15.153:0/1832288122 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c0aaad0 con 0x7f8e700051d0 2024-03-30T13:08:03.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1832288122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e700051d0 msgr2=0x7f8e7000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e8bf72640 1 --2- 172.21.15.153:0/1832288122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e700051d0 0x7f8e7000b9d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8e840b5bc0 tx=0x7f8e7c01fb20 comp rx=0 tx=0).stop 2024-03-30T13:08:03.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1832288122 shutdown_connections 2024-03-30T13:08:03.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e8bf72640 1 --2- 172.21.15.153:0/1832288122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e700051d0 0x7f8e7000b9d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1832288122 >> 172.21.15.153:0/1832288122 conn(0x7f8e84072d30 msgr2=0x7f8e840b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1832288122 shutdown_connections 2024-03-30T13:08:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1832288122 wait complete. 2024-03-30T13:08:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e8bf72640 1 Processor -- start 2024-03-30T13:08:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.606+0000 7f8e8bf72640 1 -- start start 2024-03-30T13:08:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8bf72640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e700051d0 0x7f8e8413a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8bf72640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e8413ab60 0x7f8e8413ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8bf72640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8406f300 0x7f8e8413d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8bf72640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8e840afd30 con 0x7f8e8406f300 2024-03-30T13:08:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8bf72640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e840afa50 con 0x7f8e700051d0 2024-03-30T13:08:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8bf72640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8e840af0b0 con 0x7f8e8413ab60 2024-03-30T13:08:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8950d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e8413ab60 0x7f8e8413ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e89d0e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e700051d0 0x7f8e8413a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8950d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e8413ab60 0x7f8e8413ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:39508/0 (socket says 172.21.15.153:39508) 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8950d640 1 -- 172.21.15.153:0/1512834063 learned_addr learned my addr 172.21.15.153:0/1512834063 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8a50f640 1 --2- 172.21.15.153:0/1512834063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8406f300 0x7f8e8413d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8950d640 1 -- 172.21.15.153:0/1512834063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e700051d0 msgr2=0x7f8e8413a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8950d640 1 --2- 172.21.15.153:0/1512834063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e700051d0 0x7f8e8413a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8950d640 1 -- 172.21.15.153:0/1512834063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8406f300 msgr2=0x7f8e8413d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8950d640 1 --2- 172.21.15.153:0/1512834063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8406f300 0x7f8e8413d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8950d640 1 -- 172.21.15.153:0/1512834063 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8413b7a0 con 0x7f8e8413ab60 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8950d640 1 --2- 172.21.15.153:0/1512834063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e8413ab60 0x7f8e8413ce20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800e3f0 tx=0x7f8e7800e7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e767fc640 1 -- 172.21.15.153:0/1512834063 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78019070 con 0x7f8e8413ab60 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e767fc640 1 -- 172.21.15.153:0/1512834063 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e780052e0 con 0x7f8e8413ab60 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1512834063 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8415e400 con 0x7f8e8413ab60 2024-03-30T13:08:03.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e767fc640 1 -- 172.21.15.153:0/1512834063 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78003820 con 0x7f8e8413ab60 2024-03-30T13:08:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1512834063 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8413af70 con 0x7f8e8413ab60 2024-03-30T13:08:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e767fc640 1 -- 172.21.15.153:0/1512834063 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8e7801c070 con 0x7f8e8413ab60 2024-03-30T13:08:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e767fc640 1 -- 172.21.15.153:0/1512834063 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f8e7801e440 con 0x7f8e8413ab60 2024-03-30T13:08:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.610+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1512834063 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8409f3d0 con 0x7f8e8413ab60 2024-03-30T13:08:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.614+0000 7f8e767fc640 1 -- 172.21.15.153:0/1512834063 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8e78014480 con 0x7f8e8413ab60 2024-03-30T13:08:03.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.682+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1512834063 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a37635eb-ed0e-4c95-9d84-557cd88d1c29", "id": 7} v 0) -- 0x7f8e8413b260 con 0x7f8e8413ab60 2024-03-30T13:08:03.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.690+0000 7f8e767fc640 1 -- 172.21.15.153:0/1512834063 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a37635eb-ed0e-4c95-9d84-557cd88d1c29", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f8e780039c0 con 0x7f8e8413ab60 2024-03-30T13:08:03.696 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-03-30T13:08:03.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.690+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1512834063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e8413ab60 msgr2=0x7f8e8413ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.690+0000 7f8e8bf72640 1 --2- 172.21.15.153:0/1512834063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e8413ab60 0x7f8e8413ce20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800e3f0 tx=0x7f8e7800e7f0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.690+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1512834063 shutdown_connections 2024-03-30T13:08:03.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.690+0000 7f8e8bf72640 1 --2- 172.21.15.153:0/1512834063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8406f300 0x7f8e8413d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.690+0000 7f8e8bf72640 1 --2- 172.21.15.153:0/1512834063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e8413ab60 0x7f8e8413ce20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.690+0000 7f8e8bf72640 1 --2- 172.21.15.153:0/1512834063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e700051d0 0x7f8e8413a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.690+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1512834063 >> 172.21.15.153:0/1512834063 conn(0x7f8e84072d30 msgr2=0x7f8e84156a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:03.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.690+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1512834063 shutdown_connections 2024-03-30T13:08:03.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:03.690+0000 7f8e8bf72640 1 -- 172.21.15.153:0/1512834063 wait complete. 2024-03-30T13:08:03.712 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-30T13:08:03.713 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-30T13:08:03.715 INFO:tasks.ceph.osd.0:Started 2024-03-30T13:08:03.715 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-30T13:08:03.715 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-30T13:08:03.718 INFO:tasks.ceph.osd.1:Started 2024-03-30T13:08:03.718 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-30T13:08:03.718 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-30T13:08:03.721 INFO:tasks.ceph.osd.2:Started 2024-03-30T13:08:03.721 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-30T13:08:03.721 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-30T13:08:03.724 INFO:tasks.ceph.osd.3:Started 2024-03-30T13:08:03.724 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-30T13:08:03.724 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-30T13:08:03.726 INFO:tasks.ceph.osd.4:Started 2024-03-30T13:08:03.726 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-30T13:08:03.726 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-30T13:08:03.729 INFO:tasks.ceph.osd.5:Started 2024-03-30T13:08:03.729 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-30T13:08:03.729 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-30T13:08:03.731 INFO:tasks.ceph.osd.6:Started 2024-03-30T13:08:03.731 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-30T13:08:03.732 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-30T13:08:03.733 INFO:tasks.ceph.osd.7:Started 2024-03-30T13:08:03.734 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:03.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38c0295640 1 Processor -- start 2024-03-30T13:08:03.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38c0295640 1 -- start start 2024-03-30T13:08:03.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38c0295640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38b80cdb50 0x7f38b806fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38c0295640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f38b8070010 0x7f38b80cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38c0295640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b80ce2c0 con 0x7f38b815e7a0 2024-03-30T13:08:03.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38c0295640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f38b815eb80 con 0x7f38b8070010 2024-03-30T13:08:03.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38c0295640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38b809b2b0 con 0x7f38b80cdb50 2024-03-30T13:08:03.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38be832640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f38b8070010 0x7f38b80cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38be832640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f38b8070010 0x7f38b80cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35444/0 (socket says 172.21.15.83:35444) 2024-03-30T13:08:03.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38be832640 1 -- 172.21.15.83:0/2370766998 learned_addr learned my addr 172.21.15.83:0/2370766998 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:03.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38bd830640 1 --2- 172.21.15.83:0/2370766998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38b80cdb50 0x7f38b806fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38be832640 1 -- 172.21.15.83:0/2370766998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38b80cdb50 msgr2=0x7f38b806fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:03.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38be832640 1 --2- 172.21.15.83:0/2370766998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38b80cdb50 0x7f38b806fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38be832640 1 -- 172.21.15.83:0/2370766998 >> v1:172.21.15.83:6789/0 conn(0x7f38b815e7a0 legacy=0x7f38b809b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38be832640 1 -- 172.21.15.83:0/2370766998 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b809ac60 con 0x7f38b8070010 2024-03-30T13:08:03.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.890+0000 7f38bd830640 1 --2- 172.21.15.83:0/2370766998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38b80cdb50 0x7f38b806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:03.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38be832640 1 --2- 172.21.15.83:0/2370766998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38b8070010 0x7f38b80cfed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009870 tx=0x7f38b001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453f071844daa290 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:03.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38bd02f640 1 -- 172.21.15.83:0/2370766998 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b00a7070 con 0x7f38b8070010 2024-03-30T13:08:03.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38bd02f640 1 -- 172.21.15.83:0/2370766998 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b00b0070 con 0x7f38b8070010 2024-03-30T13:08:03.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38bd02f640 1 -- 172.21.15.83:0/2370766998 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b00ab890 con 0x7f38b8070010 2024-03-30T13:08:03.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 -- 172.21.15.83:0/2370766998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38b8070010 msgr2=0x7f38b80cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 --2- 172.21.15.83:0/2370766998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38b8070010 0x7f38b80cfed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009870 tx=0x7f38b001c560 comp rx=0 tx=0).stop 2024-03-30T13:08:03.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 -- 172.21.15.83:0/2370766998 shutdown_connections 2024-03-30T13:08:03.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 --2- 172.21.15.83:0/2370766998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38b8070010 0x7f38b80cfed0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 --2- 172.21.15.83:0/2370766998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38b80cdb50 0x7f38b806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 -- 172.21.15.83:0/2370766998 >> 172.21.15.83:0/2370766998 conn(0x7f38b80b3d40 msgr2=0x7f38b80b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:03.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 -- 172.21.15.83:0/2370766998 shutdown_connections 2024-03-30T13:08:03.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 -- 172.21.15.83:0/2370766998 wait complete. 2024-03-30T13:08:03.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 Processor -- start 2024-03-30T13:08:03.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 -- start start 2024-03-30T13:08:03.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38b8070010 0x7f38b8155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38b80cdb50 0x7f38b80c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b815e7a0 0x7f38b81572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:03.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f38b816b730 con 0x7f38b8070010 2024-03-30T13:08:03.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38b816b5b0 con 0x7f38b815e7a0 2024-03-30T13:08:03.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38c0295640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38b816b8b0 con 0x7f38b80cdb50 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38be031640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38b8070010 0x7f38b8155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38be031640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38b8070010 0x7f38b8155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35450/0 (socket says 172.21.15.83:35450) 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38be031640 1 -- 172.21.15.83:0/228332775 learned_addr learned my addr 172.21.15.83:0/228332775 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38bd830640 1 --2- 172.21.15.83:0/228332775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38b80cdb50 0x7f38b80c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38be832640 1 --2- 172.21.15.83:0/228332775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b815e7a0 0x7f38b81572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38be031640 1 -- 172.21.15.83:0/228332775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38b80cdb50 msgr2=0x7f38b80c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38be031640 1 --2- 172.21.15.83:0/228332775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38b80cdb50 0x7f38b80c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38be031640 1 -- 172.21.15.83:0/228332775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b815e7a0 msgr2=0x7f38b81572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38be031640 1 --2- 172.21.15.83:0/228332775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b815e7a0 0x7f38b81572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38be031640 1 -- 172.21.15.83:0/228332775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b8155760 con 0x7f38b8070010 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38be031640 1 --2- 172.21.15.83:0/228332775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38b8070010 0x7f38b8155090 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f38a800c370 tx=0x7f38a800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38aeffd640 1 -- 172.21.15.83:0/228332775 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a80052d0 con 0x7f38b8070010 2024-03-30T13:08:03.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38aeffd640 1 -- 172.21.15.83:0/228332775 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a8005470 con 0x7f38b8070010 2024-03-30T13:08:03.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.894+0000 7f38aeffd640 1 -- 172.21.15.83:0/228332775 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8007260 con 0x7f38b8070010 2024-03-30T13:08:03.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.898+0000 7f38c0295640 1 -- 172.21.15.83:0/228332775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b8155a20 con 0x7f38b8070010 2024-03-30T13:08:03.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.898+0000 7f38c0295640 1 -- 172.21.15.83:0/228332775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b8155fe0 con 0x7f38b8070010 2024-03-30T13:08:03.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.898+0000 7f38aeffd640 1 -- 172.21.15.83:0/228332775 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38a8007400 con 0x7f38b8070010 2024-03-30T13:08:03.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.898+0000 7f38aeffd640 1 -- 172.21.15.83:0/228332775 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f38a80039c0 con 0x7f38b8070010 2024-03-30T13:08:03.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.898+0000 7f38c0295640 1 -- 172.21.15.83:0/228332775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b8068dd0 con 0x7f38b8070010 2024-03-30T13:08:03.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.898+0000 7f38aeffd640 1 -- 172.21.15.83:0/228332775 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f38a8003c90 con 0x7f38b8070010 2024-03-30T13:08:03.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.954+0000 7f38c0295640 1 -- 172.21.15.83:0/228332775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38b806fdf0 con 0x7f38b8070010 2024-03-30T13:08:03.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.958+0000 7f38aeffd640 1 -- 172.21.15.83:0/228332775 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f38a80067e0 con 0x7f38b8070010 2024-03-30T13:08:03.960 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:03.961 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":10,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:03.688519+0000","last_up_change":"0.000000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:03.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.958+0000 7f38c0295640 1 -- 172.21.15.83:0/228332775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38b8070010 msgr2=0x7f38b8155090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:03.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.958+0000 7f38c0295640 1 --2- 172.21.15.83:0/228332775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38b8070010 0x7f38b8155090 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f38a800c370 tx=0x7f38a800c830 comp rx=0 tx=0).stop 2024-03-30T13:08:03.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.958+0000 7f38c0295640 1 -- 172.21.15.83:0/228332775 shutdown_connections 2024-03-30T13:08:03.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.958+0000 7f38c0295640 1 --2- 172.21.15.83:0/228332775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b815e7a0 0x7f38b81572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.958+0000 7f38c0295640 1 --2- 172.21.15.83:0/228332775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38b80cdb50 0x7f38b80c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.958+0000 7f38c0295640 1 --2- 172.21.15.83:0/228332775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38b8070010 0x7f38b8155090 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:03.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.958+0000 7f38c0295640 1 -- 172.21.15.83:0/228332775 >> 172.21.15.83:0/228332775 conn(0x7f38b80b3d40 msgr2=0x7f38b8162080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:03.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.958+0000 7f38c0295640 1 -- 172.21.15.83:0/228332775 shutdown_connections 2024-03-30T13:08:03.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:03.958+0000 7f38c0295640 1 -- 172.21.15.83:0/228332775 wait complete. 2024-03-30T13:08:03.977 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-30T13:08:03.977 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-30T13:08:04.125 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-03-30T13:08:04.122+0000 7f44e9a797c0 -1 Falling back to public interface 2024-03-30T13:08:04.195 INFO:tasks.ceph.mgr.y.smithi083.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-30T13:08:04.195 INFO:tasks.ceph.mgr.y.smithi083.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-30T13:08:04.196 INFO:tasks.ceph.mgr.y.smithi083.stderr: from numpy import show_config as show_numpy_config 2024-03-30T13:08:04.208 INFO:tasks.ceph.mgr.x.smithi153.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-30T13:08:04.208 INFO:tasks.ceph.mgr.x.smithi153.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-30T13:08:04.208 INFO:tasks.ceph.mgr.x.smithi153.stderr: from numpy import show_config as show_numpy_config 2024-03-30T13:08:04.264 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:04.258+0000 7f55592dd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:08:04.281 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:04.274+0000 7f741d789180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:08:04.338 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-03-30T13:08:04.334+0000 7f85fc5997c0 -1 Falling back to public interface 2024-03-30T13:08:04.340 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-03-30T13:08:04.334+0000 7fab048737c0 -1 Falling back to public interface 2024-03-30T13:08:04.340 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-03-30T13:08:04.334+0000 7fc97edb97c0 -1 Falling back to public interface 2024-03-30T13:08:04.340 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-03-30T13:08:04.334+0000 7f8c41ce17c0 -1 Falling back to public interface 2024-03-30T13:08:04.342 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-03-30T13:08:04.338+0000 7f8c40ca1640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2024-03-30T13:08:04.349 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-03-30T13:08:04.346+0000 7f913ae297c0 -1 Falling back to public interface 2024-03-30T13:08:04.350 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-03-30T13:08:04.346+0000 7f215fa6f7c0 -1 Falling back to public interface 2024-03-30T13:08:04.351 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-03-30T13:08:04.346+0000 7fbc2a44a7c0 -1 Falling back to public interface 2024-03-30T13:08:04.441 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:04.438+0000 7f55592dd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:08:04.468 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:04.462+0000 7f741d789180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:08:04.593 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:04.590+0000 7f55592dd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:08:04.639 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:04.634+0000 7f741d789180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:08:04.655 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:04.650+0000 7f55592dd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:08:04.720 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:04.714+0000 7f741d789180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:08:04.782 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:04.795 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:04.790+0000 7f55592dd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:08:04.867 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:04.862+0000 7f741d789180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:08:04.893 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870f249640 1 Processor -- start 2024-03-30T13:08:04.893 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870f249640 1 -- start start 2024-03-30T13:08:04.895 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870f249640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f870815c5d0 0x7f87080cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:04.895 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870f249640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870815cd00 con 0x7f87080cf040 2024-03-30T13:08:04.895 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870f249640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870815cfc0 con 0x7f87080ccea0 2024-03-30T13:08:04.895 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870f249640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f87080cd310 con 0x7f870815c5d0 2024-03-30T13:08:04.895 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870d7e6640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f87080cf040 0x7f87081601a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36252/0 (socket says 172.21.15.83:36252) 2024-03-30T13:08:04.895 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870d7e6640 1 -- 172.21.15.83:0/3322702765 learned_addr learned my addr 172.21.15.83:0/3322702765 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870cfe5640 1 --2- 172.21.15.83:0/3322702765 >> v2:172.21.15.153:3300/0 conn(0x7f870815c5d0 0x7f87080cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1157620791 0 0) 0x7f870815cd00 con 0x7f87080cf040 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f8003530 con 0x7f87080cf040 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2557459215 0 0) 0x7f86f8003530 con 0x7f87080cf040 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 >> v2:172.21.15.153:3300/0 conn(0x7f870815c5d0 msgr2=0x7f87080cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 --2- 172.21.15.83:0/3322702765 >> v2:172.21.15.153:3300/0 conn(0x7f870815c5d0 0x7f87080cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 >> v1:172.21.15.153:6789/0 conn(0x7f87080ccea0 legacy=0x7f87080ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870815d2a0 con 0x7f87080cf040 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f8700001a00 con 0x7f87080cf040 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 >> v1:172.21.15.83:6789/0 conn(0x7f87080cf040 legacy=0x7f87081601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 --2- 172.21.15.83:0/3322702765 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 0x7f86f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 --2- 172.21.15.83:0/3322702765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86f8004810 0x7f86f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 --2- 172.21.15.83:0/3322702765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86f80051d0 0x7f86f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:04.896 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f87080cd310 con 0x7f86f80039c0 2024-03-30T13:08:04.897 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86f800c070 con 0x7f86f8004810 2024-03-30T13:08:04.897 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f86f800c270 con 0x7f86f80051d0 2024-03-30T13:08:04.897 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870cfe5640 1 --2- 172.21.15.83:0/3322702765 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 0x7f86f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:04.897 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f8707fff640 1 --2- 172.21.15.83:0/3322702765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86f8004810 0x7f86f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:04.897 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870cfe5640 1 -- 172.21.15.83:0/3322702765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86f80051d0 msgr2=0x7f86f800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:04.897 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870cfe5640 1 --2- 172.21.15.83:0/3322702765 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86f80051d0 0x7f86f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:04.897 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870cfe5640 1 -- 172.21.15.83:0/3322702765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86f8004810 msgr2=0x7f86f8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:04.897 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870cfe5640 1 --2- 172.21.15.83:0/3322702765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86f8004810 0x7f86f8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:04.897 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870cfe5640 1 -- 172.21.15.83:0/3322702765 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f8003530 con 0x7f86f80039c0 2024-03-30T13:08:04.897 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.890+0000 7f870d7e6640 1 -- 172.21.15.83:0/3322702765 reap_dead start 2024-03-30T13:08:04.899 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870cfe5640 1 --2- 172.21.15.83:0/3322702765 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 0x7f86f8003de0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009ac0 tx=0x7f86fc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de137c842a7d4e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:04.899 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0b2070 con 0x7f86f80039c0 2024-03-30T13:08:04.899 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86fc0a5550 con 0x7f86f80039c0 2024-03-30T13:08:04.899 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f87077fe640 1 -- 172.21.15.83:0/3322702765 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc009690 con 0x7f86f80039c0 2024-03-30T13:08:04.899 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 -- 172.21.15.83:0/3322702765 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 msgr2=0x7f86f8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:04.899 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 --2- 172.21.15.83:0/3322702765 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 0x7f86f8003de0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009ac0 tx=0x7f86fc01ca70 comp rx=0 tx=0).stop 2024-03-30T13:08:04.899 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 -- 172.21.15.83:0/3322702765 shutdown_connections 2024-03-30T13:08:04.899 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 --2- 172.21.15.83:0/3322702765 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 0x7f86f8003de0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:04.899 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 -- 172.21.15.83:0/3322702765 >> 172.21.15.83:0/3322702765 conn(0x7f870806f970 msgr2=0x7f870806fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:04.899 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 -- 172.21.15.83:0/3322702765 shutdown_connections 2024-03-30T13:08:04.899 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 -- 172.21.15.83:0/3322702765 wait complete. 2024-03-30T13:08:04.899 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 Processor -- start 2024-03-30T13:08:04.900 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 -- start start 2024-03-30T13:08:04.902 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 0x7f8708156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:04.902 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8708157110 0x7f87080c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:04.902 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8708157c20 0x7f87080c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:04.902 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f87080ced40 con 0x7f86f80039c0 2024-03-30T13:08:04.902 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f870815daa0 con 0x7f8708157c20 2024-03-30T13:08:04.902 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870f249640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f87080ceec0 con 0x7f8708157110 2024-03-30T13:08:04.902 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870cfe5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 0x7f8708156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:04.902 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870cfe5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 0x7f8708156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35460/0 (socket says 172.21.15.83:35460) 2024-03-30T13:08:04.902 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870cfe5640 1 -- 172.21.15.83:0/2612344327 learned_addr learned my addr 172.21.15.83:0/2612344327 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870d7e6640 1 --2- 172.21.15.83:0/2612344327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8708157c20 0x7f87080c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f8707fff640 1 --2- 172.21.15.83:0/2612344327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8708157110 0x7f87080c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870cfe5640 1 -- 172.21.15.83:0/2612344327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8708157110 msgr2=0x7f87080c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870cfe5640 1 --2- 172.21.15.83:0/2612344327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8708157110 0x7f87080c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870cfe5640 1 -- 172.21.15.83:0/2612344327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8708157c20 msgr2=0x7f87080c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870cfe5640 1 --2- 172.21.15.83:0/2612344327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8708157c20 0x7f87080c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.894+0000 7f870cfe5640 1 -- 172.21.15.83:0/2612344327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87080c8cf0 con 0x7f86f80039c0 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.898+0000 7f870cfe5640 1 --2- 172.21.15.83:0/2612344327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 0x7f8708156b20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f86fc01c8a0 tx=0x7f86f8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.898+0000 7f87057fa640 1 -- 172.21.15.83:0/2612344327 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0b2040 con 0x7f86f80039c0 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.898+0000 7f87057fa640 1 -- 172.21.15.83:0/2612344327 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86fc0b7460 con 0x7f86f80039c0 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.898+0000 7f870f249640 1 -- 172.21.15.83:0/2612344327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87080b7810 con 0x7f86f80039c0 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.898+0000 7f87057fa640 1 -- 172.21.15.83:0/2612344327 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0b7850 con 0x7f86f80039c0 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.898+0000 7f870f249640 1 -- 172.21.15.83:0/2612344327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87080c8290 con 0x7f86f80039c0 2024-03-30T13:08:04.903 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.898+0000 7f87057fa640 1 -- 172.21.15.83:0/2612344327 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f86fc0b5070 con 0x7f86f80039c0 2024-03-30T13:08:04.904 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.898+0000 7f87057fa640 1 -- 172.21.15.83:0/2612344327 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f86fc0adde0 con 0x7f86f80039c0 2024-03-30T13:08:04.904 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.898+0000 7f870f249640 1 -- 172.21.15.83:0/2612344327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87080b7d30 con 0x7f86f80039c0 2024-03-30T13:08:04.904 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.898+0000 7f87057fa640 1 -- 172.21.15.83:0/2612344327 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f87080b7d30 con 0x7f86f80039c0 2024-03-30T13:08:04.961 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.958+0000 7f870f249640 1 -- 172.21.15.83:0/2612344327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8708069170 con 0x7f86f80039c0 2024-03-30T13:08:04.962 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.958+0000 7f87057fa640 1 -- 172.21.15.83:0/2612344327 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f86fc016780 con 0x7f86f80039c0 2024-03-30T13:08:04.962 INFO:teuthology.misc.health.smithi083.stdout: 2024-03-30T13:08:04.962 INFO:teuthology.misc.health.smithi083.stdout:{"epoch":10,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:03.688519+0000","last_up_change":"0.000000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:04.963 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.958+0000 7f870f249640 1 -- 172.21.15.83:0/2612344327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 msgr2=0x7f8708156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:04.963 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.958+0000 7f870f249640 1 --2- 172.21.15.83:0/2612344327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 0x7f8708156b20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f86fc01c8a0 tx=0x7f86f8005840 comp rx=0 tx=0).stop 2024-03-30T13:08:04.963 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.958+0000 7f870f249640 1 -- 172.21.15.83:0/2612344327 shutdown_connections 2024-03-30T13:08:04.963 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.958+0000 7f870f249640 1 --2- 172.21.15.83:0/2612344327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8708157c20 0x7f87080c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:04.963 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.958+0000 7f870f249640 1 --2- 172.21.15.83:0/2612344327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8708157110 0x7f87080c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:04.963 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.958+0000 7f870f249640 1 --2- 172.21.15.83:0/2612344327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86f80039c0 0x7f8708156b20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:04.963 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.958+0000 7f870f249640 1 -- 172.21.15.83:0/2612344327 >> 172.21.15.83:0/2612344327 conn(0x7f870806f970 msgr2=0x7f8708160110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:04.964 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.958+0000 7f870f249640 1 -- 172.21.15.83:0/2612344327 shutdown_connections 2024-03-30T13:08:04.964 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:04.958+0000 7f870f249640 1 -- 172.21.15.83:0/2612344327 wait complete. 2024-03-30T13:08:04.976 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-30T13:08:05.427 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:05.422+0000 7f55592dd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:08:05.498 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:05.490+0000 7f741d789180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:08:05.503 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:05.498+0000 7f55592dd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:08:05.573 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:05.566+0000 7f741d789180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:08:05.684 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:05.678+0000 7f55592dd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:08:05.755 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:05.750+0000 7f741d789180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:08:05.757 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:05.754+0000 7f55592dd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:08:05.831 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:05.826+0000 7f741d789180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:08:06.046 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:06.042+0000 7f55592dd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:08:06.108 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:06.102+0000 7f55592dd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:08:06.123 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:06.118+0000 7f741d789180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:08:06.193 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-30T13:08:06.186+0000 7f741d789180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:08:07.150 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:07.146+0000 7f5500729640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-30T13:08:07.151 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-03-30T13:08:07.146+0000 7f5500729640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-30T13:08:07.777 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-03-30T13:08:07.770+0000 7fbc2a44a7c0 -1 osd.4 0 log_to_monitors true 2024-03-30T13:08:07.815 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-03-30T13:08:07.810+0000 7f44e9a797c0 -1 osd.2 0 log_to_monitors true 2024-03-30T13:08:08.206 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-03-30T13:08:08.202+0000 7fc97edb97c0 -1 osd.6 0 log_to_monitors true 2024-03-30T13:08:08.219 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-03-30T13:08:08.214+0000 7f8c41ce17c0 -1 osd.5 0 log_to_monitors true 2024-03-30T13:08:08.236 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-03-30T13:08:08.230+0000 7f85fc5997c0 -1 osd.1 0 log_to_monitors true 2024-03-30T13:08:08.326 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-03-30T13:08:08.322+0000 7f215fa6f7c0 -1 osd.0 0 log_to_monitors true 2024-03-30T13:08:08.329 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-03-30T13:08:08.322+0000 7fab048737c0 -1 osd.7 0 log_to_monitors true 2024-03-30T13:08:08.335 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-03-30T13:08:08.330+0000 7f913ae297c0 -1 osd.3 0 log_to_monitors true 2024-03-30T13:08:10.083 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-03-30T13:08:10.078+0000 7fbc263f3640 -1 osd.4 0 waiting for initial osdmap 2024-03-30T13:08:10.089 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-03-30T13:08:10.086+0000 7f44e5a22640 -1 osd.2 0 waiting for initial osdmap 2024-03-30T13:08:10.104 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-03-30T13:08:10.098+0000 7fbc1e227640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:08:10.109 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-03-30T13:08:10.106+0000 7f44dd856640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:08:11.783 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:11.888 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-03-30T13:08:11.882+0000 7f85f8542640 -1 osd.1 0 waiting for initial osdmap 2024-03-30T13:08:11.924 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-03-30T13:08:11.918+0000 7f85f0376640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:08:11.933 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff29714a640 1 Processor -- start 2024-03-30T13:08:11.934 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff29714a640 1 -- start start 2024-03-30T13:08:11.934 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff29714a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2900d3000 0x7ff290169250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:11.934 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff29714a640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff29006e5f0 con 0x7ff29015e7a0 2024-03-30T13:08:11.934 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff29714a640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2900b15b0 con 0x7ff2900b10f0 2024-03-30T13:08:11.935 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff29714a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff29015eb80 con 0x7ff2900d3000 2024-03-30T13:08:11.935 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff294ee6640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff29015e7a0 0x7ff29006dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:54298/0 (socket says 172.21.15.83:54298) 2024-03-30T13:08:11.935 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff294ee6640 1 -- 172.21.15.83:0/1943549546 learned_addr learned my addr 172.21.15.83:0/1943549546 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:11.935 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff2956e7640 1 --2- 172.21.15.83:0/1943549546 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2900d3000 0x7ff290169250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:11.936 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff28f7fe640 1 -- 172.21.15.83:0/1943549546 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697119930 0 0) 0x7ff284001120 con 0x7ff29015e7a0 2024-03-30T13:08:11.936 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff28f7fe640 1 -- 172.21.15.83:0/1943549546 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff280003530 con 0x7ff29015e7a0 2024-03-30T13:08:11.936 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff28f7fe640 1 -- 172.21.15.83:0/1943549546 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864066436 0 0) 0x7ff2900b15b0 con 0x7ff2900b10f0 2024-03-30T13:08:11.936 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff28f7fe640 1 -- 172.21.15.83:0/1943549546 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff284001120 con 0x7ff2900b10f0 2024-03-30T13:08:11.936 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff2956e7640 1 -- 172.21.15.83:0/1943549546 >> v1:172.21.15.153:6789/0 conn(0x7ff2900b10f0 legacy=0x7ff2900d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:11.936 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff2956e7640 1 -- 172.21.15.83:0/1943549546 >> v1:172.21.15.83:6789/0 conn(0x7ff29015e7a0 legacy=0x7ff29006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:11.936 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.930+0000 7ff2956e7640 1 -- 172.21.15.83:0/1943549546 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2900b1890 con 0x7ff2900d3000 2024-03-30T13:08:11.938 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.934+0000 7ff2956e7640 1 --2- 172.21.15.83:0/1943549546 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2900d3000 0x7ff290169250 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff288009dc0 tx=0x7ff28801c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fd6983b83f124d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:11.938 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.934+0000 7ff28f7fe640 1 -- 172.21.15.83:0/1943549546 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2880b2070 con 0x7ff2900d3000 2024-03-30T13:08:11.938 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.934+0000 7ff28f7fe640 1 -- 172.21.15.83:0/1943549546 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2880a5a20 con 0x7ff2900d3000 2024-03-30T13:08:11.939 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.934+0000 7ff28f7fe640 1 -- 172.21.15.83:0/1943549546 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2880a5dd0 con 0x7ff2900d3000 2024-03-30T13:08:11.939 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.934+0000 7ff29714a640 1 -- 172.21.15.83:0/1943549546 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2900d3000 msgr2=0x7ff290169250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:11.940 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.934+0000 7ff29714a640 1 --2- 172.21.15.83:0/1943549546 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2900d3000 0x7ff290169250 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff288009dc0 tx=0x7ff28801c960 comp rx=0 tx=0).stop 2024-03-30T13:08:11.940 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.934+0000 7ff29714a640 1 -- 172.21.15.83:0/1943549546 shutdown_connections 2024-03-30T13:08:11.940 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.934+0000 7ff29714a640 1 --2- 172.21.15.83:0/1943549546 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2900d3000 0x7ff290169250 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:11.940 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.934+0000 7ff29714a640 1 -- 172.21.15.83:0/1943549546 >> 172.21.15.83:0/1943549546 conn(0x7ff29008bf20 msgr2=0x7ff29009d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:11.940 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.934+0000 7ff29714a640 1 -- 172.21.15.83:0/1943549546 shutdown_connections 2024-03-30T13:08:11.940 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.934+0000 7ff29714a640 1 -- 172.21.15.83:0/1943549546 wait complete. 2024-03-30T13:08:11.941 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff29714a640 1 Processor -- start 2024-03-30T13:08:11.941 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff29714a640 1 -- start start 2024-03-30T13:08:11.943 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff29714a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2900b10f0 0x7ff29015f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:11.943 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff29714a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2900d3000 0x7ff290160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:11.943 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff29714a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff29015e7a0 0x7ff2900ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:11.943 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff29714a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff29016c130 con 0x7ff29015e7a0 2024-03-30T13:08:11.943 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff29714a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff29016bfb0 con 0x7ff2900b10f0 2024-03-30T13:08:11.943 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff29714a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff29016c2b0 con 0x7ff2900d3000 2024-03-30T13:08:11.944 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff2956e7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff29015e7a0 0x7ff2900ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:11.944 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff2956e7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff29015e7a0 0x7ff2900ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48910/0 (socket says 172.21.15.83:48910) 2024-03-30T13:08:11.944 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff2956e7640 1 -- 172.21.15.83:0/850682501 learned_addr learned my addr 172.21.15.83:0/850682501 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:11.944 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff294ee6640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2900b10f0 0x7ff29015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:11.944 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff28ffff640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2900d3000 0x7ff290160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:11.944 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff2956e7640 1 -- 172.21.15.83:0/850682501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2900d3000 msgr2=0x7ff290160f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:11.944 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff2956e7640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2900d3000 0x7ff290160f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:11.944 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff2956e7640 1 -- 172.21.15.83:0/850682501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2900b10f0 msgr2=0x7ff29015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:11.944 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff2956e7640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2900b10f0 0x7ff29015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:11.944 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff2956e7640 1 -- 172.21.15.83:0/850682501 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2900cba30 con 0x7ff29015e7a0 2024-03-30T13:08:11.944 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff2956e7640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff29015e7a0 0x7ff2900ca7d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff288019570 tx=0x7ff288019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:11.944 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-03-30T13:08:11.938+0000 7f215ba18640 -1 osd.0 0 waiting for initial osdmap 2024-03-30T13:08:11.945 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff28d7fa640 1 -- 172.21.15.83:0/850682501 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2880b2050 con 0x7ff29015e7a0 2024-03-30T13:08:11.945 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff28d7fa640 1 -- 172.21.15.83:0/850682501 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2880be070 con 0x7ff29015e7a0 2024-03-30T13:08:11.945 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff29714a640 1 -- 172.21.15.83:0/850682501 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2900cbd10 con 0x7ff29015e7a0 2024-03-30T13:08:11.945 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff28d7fa640 1 -- 172.21.15.83:0/850682501 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2880ada50 con 0x7ff29015e7a0 2024-03-30T13:08:11.946 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.938+0000 7ff29714a640 1 -- 172.21.15.83:0/850682501 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2900cc2d0 con 0x7ff29015e7a0 2024-03-30T13:08:11.946 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.942+0000 7ff29714a640 1 -- 172.21.15.83:0/850682501 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2900cc7b0 con 0x7ff29015e7a0 2024-03-30T13:08:11.948 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-03-30T13:08:11.942+0000 7f9136dd2640 -1 osd.3 0 waiting for initial osdmap 2024-03-30T13:08:11.949 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.942+0000 7ff28d7fa640 1 -- 172.21.15.83:0/850682501 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) ==== 87747+0+0 (secure 0 0 0) 0x7ff2880adbf0 con 0x7ff29015e7a0 2024-03-30T13:08:11.949 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.946+0000 7ff28d7fa640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff274067f30 0x7ff27406a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:11.949 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.946+0000 7ff28d7fa640 1 -- 172.21.15.83:0/850682501 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3166+0+0 (secure 0 0 0) 0x7ff288121500 con 0x7ff29015e7a0 2024-03-30T13:08:11.949 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.946+0000 7ff294ee6640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff274067f30 0x7ff27406a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:11.949 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.946+0000 7ff294ee6640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff274067f30 0x7ff27406a3f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff284007fd0 tx=0x7ff284007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:11.953 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:11.950+0000 7ff28d7fa640 1 -- 172.21.15.83:0/850682501 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff2900cc7b0 con 0x7ff29015e7a0 2024-03-30T13:08:11.964 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-03-30T13:08:11.958+0000 7f8c3dc8a640 -1 osd.5 0 waiting for initial osdmap 2024-03-30T13:08:11.971 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-03-30T13:08:11.966+0000 7fc97ad62640 -1 osd.6 0 waiting for initial osdmap 2024-03-30T13:08:11.973 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-03-30T13:08:11.970+0000 7f215384c640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:08:11.989 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-03-30T13:08:11.986+0000 7f912ec06640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:08:11.994 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-03-30T13:08:11.990+0000 7fab0102e640 -1 osd.7 0 waiting for initial osdmap 2024-03-30T13:08:12.007 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-03-30T13:08:12.002+0000 7f8c35abe640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:08:12.007 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-03-30T13:08:12.002+0000 7fc972b96640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:08:12.027 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-03-30T13:08:12.022+0000 7faaf8650640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:08:12.116 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.110+0000 7ff29714a640 1 -- 172.21.15.83:0/850682501 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff290069170 con 0x7ff29015e7a0 2024-03-30T13:08:12.117 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff28d7fa640 1 -- 172.21.15.83:0/850682501 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9602 (secure 0 0 0) 0x7ff288016580 con 0x7ff29015e7a0 2024-03-30T13:08:12.117 INFO:teuthology.misc.health.smithi083.stdout: 2024-03-30T13:08:12.117 INFO:teuthology.misc.health.smithi083.stdout:{"epoch":14,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:11.180770+0000","last_up_change":"2024-03-30T13:08:10.146184+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:12.119 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff29714a640 1 -- 172.21.15.83:0/850682501 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff274067f30 msgr2=0x7ff27406a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:12.119 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff29714a640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff274067f30 0x7ff27406a3f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff284007fd0 tx=0x7ff284007d80 comp rx=0 tx=0).stop 2024-03-30T13:08:12.119 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff29714a640 1 -- 172.21.15.83:0/850682501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff29015e7a0 msgr2=0x7ff2900ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:12.120 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff29714a640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff29015e7a0 0x7ff2900ca7d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff288019570 tx=0x7ff288019700 comp rx=0 tx=0).stop 2024-03-30T13:08:12.120 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff29714a640 1 -- 172.21.15.83:0/850682501 shutdown_connections 2024-03-30T13:08:12.120 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff29714a640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff274067f30 0x7ff27406a3f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:12.120 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff29714a640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff29015e7a0 0x7ff2900ca7d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:12.120 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff29714a640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2900d3000 0x7ff290160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:12.120 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff29714a640 1 --2- 172.21.15.83:0/850682501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2900b10f0 0x7ff29015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:12.120 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff29714a640 1 -- 172.21.15.83:0/850682501 >> 172.21.15.83:0/850682501 conn(0x7ff29008bf20 msgr2=0x7ff2900b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:12.120 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff29714a640 1 -- 172.21.15.83:0/850682501 shutdown_connections 2024-03-30T13:08:12.120 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:12.114+0000 7ff29714a640 1 -- 172.21.15.83:0/850682501 wait complete. 2024-03-30T13:08:12.135 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-03-30T13:08:18.942 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:19.067 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff2dbc640 1 Processor -- start 2024-03-30T13:08:19.067 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff2dbc640 1 -- start start 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff2dbc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdfec0cd8e0 0x7fdfec0cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff2dbc640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdfec0cf5d0 0x7fdfec15bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff2dbc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfec15c170 0x7fdfec0719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff2dbc640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fdfec0cdcc0 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff2dbc640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdfec15b730 con 0x7fdfec0cf5d0 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff2dbc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdfec15ee60 con 0x7fdfec15c170 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff0b58640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdfec0cd8e0 0x7fdfec0cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff0b58640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdfec0cd8e0 0x7fdfec0cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59152/0 (socket says 172.21.15.83:59152) 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff0b58640 1 -- 172.21.15.83:0/2303510587 learned_addr learned my addr 172.21.15.83:0/2303510587 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdfebfff640 1 --2- 172.21.15.83:0/2303510587 >> v2:172.21.15.153:3300/0 conn(0x7fdfec0cf5d0 0x7fdfec15bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff1359640 1 --2- 172.21.15.83:0/2303510587 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfec15c170 0x7fdfec0719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff0b58640 1 -- 172.21.15.83:0/2303510587 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfec15c170 msgr2=0x7fdfec0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff0b58640 1 --2- 172.21.15.83:0/2303510587 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfec15c170 0x7fdfec0719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.068 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff0b58640 1 -- 172.21.15.83:0/2303510587 >> v2:172.21.15.153:3300/0 conn(0x7fdfec0cf5d0 msgr2=0x7fdfec15bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:19.069 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff0b58640 1 --2- 172.21.15.83:0/2303510587 >> v2:172.21.15.153:3300/0 conn(0x7fdfec0cf5d0 0x7fdfec15bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.069 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.061+0000 7fdff0b58640 1 -- 172.21.15.83:0/2303510587 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec15f120 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.070 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff0b58640 1 --2- 172.21.15.83:0/2303510587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfec0cd8e0 0x7fdfec0cf090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdfec070ec0 tx=0x7fdfdc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3987a53b0ac3b25d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:19.070 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdfeb7fe640 1 -- 172.21.15.83:0/2303510587 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0b0070 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.070 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdfeb7fe640 1 -- 172.21.15.83:0/2303510587 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfdc0ab600 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.070 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdfeb7fe640 1 -- 172.21.15.83:0/2303510587 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0ab9d0 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.070 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 -- 172.21.15.83:0/2303510587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfec0cd8e0 msgr2=0x7fdfec0cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.071 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 --2- 172.21.15.83:0/2303510587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfec0cd8e0 0x7fdfec0cf090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdfec070ec0 tx=0x7fdfdc01c490 comp rx=0 tx=0).stop 2024-03-30T13:08:19.071 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 -- 172.21.15.83:0/2303510587 shutdown_connections 2024-03-30T13:08:19.071 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 --2- 172.21.15.83:0/2303510587 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfec15c170 0x7fdfec0719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.071 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 --2- 172.21.15.83:0/2303510587 >> v2:172.21.15.153:3300/0 conn(0x7fdfec0cf5d0 0x7fdfec15bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.071 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 --2- 172.21.15.83:0/2303510587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfec0cd8e0 0x7fdfec0cf090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.071 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 -- 172.21.15.83:0/2303510587 >> 172.21.15.83:0/2303510587 conn(0x7fdfec06b660 msgr2=0x7fdfec06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:19.071 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 -- 172.21.15.83:0/2303510587 shutdown_connections 2024-03-30T13:08:19.071 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 -- 172.21.15.83:0/2303510587 wait complete. 2024-03-30T13:08:19.073 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 Processor -- start 2024-03-30T13:08:19.074 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 -- start start 2024-03-30T13:08:19.074 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfec0cd8e0 0x7fdfec143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.074 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfec0cf5d0 0x7fdfec1580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.074 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfec15c170 0x7fdfec15a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.074 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec15c700 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.074 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec15c580 con 0x7fdfec15c170 2024-03-30T13:08:19.074 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdfec140bb0 con 0x7fdfec0cf5d0 2024-03-30T13:08:19.074 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff0b58640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfec0cd8e0 0x7fdfec143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.074 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff0b58640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfec0cd8e0 0x7fdfec143360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59158/0 (socket says 172.21.15.83:59158) 2024-03-30T13:08:19.074 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff0b58640 1 -- 172.21.15.83:0/1484621184 learned_addr learned my addr 172.21.15.83:0/1484621184 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:19.074 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdfebfff640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfec0cf5d0 0x7fdfec1580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.074 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff1359640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfec15c170 0x7fdfec15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff0b58640 1 -- 172.21.15.83:0/1484621184 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfec0cf5d0 msgr2=0x7fdfec1580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff0b58640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfec0cf5d0 0x7fdfec1580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff0b58640 1 -- 172.21.15.83:0/1484621184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfec15c170 msgr2=0x7fdfec15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff0b58640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfec15c170 0x7fdfec15a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff0b58640 1 -- 172.21.15.83:0/1484621184 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec158600 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdfebfff640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfec0cf5d0 0x7fdfec1580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff0b58640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfec0cd8e0 0x7fdfec143360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc01cd30 tx=0x7fdfdc019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdfe97fa640 1 -- 172.21.15.83:0/1484621184 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0bb070 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdfe97fa640 1 -- 172.21.15.83:0/1484621184 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfdc0b6640 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 -- 172.21.15.83:0/1484621184 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfec142320 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdfe97fa640 1 -- 172.21.15.83:0/1484621184 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0b0040 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.065+0000 7fdff2dbc640 1 -- 172.21.15.83:0/1484621184 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfec1425a0 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.075 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.069+0000 7fdff2dbc640 1 -- 172.21.15.83:0/1484621184 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfec069170 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.076 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.069+0000 7fdfe97fa640 1 -- 172.21.15.83:0/1484621184 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fdfdc0b69f0 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.076 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.069+0000 7fdfe97fa640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdfd8067fc0 0x7fdfd806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.076 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.069+0000 7fdfe97fa640 1 -- 172.21.15.83:0/1484621184 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fdfdc11fd60 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.076 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.069+0000 7fdfebfff640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdfd8067fc0 0x7fdfd806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.076 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.069+0000 7fdfebfff640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdfd8067fc0 0x7fdfd806a480 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0006fd0 tx=0x7fdfe0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:19.097 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.093+0000 7fdfe97fa640 1 -- 172.21.15.83:0/1484621184 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fdfec142320 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.259 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.253+0000 7fdff2dbc640 1 -- 172.21.15.83:0/1484621184 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfec06c360 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.260 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.253+0000 7fdfe97fa640 1 -- 172.21.15.83:0/1484621184 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7fdfdc016110 con 0x7fdfec0cd8e0 2024-03-30T13:08:19.260 INFO:teuthology.misc.health.smithi083.stdout: 2024-03-30T13:08:19.260 INFO:teuthology.misc.health.smithi083.stdout:{"epoch":17,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:14.320840+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:19.263 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.257+0000 7fdff2dbc640 1 -- 172.21.15.83:0/1484621184 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdfd8067fc0 msgr2=0x7fdfd806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.263 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.257+0000 7fdff2dbc640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdfd8067fc0 0x7fdfd806a480 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0006fd0 tx=0x7fdfe0008040 comp rx=0 tx=0).stop 2024-03-30T13:08:19.263 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.257+0000 7fdff2dbc640 1 -- 172.21.15.83:0/1484621184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfec0cd8e0 msgr2=0x7fdfec143360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.263 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.257+0000 7fdff2dbc640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfec0cd8e0 0x7fdfec143360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc01cd30 tx=0x7fdfdc019230 comp rx=0 tx=0).stop 2024-03-30T13:08:19.263 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.257+0000 7fdff2dbc640 1 -- 172.21.15.83:0/1484621184 shutdown_connections 2024-03-30T13:08:19.263 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.257+0000 7fdff2dbc640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdfd8067fc0 0x7fdfd806a480 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.263 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.257+0000 7fdff2dbc640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfec15c170 0x7fdfec15a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.263 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.257+0000 7fdff2dbc640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfec0cf5d0 0x7fdfec1580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.264 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.257+0000 7fdff2dbc640 1 --2- 172.21.15.83:0/1484621184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfec0cd8e0 0x7fdfec143360 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.264 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.257+0000 7fdff2dbc640 1 -- 172.21.15.83:0/1484621184 >> 172.21.15.83:0/1484621184 conn(0x7fdfec06b660 msgr2=0x7fdfec0ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:19.264 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.257+0000 7fdff2dbc640 1 -- 172.21.15.83:0/1484621184 shutdown_connections 2024-03-30T13:08:19.264 INFO:teuthology.misc.health.smithi083.stderr:2024-03-30T13:08:19.257+0000 7fdff2dbc640 1 -- 172.21.15.83:0/1484621184 wait complete. 2024-03-30T13:08:19.277 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-30T13:08:19.277 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-30T13:08:19.278 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-30T13:08:19.278 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-30T13:08:19.280 INFO:tasks.ceph.mds.a:Started 2024-03-30T13:08:19.280 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-30T13:08:19.280 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-30T13:08:19.282 INFO:tasks.ceph.mds.c:Started 2024-03-30T13:08:19.283 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-30T13:08:19.283 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-30T13:08:19.285 INFO:tasks.ceph.mds.b:Started 2024-03-30T13:08:19.285 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-30T13:08:19.286 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-30T13:08:19.288 INFO:tasks.ceph.mds.d:Started 2024-03-30T13:08:19.288 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-30T13:08:19.289 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:19.365 INFO:tasks.ceph.mds.a.smithi083.stdout:starting mds.a at 2024-03-30T13:08:19.369 INFO:tasks.ceph.mds.c.smithi083.stdout:starting mds.c at 2024-03-30T13:08:19.376 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-03-30T13:08:19.381 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-03-30T13:08:19.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.401+0000 7fa5d2306640 1 Processor -- start 2024-03-30T13:08:19.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.401+0000 7fa5d2306640 1 -- start start 2024-03-30T13:08:19.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.401+0000 7fa5d2306640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5cc15fb60 0x7fa5cc0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.401+0000 7fa5d2306640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5cc0b1200 0x7fa5cc0af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.401+0000 7fa5d2306640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5cc0cd130 con 0x7fa5cc0af5b0 2024-03-30T13:08:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.401+0000 7fa5d2306640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa5cc0cd410 con 0x7fa5cc15fb60 2024-03-30T13:08:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.401+0000 7fa5d2306640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa5cc0cd6f0 con 0x7fa5cc0b1200 2024-03-30T13:08:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5cb7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5cc0b1200 0x7fa5cc0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5cbfff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5cc15fb60 0x7fa5cc0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5cb7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5cc0b1200 0x7fa5cc0af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:46124/0 (socket says 172.21.15.83:46124) 2024-03-30T13:08:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5d08a3640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa5cc0af5b0 0x7fa5cc09aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:33754/0 (socket says 172.21.15.83:33754) 2024-03-30T13:08:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5cb7fe640 1 -- 172.21.15.83:0/4224528419 learned_addr learned my addr 172.21.15.83:0/4224528419 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5cbfff640 1 -- 172.21.15.83:0/4224528419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5cc0b1200 msgr2=0x7fa5cc0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5cbfff640 1 --2- 172.21.15.83:0/4224528419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5cc0b1200 0x7fa5cc0af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5cbfff640 1 -- 172.21.15.83:0/4224528419 >> v1:172.21.15.153:6789/0 conn(0x7fa5cc0af5b0 legacy=0x7fa5cc09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5caffd640 1 -- 172.21.15.83:0/4224528419 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483810371 0 0) 0x7fa5cc0cd130 con 0x7fa5cc0af5b0 2024-03-30T13:08:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5cbfff640 1 -- 172.21.15.83:0/4224528419 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc0cd9d0 con 0x7fa5cc15fb60 2024-03-30T13:08:19.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5cbfff640 1 --2- 172.21.15.83:0/4224528419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5cc15fb60 0x7fa5cc0d0cf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0097c0 tx=0x7fa5bc01c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b44c5edeb2a24f98 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:19.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5caffd640 1 -- 172.21.15.83:0/4224528419 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc0b0070 con 0x7fa5cc15fb60 2024-03-30T13:08:19.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5caffd640 1 -- 172.21.15.83:0/4224528419 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5bc0ab600 con 0x7fa5cc15fb60 2024-03-30T13:08:19.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5caffd640 1 -- 172.21.15.83:0/4224528419 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc0ab9d0 con 0x7fa5cc15fb60 2024-03-30T13:08:19.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5d2306640 1 -- 172.21.15.83:0/4224528419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5cc15fb60 msgr2=0x7fa5cc0d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5d2306640 1 --2- 172.21.15.83:0/4224528419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5cc15fb60 0x7fa5cc0d0cf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0097c0 tx=0x7fa5bc01c350 comp rx=0 tx=0).stop 2024-03-30T13:08:19.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5d2306640 1 -- 172.21.15.83:0/4224528419 shutdown_connections 2024-03-30T13:08:19.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5d2306640 1 --2- 172.21.15.83:0/4224528419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5cc0b1200 0x7fa5cc0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5d2306640 1 --2- 172.21.15.83:0/4224528419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5cc15fb60 0x7fa5cc0d0cf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5d2306640 1 -- 172.21.15.83:0/4224528419 >> 172.21.15.83:0/4224528419 conn(0x7fa5cc0b3dd0 msgr2=0x7fa5cc0b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:19.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5d2306640 1 -- 172.21.15.83:0/4224528419 shutdown_connections 2024-03-30T13:08:19.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.405+0000 7fa5d2306640 1 -- 172.21.15.83:0/4224528419 wait complete. 2024-03-30T13:08:19.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d2306640 1 Processor -- start 2024-03-30T13:08:19.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d2306640 1 -- start start 2024-03-30T13:08:19.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d2306640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5cc0af5b0 0x7fa5cc1657f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d2306640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5cc0b1200 0x7fa5cc14f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d2306640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5cc15fb60 0x7fa5cc1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d2306640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc09b2e0 con 0x7fa5cc15fb60 2024-03-30T13:08:19.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d2306640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc09b160 con 0x7fa5cc0b1200 2024-03-30T13:08:19.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d2306640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa5cc0ccc50 con 0x7fa5cc0af5b0 2024-03-30T13:08:19.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d08a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5cc15fb60 0x7fa5cc1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d08a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5cc15fb60 0x7fa5cc1577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59196/0 (socket says 172.21.15.83:59196) 2024-03-30T13:08:19.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5cbfff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5cc0af5b0 0x7fa5cc1657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d08a3640 1 -- 172.21.15.83:0/1205870436 learned_addr learned my addr 172.21.15.83:0/1205870436 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:19.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5cb7fe640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5cc0b1200 0x7fa5cc14f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d08a3640 1 -- 172.21.15.83:0/1205870436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5cc0af5b0 msgr2=0x7fa5cc1657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d08a3640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5cc0af5b0 0x7fa5cc1657f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d08a3640 1 -- 172.21.15.83:0/1205870436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5cc0b1200 msgr2=0x7fa5cc14f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d08a3640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5cc0b1200 0x7fa5cc14f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d08a3640 1 -- 172.21.15.83:0/1205870436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc14fe10 con 0x7fa5cc15fb60 2024-03-30T13:08:19.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d08a3640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5cc15fb60 0x7fa5cc1577f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400c780 tx=0x7fa5c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:19.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5c8ff9640 1 -- 172.21.15.83:0/1205870436 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4018070 con 0x7fa5cc15fb60 2024-03-30T13:08:19.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5c8ff9640 1 -- 172.21.15.83:0/1205870436 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c400a640 con 0x7fa5cc15fb60 2024-03-30T13:08:19.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d2306640 1 -- 172.21.15.83:0/1205870436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5cc158fd0 con 0x7fa5cc15fb60 2024-03-30T13:08:19.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5c8ff9640 1 -- 172.21.15.83:0/1205870436 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c400aab0 con 0x7fa5cc15fb60 2024-03-30T13:08:19.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d2306640 1 -- 172.21.15.83:0/1205870436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5cc158980 con 0x7fa5cc15fb60 2024-03-30T13:08:19.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5d2306640 1 -- 172.21.15.83:0/1205870436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5cc068dd0 con 0x7fa5cc15fb60 2024-03-30T13:08:19.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.409+0000 7fa5c8ff9640 1 -- 172.21.15.83:0/1205870436 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa5c400ac50 con 0x7fa5cc15fb60 2024-03-30T13:08:19.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.413+0000 7fa5c8ff9640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa5b8067fc0 0x7fa5b806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.413+0000 7fa5cbfff640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa5b8067fc0 0x7fa5b806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.413+0000 7fa5c8ff9640 1 -- 172.21.15.83:0/1205870436 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa5c40858b0 con 0x7fa5cc15fb60 2024-03-30T13:08:19.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.413+0000 7fa5cbfff640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa5b8067fc0 0x7fa5b806a480 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0ad000 tx=0x7fa5bc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:19.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.417+0000 7fa5c8ff9640 1 -- 172.21.15.83:0/1205870436 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fa5c4055c40 con 0x7fa5cc15fb60 2024-03-30T13:08:19.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.581+0000 7fa5d2306640 1 -- 172.21.15.83:0/1205870436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5cc0b8240 con 0x7fa5cc15fb60 2024-03-30T13:08:19.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.581+0000 7fa5c8ff9640 1 -- 172.21.15.83:0/1205870436 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7fa5c4059f40 con 0x7fa5cc15fb60 2024-03-30T13:08:19.588 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:19.588 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":17,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:14.320840+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:19.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.585+0000 7fa5d2306640 1 -- 172.21.15.83:0/1205870436 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa5b8067fc0 msgr2=0x7fa5b806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.585+0000 7fa5d2306640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa5b8067fc0 0x7fa5b806a480 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0ad000 tx=0x7fa5bc0a6000 comp rx=0 tx=0).stop 2024-03-30T13:08:19.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.585+0000 7fa5d2306640 1 -- 172.21.15.83:0/1205870436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5cc15fb60 msgr2=0x7fa5cc1577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.585+0000 7fa5d2306640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5cc15fb60 0x7fa5cc1577f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400c780 tx=0x7fa5c400cc40 comp rx=0 tx=0).stop 2024-03-30T13:08:19.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.585+0000 7fa5d2306640 1 -- 172.21.15.83:0/1205870436 shutdown_connections 2024-03-30T13:08:19.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.585+0000 7fa5d2306640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa5b8067fc0 0x7fa5b806a480 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.585+0000 7fa5d2306640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5cc15fb60 0x7fa5cc1577f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.585+0000 7fa5d2306640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5cc0b1200 0x7fa5cc14f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.585+0000 7fa5d2306640 1 --2- 172.21.15.83:0/1205870436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5cc0af5b0 0x7fa5cc1657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.585+0000 7fa5d2306640 1 -- 172.21.15.83:0/1205870436 >> 172.21.15.83:0/1205870436 conn(0x7fa5cc0b3dd0 msgr2=0x7fa5cc09aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:19.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.585+0000 7fa5d2306640 1 -- 172.21.15.83:0/1205870436 shutdown_connections 2024-03-30T13:08:19.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.585+0000 7fa5d2306640 1 -- 172.21.15.83:0/1205870436 wait complete. 2024-03-30T13:08:19.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:08:19.607 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:08:19.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.725+0000 7face3602640 1 Processor -- start 2024-03-30T13:08:19.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.725+0000 7face3602640 1 -- start start 2024-03-30T13:08:19.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face3602640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7facdc15c8e0 0x7facdc0ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face3602640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7facdc0b4680 0x7facdc165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face3602640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc0ae040 con 0x7facdc0adac0 2024-03-30T13:08:19.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face3602640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7facdc0b31e0 con 0x7facdc15c8e0 2024-03-30T13:08:19.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face3602640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7facdc0ae320 con 0x7facdc0b4680 2024-03-30T13:08:19.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face139e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7facdc15c8e0 0x7facdc0ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face139e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7facdc15c8e0 0x7facdc0ad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59212/0 (socket says 172.21.15.83:59212) 2024-03-30T13:08:19.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face139e640 1 -- 172.21.15.83:0/2185680501 learned_addr learned my addr 172.21.15.83:0/2185680501 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:19.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face1b9f640 1 --2- 172.21.15.83:0/2185680501 >> v2:172.21.15.153:3300/0 conn(0x7facdc0b4680 0x7facdc165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face139e640 1 -- 172.21.15.83:0/2185680501 >> v2:172.21.15.153:3300/0 conn(0x7facdc0b4680 msgr2=0x7facdc165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:19.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face139e640 1 --2- 172.21.15.83:0/2185680501 >> v2:172.21.15.153:3300/0 conn(0x7facdc0b4680 0x7facdc165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face139e640 1 -- 172.21.15.83:0/2185680501 >> v1:172.21.15.83:6789/0 conn(0x7facdc0adac0 legacy=0x7facdc15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face139e640 1 -- 172.21.15.83:0/2185680501 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc0ae600 con 0x7facdc15c8e0 2024-03-30T13:08:19.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face139e640 1 --2- 172.21.15.83:0/2185680501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facdc15c8e0 0x7facdc0ad580 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7facdc073a30 tx=0x7facd401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcffa806b4f810f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:19.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7facd3fff640 1 -- 172.21.15.83:0/2185680501 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd40a56c0 con 0x7facdc15c8e0 2024-03-30T13:08:19.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7facd3fff640 1 -- 172.21.15.83:0/2185680501 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd40a5860 con 0x7facdc15c8e0 2024-03-30T13:08:19.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7facd3fff640 1 -- 172.21.15.83:0/2185680501 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd40a5c30 con 0x7facdc15c8e0 2024-03-30T13:08:19.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face3602640 1 -- 172.21.15.83:0/2185680501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facdc15c8e0 msgr2=0x7facdc0ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.729+0000 7face3602640 1 --2- 172.21.15.83:0/2185680501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facdc15c8e0 0x7facdc0ad580 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7facdc073a30 tx=0x7facd401c9f0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 -- 172.21.15.83:0/2185680501 shutdown_connections 2024-03-30T13:08:19.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 --2- 172.21.15.83:0/2185680501 >> v2:172.21.15.153:3300/0 conn(0x7facdc0b4680 0x7facdc165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 --2- 172.21.15.83:0/2185680501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facdc15c8e0 0x7facdc0ad580 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 -- 172.21.15.83:0/2185680501 >> 172.21.15.83:0/2185680501 conn(0x7facdc06b660 msgr2=0x7facdc06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:19.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 -- 172.21.15.83:0/2185680501 shutdown_connections 2024-03-30T13:08:19.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 -- 172.21.15.83:0/2185680501 wait complete. 2024-03-30T13:08:19.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 Processor -- start 2024-03-30T13:08:19.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 -- start start 2024-03-30T13:08:19.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facdc0adac0 0x7facdc164570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facdc0b4680 0x7facdc14c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facdc15c8e0 0x7facdc0b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7facdc168f80 con 0x7facdc15c8e0 2024-03-30T13:08:19.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7facdc168e00 con 0x7facdc0b4680 2024-03-30T13:08:19.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7facdc169100 con 0x7facdc0adac0 2024-03-30T13:08:19.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face1b9f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facdc15c8e0 0x7facdc0b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face1b9f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facdc15c8e0 0x7facdc0b0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59226/0 (socket says 172.21.15.83:59226) 2024-03-30T13:08:19.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face1b9f640 1 -- 172.21.15.83:0/1325971131 learned_addr learned my addr 172.21.15.83:0/1325971131 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:19.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face139e640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facdc0adac0 0x7facdc164570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face0b9d640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facdc0b4680 0x7facdc14c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face1b9f640 1 -- 172.21.15.83:0/1325971131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facdc0adac0 msgr2=0x7facdc164570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face1b9f640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facdc0adac0 0x7facdc164570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face1b9f640 1 -- 172.21.15.83:0/1325971131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facdc0b4680 msgr2=0x7facdc14c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face1b9f640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facdc0b4680 0x7facdc14c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face1b9f640 1 -- 172.21.15.83:0/1325971131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc156800 con 0x7facdc15c8e0 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face0b9d640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facdc0b4680 0x7facdc14c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face1b9f640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facdc15c8e0 0x7facdc0b0ed0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7facd800d560 tx=0x7facd800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7facd1ffb640 1 -- 172.21.15.83:0/1325971131 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd80125f0 con 0x7facdc15c8e0 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7facd1ffb640 1 -- 172.21.15.83:0/1325971131 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd8019070 con 0x7facdc15c8e0 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 -- 172.21.15.83:0/1325971131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facdc14ca10 con 0x7facdc15c8e0 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7facd1ffb640 1 -- 172.21.15.83:0/1325971131 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd80129f0 con 0x7facdc15c8e0 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 -- 172.21.15.83:0/1325971131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facdc164b70 con 0x7facdc15c8e0 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.733+0000 7face3602640 1 -- 172.21.15.83:0/1325971131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facdc04f9e0 con 0x7facdc15c8e0 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.737+0000 7facd1ffb640 1 -- 172.21.15.83:0/1325971131 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7facd8012b90 con 0x7facdc15c8e0 2024-03-30T13:08:19.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.737+0000 7facd1ffb640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7facc0067fc0 0x7facc006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:19.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.737+0000 7facd1ffb640 1 -- 172.21.15.83:0/1325971131 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7facd8086590 con 0x7facdc15c8e0 2024-03-30T13:08:19.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.737+0000 7face139e640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7facc0067fc0 0x7facc006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:19.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.737+0000 7face139e640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7facc0067fc0 0x7facc006a480 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7facd40ae000 tx=0x7facd40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:19.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.741+0000 7facd1ffb640 1 -- 172.21.15.83:0/1325971131 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7facd8057090 con 0x7facdc15c8e0 2024-03-30T13:08:19.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.897+0000 7face3602640 1 -- 172.21.15.83:0/1325971131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7facdc06ebe0 con 0x7facdc15c8e0 2024-03-30T13:08:19.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.897+0000 7facd1ffb640 1 -- 172.21.15.83:0/1325971131 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7facd8056990 con 0x7facdc15c8e0 2024-03-30T13:08:19.905 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:08:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.901+0000 7face3602640 1 -- 172.21.15.83:0/1325971131 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7facc0067fc0 msgr2=0x7facc006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.901+0000 7face3602640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7facc0067fc0 0x7facc006a480 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7facd40ae000 tx=0x7facd40a7070 comp rx=0 tx=0).stop 2024-03-30T13:08:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.901+0000 7face3602640 1 -- 172.21.15.83:0/1325971131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facdc15c8e0 msgr2=0x7facdc0b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.901+0000 7face3602640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facdc15c8e0 0x7facdc0b0ed0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7facd800d560 tx=0x7facd800da20 comp rx=0 tx=0).stop 2024-03-30T13:08:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.901+0000 7face3602640 1 -- 172.21.15.83:0/1325971131 shutdown_connections 2024-03-30T13:08:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.901+0000 7face3602640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7facc0067fc0 0x7facc006a480 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.901+0000 7face3602640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facdc15c8e0 0x7facdc0b0ed0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.901+0000 7face3602640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facdc0b4680 0x7facdc14c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.901+0000 7face3602640 1 --2- 172.21.15.83:0/1325971131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facdc0adac0 0x7facdc164570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.901+0000 7face3602640 1 -- 172.21.15.83:0/1325971131 >> 172.21.15.83:0/1325971131 conn(0x7facdc06b660 msgr2=0x7facdc06de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.901+0000 7face3602640 1 -- 172.21.15.83:0/1325971131 shutdown_connections 2024-03-30T13:08:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:19.901+0000 7face3602640 1 -- 172.21.15.83:0/1325971131 wait complete. 2024-03-30T13:08:19.923 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:08:20.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8af23ba640 1 Processor -- start 2024-03-30T13:08:20.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8af23ba640 1 -- start start 2024-03-30T13:08:20.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8af23ba640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8aec0aed20 0x7f8aec0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:20.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8af23ba640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8aec06dfe0 0x7f8aec06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:20.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8af23ba640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aec0cfcb0 con 0x7f8aec0b4830 2024-03-30T13:08:20.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8af23ba640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f8aec156e00 con 0x7f8aec0aed20 2024-03-30T13:08:20.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8af23ba640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8aec0ad040 con 0x7f8aec06dfe0 2024-03-30T13:08:20.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8aeb7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8aec0aed20 0x7f8aec0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:20.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8aeb7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8aec0aed20 0x7f8aec0af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59238/0 (socket says 172.21.15.83:59238) 2024-03-30T13:08:20.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8aeb7fe640 1 -- 172.21.15.83:0/3961908020 learned_addr learned my addr 172.21.15.83:0/3961908020 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:20.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8aeb7fe640 1 -- 172.21.15.83:0/3961908020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8aec06dfe0 msgr2=0x7f8aec06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:20.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8aeb7fe640 1 --2- 172.21.15.83:0/3961908020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8aec06dfe0 0x7f8aec06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:20.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8aeb7fe640 1 -- 172.21.15.83:0/3961908020 >> v1:172.21.15.153:6789/0 conn(0x7f8aec0b4830 legacy=0x7f8aec15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:20.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8aeb7fe640 1 -- 172.21.15.83:0/3961908020 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aec0ad290 con 0x7f8aec0aed20 2024-03-30T13:08:20.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.029+0000 7f8aeb7fe640 1 --2- 172.21.15.83:0/3961908020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8aec0aed20 0x7f8aec0af1d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009870 tx=0x7f8ae001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f2f586a3e17fb0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:20.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aeaffd640 1 -- 172.21.15.83:0/3961908020 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00ab610 con 0x7f8aec0aed20 2024-03-30T13:08:20.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aeaffd640 1 -- 172.21.15.83:0/3961908020 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae00b0070 con 0x7f8aec0aed20 2024-03-30T13:08:20.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aeaffd640 1 -- 172.21.15.83:0/3961908020 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00ab9d0 con 0x7f8aec0aed20 2024-03-30T13:08:20.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 -- 172.21.15.83:0/3961908020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8aec0aed20 msgr2=0x7f8aec0af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:20.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 --2- 172.21.15.83:0/3961908020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8aec0aed20 0x7f8aec0af1d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009870 tx=0x7f8ae001c410 comp rx=0 tx=0).stop 2024-03-30T13:08:20.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 -- 172.21.15.83:0/3961908020 shutdown_connections 2024-03-30T13:08:20.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 --2- 172.21.15.83:0/3961908020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8aec06dfe0 0x7f8aec06e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:20.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 --2- 172.21.15.83:0/3961908020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8aec0aed20 0x7f8aec0af1d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:20.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 -- 172.21.15.83:0/3961908020 >> 172.21.15.83:0/3961908020 conn(0x7f8aec0b1d60 msgr2=0x7f8aec0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:20.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 -- 172.21.15.83:0/3961908020 shutdown_connections 2024-03-30T13:08:20.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 -- 172.21.15.83:0/3961908020 wait complete. 2024-03-30T13:08:20.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 Processor -- start 2024-03-30T13:08:20.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 -- start start 2024-03-30T13:08:20.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8aec06dfe0 0x7f8aec14d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:20.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8aec0aed20 0x7f8aec1f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:20.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aec0b4830 0x7f8aec14b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:20.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8aec0cf860 con 0x7f8aec0aed20 2024-03-30T13:08:20.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8aec06fa90 con 0x7f8aec0b4830 2024-03-30T13:08:20.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8aec0cf9e0 con 0x7f8aec06dfe0 2024-03-30T13:08:20.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aeb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8aec0aed20 0x7f8aec1f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:20.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aeb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8aec0aed20 0x7f8aec1f5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59248/0 (socket says 172.21.15.83:59248) 2024-03-30T13:08:20.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aeb7fe640 1 -- 172.21.15.83:0/1867239171 learned_addr learned my addr 172.21.15.83:0/1867239171 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:20.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aebfff640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8aec06dfe0 0x7f8aec14d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:20.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af0957640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aec0b4830 0x7f8aec14b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:20.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aeb7fe640 1 -- 172.21.15.83:0/1867239171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8aec06dfe0 msgr2=0x7f8aec14d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:20.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aeb7fe640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8aec06dfe0 0x7f8aec14d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:20.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aeb7fe640 1 -- 172.21.15.83:0/1867239171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aec0b4830 msgr2=0x7f8aec14b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:20.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aeb7fe640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aec0b4830 0x7f8aec14b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:20.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aeb7fe640 1 -- 172.21.15.83:0/1867239171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aec1f5c90 con 0x7f8aec0aed20 2024-03-30T13:08:20.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aebfff640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8aec06dfe0 0x7f8aec14d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:20.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8aeb7fe640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8aec0aed20 0x7f8aec1f5650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00ad040 tx=0x7f8ae001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:20.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8ae8ff9640 1 -- 172.21.15.83:0/1867239171 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00b4600 con 0x7f8aec0aed20 2024-03-30T13:08:20.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8ae8ff9640 1 -- 172.21.15.83:0/1867239171 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae00b47c0 con 0x7f8aec0aed20 2024-03-30T13:08:20.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 -- 172.21.15.83:0/1867239171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aec1f5f70 con 0x7f8aec0aed20 2024-03-30T13:08:20.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8ae8ff9640 1 -- 172.21.15.83:0/1867239171 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00b4bb0 con 0x7f8aec0aed20 2024-03-30T13:08:20.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.033+0000 7f8af23ba640 1 -- 172.21.15.83:0/1867239171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aec1f6530 con 0x7f8aec0aed20 2024-03-30T13:08:20.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.037+0000 7f8af23ba640 1 -- 172.21.15.83:0/1867239171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aec0686c0 con 0x7f8aec0aed20 2024-03-30T13:08:20.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.037+0000 7f8ae8ff9640 1 -- 172.21.15.83:0/1867239171 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f8ae00c7430 con 0x7f8aec0aed20 2024-03-30T13:08:20.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.037+0000 7f8ae8ff9640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8ad8067fc0 0x7f8ad806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:20.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.037+0000 7f8aebfff640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8ad8067fc0 0x7f8ad806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:20.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.037+0000 7f8ae8ff9640 1 -- 172.21.15.83:0/1867239171 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8ae0120d00 con 0x7f8aec0aed20 2024-03-30T13:08:20.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.037+0000 7f8aebfff640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8ad8067fc0 0x7f8ad806a480 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0afbb0 tx=0x7f8adc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:20.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.041+0000 7f8ae8ff9640 1 -- 172.21.15.83:0/1867239171 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f8ae00a8050 con 0x7f8aec0aed20 2024-03-30T13:08:20.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.233+0000 7f8af23ba640 1 -- 172.21.15.83:0/1867239171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8aec0b1700 con 0x7f8aec0aed20 2024-03-30T13:08:20.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8ae8ff9640 1 -- 172.21.15.83:0/1867239171 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f8ae0016150 con 0x7f8aec0aed20 2024-03-30T13:08:20.241 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:20.241 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2692566836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2692566836},{"type":"v1","addr":"172.21.15.83:6837","nonce":2692566836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-30T13:08:20.241 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 2 2024-03-30T13:08:20.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8af23ba640 1 -- 172.21.15.83:0/1867239171 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8ad8067fc0 msgr2=0x7f8ad806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:20.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8af23ba640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8ad8067fc0 0x7f8ad806a480 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0afbb0 tx=0x7f8adc009040 comp rx=0 tx=0).stop 2024-03-30T13:08:20.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8af23ba640 1 -- 172.21.15.83:0/1867239171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8aec0aed20 msgr2=0x7f8aec1f5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:20.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8af23ba640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8aec0aed20 0x7f8aec1f5650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00ad040 tx=0x7f8ae001ac50 comp rx=0 tx=0).stop 2024-03-30T13:08:20.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8af23ba640 1 -- 172.21.15.83:0/1867239171 shutdown_connections 2024-03-30T13:08:20.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8af23ba640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8ad8067fc0 0x7f8ad806a480 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:20.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8af23ba640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aec0b4830 0x7f8aec14b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:20.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8af23ba640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8aec0aed20 0x7f8aec1f5650 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:20.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8af23ba640 1 --2- 172.21.15.83:0/1867239171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8aec06dfe0 0x7f8aec14d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:20.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8af23ba640 1 -- 172.21.15.83:0/1867239171 >> 172.21.15.83:0/1867239171 conn(0x7f8aec0b1d60 msgr2=0x7f8aec14fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:20.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8af23ba640 1 -- 172.21.15.83:0/1867239171 shutdown_connections 2024-03-30T13:08:20.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:20.237+0000 7f8af23ba640 1 -- 172.21.15.83:0/1867239171 wait complete. 2024-03-30T13:08:22.258 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:08:22.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.381+0000 7ff00dedc640 1 Processor -- start 2024-03-30T13:08:22.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.381+0000 7ff00dedc640 1 -- start start 2024-03-30T13:08:22.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7ff00dedc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff0080d1890 0x7ff0080b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:22.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7ff00dedc640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0080ae650 con 0x7ff0080b5060 2024-03-30T13:08:22.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7ff00dedc640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0080d1e70 con 0x7ff00815b130 2024-03-30T13:08:22.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7ff00dedc640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff0080b54d0 con 0x7ff0080d1890 2024-03-30T13:08:22.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7feffeffd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff0080d1890 0x7ff0080b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:22.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7feffeffd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff0080d1890 0x7ff0080b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59258/0 (socket says 172.21.15.83:59258) 2024-03-30T13:08:22.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7feffeffd640 1 -- 172.21.15.83:0/1186632928 learned_addr learned my addr 172.21.15.83:0/1186632928 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:22.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7ff007fff640 1 --1- 172.21.15.83:0/1186632928 >> v1:172.21.15.83:6789/0 conn(0x7ff0080b5060 0x7ff0080af3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:35396/0 (socket says 172.21.15.83:35396) 2024-03-30T13:08:22.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7feffeffd640 1 -- 172.21.15.83:0/1186632928 >> v1:172.21.15.153:6789/0 conn(0x7ff00815b130 legacy=0x7ff0080b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:22.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7feffeffd640 1 -- 172.21.15.83:0/1186632928 >> v1:172.21.15.83:6789/0 conn(0x7ff0080b5060 legacy=0x7ff0080af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:22.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7ff006ffd640 1 -- 172.21.15.83:0/1186632928 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 342967492 0 0) 0x7ff0080ae650 con 0x7ff0080b5060 2024-03-30T13:08:22.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7feffeffd640 1 -- 172.21.15.83:0/1186632928 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0080ae8f0 con 0x7ff0080d1890 2024-03-30T13:08:22.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7feffeffd640 1 --2- 172.21.15.83:0/1186632928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0080d1890 0x7ff0080b4b20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feff0009870 tx=0x7feff001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1504686ad4b54724 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:22.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7ff006ffd640 1 -- 172.21.15.83:0/1186632928 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff00ab610 con 0x7ff0080d1890 2024-03-30T13:08:22.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7ff006ffd640 1 -- 172.21.15.83:0/1186632928 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feff00b0070 con 0x7ff0080d1890 2024-03-30T13:08:22.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.385+0000 7ff006ffd640 1 -- 172.21.15.83:0/1186632928 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff00ab9d0 con 0x7ff0080d1890 2024-03-30T13:08:22.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 -- 172.21.15.83:0/1186632928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0080d1890 msgr2=0x7ff0080b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:22.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 --2- 172.21.15.83:0/1186632928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0080d1890 0x7ff0080b4b20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feff0009870 tx=0x7feff001c520 comp rx=0 tx=0).stop 2024-03-30T13:08:22.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 -- 172.21.15.83:0/1186632928 shutdown_connections 2024-03-30T13:08:22.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 --2- 172.21.15.83:0/1186632928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0080d1890 0x7ff0080b4b20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 -- 172.21.15.83:0/1186632928 >> 172.21.15.83:0/1186632928 conn(0x7ff00809aa50 msgr2=0x7ff0080b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:22.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 -- 172.21.15.83:0/1186632928 shutdown_connections 2024-03-30T13:08:22.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 -- 172.21.15.83:0/1186632928 wait complete. 2024-03-30T13:08:22.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 Processor -- start 2024-03-30T13:08:22.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 -- start start 2024-03-30T13:08:22.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0080b5060 0x7ff008156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:22.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0080d1890 0x7ff0081477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:22.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff00815b130 0x7ff0080b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:22.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff0080b0470 con 0x7ff00815b130 2024-03-30T13:08:22.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff0080b02f0 con 0x7ff0080b5060 2024-03-30T13:08:22.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff0080b05f0 con 0x7ff0080d1890 2024-03-30T13:08:22.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff007fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff00815b130 0x7ff0080b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:22.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff007fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff00815b130 0x7ff0080b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59260/0 (socket says 172.21.15.83:59260) 2024-03-30T13:08:22.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff007fff640 1 -- 172.21.15.83:0/2813635561 learned_addr learned my addr 172.21.15.83:0/2813635561 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:22.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff0077fe640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0080b5060 0x7ff008156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:22.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7feffeffd640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0080d1890 0x7ff0081477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:22.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff007fff640 1 -- 172.21.15.83:0/2813635561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0080d1890 msgr2=0x7ff0081477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:22.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff007fff640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0080d1890 0x7ff0081477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff007fff640 1 -- 172.21.15.83:0/2813635561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0080b5060 msgr2=0x7ff008156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:22.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff007fff640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0080b5060 0x7ff008156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff007fff640 1 -- 172.21.15.83:0/2813635561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff008147f10 con 0x7ff00815b130 2024-03-30T13:08:22.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff0077fe640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0080b5060 0x7ff008156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:22.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff007fff640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff00815b130 0x7ff0080b1cb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c7d0 tx=0x7ff00000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:22.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff004ff9640 1 -- 172.21.15.83:0/2813635561 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000018070 con 0x7ff00815b130 2024-03-30T13:08:22.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff004ff9640 1 -- 172.21.15.83:0/2813635561 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff00000a640 con 0x7ff00815b130 2024-03-30T13:08:22.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 -- 172.21.15.83:0/2813635561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0081481f0 con 0x7ff00815b130 2024-03-30T13:08:22.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff004ff9640 1 -- 172.21.15.83:0/2813635561 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00000aa70 con 0x7ff00815b130 2024-03-30T13:08:22.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.389+0000 7ff00dedc640 1 -- 172.21.15.83:0/2813635561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0081577d0 con 0x7ff00815b130 2024-03-30T13:08:22.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.393+0000 7ff00dedc640 1 -- 172.21.15.83:0/2813635561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff008068dd0 con 0x7ff00815b130 2024-03-30T13:08:22.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.393+0000 7ff004ff9640 1 -- 172.21.15.83:0/2813635561 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff00001b070 con 0x7ff00815b130 2024-03-30T13:08:22.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.393+0000 7ff004ff9640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fefe8067fc0 0x7fefe806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:22.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.393+0000 7ff004ff9640 1 -- 172.21.15.83:0/2813635561 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff000085740 con 0x7ff00815b130 2024-03-30T13:08:22.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.393+0000 7ff0077fe640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fefe8067fc0 0x7fefe806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:22.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.393+0000 7ff0077fe640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fefe8067fc0 0x7fefe806a480 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feff800a850 tx=0x7feff8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:22.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.397+0000 7ff004ff9640 1 -- 172.21.15.83:0/2813635561 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff0000562d0 con 0x7ff00815b130 2024-03-30T13:08:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.593+0000 7ff00dedc640 1 -- 172.21.15.83:0/2813635561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0080b40d0 con 0x7ff00815b130 2024-03-30T13:08:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff004ff9640 1 -- 172.21.15.83:0/2813635561 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3864 (secure 0 0 0) 0x7ff000055bd0 con 0x7ff00815b130 2024-03-30T13:08:22.602 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:22.602 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2431286615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2431286615},{"type":"v1","addr":"172.21.15.153:6835","nonce":2431286615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1036905849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1036905849},{"type":"v1","addr":"172.21.15.83:6835","nonce":1036905849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2692566836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2692566836},{"type":"v1","addr":"172.21.15.83:6837","nonce":2692566836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/53727078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":53727078},{"type":"v1","addr":"172.21.15.153:6833","nonce":53727078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-30T13:08:22.602 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 3 2024-03-30T13:08:22.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff00dedc640 1 -- 172.21.15.83:0/2813635561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fefe8067fc0 msgr2=0x7fefe806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:22.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff00dedc640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fefe8067fc0 0x7fefe806a480 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feff800a850 tx=0x7feff8008040 comp rx=0 tx=0).stop 2024-03-30T13:08:22.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff00dedc640 1 -- 172.21.15.83:0/2813635561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff00815b130 msgr2=0x7ff0080b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:22.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff00dedc640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff00815b130 0x7ff0080b1cb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c7d0 tx=0x7ff00000cc90 comp rx=0 tx=0).stop 2024-03-30T13:08:22.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff00dedc640 1 -- 172.21.15.83:0/2813635561 shutdown_connections 2024-03-30T13:08:22.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff00dedc640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fefe8067fc0 0x7fefe806a480 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff00dedc640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff00815b130 0x7ff0080b1cb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff00dedc640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0080d1890 0x7ff0081477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff00dedc640 1 --2- 172.21.15.83:0/2813635561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0080b5060 0x7ff008156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff00dedc640 1 -- 172.21.15.83:0/2813635561 >> 172.21.15.83:0/2813635561 conn(0x7ff00809aa50 msgr2=0x7ff0080701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:22.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff00dedc640 1 -- 172.21.15.83:0/2813635561 shutdown_connections 2024-03-30T13:08:22.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.597+0000 7ff00dedc640 1 -- 172.21.15.83:0/2813635561 wait complete. 2024-03-30T13:08:22.620 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:22.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.733+0000 7fbe15b7f640 1 Processor -- start 2024-03-30T13:08:22.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.733+0000 7fbe15b7f640 1 -- start start 2024-03-30T13:08:22.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.733+0000 7fbe15b7f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe1015fb60 0x7fbe100d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:22.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.733+0000 7fbe15b7f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbe100ccc50 0x7fbe1009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:22.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.733+0000 7fbe15b7f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe100cd130 con 0x7fbe100b1200 2024-03-30T13:08:22.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.733+0000 7fbe15b7f640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbe100cd410 con 0x7fbe100ccc50 2024-03-30T13:08:22.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.733+0000 7fbe15b7f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbe100cd6f0 con 0x7fbe1015fb60 2024-03-30T13:08:22.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.733+0000 7fbe0f7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe1015fb60 0x7fbe100d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:22.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.733+0000 7fbe0f7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe1015fb60 0x7fbe100d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:46182/0 (socket says 172.21.15.83:46182) 2024-03-30T13:08:22.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.733+0000 7fbe0f7fe640 1 -- 172.21.15.83:0/2620934325 learned_addr learned my addr 172.21.15.83:0/2620934325 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:22.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.733+0000 7fbe0ffff640 1 --2- 172.21.15.83:0/2620934325 >> v2:172.21.15.153:3300/0 conn(0x7fbe100ccc50 0x7fbe1009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:22.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe0f7fe640 1 -- 172.21.15.83:0/2620934325 >> v2:172.21.15.153:3300/0 conn(0x7fbe100ccc50 msgr2=0x7fbe1009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:22.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe0f7fe640 1 --2- 172.21.15.83:0/2620934325 >> v2:172.21.15.153:3300/0 conn(0x7fbe100ccc50 0x7fbe1009aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe0f7fe640 1 -- 172.21.15.83:0/2620934325 >> v1:172.21.15.153:6789/0 conn(0x7fbe100b1200 legacy=0x7fbe100af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:22.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe0f7fe640 1 -- 172.21.15.83:0/2620934325 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe100cd9d0 con 0x7fbe1015fb60 2024-03-30T13:08:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe0f7fe640 1 --2- 172.21.15.83:0/2620934325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe1015fb60 0x7fbe100d0cf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009870 tx=0x7fbe0001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d811c6d60de669fb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe0e7fc640 1 -- 172.21.15.83:0/2620934325 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe000b0070 con 0x7fbe1015fb60 2024-03-30T13:08:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe0e7fc640 1 -- 172.21.15.83:0/2620934325 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe000ab600 con 0x7fbe1015fb60 2024-03-30T13:08:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe0e7fc640 1 -- 172.21.15.83:0/2620934325 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe000ab9d0 con 0x7fbe1015fb60 2024-03-30T13:08:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe15b7f640 1 -- 172.21.15.83:0/2620934325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe1015fb60 msgr2=0x7fbe100d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe15b7f640 1 --2- 172.21.15.83:0/2620934325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe1015fb60 0x7fbe100d0cf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009870 tx=0x7fbe0001c410 comp rx=0 tx=0).stop 2024-03-30T13:08:22.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe15b7f640 1 -- 172.21.15.83:0/2620934325 shutdown_connections 2024-03-30T13:08:22.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe15b7f640 1 --2- 172.21.15.83:0/2620934325 >> v2:172.21.15.153:3300/0 conn(0x7fbe100ccc50 0x7fbe1009aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe15b7f640 1 --2- 172.21.15.83:0/2620934325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe1015fb60 0x7fbe100d0cf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe15b7f640 1 -- 172.21.15.83:0/2620934325 >> 172.21.15.83:0/2620934325 conn(0x7fbe100b3dd0 msgr2=0x7fbe100b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:22.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe15b7f640 1 -- 172.21.15.83:0/2620934325 shutdown_connections 2024-03-30T13:08:22.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.737+0000 7fbe15b7f640 1 -- 172.21.15.83:0/2620934325 wait complete. 2024-03-30T13:08:22.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe15b7f640 1 Processor -- start 2024-03-30T13:08:22.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe15b7f640 1 -- start start 2024-03-30T13:08:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe15b7f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe100b1200 0x7fbe101557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe15b7f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe100ccc50 0x7fbe1015da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe15b7f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe1015fb60 0x7fbe100b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe15b7f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbe101697b0 con 0x7fbe100b1200 2024-03-30T13:08:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe15b7f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe10169630 con 0x7fbe1015fb60 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe15b7f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbe10169930 con 0x7fbe100ccc50 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe0f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe100b1200 0x7fbe101557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe0f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe100b1200 0x7fbe101557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59272/0 (socket says 172.21.15.83:59272) 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe0f7fe640 1 -- 172.21.15.83:0/3350106709 learned_addr learned my addr 172.21.15.83:0/3350106709 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe0ffff640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe1015fb60 0x7fbe100b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe0effd640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe100ccc50 0x7fbe1015da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe0f7fe640 1 -- 172.21.15.83:0/3350106709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe100ccc50 msgr2=0x7fbe1015da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe0f7fe640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe100ccc50 0x7fbe1015da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe0f7fe640 1 -- 172.21.15.83:0/3350106709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe1015fb60 msgr2=0x7fbe100b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe0f7fe640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe1015fb60 0x7fbe100b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe0f7fe640 1 -- 172.21.15.83:0/3350106709 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe100cb960 con 0x7fbe100b1200 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe0f7fe640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe100b1200 0x7fbe101557a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbe000ae040 tx=0x7fbe000191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbdf7fff640 1 -- 172.21.15.83:0/3350106709 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe000b0040 con 0x7fbe100b1200 2024-03-30T13:08:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbdf7fff640 1 -- 172.21.15.83:0/3350106709 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe000b4410 con 0x7fbe100b1200 2024-03-30T13:08:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe15b7f640 1 -- 172.21.15.83:0/3350106709 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe100cbc40 con 0x7fbe100b1200 2024-03-30T13:08:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbdf7fff640 1 -- 172.21.15.83:0/3350106709 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe000b4820 con 0x7fbe100b1200 2024-03-30T13:08:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe15b7f640 1 -- 172.21.15.83:0/3350106709 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe100cc200 con 0x7fbe100b1200 2024-03-30T13:08:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.741+0000 7fbe15b7f640 1 -- 172.21.15.83:0/3350106709 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe10068dd0 con 0x7fbe100b1200 2024-03-30T13:08:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.745+0000 7fbdf7fff640 1 -- 172.21.15.83:0/3350106709 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fbe000b49c0 con 0x7fbe100b1200 2024-03-30T13:08:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.745+0000 7fbdf7fff640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbdfc067ff0 0x7fbdfc06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.745+0000 7fbdf7fff640 1 -- 172.21.15.83:0/3350106709 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fbe001200d0 con 0x7fbe100b1200 2024-03-30T13:08:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.745+0000 7fbe0effd640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbdfc067ff0 0x7fbdfc06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.745+0000 7fbe0effd640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbdfc067ff0 0x7fbdfc06a4b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe1015f220 tx=0x7fbe04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:22.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.749+0000 7fbdf7fff640 1 -- 172.21.15.83:0/3350106709 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fbe00016150 con 0x7fbe100b1200 2024-03-30T13:08:22.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.901+0000 7fbe15b7f640 1 -- 172.21.15.83:0/3350106709 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe100b8260 con 0x7fbe100b1200 2024-03-30T13:08:22.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.901+0000 7fbdf7fff640 1 -- 172.21.15.83:0/3350106709 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7fbe000f0c60 con 0x7fbe100b1200 2024-03-30T13:08:22.909 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:22.909 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":17,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:14.320840+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:22.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.905+0000 7fbe15b7f640 1 -- 172.21.15.83:0/3350106709 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbdfc067ff0 msgr2=0x7fbdfc06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.905+0000 7fbe15b7f640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbdfc067ff0 0x7fbdfc06a4b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe1015f220 tx=0x7fbe04009040 comp rx=0 tx=0).stop 2024-03-30T13:08:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.905+0000 7fbe15b7f640 1 -- 172.21.15.83:0/3350106709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe100b1200 msgr2=0x7fbe101557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.905+0000 7fbe15b7f640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe100b1200 0x7fbe101557a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbe000ae040 tx=0x7fbe000191b0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.905+0000 7fbe15b7f640 1 -- 172.21.15.83:0/3350106709 shutdown_connections 2024-03-30T13:08:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.905+0000 7fbe15b7f640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbdfc067ff0 0x7fbdfc06a4b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.905+0000 7fbe15b7f640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe1015fb60 0x7fbe100b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.905+0000 7fbe15b7f640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe100ccc50 0x7fbe1015da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.905+0000 7fbe15b7f640 1 --2- 172.21.15.83:0/3350106709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe100b1200 0x7fbe101557a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.905+0000 7fbe15b7f640 1 -- 172.21.15.83:0/3350106709 >> 172.21.15.83:0/3350106709 conn(0x7fbe100b3dd0 msgr2=0x7fbe100b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.905+0000 7fbe15b7f640 1 -- 172.21.15.83:0/3350106709 shutdown_connections 2024-03-30T13:08:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:22.905+0000 7fbe15b7f640 1 -- 172.21.15.83:0/3350106709 wait complete. 2024-03-30T13:08:22.926 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:08:22.927 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:08:23.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.041+0000 7f641bed4640 1 Processor -- start 2024-03-30T13:08:23.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641bed4640 1 -- start start 2024-03-30T13:08:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641bed4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641415a8b0 0x7f6414072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641bed4640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6414071830 con 0x7f64140b4d90 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641bed4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6414071ad0 con 0x7f6414072f20 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641bed4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6414071db0 con 0x7f641415a8b0 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641a471640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f64140b4d90 0x7f64140ae5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:35406/0 (socket says 172.21.15.83:35406) 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641a471640 1 -- 172.21.15.83:0/3854157300 learned_addr learned my addr 172.21.15.83:0/3854157300 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6419c70640 1 --2- 172.21.15.83:0/3854157300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641415a8b0 0x7f6414072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701989560 0 0) 0x7f6414071830 con 0x7f64140b4d90 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6400003530 con 0x7f64140b4d90 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4228084723 0 0) 0x7f6400003530 con 0x7f64140b4d90 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641415a8b0 msgr2=0x7f6414072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 --2- 172.21.15.83:0/3854157300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641415a8b0 0x7f6414072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 >> v1:172.21.15.153:6789/0 conn(0x7f6414072f20 legacy=0x7f64140b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6414072090 con 0x7f64140b4d90 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f640c001a20 con 0x7f64140b4d90 2024-03-30T13:08:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 >> v1:172.21.15.83:6789/0 conn(0x7f64140b4d90 legacy=0x7f64140ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 --2- 172.21.15.83:0/3854157300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64000039f0 0x7f6400003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 --2- 172.21.15.83:0/3854157300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6400004810 0x7f6400004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 --2- 172.21.15.83:0/3854157300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641415a8b0 0x7f64000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6414071db0 con 0x7f6400004810 2024-03-30T13:08:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f640000ba80 con 0x7f64000039f0 2024-03-30T13:08:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f640000bc80 con 0x7f641415a8b0 2024-03-30T13:08:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641946f640 1 --2- 172.21.15.83:0/3854157300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6400004810 0x7f6400004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f6419c70640 1 --2- 172.21.15.83:0/3854157300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64000039f0 0x7f6400003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641a471640 1 --2- 172.21.15.83:0/3854157300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641415a8b0 0x7f64000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641946f640 1 -- 172.21.15.83:0/3854157300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641415a8b0 msgr2=0x7f64000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641946f640 1 --2- 172.21.15.83:0/3854157300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641415a8b0 0x7f64000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641946f640 1 -- 172.21.15.83:0/3854157300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64000039f0 msgr2=0x7f6400003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:23.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641946f640 1 --2- 172.21.15.83:0/3854157300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64000039f0 0x7f6400003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.045+0000 7f641946f640 1 -- 172.21.15.83:0/3854157300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6400003530 con 0x7f6400004810 2024-03-30T13:08:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641946f640 1 --2- 172.21.15.83:0/3854157300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6400004810 0x7f6400004c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6410001750 tx=0x7f641001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac1f2415b0b6f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64100013a0 con 0x7f6400004810 2024-03-30T13:08:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64100052f0 con 0x7f6400004810 2024-03-30T13:08:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f6418c6e640 1 -- 172.21.15.83:0/3854157300 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410003840 con 0x7f6400004810 2024-03-30T13:08:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 -- 172.21.15.83:0/3854157300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6400004810 msgr2=0x7f6400004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 --2- 172.21.15.83:0/3854157300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6400004810 0x7f6400004c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6410001750 tx=0x7f641001c3c0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641a471640 1 -- 172.21.15.83:0/3854157300 reap_dead start 2024-03-30T13:08:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 -- 172.21.15.83:0/3854157300 shutdown_connections 2024-03-30T13:08:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 -- 172.21.15.83:0/3854157300 >> 172.21.15.83:0/3854157300 conn(0x7f641406b660 msgr2=0x7f641406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 -- 172.21.15.83:0/3854157300 shutdown_connections 2024-03-30T13:08:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 -- 172.21.15.83:0/3854157300 wait complete. 2024-03-30T13:08:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 Processor -- start 2024-03-30T13:08:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 -- start start 2024-03-30T13:08:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6400004810 0x7f64141496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6414158c80 0x7f6414159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641409c1f0 0x7f641409c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f641415ae10 con 0x7f6414158c80 2024-03-30T13:08:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f641415ac90 con 0x7f6400004810 2024-03-30T13:08:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641bed4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6414072890 con 0x7f641409c1f0 2024-03-30T13:08:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641946f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6414158c80 0x7f6414159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641946f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6414158c80 0x7f6414159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59292/0 (socket says 172.21.15.83:59292) 2024-03-30T13:08:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.049+0000 7f641946f640 1 -- 172.21.15.83:0/2452160397 learned_addr learned my addr 172.21.15.83:0/2452160397 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f641a471640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641409c1f0 0x7f641409c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f6419c70640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6400004810 0x7f64141496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f641946f640 1 -- 172.21.15.83:0/2452160397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641409c1f0 msgr2=0x7f641409c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f641946f640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641409c1f0 0x7f641409c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f641946f640 1 -- 172.21.15.83:0/2452160397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6400004810 msgr2=0x7f64141496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f641946f640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6400004810 0x7f64141496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f641946f640 1 -- 172.21.15.83:0/2452160397 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641409ace0 con 0x7f6414158c80 2024-03-30T13:08:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f641946f640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6414158c80 0x7f6414159100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6410005040 tx=0x7f6400005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f640a7fc640 1 -- 172.21.15.83:0/2452160397 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64100054a0 con 0x7f6414158c80 2024-03-30T13:08:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f640a7fc640 1 -- 172.21.15.83:0/2452160397 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64100bb070 con 0x7f6414158c80 2024-03-30T13:08:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f641bed4640 1 -- 172.21.15.83:0/2452160397 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641409afc0 con 0x7f6414158c80 2024-03-30T13:08:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f640a7fc640 1 -- 172.21.15.83:0/2452160397 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64100069e0 con 0x7f6414158c80 2024-03-30T13:08:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f641bed4640 1 -- 172.21.15.83:0/2452160397 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f641409b580 con 0x7f6414158c80 2024-03-30T13:08:23.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f641bed4640 1 -- 172.21.15.83:0/2452160397 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641409e540 con 0x7f6414158c80 2024-03-30T13:08:23.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f640a7fc640 1 -- 172.21.15.83:0/2452160397 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f64100b4040 con 0x7f6414158c80 2024-03-30T13:08:23.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f640a7fc640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f63f8067ff0 0x7f63f806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f640a7fc640 1 -- 172.21.15.83:0/2452160397 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6410120790 con 0x7f6414158c80 2024-03-30T13:08:23.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f6419c70640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f63f8067ff0 0x7f63f806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.053+0000 7f6419c70640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f63f8067ff0 0x7f63f806a4b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6404010ad0 tx=0x7f6404008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:23.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.057+0000 7f640a7fc640 1 -- 172.21.15.83:0/2452160397 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f64100160d0 con 0x7f6414158c80 2024-03-30T13:08:23.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.209+0000 7f641bed4640 1 -- 172.21.15.83:0/2452160397 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f641406bc20 con 0x7f6414158c80 2024-03-30T13:08:23.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f640a7fc640 1 -- 172.21.15.83:0/2452160397 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f64100aa3a0 con 0x7f6414158c80 2024-03-30T13:08:23.217 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:08:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f641bed4640 1 -- 172.21.15.83:0/2452160397 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f63f8067ff0 msgr2=0x7f63f806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f641bed4640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f63f8067ff0 0x7f63f806a4b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6404010ad0 tx=0x7f6404008040 comp rx=0 tx=0).stop 2024-03-30T13:08:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f641bed4640 1 -- 172.21.15.83:0/2452160397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6414158c80 msgr2=0x7f6414159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f641bed4640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6414158c80 0x7f6414159100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6410005040 tx=0x7f6400005840 comp rx=0 tx=0).stop 2024-03-30T13:08:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f641bed4640 1 -- 172.21.15.83:0/2452160397 shutdown_connections 2024-03-30T13:08:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f641bed4640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f63f8067ff0 0x7f63f806a4b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f641bed4640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641409c1f0 0x7f641409c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f641bed4640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6414158c80 0x7f6414159100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f641bed4640 1 --2- 172.21.15.83:0/2452160397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6400004810 0x7f64141496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f641bed4640 1 -- 172.21.15.83:0/2452160397 >> 172.21.15.83:0/2452160397 conn(0x7f641406b660 msgr2=0x7f641406e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f641bed4640 1 -- 172.21.15.83:0/2452160397 shutdown_connections 2024-03-30T13:08:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.213+0000 7f641bed4640 1 -- 172.21.15.83:0/2452160397 wait complete. 2024-03-30T13:08:23.236 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-30T13:08:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa3814f4640 1 Processor -- start 2024-03-30T13:08:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa3814f4640 1 -- start start 2024-03-30T13:08:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa3814f4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa37c0aed20 0x7fa37c0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa3814f4640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37c0cfcb0 con 0x7fa37c06dfe0 2024-03-30T13:08:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa3814f4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37c0ad290 con 0x7fa37c0b4830 2024-03-30T13:08:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa3814f4640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fa37c156e00 con 0x7fa37c0aed20 2024-03-30T13:08:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa37a7fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa37c0aed20 0x7fa37c0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa37a7fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa37c0aed20 0x7fa37c0af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59296/0 (socket says 172.21.15.83:59296) 2024-03-30T13:08:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa37a7fc640 1 -- 172.21.15.83:0/2509331876 learned_addr learned my addr 172.21.15.83:0/2509331876 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa37a7fc640 1 -- 172.21.15.83:0/2509331876 >> v1:172.21.15.153:6789/0 conn(0x7fa37c0b4830 legacy=0x7fa37c15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa37a7fc640 1 -- 172.21.15.83:0/2509331876 >> v1:172.21.15.83:6789/0 conn(0x7fa37c06dfe0 legacy=0x7fa37c06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa37a7fc640 1 -- 172.21.15.83:0/2509331876 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c0ad570 con 0x7fa37c0aed20 2024-03-30T13:08:23.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.337+0000 7fa37a7fc640 1 --2- 172.21.15.83:0/2509331876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37c0aed20 0x7fa37c0af1d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009870 tx=0x7fa36c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c528bb16d5aa1b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:23.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa379ffb640 1 -- 172.21.15.83:0/2509331876 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0b0070 con 0x7fa37c0aed20 2024-03-30T13:08:23.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa379ffb640 1 -- 172.21.15.83:0/2509331876 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c0ab600 con 0x7fa37c0aed20 2024-03-30T13:08:23.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa379ffb640 1 -- 172.21.15.83:0/2509331876 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0ab9d0 con 0x7fa37c0aed20 2024-03-30T13:08:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 -- 172.21.15.83:0/2509331876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37c0aed20 msgr2=0x7fa37c0af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 --2- 172.21.15.83:0/2509331876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37c0aed20 0x7fa37c0af1d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009870 tx=0x7fa36c01c400 comp rx=0 tx=0).stop 2024-03-30T13:08:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 -- 172.21.15.83:0/2509331876 shutdown_connections 2024-03-30T13:08:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 --2- 172.21.15.83:0/2509331876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37c0aed20 0x7fa37c0af1d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 -- 172.21.15.83:0/2509331876 >> 172.21.15.83:0/2509331876 conn(0x7fa37c0b1d60 msgr2=0x7fa37c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 -- 172.21.15.83:0/2509331876 shutdown_connections 2024-03-30T13:08:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 -- 172.21.15.83:0/2509331876 wait complete. 2024-03-30T13:08:23.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 Processor -- start 2024-03-30T13:08:23.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 -- start start 2024-03-30T13:08:23.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa37c06dfe0 0x7fa37c14e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa37c0aed20 0x7fa37c099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37c0b4830 0x7fa37c09a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c0cf9e0 con 0x7fa37c0b4830 2024-03-30T13:08:23.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c0cf860 con 0x7fa37c0aed20 2024-03-30T13:08:23.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa37c16a290 con 0x7fa37c06dfe0 2024-03-30T13:08:23.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa37b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37c0b4830 0x7fa37c09a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa37b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37c0b4830 0x7fa37c09a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59304/0 (socket says 172.21.15.83:59304) 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa37b7fe640 1 -- 172.21.15.83:0/794590243 learned_addr learned my addr 172.21.15.83:0/794590243 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa37a7fc640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa37c0aed20 0x7fa37c099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa37affd640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa37c06dfe0 0x7fa37c14e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa37b7fe640 1 -- 172.21.15.83:0/794590243 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa37c06dfe0 msgr2=0x7fa37c14e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa37b7fe640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa37c06dfe0 0x7fa37c14e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa37b7fe640 1 -- 172.21.15.83:0/794590243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa37c0aed20 msgr2=0x7fa37c099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa37b7fe640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa37c0aed20 0x7fa37c099a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa37b7fe640 1 -- 172.21.15.83:0/794590243 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c14e880 con 0x7fa37c0b4830 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa37affd640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa37c06dfe0 0x7fa37c14e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa37b7fe640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37c0b4830 0x7fa37c09a1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa37400c730 tx=0x7fa37400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3637fe640 1 -- 172.21.15.83:0/794590243 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374003b80 con 0x7fa37c0b4830 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3637fe640 1 -- 172.21.15.83:0/794590243 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa374003d20 con 0x7fa37c0b4830 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 -- 172.21.15.83:0/794590243 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37c14eb60 con 0x7fa37c0b4830 2024-03-30T13:08:23.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3637fe640 1 -- 172.21.15.83:0/794590243 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374005310 con 0x7fa37c0b4830 2024-03-30T13:08:23.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.341+0000 7fa3814f4640 1 -- 172.21.15.83:0/794590243 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37c14f120 con 0x7fa37c0b4830 2024-03-30T13:08:23.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.345+0000 7fa3814f4640 1 -- 172.21.15.83:0/794590243 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa37c0686c0 con 0x7fa37c0b4830 2024-03-30T13:08:23.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.345+0000 7fa3637fe640 1 -- 172.21.15.83:0/794590243 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa3740056c0 con 0x7fa37c0b4830 2024-03-30T13:08:23.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.345+0000 7fa3637fe640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa368067fc0 0x7fa36806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.345+0000 7fa37affd640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa368067fc0 0x7fa36806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.345+0000 7fa3637fe640 1 -- 172.21.15.83:0/794590243 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa3740861e0 con 0x7fa37c0b4830 2024-03-30T13:08:23.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.345+0000 7fa37affd640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa368067fc0 0x7fa36806a480 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa370003e40 tx=0x7fa370009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:23.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.349+0000 7fa3637fe640 1 -- 172.21.15.83:0/794590243 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fa374056ce0 con 0x7fa37c0b4830 2024-03-30T13:08:23.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.505+0000 7fa3814f4640 1 -- 172.21.15.83:0/794590243 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa37c0b4ca0 con 0x7fa37c0b4830 2024-03-30T13:08:23.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.505+0000 7fa3637fe640 1 -- 172.21.15.83:0/794590243 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fa3740565e0 con 0x7fa37c0b4830 2024-03-30T13:08:23.512 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:23.512 INFO:teuthology.orchestra.run.smithi083.stdout:[ 2024-03-30T13:08:23.512 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:08:23.512 INFO:teuthology.orchestra.run.smithi083.stdout: "poolnum": 1, 2024-03-30T13:08:23.512 INFO:teuthology.orchestra.run.smithi083.stdout: "poolname": ".mgr" 2024-03-30T13:08:23.512 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:08:23.512 INFO:teuthology.orchestra.run.smithi083.stdout:] 2024-03-30T13:08:23.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.509+0000 7fa3814f4640 1 -- 172.21.15.83:0/794590243 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa368067fc0 msgr2=0x7fa36806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.509+0000 7fa3814f4640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa368067fc0 0x7fa36806a480 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa370003e40 tx=0x7fa370009040 comp rx=0 tx=0).stop 2024-03-30T13:08:23.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.509+0000 7fa3814f4640 1 -- 172.21.15.83:0/794590243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37c0b4830 msgr2=0x7fa37c09a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.509+0000 7fa3814f4640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37c0b4830 0x7fa37c09a1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa37400c730 tx=0x7fa37400cbf0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.509+0000 7fa3814f4640 1 -- 172.21.15.83:0/794590243 shutdown_connections 2024-03-30T13:08:23.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.509+0000 7fa3814f4640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa368067fc0 0x7fa36806a480 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.509+0000 7fa3814f4640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37c0b4830 0x7fa37c09a1c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.509+0000 7fa3814f4640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa37c0aed20 0x7fa37c099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.509+0000 7fa3814f4640 1 --2- 172.21.15.83:0/794590243 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa37c06dfe0 0x7fa37c14e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.509+0000 7fa3814f4640 1 -- 172.21.15.83:0/794590243 >> 172.21.15.83:0/794590243 conn(0x7fa37c0b1d60 msgr2=0x7fa37c0b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:23.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.509+0000 7fa3814f4640 1 -- 172.21.15.83:0/794590243 shutdown_connections 2024-03-30T13:08:23.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.509+0000 7fa3814f4640 1 -- 172.21.15.83:0/794590243 wait complete. 2024-03-30T13:08:23.528 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-30T13:08:23.528 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-30T13:08:23.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f22969d5640 1 Processor -- start 2024-03-30T13:08:23.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f22969d5640 1 -- start start 2024-03-30T13:08:23.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f22969d5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22900d0290 0x7f22900af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f22969d5640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f22900d0670 0x7f229015cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f22969d5640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22900ad490 con 0x7f22900738a0 2024-03-30T13:08:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f22969d5640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f22900ad770 con 0x7f22900d0670 2024-03-30T13:08:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f22969d5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f22900cf790 con 0x7f22900d0290 2024-03-30T13:08:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228f7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f22900738a0 0x7f229006d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:35426/0 (socket says 172.21.15.83:35426) 2024-03-30T13:08:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228f7fe640 1 -- 172.21.15.83:0/175176354 learned_addr learned my addr 172.21.15.83:0/175176354 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f2294f72640 1 --2- 172.21.15.83:0/175176354 >> v2:172.21.15.153:3300/0 conn(0x7f22900d0670 0x7f229015cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228ffff640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22900d0290 0x7f22900af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766603786 0 0) 0x7f22900ad490 con 0x7f22900738a0 2024-03-30T13:08:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2278003530 con 0x7f22900738a0 2024-03-30T13:08:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 30391704 0 0) 0x7f2278003530 con 0x7f22900738a0 2024-03-30T13:08:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22900d0290 msgr2=0x7f22900af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22900d0290 0x7f22900af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 >> v2:172.21.15.153:3300/0 conn(0x7f22900d0670 msgr2=0x7f229015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 --2- 172.21.15.83:0/175176354 >> v2:172.21.15.153:3300/0 conn(0x7f22900d0670 0x7f229015cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22900cfa70 con 0x7f22900738a0 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f2284001680 con 0x7f22900738a0 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 >> v1:172.21.15.83:6789/0 conn(0x7f22900738a0 legacy=0x7f229006d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22780039c0 0x7f2278003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22900d0290 0x7f2278004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2278004d50 0x7f22780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f22900ad770 con 0x7f22780039c0 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f22900cf790 con 0x7f2278004d50 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f227800b9d0 con 0x7f22900d0290 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228ffff640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22780039c0 0x7f2278003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228f7fe640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22900d0290 0x7f2278004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f2294f72640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2278004d50 0x7f22780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228ffff640 1 -- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22900d0290 msgr2=0x7f2278004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:23.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228ffff640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22900d0290 0x7f2278004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228ffff640 1 -- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2278004d50 msgr2=0x7f22780051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:23.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228ffff640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2278004d50 0x7f22780051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228ffff640 1 -- 172.21.15.83:0/175176354 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2278003530 con 0x7f22780039c0 2024-03-30T13:08:23.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f228f7fe640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22900d0290 0x7f2278004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:23.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.649+0000 7f2294f72640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2278004d50 0x7f22780051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f228ffff640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22780039c0 0x7f2278003de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2280009ae0 tx=0x7f228001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25317d9713caa03 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22800096b0 con 0x7f22780039c0 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22800a64a0 con 0x7f22780039c0 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f228effd640 1 -- 172.21.15.83:0/175176354 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22800a6890 con 0x7f22780039c0 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f22969d5640 1 -- 172.21.15.83:0/175176354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22780039c0 msgr2=0x7f2278003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f22969d5640 1 --2- 172.21.15.83:0/175176354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22780039c0 0x7f2278003de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2280009ae0 tx=0x7f228001ca40 comp rx=0 tx=0).stop 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f2294f72640 1 -- 172.21.15.83:0/175176354 reap_dead start 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f22969d5640 1 -- 172.21.15.83:0/175176354 shutdown_connections 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f22969d5640 1 -- 172.21.15.83:0/175176354 >> 172.21.15.83:0/175176354 conn(0x7f22900b21d0 msgr2=0x7f22900b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f22969d5640 1 -- 172.21.15.83:0/175176354 shutdown_connections 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f22969d5640 1 -- 172.21.15.83:0/175176354 wait complete. 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f22969d5640 1 Processor -- start 2024-03-30T13:08:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.653+0000 7f22969d5640 1 -- start start 2024-03-30T13:08:23.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f22969d5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229015eac0 0x7f229014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f22969d5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f229015dcd0 0x7f2290151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f22969d5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2290071cd0 0x7f2290072180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f22969d5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f22900d0c00 con 0x7f229015eac0 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f22969d5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f22900d0a80 con 0x7f229015dcd0 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f22969d5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2290167240 con 0x7f2290071cd0 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229015eac0 0x7f229014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229015eac0 0x7f229014d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59324/0 (socket says 172.21.15.83:59324) 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228ffff640 1 -- 172.21.15.83:0/1254095249 learned_addr learned my addr 172.21.15.83:0/1254095249 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228ffff640 1 -- 172.21.15.83:0/1254095249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2290071cd0 msgr2=0x7f2290072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228f7fe640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f229015dcd0 0x7f2290151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228ffff640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2290071cd0 0x7f2290072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228ffff640 1 -- 172.21.15.83:0/1254095249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f229015dcd0 msgr2=0x7f2290151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228ffff640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f229015dcd0 0x7f2290151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228ffff640 1 -- 172.21.15.83:0/1254095249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229015eea0 con 0x7f229015eac0 2024-03-30T13:08:23.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228ffff640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229015eac0 0x7f229014d380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2280009ae0 tx=0x7f22800197e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228cff9640 1 -- 172.21.15.83:0/1254095249 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22800a6bd0 con 0x7f229015eac0 2024-03-30T13:08:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228cff9640 1 -- 172.21.15.83:0/1254095249 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22800a6d70 con 0x7f229015eac0 2024-03-30T13:08:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f22969d5640 1 -- 172.21.15.83:0/1254095249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22900b0fc0 con 0x7f229015eac0 2024-03-30T13:08:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228cff9640 1 -- 172.21.15.83:0/1254095249 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280004260 con 0x7f229015eac0 2024-03-30T13:08:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f22969d5640 1 -- 172.21.15.83:0/1254095249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22900b1580 con 0x7f229015eac0 2024-03-30T13:08:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f22969d5640 1 -- 172.21.15.83:0/1254095249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22900686c0 con 0x7f229015eac0 2024-03-30T13:08:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228cff9640 1 -- 172.21.15.83:0/1254095249 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2280003620 con 0x7f229015eac0 2024-03-30T13:08:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228cff9640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f227c067ff0 0x7f227c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228cff9640 1 -- 172.21.15.83:0/1254095249 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2280120200 con 0x7f229015eac0 2024-03-30T13:08:23.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228f7fe640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f227c067ff0 0x7f227c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:23.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.657+0000 7f228f7fe640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f227c067ff0 0x7f227c06a4b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2284001210 tx=0x7f2284009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.661+0000 7f228cff9640 1 -- 172.21.15.83:0/1254095249 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f22800ac020 con 0x7f229015eac0 2024-03-30T13:08:23.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:23.813+0000 7f22969d5640 1 -- 172.21.15.83:0/1254095249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f22900cf570 con 0x7f229015eac0 2024-03-30T13:08:24.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.209+0000 7f228cff9640 1 -- 172.21.15.83:0/1254095249 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f2280016780 con 0x7f229015eac0 2024-03-30T13:08:24.215 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' created 2024-03-30T13:08:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.213+0000 7f22969d5640 1 -- 172.21.15.83:0/1254095249 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f227c067ff0 msgr2=0x7f227c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.213+0000 7f22969d5640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f227c067ff0 0x7f227c06a4b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2284001210 tx=0x7f2284009040 comp rx=0 tx=0).stop 2024-03-30T13:08:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.213+0000 7f22969d5640 1 -- 172.21.15.83:0/1254095249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229015eac0 msgr2=0x7f229014d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.213+0000 7f22969d5640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229015eac0 0x7f229014d380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2280009ae0 tx=0x7f22800197e0 comp rx=0 tx=0).stop 2024-03-30T13:08:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.213+0000 7f22969d5640 1 -- 172.21.15.83:0/1254095249 shutdown_connections 2024-03-30T13:08:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.213+0000 7f22969d5640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f227c067ff0 0x7f227c06a4b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.213+0000 7f22969d5640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2290071cd0 0x7f2290072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:24.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.213+0000 7f22969d5640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f229015dcd0 0x7f2290151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:24.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.213+0000 7f22969d5640 1 --2- 172.21.15.83:0/1254095249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229015eac0 0x7f229014d380 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:24.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.213+0000 7f22969d5640 1 -- 172.21.15.83:0/1254095249 >> 172.21.15.83:0/1254095249 conn(0x7f22900b21d0 msgr2=0x7f22900b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:24.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.213+0000 7f22969d5640 1 -- 172.21.15.83:0/1254095249 shutdown_connections 2024-03-30T13:08:24.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.213+0000 7f22969d5640 1 -- 172.21.15.83:0/1254095249 wait complete. 2024-03-30T13:08:24.242 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-30T13:08:24.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17d64dd640 1 Processor -- start 2024-03-30T13:08:24.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17d64dd640 1 -- start start 2024-03-30T13:08:24.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17d64dd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17d015c8e0 0x7f17d00ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:24.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17d64dd640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17d00ae040 con 0x7f17d00adac0 2024-03-30T13:08:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17d64dd640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17d00ae320 con 0x7f17d00b4680 2024-03-30T13:08:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17d64dd640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f17d00b31e0 con 0x7f17d015c8e0 2024-03-30T13:08:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17cf7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f17d00adac0 0x7f17d015ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:35434/0 (socket says 172.21.15.83:35434) 2024-03-30T13:08:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17cf7fe640 1 -- 172.21.15.83:0/1637080094 learned_addr learned my addr 172.21.15.83:0/1637080094 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149119509 0 0) 0x7f17d00ae040 con 0x7f17d00adac0 2024-03-30T13:08:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17cffff640 1 --2- 172.21.15.83:0/1637080094 >> v2:172.21.15.153:3300/0 conn(0x7f17d015c8e0 0x7f17d00ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17b8003530 con 0x7f17d00adac0 2024-03-30T13:08:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1090412372 0 0) 0x7f17b8003530 con 0x7f17d00adac0 2024-03-30T13:08:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 >> v2:172.21.15.153:3300/0 conn(0x7f17d015c8e0 msgr2=0x7f17d00ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 --2- 172.21.15.83:0/1637080094 >> v2:172.21.15.153:3300/0 conn(0x7f17d015c8e0 0x7f17d00ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 >> v1:172.21.15.153:6789/0 conn(0x7f17d00b4680 legacy=0x7f17d0165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d00ae600 con 0x7f17d00adac0 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f17c4001680 con 0x7f17d00adac0 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17cffff640 1 --2- 172.21.15.83:0/1637080094 >> v2:172.21.15.153:3300/0 conn(0x7f17d015c8e0 0x7f17d00ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 >> v1:172.21.15.83:6789/0 conn(0x7f17d00adac0 legacy=0x7f17d015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 --2- 172.21.15.83:0/1637080094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 0x7f17b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 --2- 172.21.15.83:0/1637080094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17b8004810 0x7f17b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 --2- 172.21.15.83:0/1637080094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b80051d0 0x7f17b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f17d00b31e0 con 0x7f17b80039c0 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f17b800c120 con 0x7f17b80051d0 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f17b800c320 con 0x7f17b8004810 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.365+0000 7f17cffff640 1 --2- 172.21.15.83:0/1637080094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 0x7f17b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17d4a7a640 1 --2- 172.21.15.83:0/1637080094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b80051d0 0x7f17b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17cf7fe640 1 --2- 172.21.15.83:0/1637080094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17b8004810 0x7f17b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17cffff640 1 -- 172.21.15.83:0/1637080094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17b8004810 msgr2=0x7f17b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17cffff640 1 --2- 172.21.15.83:0/1637080094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17b8004810 0x7f17b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17cffff640 1 -- 172.21.15.83:0/1637080094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b80051d0 msgr2=0x7f17b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17cffff640 1 --2- 172.21.15.83:0/1637080094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b80051d0 0x7f17b800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:24.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17d4a7a640 1 -- 172.21.15.83:0/1637080094 reap_dead start 2024-03-30T13:08:24.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17cffff640 1 -- 172.21.15.83:0/1637080094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b8003530 con 0x7f17b80039c0 2024-03-30T13:08:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17cffff640 1 --2- 172.21.15.83:0/1637080094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 0x7f17b8003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17c00098d0 tx=0x7f17c001c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fbb914d87aa926 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c000f040 con 0x7f17b80039c0 2024-03-30T13:08:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c00b0070 con 0x7f17b80039c0 2024-03-30T13:08:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17ceffd640 1 -- 172.21.15.83:0/1637080094 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c00ab800 con 0x7f17b80039c0 2024-03-30T13:08:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17d64dd640 1 -- 172.21.15.83:0/1637080094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 msgr2=0x7f17b8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17d64dd640 1 --2- 172.21.15.83:0/1637080094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 0x7f17b8003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17c00098d0 tx=0x7f17c001c5d0 comp rx=0 tx=0).stop 2024-03-30T13:08:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17d64dd640 1 -- 172.21.15.83:0/1637080094 shutdown_connections 2024-03-30T13:08:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17d64dd640 1 --2- 172.21.15.83:0/1637080094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 0x7f17b8003de0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:24.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17d64dd640 1 -- 172.21.15.83:0/1637080094 >> 172.21.15.83:0/1637080094 conn(0x7f17d006b660 msgr2=0x7f17d006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:24.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17d64dd640 1 -- 172.21.15.83:0/1637080094 shutdown_connections 2024-03-30T13:08:24.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.369+0000 7f17d64dd640 1 -- 172.21.15.83:0/1637080094 wait complete. 2024-03-30T13:08:24.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d64dd640 1 Processor -- start 2024-03-30T13:08:24.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d64dd640 1 -- start start 2024-03-30T13:08:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d64dd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 0x7f17d014b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d64dd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17d00729d0 0x7f17d0152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d64dd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17d01526c0 0x7f17d00c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d64dd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f17d00b3670 con 0x7f17b80039c0 2024-03-30T13:08:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d64dd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f17d015d6e0 con 0x7f17d01526c0 2024-03-30T13:08:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d64dd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f17d00b37f0 con 0x7f17d00729d0 2024-03-30T13:08:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17cffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 0x7f17d014b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17cffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 0x7f17d014b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59340/0 (socket says 172.21.15.83:59340) 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17cffff640 1 -- 172.21.15.83:0/756587158 learned_addr learned my addr 172.21.15.83:0/756587158 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d4a7a640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17d01526c0 0x7f17d00c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17cf7fe640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17d00729d0 0x7f17d0152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17cffff640 1 -- 172.21.15.83:0/756587158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17d00729d0 msgr2=0x7f17d0152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17cffff640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17d00729d0 0x7f17d0152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17cffff640 1 -- 172.21.15.83:0/756587158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17d01526c0 msgr2=0x7f17d00c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17cffff640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17d01526c0 0x7f17d00c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17cffff640 1 -- 172.21.15.83:0/756587158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d0071930 con 0x7f17b80039c0 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d4a7a640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17d01526c0 0x7f17d00c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17cffff640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 0x7f17d014b6e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f17c001c400 tx=0x7f17b8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17ccff9640 1 -- 172.21.15.83:0/756587158 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c00b5800 con 0x7f17b80039c0 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17ccff9640 1 -- 172.21.15.83:0/756587158 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c00b59a0 con 0x7f17b80039c0 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d64dd640 1 -- 172.21.15.83:0/756587158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d0071c10 con 0x7f17b80039c0 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17ccff9640 1 -- 172.21.15.83:0/756587158 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c00b5d50 con 0x7f17b80039c0 2024-03-30T13:08:24.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d64dd640 1 -- 172.21.15.83:0/756587158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d00721d0 con 0x7f17b80039c0 2024-03-30T13:08:24.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17d64dd640 1 -- 172.21.15.83:0/756587158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17d004f9e0 con 0x7f17b80039c0 2024-03-30T13:08:24.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17ccff9640 1 -- 172.21.15.83:0/756587158 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f17c00aa070 con 0x7f17b80039c0 2024-03-30T13:08:24.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17ccff9640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f17bc067fc0 0x7f17bc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:24.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.373+0000 7f17ccff9640 1 -- 172.21.15.83:0/756587158 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f17c01202a0 con 0x7f17b80039c0 2024-03-30T13:08:24.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.377+0000 7f17cf7fe640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f17bc067fc0 0x7f17bc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:24.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.377+0000 7f17cf7fe640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f17bc067fc0 0x7f17bc06a480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17c4001060 tx=0x7f17c4001160 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:24.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.381+0000 7f17ccff9640 1 -- 172.21.15.83:0/756587158 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f17c00162e0 con 0x7f17b80039c0 2024-03-30T13:08:24.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:24.537+0000 7f17d64dd640 1 -- 172.21.15.83:0/756587158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f17d006ee20 con 0x7f17b80039c0 2024-03-30T13:08:24.683 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:08:24.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:08:25.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.221+0000 7f17ccff9640 1 -- 172.21.15.83:0/756587158 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f17c00f0c30 con 0x7f17b80039c0 2024-03-30T13:08:25.226 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' created 2024-03-30T13:08:25.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.225+0000 7f17d64dd640 1 -- 172.21.15.83:0/756587158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f17bc067fc0 msgr2=0x7f17bc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:25.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.225+0000 7f17d64dd640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f17bc067fc0 0x7f17bc06a480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17c4001060 tx=0x7f17c4001160 comp rx=0 tx=0).stop 2024-03-30T13:08:25.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.225+0000 7f17d64dd640 1 -- 172.21.15.83:0/756587158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 msgr2=0x7f17d014b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:25.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.225+0000 7f17d64dd640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 0x7f17d014b6e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f17c001c400 tx=0x7f17b8005840 comp rx=0 tx=0).stop 2024-03-30T13:08:25.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.225+0000 7f17d64dd640 1 -- 172.21.15.83:0/756587158 shutdown_connections 2024-03-30T13:08:25.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.225+0000 7f17d64dd640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f17bc067fc0 0x7f17bc06a480 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:25.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.225+0000 7f17d64dd640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17d01526c0 0x7f17d00c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:25.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.225+0000 7f17d64dd640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17d00729d0 0x7f17d0152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:25.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.225+0000 7f17d64dd640 1 --2- 172.21.15.83:0/756587158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17b80039c0 0x7f17d014b6e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:25.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.225+0000 7f17d64dd640 1 -- 172.21.15.83:0/756587158 >> 172.21.15.83:0/756587158 conn(0x7f17d006b660 msgr2=0x7f17d006ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:25.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.225+0000 7f17d64dd640 1 -- 172.21.15.83:0/756587158 shutdown_connections 2024-03-30T13:08:25.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.225+0000 7f17d64dd640 1 -- 172.21.15.83:0/756587158 wait complete. 2024-03-30T13:08:25.267 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-30T13:08:25.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe589719640 1 Processor -- start 2024-03-30T13:08:25.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe589719640 1 -- start start 2024-03-30T13:08:25.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe589719640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe58409aa50 0x7fe5841607a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:25.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe589719640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe5840b0970 0x7fe5840b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:25.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe589719640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5840b0690 con 0x7fe584145c40 2024-03-30T13:08:25.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe589719640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe5840ae3a0 con 0x7fe5840b0970 2024-03-30T13:08:25.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe589719640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe5840b3520 con 0x7fe58409aa50 2024-03-30T13:08:25.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe582ffd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fe584145c40 0x7fe584160090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:35450/0 (socket says 172.21.15.83:35450) 2024-03-30T13:08:25.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe582ffd640 1 -- 172.21.15.83:0/3464311050 learned_addr learned my addr 172.21.15.83:0/3464311050 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:25.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe5837fe640 1 --2- 172.21.15.83:0/3464311050 >> v2:172.21.15.153:3300/0 conn(0x7fe5840b0970 0x7fe5840b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:25.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe5827fc640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe58409aa50 0x7fe5841607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:25.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 198114356 0 0) 0x7fe5840b0690 con 0x7fe584145c40 2024-03-30T13:08:25.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe56c003530 con 0x7fe584145c40 2024-03-30T13:08:25.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3829834771 0 0) 0x7fe56c003530 con 0x7fe584145c40 2024-03-30T13:08:25.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe58409aa50 msgr2=0x7fe5841607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:25.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe58409aa50 0x7fe5841607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:25.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 >> v2:172.21.15.153:3300/0 conn(0x7fe5840b0970 msgr2=0x7fe5840b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:25.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 --2- 172.21.15.83:0/3464311050 >> v2:172.21.15.153:3300/0 conn(0x7fe5840b0970 0x7fe5840b0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:25.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5840b3800 con 0x7fe584145c40 2024-03-30T13:08:25.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fe57c001a00 con 0x7fe584145c40 2024-03-30T13:08:25.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 >> v1:172.21.15.83:6789/0 conn(0x7fe584145c40 legacy=0x7fe584160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe56c0039c0 0x7fe56c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe58409aa50 0x7fe56c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe56c004d50 0x7fe56c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe5840b3520 con 0x7fe56c0039c0 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c00b9d0 con 0x7fe56c004d50 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe56c00bb50 con 0x7fe58409aa50 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe582ffd640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe56c0039c0 0x7fe56c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe5827fc640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe58409aa50 0x7fe56c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe5837fe640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe56c004d50 0x7fe56c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe582ffd640 1 -- 172.21.15.83:0/3464311050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe58409aa50 msgr2=0x7fe56c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe582ffd640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe58409aa50 0x7fe56c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe582ffd640 1 -- 172.21.15.83:0/3464311050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe56c004d50 msgr2=0x7fe56c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:25.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe582ffd640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe56c004d50 0x7fe56c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:25.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe582ffd640 1 -- 172.21.15.83:0/3464311050 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c003530 con 0x7fe56c0039c0 2024-03-30T13:08:25.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.385+0000 7fe5837fe640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe56c004d50 0x7fe56c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:25.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe582ffd640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe56c0039c0 0x7fe56c003de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00a880 tx=0x7fe57c01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2e24c9382d9288 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:25.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c00a4a0 con 0x7fe56c0039c0 2024-03-30T13:08:25.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c0ad650 con 0x7fe56c0039c0 2024-03-30T13:08:25.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe581ffb640 1 -- 172.21.15.83:0/3464311050 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0ada40 con 0x7fe56c0039c0 2024-03-30T13:08:25.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe589719640 1 -- 172.21.15.83:0/3464311050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe56c0039c0 msgr2=0x7fe56c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:25.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe589719640 1 --2- 172.21.15.83:0/3464311050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe56c0039c0 0x7fe56c003de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00a880 tx=0x7fe57c01d3a0 comp rx=0 tx=0).stop 2024-03-30T13:08:25.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe5837fe640 1 -- 172.21.15.83:0/3464311050 reap_dead start 2024-03-30T13:08:25.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe589719640 1 -- 172.21.15.83:0/3464311050 shutdown_connections 2024-03-30T13:08:25.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe589719640 1 -- 172.21.15.83:0/3464311050 >> 172.21.15.83:0/3464311050 conn(0x7fe584072d30 msgr2=0x7fe5840b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:25.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe589719640 1 -- 172.21.15.83:0/3464311050 shutdown_connections 2024-03-30T13:08:25.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe589719640 1 -- 172.21.15.83:0/3464311050 wait complete. 2024-03-30T13:08:25.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe589719640 1 Processor -- start 2024-03-30T13:08:25.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.389+0000 7fe589719640 1 -- start start 2024-03-30T13:08:25.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe589719640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58415ef00 0x7fe58413e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:25.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe589719640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58415f2e0 0x7fe584139f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:25.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe589719640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5841f5610 0x7fe5841f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:25.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe589719640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe5840b16b0 con 0x7fe58415f2e0 2024-03-30T13:08:25.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe589719640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe5840b1530 con 0x7fe58415ef00 2024-03-30T13:08:25.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe589719640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe5840b1830 con 0x7fe5841f5610 2024-03-30T13:08:25.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe5827fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58415f2e0 0x7fe584139f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:25.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe5827fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58415f2e0 0x7fe584139f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59352/0 (socket says 172.21.15.83:59352) 2024-03-30T13:08:25.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe5827fc640 1 -- 172.21.15.83:0/3881373379 learned_addr learned my addr 172.21.15.83:0/3881373379 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:25.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe582ffd640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58415ef00 0x7fe58413e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe5837fe640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5841f5610 0x7fe5841f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe5827fc640 1 -- 172.21.15.83:0/3881373379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5841f5610 msgr2=0x7fe5841f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe5827fc640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5841f5610 0x7fe5841f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe5827fc640 1 -- 172.21.15.83:0/3881373379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58415ef00 msgr2=0x7fe58413e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe5827fc640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58415ef00 0x7fe58413e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe5827fc640 1 -- 172.21.15.83:0/3881373379 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe584160030 con 0x7fe58415f2e0 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe5837fe640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5841f5610 0x7fe5841f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe5827fc640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58415f2e0 0x7fe584139f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5740115e0 tx=0x7fe574011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe56b7fe640 1 -- 172.21.15.83:0/3881373379 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574015870 con 0x7fe58415f2e0 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe56b7fe640 1 -- 172.21.15.83:0/3881373379 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe574015a10 con 0x7fe58415f2e0 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe589719640 1 -- 172.21.15.83:0/3881373379 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58413e5f0 con 0x7fe58415f2e0 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe56b7fe640 1 -- 172.21.15.83:0/3881373379 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574015dc0 con 0x7fe58415f2e0 2024-03-30T13:08:25.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe589719640 1 -- 172.21.15.83:0/3881373379 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe58413ebb0 con 0x7fe58415f2e0 2024-03-30T13:08:25.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe589719640 1 -- 172.21.15.83:0/3881373379 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe58409f3d0 con 0x7fe58415f2e0 2024-03-30T13:08:25.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe56b7fe640 1 -- 172.21.15.83:0/3881373379 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fe57400f480 con 0x7fe58415f2e0 2024-03-30T13:08:25.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe56b7fe640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe570067fc0 0x7fe57006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:25.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe56b7fe640 1 -- 172.21.15.83:0/3881373379 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fe574086e70 con 0x7fe58415f2e0 2024-03-30T13:08:25.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe582ffd640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe570067fc0 0x7fe57006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:25.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.393+0000 7fe582ffd640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe570067fc0 0x7fe57006a480 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0ad000 tx=0x7fe57c007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:25.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.397+0000 7fe56b7fe640 1 -- 172.21.15.83:0/3881373379 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fe584160030 con 0x7fe58415f2e0 2024-03-30T13:08:25.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:25.593+0000 7fe589719640 1 -- 172.21.15.83:0/3881373379 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe58404f9e0 con 0x7fe58415f2e0 2024-03-30T13:08:26.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.221+0000 7fe56b7fe640 1 -- 172.21.15.83:0/3881373379 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fe574019030 con 0x7fe58415f2e0 2024-03-30T13:08:26.228 INFO:teuthology.orchestra.run.smithi083.stderr:new fs with metadata pool 2 and data pool 3 2024-03-30T13:08:26.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.225+0000 7fe589719640 1 -- 172.21.15.83:0/3881373379 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe570067fc0 msgr2=0x7fe57006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.225+0000 7fe589719640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe570067fc0 0x7fe57006a480 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0ad000 tx=0x7fe57c007040 comp rx=0 tx=0).stop 2024-03-30T13:08:26.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.225+0000 7fe589719640 1 -- 172.21.15.83:0/3881373379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58415f2e0 msgr2=0x7fe584139f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.225+0000 7fe589719640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58415f2e0 0x7fe584139f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5740115e0 tx=0x7fe574011aa0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.225+0000 7fe589719640 1 -- 172.21.15.83:0/3881373379 shutdown_connections 2024-03-30T13:08:26.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.225+0000 7fe589719640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe570067fc0 0x7fe57006a480 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.225+0000 7fe589719640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5841f5610 0x7fe5841f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.225+0000 7fe589719640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58415f2e0 0x7fe584139f80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.225+0000 7fe589719640 1 --2- 172.21.15.83:0/3881373379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe58415ef00 0x7fe58413e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.225+0000 7fe589719640 1 -- 172.21.15.83:0/3881373379 >> 172.21.15.83:0/3881373379 conn(0x7fe584072d30 msgr2=0x7fe5840d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:26.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.225+0000 7fe589719640 1 -- 172.21.15.83:0/3881373379 shutdown_connections 2024-03-30T13:08:26.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.225+0000 7fe589719640 1 -- 172.21.15.83:0/3881373379 wait complete. 2024-03-30T13:08:26.266 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddfe7f640 1 Processor -- start 2024-03-30T13:08:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddfe7f640 1 -- start start 2024-03-30T13:08:26.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddfe7f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fedd806eff0 0x7fedd8167270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddfe7f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd80cfcb0 con 0x7fedd80aed20 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddfe7f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd80ad290 con 0x7fedd80b4830 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddfe7f640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fedd8156e00 con 0x7fedd806eff0 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddd41a640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fedd80aed20 0x7fedd80af1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:35458/0 (socket says 172.21.15.83:35458) 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddd41a640 1 -- 172.21.15.83:0/3407467954 learned_addr learned my addr 172.21.15.83:0/3407467954 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7fedde41c640 1 --2- 172.21.15.83:0/3407467954 >> v2:172.21.15.153:3300/0 conn(0x7fedd806eff0 0x7fedd8167270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153977572 0 0) 0x7fedd80cfcb0 con 0x7fedd80aed20 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedc4003530 con 0x7fedd80aed20 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1872576858 0 0) 0x7fedc4003530 con 0x7fedd80aed20 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 >> v2:172.21.15.153:3300/0 conn(0x7fedd806eff0 msgr2=0x7fedd8167270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 --2- 172.21.15.83:0/3407467954 >> v2:172.21.15.153:3300/0 conn(0x7fedd806eff0 0x7fedd8167270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 >> v1:172.21.15.153:6789/0 conn(0x7fedd80b4830 legacy=0x7fedd815d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd80ad570 con 0x7fedd80aed20 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fedd4001680 con 0x7fedd80aed20 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 >> v1:172.21.15.83:6789/0 conn(0x7fedd80aed20 legacy=0x7fedd80af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 --2- 172.21.15.83:0/3407467954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedc40039c0 0x7fedc4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 --2- 172.21.15.83:0/3407467954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc4004810 0x7fedc4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 --2- 172.21.15.83:0/3407467954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedc40052f0 0x7fedc400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fedd8156e00 con 0x7fedc40039c0 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fedc400c1c0 con 0x7fedc4004810 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fedc400c3c0 con 0x7fedc40052f0 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7fedddc1b640 1 --2- 172.21.15.83:0/3407467954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedc40039c0 0x7fedc4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7feddd41a640 1 --2- 172.21.15.83:0/3407467954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc4004810 0x7fedc4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7fedde41c640 1 --2- 172.21.15.83:0/3407467954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedc40052f0 0x7fedc400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7fedddc1b640 1 -- 172.21.15.83:0/3407467954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedc40052f0 msgr2=0x7fedc400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7fedddc1b640 1 --2- 172.21.15.83:0/3407467954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedc40052f0 0x7fedc400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7fedddc1b640 1 -- 172.21.15.83:0/3407467954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc4004810 msgr2=0x7fedc4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:26.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7fedddc1b640 1 --2- 172.21.15.83:0/3407467954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc4004810 0x7fedc4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7fedddc1b640 1 -- 172.21.15.83:0/3407467954 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc4003530 con 0x7fedc40039c0 2024-03-30T13:08:26.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7fedde41c640 1 --2- 172.21.15.83:0/3407467954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedc40052f0 0x7fedc400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:26.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.381+0000 7fedde41c640 1 -- 172.21.15.83:0/3407467954 reap_dead start 2024-03-30T13:08:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7fedddc1b640 1 --2- 172.21.15.83:0/3407467954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedc40039c0 0x7fedc4003de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fedc8001750 tx=0x7fedc801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac25c9c51944ed8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc80013a0 con 0x7fedc40039c0 2024-03-30T13:08:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc80052f0 con 0x7fedc40039c0 2024-03-30T13:08:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddcc19640 1 -- 172.21.15.83:0/3407467954 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc80a4e60 con 0x7fedc40039c0 2024-03-30T13:08:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 -- 172.21.15.83:0/3407467954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedc40039c0 msgr2=0x7fedc4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 --2- 172.21.15.83:0/3407467954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedc40039c0 0x7fedc4003de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fedc8001750 tx=0x7fedc801c3a0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 -- 172.21.15.83:0/3407467954 shutdown_connections 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 --2- 172.21.15.83:0/3407467954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedc40039c0 0x7fedc4003de0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 -- 172.21.15.83:0/3407467954 >> 172.21.15.83:0/3407467954 conn(0x7fedd80b1d60 msgr2=0x7fedd80b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 -- 172.21.15.83:0/3407467954 shutdown_connections 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 -- 172.21.15.83:0/3407467954 wait complete. 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 Processor -- start 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 -- start start 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc40039c0 0x7fedd809de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedd8141c20 0x7fedd8145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedd8099860 0x7fedd80cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fedd80af6e0 con 0x7fedd8099860 2024-03-30T13:08:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fedd80af560 con 0x7fedc40039c0 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.385+0000 7feddfe7f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fedd80cf860 con 0x7fedd8141c20 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedde41c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedd8099860 0x7fedd80cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedde41c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedd8099860 0x7fedd80cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59366/0 (socket says 172.21.15.83:59366) 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedde41c640 1 -- 172.21.15.83:0/2591106711 learned_addr learned my addr 172.21.15.83:0/2591106711 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedddc1b640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc40039c0 0x7fedd809de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7feddd41a640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedd8141c20 0x7fedd8145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedde41c640 1 -- 172.21.15.83:0/2591106711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedd8141c20 msgr2=0x7fedd8145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedde41c640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedd8141c20 0x7fedd8145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedde41c640 1 -- 172.21.15.83:0/2591106711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc40039c0 msgr2=0x7fedd809de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedde41c640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc40039c0 0x7fedd809de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedde41c640 1 -- 172.21.15.83:0/2591106711 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd81462e0 con 0x7fedd8099860 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7feddd41a640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedd8141c20 0x7fedd8145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedde41c640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedd8099860 0x7fedd80cdab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fedd806db20 tx=0x7fedd000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedce7fc640 1 -- 172.21.15.83:0/2591106711 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd0016620 con 0x7fedd8099860 2024-03-30T13:08:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedce7fc640 1 -- 172.21.15.83:0/2591106711 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd001b070 con 0x7fedd8099860 2024-03-30T13:08:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7feddfe7f640 1 -- 172.21.15.83:0/2591106711 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd81465c0 con 0x7fedd8099860 2024-03-30T13:08:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedce7fc640 1 -- 172.21.15.83:0/2591106711 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd00169c0 con 0x7fedd8099860 2024-03-30T13:08:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7feddfe7f640 1 -- 172.21.15.83:0/2591106711 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd8146b80 con 0x7fedd8099860 2024-03-30T13:08:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7feddfe7f640 1 -- 172.21.15.83:0/2591106711 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd80686c0 con 0x7fedd8099860 2024-03-30T13:08:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedce7fc640 1 -- 172.21.15.83:0/2591106711 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fedd0016b60 con 0x7fedd8099860 2024-03-30T13:08:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedce7fc640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fedbc067fc0 0x7fedbc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedce7fc640 1 -- 172.21.15.83:0/2591106711 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fedd0087070 con 0x7fedd8099860 2024-03-30T13:08:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedddc1b640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fedbc067fc0 0x7fedbc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.389+0000 7fedddc1b640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fedbc067fc0 0x7fedbc06a480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fedc40057f0 tx=0x7fedc80011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:26.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.393+0000 7fedce7fc640 1 -- 172.21.15.83:0/2591106711 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fedd0057820 con 0x7fedd8099860 2024-03-30T13:08:26.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.557+0000 7feddfe7f640 1 -- 172.21.15.83:0/2591106711 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedd80b4100 con 0x7fedd8099860 2024-03-30T13:08:26.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.557+0000 7fedce7fc640 1 -- 172.21.15.83:0/2591106711 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16594 (secure 0 0 0) 0x7fedd0057120 con 0x7fedd8099860 2024-03-30T13:08:26.564 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:26.565 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":20,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:25.599546+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.561+0000 7feddfe7f640 1 -- 172.21.15.83:0/2591106711 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fedbc067fc0 msgr2=0x7fedbc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.561+0000 7feddfe7f640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fedbc067fc0 0x7fedbc06a480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fedc40057f0 tx=0x7fedc80011a0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.561+0000 7feddfe7f640 1 -- 172.21.15.83:0/2591106711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedd8099860 msgr2=0x7fedd80cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.561+0000 7feddfe7f640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedd8099860 0x7fedd80cdab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fedd806db20 tx=0x7fedd000f520 comp rx=0 tx=0).stop 2024-03-30T13:08:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.561+0000 7feddfe7f640 1 -- 172.21.15.83:0/2591106711 shutdown_connections 2024-03-30T13:08:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.561+0000 7feddfe7f640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fedbc067fc0 0x7fedbc06a480 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.561+0000 7feddfe7f640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedd8099860 0x7fedd80cdab0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.561+0000 7feddfe7f640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedd8141c20 0x7fedd8145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.561+0000 7feddfe7f640 1 --2- 172.21.15.83:0/2591106711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc40039c0 0x7fedd809de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.561+0000 7feddfe7f640 1 -- 172.21.15.83:0/2591106711 >> 172.21.15.83:0/2591106711 conn(0x7fedd80b1d60 msgr2=0x7fedd80b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.561+0000 7feddfe7f640 1 -- 172.21.15.83:0/2591106711 shutdown_connections 2024-03-30T13:08:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.561+0000 7feddfe7f640 1 -- 172.21.15.83:0/2591106711 wait complete. 2024-03-30T13:08:26.583 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:26.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66c49e9640 1 Processor -- start 2024-03-30T13:08:26.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66c49e9640 1 -- start start 2024-03-30T13:08:26.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66c49e9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c0141740 0x7f66c00cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66c49e9640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f66c015c420 0x7f66c00d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66c49e9640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f66c006c670 0x7f66c006cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66c49e9640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f66c00ccce0 con 0x7f66c015c420 2024-03-30T13:08:26.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66c49e9640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f66c00ccfc0 con 0x7f66c006c670 2024-03-30T13:08:26.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66c49e9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f66c00cd2a0 con 0x7f66c0141740 2024-03-30T13:08:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66bdd9b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f66c015c420 0x7f66c00d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66bdd9b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f66c015c420 0x7f66c00d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59376/0 (socket says 172.21.15.83:59376) 2024-03-30T13:08:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66bdd9b640 1 -- 172.21.15.83:0/2560833808 learned_addr learned my addr 172.21.15.83:0/2560833808 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66be59c640 1 --2- 172.21.15.83:0/2560833808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c0141740 0x7f66c00cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66bed9d640 1 --2- 172.21.15.83:0/2560833808 >> v2:172.21.15.153:3300/0 conn(0x7f66c006c670 0x7f66c006cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66bdd9b640 1 -- 172.21.15.83:0/2560833808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c0141740 msgr2=0x7f66c00cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66bdd9b640 1 --2- 172.21.15.83:0/2560833808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c0141740 0x7f66c00cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66bdd9b640 1 -- 172.21.15.83:0/2560833808 >> v2:172.21.15.153:3300/0 conn(0x7f66c006c670 msgr2=0x7f66c006cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66bdd9b640 1 --2- 172.21.15.83:0/2560833808 >> v2:172.21.15.153:3300/0 conn(0x7f66c006c670 0x7f66c006cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.697+0000 7f66bdd9b640 1 -- 172.21.15.83:0/2560833808 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c00cd580 con 0x7f66c015c420 2024-03-30T13:08:26.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bdd9b640 1 --2- 172.21.15.83:0/2560833808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c015c420 0x7f66c00d00b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f66c00b3b80 tx=0x7f66b401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aef7722f3300875 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:26.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bd59a640 1 -- 172.21.15.83:0/2560833808 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b40b2070 con 0x7f66c015c420 2024-03-30T13:08:26.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bd59a640 1 -- 172.21.15.83:0/2560833808 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b40ad640 con 0x7f66c015c420 2024-03-30T13:08:26.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bd59a640 1 -- 172.21.15.83:0/2560833808 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b40ada10 con 0x7f66c015c420 2024-03-30T13:08:26.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 -- 172.21.15.83:0/2560833808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c015c420 msgr2=0x7f66c00d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 --2- 172.21.15.83:0/2560833808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c015c420 0x7f66c00d00b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f66c00b3b80 tx=0x7f66b401c520 comp rx=0 tx=0).stop 2024-03-30T13:08:26.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 -- 172.21.15.83:0/2560833808 shutdown_connections 2024-03-30T13:08:26.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 --2- 172.21.15.83:0/2560833808 >> v2:172.21.15.153:3300/0 conn(0x7f66c006c670 0x7f66c006cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 --2- 172.21.15.83:0/2560833808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c015c420 0x7f66c00d00b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 --2- 172.21.15.83:0/2560833808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c0141740 0x7f66c00cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 -- 172.21.15.83:0/2560833808 >> 172.21.15.83:0/2560833808 conn(0x7f66c0072030 msgr2=0x7f66c0072440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:26.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 -- 172.21.15.83:0/2560833808 shutdown_connections 2024-03-30T13:08:26.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 -- 172.21.15.83:0/2560833808 wait complete. 2024-03-30T13:08:26.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 Processor -- start 2024-03-30T13:08:26.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 -- start start 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c006c670 0x7f66c013f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c015c420 0x7f66c0154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c0154560 0x7f66c01523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f66c015d520 con 0x7f66c0154560 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66c015d3a0 con 0x7f66c015c420 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66c49e9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f66c015d6a0 con 0x7f66c006c670 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c0154560 0x7f66c01523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c0154560 0x7f66c01523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59390/0 (socket says 172.21.15.83:59390) 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bed9d640 1 -- 172.21.15.83:0/676366931 learned_addr learned my addr 172.21.15.83:0/676366931 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66be59c640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c006c670 0x7f66c013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bdd9b640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c015c420 0x7f66c0154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bed9d640 1 -- 172.21.15.83:0/676366931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c006c670 msgr2=0x7f66c013f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bed9d640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c006c670 0x7f66c013f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bed9d640 1 -- 172.21.15.83:0/676366931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c015c420 msgr2=0x7f66c0154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bed9d640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c015c420 0x7f66c0154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.701+0000 7f66bed9d640 1 -- 172.21.15.83:0/676366931 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c01563a0 con 0x7f66c0154560 2024-03-30T13:08:26.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.705+0000 7f66bed9d640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c0154560 0x7f66c01523e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f66b8007d20 tx=0x7f66b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:26.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.705+0000 7f66aeffd640 1 -- 172.21.15.83:0/676366931 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b8014420 con 0x7f66c0154560 2024-03-30T13:08:26.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.705+0000 7f66aeffd640 1 -- 172.21.15.83:0/676366931 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b8019070 con 0x7f66c0154560 2024-03-30T13:08:26.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.705+0000 7f66c49e9640 1 -- 172.21.15.83:0/676366931 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c0156680 con 0x7f66c0154560 2024-03-30T13:08:26.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.705+0000 7f66aeffd640 1 -- 172.21.15.83:0/676366931 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b8014820 con 0x7f66c0154560 2024-03-30T13:08:26.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.705+0000 7f66c49e9640 1 -- 172.21.15.83:0/676366931 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c0156c40 con 0x7f66c0154560 2024-03-30T13:08:26.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.705+0000 7f66c49e9640 1 -- 172.21.15.83:0/676366931 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c0068dd0 con 0x7f66c0154560 2024-03-30T13:08:26.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.705+0000 7f66aeffd640 1 -- 172.21.15.83:0/676366931 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f66b80149c0 con 0x7f66c0154560 2024-03-30T13:08:26.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.705+0000 7f66aeffd640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f66a0067fc0 0x7f66a006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:26.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.705+0000 7f66be59c640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f66a0067fc0 0x7f66a006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:26.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.705+0000 7f66aeffd640 1 -- 172.21.15.83:0/676366931 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f66b8086d20 con 0x7f66c0154560 2024-03-30T13:08:26.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.705+0000 7f66be59c640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f66a0067fc0 0x7f66a006a480 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66b000b930 tx=0x7f66b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:26.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.709+0000 7f66aeffd640 1 -- 172.21.15.83:0/676366931 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f66b80574d0 con 0x7f66c0154560 2024-03-30T13:08:26.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.869+0000 7f66c49e9640 1 -- 172.21.15.83:0/676366931 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66c006d1a0 con 0x7f66c0154560 2024-03-30T13:08:26.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66aeffd640 1 -- 172.21.15.83:0/676366931 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16594 (secure 0 0 0) 0x7f66b8056dd0 con 0x7f66c0154560 2024-03-30T13:08:26.877 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:26.878 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":20,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:25.599546+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:26.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66c49e9640 1 -- 172.21.15.83:0/676366931 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f66a0067fc0 msgr2=0x7f66a006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66c49e9640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f66a0067fc0 0x7f66a006a480 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66b000b930 tx=0x7f66b0008040 comp rx=0 tx=0).stop 2024-03-30T13:08:26.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66c49e9640 1 -- 172.21.15.83:0/676366931 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c0154560 msgr2=0x7f66c01523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:26.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66c49e9640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c0154560 0x7f66c01523e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f66b8007d20 tx=0x7f66b800e4b0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66c49e9640 1 -- 172.21.15.83:0/676366931 shutdown_connections 2024-03-30T13:08:26.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66c49e9640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f66a0067fc0 0x7f66a006a480 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66c49e9640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c0154560 0x7f66c01523e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66c49e9640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c015c420 0x7f66c0154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66c49e9640 1 --2- 172.21.15.83:0/676366931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c006c670 0x7f66c013f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:26.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66c49e9640 1 -- 172.21.15.83:0/676366931 >> 172.21.15.83:0/676366931 conn(0x7f66c0072030 msgr2=0x7f66c00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:26.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66c49e9640 1 -- 172.21.15.83:0/676366931 shutdown_connections 2024-03-30T13:08:26.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:26.873+0000 7f66c49e9640 1 -- 172.21.15.83:0/676366931 wait complete. 2024-03-30T13:08:26.897 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-30T13:08:27.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f311ea1c640 1 Processor -- start 2024-03-30T13:08:27.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f311ea1c640 1 -- start start 2024-03-30T13:08:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f311ea1c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f311815c8e0 0x7f31180ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f311ea1c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31180b4680 0x7f3118165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f311ea1c640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31180ae040 con 0x7f31180adac0 2024-03-30T13:08:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f311ea1c640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f31180b31e0 con 0x7f311815c8e0 2024-03-30T13:08:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f311ea1c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f31180ae320 con 0x7f31180b4680 2024-03-30T13:08:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f3117fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f311815c8e0 0x7f31180ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f3117fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f311815c8e0 0x7f31180ad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43250/0 (socket says 172.21.15.83:43250) 2024-03-30T13:08:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f3117fff640 1 -- 172.21.15.83:0/948738612 learned_addr learned my addr 172.21.15.83:0/948738612 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f311cfb9640 1 --2- 172.21.15.83:0/948738612 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31180b4680 0x7f3118165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f3117fff640 1 -- 172.21.15.83:0/948738612 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31180b4680 msgr2=0x7f3118165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f3117fff640 1 --2- 172.21.15.83:0/948738612 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31180b4680 0x7f3118165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f3117fff640 1 -- 172.21.15.83:0/948738612 >> v1:172.21.15.83:6789/0 conn(0x7f31180adac0 legacy=0x7f311815ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f3117fff640 1 -- 172.21.15.83:0/948738612 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31180ae600 con 0x7f311815c8e0 2024-03-30T13:08:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.013+0000 7f3116ffd640 1 -- 172.21.15.83:0/948738612 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317509879 0 0) 0x7f31180ae040 con 0x7f31180adac0 2024-03-30T13:08:27.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f3117fff640 1 --2- 172.21.15.83:0/948738612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f311815c8e0 0x7f31180ad580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3108009870 tx=0x7f310801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c0d47a24787e29 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:27.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f3116ffd640 1 -- 172.21.15.83:0/948738612 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31080b2070 con 0x7f311815c8e0 2024-03-30T13:08:27.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f3116ffd640 1 -- 172.21.15.83:0/948738612 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31080a9070 con 0x7f311815c8e0 2024-03-30T13:08:27.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f3116ffd640 1 -- 172.21.15.83:0/948738612 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31080ad880 con 0x7f311815c8e0 2024-03-30T13:08:27.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 -- 172.21.15.83:0/948738612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f311815c8e0 msgr2=0x7f31180ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:27.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 --2- 172.21.15.83:0/948738612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f311815c8e0 0x7f31180ad580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3108009870 tx=0x7f310801c560 comp rx=0 tx=0).stop 2024-03-30T13:08:27.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 -- 172.21.15.83:0/948738612 shutdown_connections 2024-03-30T13:08:27.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 --2- 172.21.15.83:0/948738612 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31180b4680 0x7f3118165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 --2- 172.21.15.83:0/948738612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f311815c8e0 0x7f31180ad580 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 -- 172.21.15.83:0/948738612 >> 172.21.15.83:0/948738612 conn(0x7f311806b660 msgr2=0x7f311806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:27.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 -- 172.21.15.83:0/948738612 shutdown_connections 2024-03-30T13:08:27.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 -- 172.21.15.83:0/948738612 wait complete. 2024-03-30T13:08:27.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 Processor -- start 2024-03-30T13:08:27.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 -- start start 2024-03-30T13:08:27.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31180adac0 0x7f311815f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31180b4680 0x7f311815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f311815c8e0 0x7f3118072610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3118168f80 con 0x7f311815c8e0 2024-03-30T13:08:27.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3118168e00 con 0x7f31180adac0 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3118169100 con 0x7f31180b4680 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311cfb9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f311815c8e0 0x7f3118072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311cfb9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f311815c8e0 0x7f3118072610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43256/0 (socket says 172.21.15.83:43256) 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311cfb9640 1 -- 172.21.15.83:0/1811452489 learned_addr learned my addr 172.21.15.83:0/1811452489 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f3117fff640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31180adac0 0x7f311815f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f31177fe640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31180b4680 0x7f311815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311cfb9640 1 -- 172.21.15.83:0/1811452489 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31180b4680 msgr2=0x7f311815dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311cfb9640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31180b4680 0x7f311815dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311cfb9640 1 -- 172.21.15.83:0/1811452489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31180adac0 msgr2=0x7f311815f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311cfb9640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31180adac0 0x7f311815f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311cfb9640 1 -- 172.21.15.83:0/1811452489 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3118072b50 con 0x7f311815c8e0 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311cfb9640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f311815c8e0 0x7f3118072610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f311000ccb0 tx=0x7f311000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f3114ff9640 1 -- 172.21.15.83:0/1811452489 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31100039a0 con 0x7f311815c8e0 2024-03-30T13:08:27.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f3114ff9640 1 -- 172.21.15.83:0/1811452489 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3110003b60 con 0x7f311815c8e0 2024-03-30T13:08:27.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.017+0000 7f311ea1c640 1 -- 172.21.15.83:0/1811452489 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311815e640 con 0x7f311815c8e0 2024-03-30T13:08:27.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.021+0000 7f3114ff9640 1 -- 172.21.15.83:0/1811452489 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110004020 con 0x7f311815c8e0 2024-03-30T13:08:27.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.021+0000 7f311ea1c640 1 -- 172.21.15.83:0/1811452489 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311815ec00 con 0x7f311815c8e0 2024-03-30T13:08:27.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.021+0000 7f311ea1c640 1 -- 172.21.15.83:0/1811452489 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f311804f9e0 con 0x7f311815c8e0 2024-03-30T13:08:27.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.021+0000 7f3114ff9640 1 -- 172.21.15.83:0/1811452489 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f31100041c0 con 0x7f311815c8e0 2024-03-30T13:08:27.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.021+0000 7f3114ff9640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3104067fc0 0x7f310406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.021+0000 7f3114ff9640 1 -- 172.21.15.83:0/1811452489 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f31100868a0 con 0x7f311815c8e0 2024-03-30T13:08:27.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.021+0000 7f3117fff640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3104067fc0 0x7f310406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.021+0000 7f3117fff640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3104067fc0 0x7f310406a480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f31080af000 tx=0x7f31080a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:27.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.025+0000 7f3114ff9640 1 -- 172.21.15.83:0/1811452489 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3110014030 con 0x7f311815c8e0 2024-03-30T13:08:27.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.225+0000 7f311ea1c640 1 -- 172.21.15.83:0/1811452489 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f311814cbe0 con 0x7f311815c8e0 2024-03-30T13:08:27.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.245+0000 7f3114ff9640 1 -- 172.21.15.83:0/1811452489 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f31100570e0 con 0x7f311815c8e0 2024-03-30T13:08:27.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.249+0000 7f311ea1c640 1 -- 172.21.15.83:0/1811452489 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3104067fc0 msgr2=0x7f310406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.249+0000 7f311ea1c640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3104067fc0 0x7f310406a480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f31080af000 tx=0x7f31080a7000 comp rx=0 tx=0).stop 2024-03-30T13:08:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.249+0000 7f311ea1c640 1 -- 172.21.15.83:0/1811452489 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f311815c8e0 msgr2=0x7f3118072610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.249+0000 7f311ea1c640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f311815c8e0 0x7f3118072610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f311000ccb0 tx=0x7f311000a5c0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.249+0000 7f311ea1c640 1 -- 172.21.15.83:0/1811452489 shutdown_connections 2024-03-30T13:08:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.249+0000 7f311ea1c640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3104067fc0 0x7f310406a480 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.249+0000 7f311ea1c640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f311815c8e0 0x7f3118072610 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.249+0000 7f311ea1c640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31180b4680 0x7f311815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.249+0000 7f311ea1c640 1 --2- 172.21.15.83:0/1811452489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31180adac0 0x7f311815f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.249+0000 7f311ea1c640 1 -- 172.21.15.83:0/1811452489 >> 172.21.15.83:0/1811452489 conn(0x7f311806b660 msgr2=0x7f311814d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.249+0000 7f311ea1c640 1 -- 172.21.15.83:0/1811452489 shutdown_connections 2024-03-30T13:08:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.249+0000 7f311ea1c640 1 -- 172.21.15.83:0/1811452489 wait complete. 2024-03-30T13:08:27.272 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-30T13:08:27.273 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-30T13:08:27.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.385+0000 7ff797974640 1 Processor -- start 2024-03-30T13:08:27.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.385+0000 7ff797974640 1 -- start start 2024-03-30T13:08:27.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff797974640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79015c8e0 0x7ff7900ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff797974640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff7900adac0 0x7ff79015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff797974640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff79015d200 0x7ff7900b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff797974640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff7900b31e0 con 0x7ff7900adac0 2024-03-30T13:08:27.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff797974640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff7900ae040 con 0x7ff79015d200 2024-03-30T13:08:27.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff797974640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff7900ae320 con 0x7ff79015c8e0 2024-03-30T13:08:27.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff794f0f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff7900adac0 0x7ff79015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff794f0f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff7900adac0 0x7ff79015ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43262/0 (socket says 172.21.15.83:43262) 2024-03-30T13:08:27.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff794f0f640 1 -- 172.21.15.83:0/178363879 learned_addr learned my addr 172.21.15.83:0/178363879 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:27.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff795f11640 1 --2- 172.21.15.83:0/178363879 >> v2:172.21.15.153:3300/0 conn(0x7ff79015d200 0x7ff7900b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff795710640 1 --2- 172.21.15.83:0/178363879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79015c8e0 0x7ff7900ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff794f0f640 1 -- 172.21.15.83:0/178363879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79015c8e0 msgr2=0x7ff7900ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:27.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff794f0f640 1 --2- 172.21.15.83:0/178363879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79015c8e0 0x7ff7900ad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff794f0f640 1 -- 172.21.15.83:0/178363879 >> v2:172.21.15.153:3300/0 conn(0x7ff79015d200 msgr2=0x7ff7900b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:27.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff794f0f640 1 --2- 172.21.15.83:0/178363879 >> v2:172.21.15.153:3300/0 conn(0x7ff79015d200 0x7ff7900b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff794f0f640 1 -- 172.21.15.83:0/178363879 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7900ae600 con 0x7ff7900adac0 2024-03-30T13:08:27.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff795f11640 1 --2- 172.21.15.83:0/178363879 >> v2:172.21.15.153:3300/0 conn(0x7ff79015d200 0x7ff7900b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:27.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff794f0f640 1 --2- 172.21.15.83:0/178363879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7900adac0 0x7ff79015ccc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff79015fda0 tx=0x7ff78001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b5474241dfafab server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:27.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff787fff640 1 -- 172.21.15.83:0/178363879 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7800ab5f0 con 0x7ff7900adac0 2024-03-30T13:08:27.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff787fff640 1 -- 172.21.15.83:0/178363879 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7800b0070 con 0x7ff7900adac0 2024-03-30T13:08:27.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff787fff640 1 -- 172.21.15.83:0/178363879 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7800ab9b0 con 0x7ff7900adac0 2024-03-30T13:08:27.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff797974640 1 -- 172.21.15.83:0/178363879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7900adac0 msgr2=0x7ff79015ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:27.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.389+0000 7ff797974640 1 --2- 172.21.15.83:0/178363879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7900adac0 0x7ff79015ccc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff79015fda0 tx=0x7ff78001c520 comp rx=0 tx=0).stop 2024-03-30T13:08:27.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 -- 172.21.15.83:0/178363879 shutdown_connections 2024-03-30T13:08:27.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 --2- 172.21.15.83:0/178363879 >> v2:172.21.15.153:3300/0 conn(0x7ff79015d200 0x7ff7900b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 --2- 172.21.15.83:0/178363879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7900adac0 0x7ff79015ccc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 --2- 172.21.15.83:0/178363879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79015c8e0 0x7ff7900ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 -- 172.21.15.83:0/178363879 >> 172.21.15.83:0/178363879 conn(0x7ff79006b660 msgr2=0x7ff79006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:27.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 -- 172.21.15.83:0/178363879 shutdown_connections 2024-03-30T13:08:27.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 -- 172.21.15.83:0/178363879 wait complete. 2024-03-30T13:08:27.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 Processor -- start 2024-03-30T13:08:27.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 -- start start 2024-03-30T13:08:27.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7900adac0 0x7ff7900cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79015c8e0 0x7ff7900b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79015d200 0x7ff7901464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff7900b4540 con 0x7ff7900adac0 2024-03-30T13:08:27.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff7900b43c0 con 0x7ff79015d200 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff7900b46c0 con 0x7ff79015c8e0 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff795710640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7900adac0 0x7ff7900cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff795710640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7900adac0 0x7ff7900cd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43270/0 (socket says 172.21.15.83:43270) 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff795710640 1 -- 172.21.15.83:0/3061510045 learned_addr learned my addr 172.21.15.83:0/3061510045 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff795f11640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79015d200 0x7ff7901464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff794f0f640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79015c8e0 0x7ff7900b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff795710640 1 -- 172.21.15.83:0/3061510045 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79015c8e0 msgr2=0x7ff7900b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff795710640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79015c8e0 0x7ff7900b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff795710640 1 -- 172.21.15.83:0/3061510045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79015d200 msgr2=0x7ff7901464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff795710640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79015d200 0x7ff7901464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff795710640 1 -- 172.21.15.83:0/3061510045 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7901581e0 con 0x7ff7900adac0 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff795710640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7900adac0 0x7ff7900cd820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00c7f0 tx=0x7ff78c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff785ffb640 1 -- 172.21.15.83:0/3061510045 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c015070 con 0x7ff7900adac0 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff785ffb640 1 -- 172.21.15.83:0/3061510045 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78c004240 con 0x7ff7900adac0 2024-03-30T13:08:27.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 -- 172.21.15.83:0/3061510045 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7901584c0 con 0x7ff7900adac0 2024-03-30T13:08:27.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff785ffb640 1 -- 172.21.15.83:0/3061510045 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c003620 con 0x7ff7900adac0 2024-03-30T13:08:27.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.393+0000 7ff797974640 1 -- 172.21.15.83:0/3061510045 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff790158a80 con 0x7ff7900adac0 2024-03-30T13:08:27.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.397+0000 7ff797974640 1 -- 172.21.15.83:0/3061510045 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff79009e540 con 0x7ff7900adac0 2024-03-30T13:08:27.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.397+0000 7ff785ffb640 1 -- 172.21.15.83:0/3061510045 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff78c0039d0 con 0x7ff7900adac0 2024-03-30T13:08:27.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.397+0000 7ff785ffb640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff774067fc0 0x7ff77406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:27.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.397+0000 7ff785ffb640 1 -- 172.21.15.83:0/3061510045 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff78c0865f0 con 0x7ff7900adac0 2024-03-30T13:08:27.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.397+0000 7ff794f0f640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff774067fc0 0x7ff77406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:27.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.397+0000 7ff794f0f640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff774067fc0 0x7ff77406a480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff7800af000 tx=0x7ff780008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:27.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.401+0000 7ff785ffb640 1 -- 172.21.15.83:0/3061510045 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff78c056da0 con 0x7ff7900adac0 2024-03-30T13:08:27.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:27.585+0000 7ff797974640 1 -- 172.21.15.83:0/3061510045 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff7900b2ad0 con 0x7ff7900adac0 2024-03-30T13:08:28.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.257+0000 7ff785ffb640 1 -- 172.21.15.83:0/3061510045 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7ff78c0566a0 con 0x7ff7900adac0 2024-03-30T13:08:28.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.261+0000 7ff797974640 1 -- 172.21.15.83:0/3061510045 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff774067fc0 msgr2=0x7ff77406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.261+0000 7ff797974640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff774067fc0 0x7ff77406a480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff7800af000 tx=0x7ff780008040 comp rx=0 tx=0).stop 2024-03-30T13:08:28.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.261+0000 7ff797974640 1 -- 172.21.15.83:0/3061510045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7900adac0 msgr2=0x7ff7900cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.261+0000 7ff797974640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7900adac0 0x7ff7900cd820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00c7f0 tx=0x7ff78c00ccb0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.261+0000 7ff797974640 1 -- 172.21.15.83:0/3061510045 shutdown_connections 2024-03-30T13:08:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.261+0000 7ff797974640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff774067fc0 0x7ff77406a480 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.261+0000 7ff797974640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79015d200 0x7ff7901464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.261+0000 7ff797974640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79015c8e0 0x7ff7900b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.261+0000 7ff797974640 1 --2- 172.21.15.83:0/3061510045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7900adac0 0x7ff7900cd820 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.261+0000 7ff797974640 1 -- 172.21.15.83:0/3061510045 >> 172.21.15.83:0/3061510045 conn(0x7ff79006b660 msgr2=0x7ff79014cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.261+0000 7ff797974640 1 -- 172.21.15.83:0/3061510045 shutdown_connections 2024-03-30T13:08:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.261+0000 7ff797974640 1 -- 172.21.15.83:0/3061510045 wait complete. 2024-03-30T13:08:28.290 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-30T13:08:28.290 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:08:28.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f634b8a9640 1 Processor -- start 2024-03-30T13:08:28.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f634b8a9640 1 -- start start 2024-03-30T13:08:28.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f634b8a9640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f634415b130 0x7f63440d1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:28.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f634b8a9640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f63440b4310 0x7f63440b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:28.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f634b8a9640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63440ae650 con 0x7f63440b5060 2024-03-30T13:08:28.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f634b8a9640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f63440b54d0 con 0x7f634415b130 2024-03-30T13:08:28.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f634b8a9640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f63440d1e70 con 0x7f63440b4310 2024-03-30T13:08:28.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f6349645640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f634415b130 0x7f63440d1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:28.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f6349645640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f634415b130 0x7f63440d1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43274/0 (socket says 172.21.15.83:43274) 2024-03-30T13:08:28.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f6349645640 1 -- 172.21.15.83:0/1748137596 learned_addr learned my addr 172.21.15.83:0/1748137596 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:28.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f6348e44640 1 --2- 172.21.15.83:0/1748137596 >> v2:172.21.15.153:3300/0 conn(0x7f63440b4310 0x7f63440b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:28.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f6349645640 1 -- 172.21.15.83:0/1748137596 >> v2:172.21.15.153:3300/0 conn(0x7f63440b4310 msgr2=0x7f63440b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:28.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f6349645640 1 --2- 172.21.15.83:0/1748137596 >> v2:172.21.15.153:3300/0 conn(0x7f63440b4310 0x7f63440b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f6349645640 1 -- 172.21.15.83:0/1748137596 >> v1:172.21.15.153:6789/0 conn(0x7f63440b5060 legacy=0x7f634415edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:28.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.405+0000 7f6349645640 1 -- 172.21.15.83:0/1748137596 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63440ae8f0 con 0x7f634415b130 2024-03-30T13:08:28.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6349645640 1 --2- 172.21.15.83:0/1748137596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f634415b130 0x7f63440d1890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6344071fa0 tx=0x7f634001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90ef5fea63763ba server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:28.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f633bfff640 1 -- 172.21.15.83:0/1748137596 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63400b0070 con 0x7f634415b130 2024-03-30T13:08:28.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f633bfff640 1 -- 172.21.15.83:0/1748137596 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63400ab600 con 0x7f634415b130 2024-03-30T13:08:28.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f633bfff640 1 -- 172.21.15.83:0/1748137596 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63400ab9d0 con 0x7f634415b130 2024-03-30T13:08:28.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 -- 172.21.15.83:0/1748137596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f634415b130 msgr2=0x7f63440d1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 --2- 172.21.15.83:0/1748137596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f634415b130 0x7f63440d1890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6344071fa0 tx=0x7f634001c4e0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 -- 172.21.15.83:0/1748137596 shutdown_connections 2024-03-30T13:08:28.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 --2- 172.21.15.83:0/1748137596 >> v2:172.21.15.153:3300/0 conn(0x7f63440b4310 0x7f63440b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 --2- 172.21.15.83:0/1748137596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f634415b130 0x7f63440d1890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 -- 172.21.15.83:0/1748137596 >> 172.21.15.83:0/1748137596 conn(0x7f634409aa50 msgr2=0x7f63440b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:28.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 -- 172.21.15.83:0/1748137596 shutdown_connections 2024-03-30T13:08:28.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 -- 172.21.15.83:0/1748137596 wait complete. 2024-03-30T13:08:28.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 Processor -- start 2024-03-30T13:08:28.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 -- start start 2024-03-30T13:08:28.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63440b4310 0x7f6344156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:28.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63440b5060 0x7f6344151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f634415b130 0x7f634406b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f634415b690 con 0x7f634415b130 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f634415b510 con 0x7f63440b5060 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f634b8a9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f63440b03e0 con 0x7f63440b4310 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6349e46640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f634415b130 0x7f634406b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6349e46640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f634415b130 0x7f634406b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43280/0 (socket says 172.21.15.83:43280) 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6349e46640 1 -- 172.21.15.83:0/2258288380 learned_addr learned my addr 172.21.15.83:0/2258288380 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6348e44640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63440b5060 0x7f6344151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6349645640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63440b4310 0x7f6344156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6349e46640 1 -- 172.21.15.83:0/2258288380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63440b4310 msgr2=0x7f6344156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6349e46640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63440b4310 0x7f6344156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6349e46640 1 -- 172.21.15.83:0/2258288380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63440b5060 msgr2=0x7f6344151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6349e46640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63440b5060 0x7f6344151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6349e46640 1 -- 172.21.15.83:0/2258288380 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634414d2a0 con 0x7f634415b130 2024-03-30T13:08:28.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6349645640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63440b4310 0x7f6344156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:28.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6349e46640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f634415b130 0x7f634406b660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f633c00c7b0 tx=0x7f633c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:28.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.409+0000 7f6339ffb640 1 -- 172.21.15.83:0/2258288380 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c004b70 con 0x7f634415b130 2024-03-30T13:08:28.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.413+0000 7f6339ffb640 1 -- 172.21.15.83:0/2258288380 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633c004d10 con 0x7f634415b130 2024-03-30T13:08:28.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.413+0000 7f6339ffb640 1 -- 172.21.15.83:0/2258288380 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c00aa90 con 0x7f634415b130 2024-03-30T13:08:28.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.413+0000 7f634b8a9640 1 -- 172.21.15.83:0/2258288380 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634414d580 con 0x7f634415b130 2024-03-30T13:08:28.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.413+0000 7f634b8a9640 1 -- 172.21.15.83:0/2258288380 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6344151670 con 0x7f634415b130 2024-03-30T13:08:28.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.413+0000 7f634b8a9640 1 -- 172.21.15.83:0/2258288380 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6344068dd0 con 0x7f634415b130 2024-03-30T13:08:28.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.413+0000 7f6339ffb640 1 -- 172.21.15.83:0/2258288380 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f633c00ac30 con 0x7f634415b130 2024-03-30T13:08:28.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.413+0000 7f6339ffb640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6328067fc0 0x7f632806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:28.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.413+0000 7f6349645640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6328067fc0 0x7f632806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:28.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.413+0000 7f6339ffb640 1 -- 172.21.15.83:0/2258288380 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f633c086720 con 0x7f634415b130 2024-03-30T13:08:28.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.413+0000 7f6349645640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6328067fc0 0x7f632806a480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f63400ad000 tx=0x7f6340008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:28.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.417+0000 7f6339ffb640 1 -- 172.21.15.83:0/2258288380 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f633c020070 con 0x7f634415b130 2024-03-30T13:08:28.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.597+0000 7f634b8a9640 1 -- 172.21.15.83:0/2258288380 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f634414a810 con 0x7f634415b130 2024-03-30T13:08:28.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.597+0000 7f6339ffb640 1 -- 172.21.15.83:0/2258288380 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7f633c056f60 con 0x7f634415b130 2024-03-30T13:08:28.603 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:28.603 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2431286615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2431286615},{"type":"v1","addr":"172.21.15.153:6835","nonce":2431286615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1036905849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1036905849},{"type":"v1","addr":"172.21.15.83:6835","nonce":1036905849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2692566836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2692566836},{"type":"v1","addr":"172.21.15.83:6837","nonce":2692566836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:08:25.599943+0000","modified":"2024-03-30T13:08:27.589265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/53727078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":53727078},{"type":"v1","addr":"172.21.15.153:6833","nonce":53727078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-30T13:08:28.604 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 6 2024-03-30T13:08:28.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.601+0000 7f634b8a9640 1 -- 172.21.15.83:0/2258288380 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6328067fc0 msgr2=0x7f632806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.601+0000 7f634b8a9640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6328067fc0 0x7f632806a480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f63400ad000 tx=0x7f6340008040 comp rx=0 tx=0).stop 2024-03-30T13:08:28.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.601+0000 7f634b8a9640 1 -- 172.21.15.83:0/2258288380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f634415b130 msgr2=0x7f634406b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.601+0000 7f634b8a9640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f634415b130 0x7f634406b660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f633c00c7b0 tx=0x7f633c00cc70 comp rx=0 tx=0).stop 2024-03-30T13:08:28.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.601+0000 7f634b8a9640 1 -- 172.21.15.83:0/2258288380 shutdown_connections 2024-03-30T13:08:28.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.601+0000 7f634b8a9640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6328067fc0 0x7f632806a480 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.601+0000 7f634b8a9640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f634415b130 0x7f634406b660 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.601+0000 7f634b8a9640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63440b5060 0x7f6344151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.601+0000 7f634b8a9640 1 --2- 172.21.15.83:0/2258288380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63440b4310 0x7f6344156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.601+0000 7f634b8a9640 1 -- 172.21.15.83:0/2258288380 >> 172.21.15.83:0/2258288380 conn(0x7f634409aa50 msgr2=0x7f634414eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:28.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.601+0000 7f634b8a9640 1 -- 172.21.15.83:0/2258288380 shutdown_connections 2024-03-30T13:08:28.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.601+0000 7f634b8a9640 1 -- 172.21.15.83:0/2258288380 wait complete. 2024-03-30T13:08:28.621 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:28.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f27535df640 1 Processor -- start 2024-03-30T13:08:28.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f27535df640 1 -- start start 2024-03-30T13:08:28.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f27535df640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f274c06b660 0x7f274c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:28.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f27535df640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f274c09ac80 0x7f274c0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:28.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f27535df640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f274c06bf80 con 0x7f274c162120 2024-03-30T13:08:28.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f27535df640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f274c15ecf0 con 0x7f274c06b660 2024-03-30T13:08:28.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f27535df640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f274c15efd0 con 0x7f274c09ac80 2024-03-30T13:08:28.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f275137b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f274c06b660 0x7f274c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:28.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f2750b7a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f274c09ac80 0x7f274c0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:28.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f275137b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f274c06b660 0x7f274c06ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:41000/0 (socket says 172.21.15.83:41000) 2024-03-30T13:08:28.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f275137b640 1 -- 172.21.15.83:0/4105661484 learned_addr learned my addr 172.21.15.83:0/4105661484 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:28.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f275137b640 1 -- 172.21.15.83:0/4105661484 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f274c09ac80 msgr2=0x7f274c0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:28.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f275137b640 1 --2- 172.21.15.83:0/4105661484 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f274c09ac80 0x7f274c0b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f275137b640 1 -- 172.21.15.83:0/4105661484 >> v1:172.21.15.153:6789/0 conn(0x7f274c162120 legacy=0x7f274c1625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f275137b640 1 -- 172.21.15.83:0/4105661484 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274c15f2b0 con 0x7f274c06b660 2024-03-30T13:08:28.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.721+0000 7f2750b7a640 1 --2- 172.21.15.83:0/4105661484 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f274c09ac80 0x7f274c0b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:28.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f275137b640 1 --2- 172.21.15.83:0/4105661484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c06b660 0x7f274c06ba40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2748009870 tx=0x7f274801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1be011a3b7ff6bc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:28.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f2743fff640 1 -- 172.21.15.83:0/4105661484 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480b1070 con 0x7f274c06b660 2024-03-30T13:08:28.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f2743fff640 1 -- 172.21.15.83:0/4105661484 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27480a8050 con 0x7f274c06b660 2024-03-30T13:08:28.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f2743fff640 1 -- 172.21.15.83:0/4105661484 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480ac860 con 0x7f274c06b660 2024-03-30T13:08:28.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f27535df640 1 -- 172.21.15.83:0/4105661484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c06b660 msgr2=0x7f274c06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f27535df640 1 --2- 172.21.15.83:0/4105661484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c06b660 0x7f274c06ba40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2748009870 tx=0x7f274801c4d0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f27535df640 1 -- 172.21.15.83:0/4105661484 shutdown_connections 2024-03-30T13:08:28.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f27535df640 1 --2- 172.21.15.83:0/4105661484 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f274c09ac80 0x7f274c0b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f27535df640 1 --2- 172.21.15.83:0/4105661484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c06b660 0x7f274c06ba40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f27535df640 1 -- 172.21.15.83:0/4105661484 >> 172.21.15.83:0/4105661484 conn(0x7f274c0b68c0 msgr2=0x7f274c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:28.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f27535df640 1 -- 172.21.15.83:0/4105661484 shutdown_connections 2024-03-30T13:08:28.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f27535df640 1 -- 172.21.15.83:0/4105661484 wait complete. 2024-03-30T13:08:28.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f27535df640 1 Processor -- start 2024-03-30T13:08:28.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f27535df640 1 -- start start 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.725+0000 7f27535df640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f274c06b660 0x7f274c070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f27535df640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c09ac80 0x7f274c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f27535df640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f274c162120 0x7f274c14b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f27535df640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f274c16bcd0 con 0x7f274c06b660 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f27535df640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f274c16be50 con 0x7f274c09ac80 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f27535df640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f274c16bfd0 con 0x7f274c162120 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f275137b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f274c06b660 0x7f274c070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f275137b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f274c06b660 0x7f274c070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43288/0 (socket says 172.21.15.83:43288) 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f275137b640 1 -- 172.21.15.83:0/3411746886 learned_addr learned my addr 172.21.15.83:0/3411746886 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f2750b7a640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c09ac80 0x7f274c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f2751b7c640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f274c162120 0x7f274c14b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f275137b640 1 -- 172.21.15.83:0/3411746886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f274c162120 msgr2=0x7f274c14b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f275137b640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f274c162120 0x7f274c14b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f275137b640 1 -- 172.21.15.83:0/3411746886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c09ac80 msgr2=0x7f274c06ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f275137b640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c09ac80 0x7f274c06ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f275137b640 1 -- 172.21.15.83:0/3411746886 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274c06f240 con 0x7f274c06b660 2024-03-30T13:08:28.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f2751b7c640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f274c162120 0x7f274c14b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:28.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f2750b7a640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c09ac80 0x7f274c06ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:28.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f275137b640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f274c06b660 0x7f274c070590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f274801a100 tx=0x7f274801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:28.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f2741ffb640 1 -- 172.21.15.83:0/3411746886 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480b1040 con 0x7f274c06b660 2024-03-30T13:08:28.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f2741ffb640 1 -- 172.21.15.83:0/3411746886 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27480bc070 con 0x7f274c06b660 2024-03-30T13:08:28.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f2741ffb640 1 -- 172.21.15.83:0/3411746886 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480b7690 con 0x7f274c06b660 2024-03-30T13:08:28.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f27535df640 1 -- 172.21.15.83:0/3411746886 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f274c06f520 con 0x7f274c06b660 2024-03-30T13:08:28.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f27535df640 1 -- 172.21.15.83:0/3411746886 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f274c136790 con 0x7f274c06b660 2024-03-30T13:08:28.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f27535df640 1 -- 172.21.15.83:0/3411746886 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f274c068dd0 con 0x7f274c06b660 2024-03-30T13:08:28.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f2741ffb640 1 -- 172.21.15.83:0/3411746886 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f27480b7830 con 0x7f274c06b660 2024-03-30T13:08:28.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f2741ffb640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2730067fc0 0x7f273006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:28.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f2741ffb640 1 -- 172.21.15.83:0/3411746886 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f27481206c0 con 0x7f274c06b660 2024-03-30T13:08:28.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f2750b7a640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2730067fc0 0x7f273006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:28.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.729+0000 7f2750b7a640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2730067fc0 0x7f273006a480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f274c0cd8f0 tx=0x7f273c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:28.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.733+0000 7f2741ffb640 1 -- 172.21.15.83:0/3411746886 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f27480c7060 con 0x7f274c06b660 2024-03-30T13:08:28.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.893+0000 7f27535df640 1 -- 172.21.15.83:0/3411746886 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f274c169290 con 0x7f274c06b660 2024-03-30T13:08:28.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.897+0000 7f2741ffb640 1 -- 172.21.15.83:0/3411746886 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f2748016150 con 0x7f274c06b660 2024-03-30T13:08:28.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:28.953 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:28.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.901+0000 7f27535df640 1 -- 172.21.15.83:0/3411746886 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2730067fc0 msgr2=0x7f273006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.901+0000 7f27535df640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2730067fc0 0x7f273006a480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f274c0cd8f0 tx=0x7f273c008040 comp rx=0 tx=0).stop 2024-03-30T13:08:28.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.901+0000 7f27535df640 1 -- 172.21.15.83:0/3411746886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f274c06b660 msgr2=0x7f274c070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:28.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.901+0000 7f27535df640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f274c06b660 0x7f274c070590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f274801a100 tx=0x7f274801ad10 comp rx=0 tx=0).stop 2024-03-30T13:08:28.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.901+0000 7f27535df640 1 -- 172.21.15.83:0/3411746886 shutdown_connections 2024-03-30T13:08:28.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.901+0000 7f27535df640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2730067fc0 0x7f273006a480 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.901+0000 7f27535df640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f274c162120 0x7f274c14b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.901+0000 7f27535df640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c09ac80 0x7f274c06ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.901+0000 7f27535df640 1 --2- 172.21.15.83:0/3411746886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f274c06b660 0x7f274c070590 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:28.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.901+0000 7f27535df640 1 -- 172.21.15.83:0/3411746886 >> 172.21.15.83:0/3411746886 conn(0x7f274c0b68c0 msgr2=0x7f274c15b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:28.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.901+0000 7f27535df640 1 -- 172.21.15.83:0/3411746886 shutdown_connections 2024-03-30T13:08:28.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:28.901+0000 7f27535df640 1 -- 172.21.15.83:0/3411746886 wait complete. 2024-03-30T13:08:28.956 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-30T13:08:28.956 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:08:29.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.069+0000 7f4040f9d640 1 Processor -- start 2024-03-30T13:08:29.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.069+0000 7f4040f9d640 1 -- start start 2024-03-30T13:08:29.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f4040f9d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c09ac50 0x7f403c15f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f4040f9d640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f403c0b4320 con 0x7f403c15e700 2024-03-30T13:08:29.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f4040f9d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f403c0b4600 con 0x7f403c06b660 2024-03-30T13:08:29.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f4040f9d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f403c15fb10 con 0x7f403c09ac50 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403a59c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f403c15e700 0x7f403c0704a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40174/0 (socket says 172.21.15.83:40174) 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403a59c640 1 -- 172.21.15.83:0/546968064 learned_addr learned my addr 172.21.15.83:0/546968064 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f4039d9b640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c09ac50 0x7f403c15f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 492145779 0 0) 0x7f403c0b4320 con 0x7f403c15e700 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4024003530 con 0x7f403c15e700 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4221934511 0 0) 0x7f403c0b4600 con 0x7f403c06b660 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f403c0b4320 con 0x7f403c06b660 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1726324233 0 0) 0x7f4024003530 con 0x7f403c15e700 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c09ac50 msgr2=0x7f403c15f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c09ac50 0x7f403c15f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 >> v1:172.21.15.153:6789/0 conn(0x7f403c06b660 legacy=0x7f403c06e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c15edd0 con 0x7f403c15e700 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f402c001a00 con 0x7f403c15e700 2024-03-30T13:08:29.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 >> v1:172.21.15.83:6789/0 conn(0x7f403c15e700 legacy=0x7f403c0704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c09ac50 0x7f4024003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40240040e0 0x7f4024004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4024004d50 0x7f40240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f403c15fb10 con 0x7f4024004d50 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f402400bb60 con 0x7f40240040e0 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f402400bd30 con 0x7f403c09ac50 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403ad9d640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4024004d50 0x7f40240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f4039d9b640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40240040e0 0x7f4024004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403a59c640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c09ac50 0x7f4024003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403ad9d640 1 -- 172.21.15.83:0/546968064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c09ac50 msgr2=0x7f4024003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403ad9d640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c09ac50 0x7f4024003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403ad9d640 1 -- 172.21.15.83:0/546968064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40240040e0 msgr2=0x7f4024004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403ad9d640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40240040e0 0x7f4024004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403ad9d640 1 -- 172.21.15.83:0/546968064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4024003530 con 0x7f4024004d50 2024-03-30T13:08:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f4039d9b640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40240040e0 0x7f4024004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.073+0000 7f403ad9d640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4024004d50 0x7f40240051d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40340018d0 tx=0x7f403401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbc6321cb322da7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034001520 con 0x7f4024004d50 2024-03-30T13:08:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40340052f0 con 0x7f4024004d50 2024-03-30T13:08:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403959a640 1 -- 172.21.15.83:0/546968064 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40340a8950 con 0x7f4024004d50 2024-03-30T13:08:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 -- 172.21.15.83:0/546968064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4024004d50 msgr2=0x7f40240051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 --2- 172.21.15.83:0/546968064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4024004d50 0x7f40240051d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40340018d0 tx=0x7f403401ecf0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403ad9d640 1 -- 172.21.15.83:0/546968064 reap_dead start 2024-03-30T13:08:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 -- 172.21.15.83:0/546968064 shutdown_connections 2024-03-30T13:08:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 -- 172.21.15.83:0/546968064 >> 172.21.15.83:0/546968064 conn(0x7f403c0b68c0 msgr2=0x7f403c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:29.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 -- 172.21.15.83:0/546968064 shutdown_connections 2024-03-30T13:08:29.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 -- 172.21.15.83:0/546968064 wait complete. 2024-03-30T13:08:29.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 Processor -- start 2024-03-30T13:08:29.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 -- start start 2024-03-30T13:08:29.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f403c14fd30 0x7f403c09eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c09bca0 0x7f403c09c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c1592c0 0x7f403c159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f403c15f5d0 con 0x7f403c14fd30 2024-03-30T13:08:29.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f403c15eae0 con 0x7f403c09bca0 2024-03-30T13:08:29.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f403c15f750 con 0x7f403c1592c0 2024-03-30T13:08:29.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f403c14fd30 0x7f403c09eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f403c14fd30 0x7f403c09eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43308/0 (socket says 172.21.15.83:43308) 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403a59c640 1 -- 172.21.15.83:0/920552498 learned_addr learned my addr 172.21.15.83:0/920552498 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403ad9d640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c1592c0 0x7f403c159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4039d9b640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c09bca0 0x7f403c09c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403a59c640 1 -- 172.21.15.83:0/920552498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c1592c0 msgr2=0x7f403c159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403a59c640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c1592c0 0x7f403c159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403a59c640 1 -- 172.21.15.83:0/920552498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c09bca0 msgr2=0x7f403c09c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403a59c640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c09bca0 0x7f403c09c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403a59c640 1 -- 172.21.15.83:0/920552498 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c159c80 con 0x7f403c14fd30 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f403a59c640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f403c14fd30 0x7f403c09eb80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f402c00e470 tx=0x7f402c00e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f402affd640 1 -- 172.21.15.83:0/920552498 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c012590 con 0x7f403c14fd30 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f402affd640 1 -- 172.21.15.83:0/920552498 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402c018070 con 0x7f403c14fd30 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 -- 172.21.15.83:0/920552498 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403c09db60 con 0x7f403c14fd30 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f402affd640 1 -- 172.21.15.83:0/920552498 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c012990 con 0x7f403c14fd30 2024-03-30T13:08:29.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.077+0000 7f4040f9d640 1 -- 172.21.15.83:0/920552498 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f403c09e0a0 con 0x7f403c14fd30 2024-03-30T13:08:29.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.081+0000 7f4040f9d640 1 -- 172.21.15.83:0/920552498 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f403c068dd0 con 0x7f403c14fd30 2024-03-30T13:08:29.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.081+0000 7f402affd640 1 -- 172.21.15.83:0/920552498 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f402c012b30 con 0x7f403c14fd30 2024-03-30T13:08:29.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.081+0000 7f402affd640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f401c067ff0 0x7f401c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.081+0000 7f402affd640 1 -- 172.21.15.83:0/920552498 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f402c086f20 con 0x7f403c14fd30 2024-03-30T13:08:29.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.081+0000 7f4039d9b640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f401c067ff0 0x7f401c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.081+0000 7f4039d9b640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f401c067ff0 0x7f401c06a4b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f403c1505e0 tx=0x7f4030008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:29.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.085+0000 7f402affd640 1 -- 172.21.15.83:0/920552498 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f402c023250 con 0x7f403c14fd30 2024-03-30T13:08:29.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.229+0000 7f4040f9d640 1 -- 172.21.15.83:0/920552498 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f403c06c190 con 0x7f401c067ff0 2024-03-30T13:08:29.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.237+0000 7f402affd640 1 -- 172.21.15.83:0/920552498 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238818 (secure 0 0 0) 0x7f403c06c190 con 0x7f401c067ff0 2024-03-30T13:08:29.245 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:29.247 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:08:29.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.241+0000 7f4040f9d640 1 -- 172.21.15.83:0/920552498 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f401c067ff0 msgr2=0x7f401c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.241+0000 7f4040f9d640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f401c067ff0 0x7f401c06a4b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f403c1505e0 tx=0x7f4030008040 comp rx=0 tx=0).stop 2024-03-30T13:08:29.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.241+0000 7f4040f9d640 1 -- 172.21.15.83:0/920552498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f403c14fd30 msgr2=0x7f403c09eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.241+0000 7f4040f9d640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f403c14fd30 0x7f403c09eb80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f402c00e470 tx=0x7f402c00e930 comp rx=0 tx=0).stop 2024-03-30T13:08:29.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.241+0000 7f4040f9d640 1 -- 172.21.15.83:0/920552498 shutdown_connections 2024-03-30T13:08:29.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.241+0000 7f4040f9d640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f401c067ff0 0x7f401c06a4b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.241+0000 7f4040f9d640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f403c1592c0 0x7f403c159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.241+0000 7f4040f9d640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403c09bca0 0x7f403c09c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.241+0000 7f4040f9d640 1 --2- 172.21.15.83:0/920552498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f403c14fd30 0x7f403c09eb80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.241+0000 7f4040f9d640 1 -- 172.21.15.83:0/920552498 >> 172.21.15.83:0/920552498 conn(0x7f403c0b68c0 msgr2=0x7f403c0afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:29.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.241+0000 7f4040f9d640 1 -- 172.21.15.83:0/920552498 shutdown_connections 2024-03-30T13:08:29.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.241+0000 7f4040f9d640 1 -- 172.21.15.83:0/920552498 wait complete. 2024-03-30T13:08:29.261 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-30T13:08:28.142013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":218624,"kb_used_data":2456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756096,"statfs":{"total":773094113280,"available":772870242304,"internally_reserved":0,"allocated":2514944,"data_stored":1588648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001219"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.234086+0000","last_change":"2024-03-30T13:08:25.234086+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.234086+0000","last_undegraded":"2024-03-30T13:08:25.234086+0000","last_fullsized":"2024-03-30T13:08:25.234086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.233892+0000","last_change":"2024-03-30T13:08:25.233892+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.233892+0000","last_undegraded":"2024-03-30T13:08:25.233892+0000","last_fullsized":"2024-03-30T13:08:25.233892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.232494+0000","last_change":"2024-03-30T13:08:25.232494+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.232494+0000","last_undegraded":"2024-03-30T13:08:25.232494+0000","last_fullsized":"2024-03-30T13:08:25.232494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.230376+0000","last_change":"2024-03-30T13:08:25.230376+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.230376+0000","last_undegraded":"2024-03-30T13:08:25.230376+0000","last_fullsized":"2024-03-30T13:08:25.230376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.230979+0000","last_change":"2024-03-30T13:08:25.230979+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.230979+0000","last_undegraded":"2024-03-30T13:08:25.230979+0000","last_fullsized":"2024-03-30T13:08:25.230979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.251866+0000","last_change":"2024-03-30T13:08:25.244929+0000","last_active":"2024-03-30T13:08:25.251866+0000","last_peered":"2024-03-30T13:08:25.251866+0000","last_clean":"2024-03-30T13:08:25.251866+0000","last_became_active":"2024-03-30T13:08:25.244565+0000","last_became_peered":"2024-03-30T13:08:25.244565+0000","last_unstale":"2024-03-30T13:08:25.251866+0000","last_undegraded":"2024-03-30T13:08:25.251866+0000","last_fullsized":"2024-03-30T13:08:25.251866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:55:06.360626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.253407+0000","last_change":"2024-03-30T13:08:25.247533+0000","last_active":"2024-03-30T13:08:25.253407+0000","last_peered":"2024-03-30T13:08:25.253407+0000","last_clean":"2024-03-30T13:08:25.253407+0000","last_became_active":"2024-03-30T13:08:25.246529+0000","last_became_peered":"2024-03-30T13:08:25.246529+0000","last_unstale":"2024-03-30T13:08:25.253407+0000","last_undegraded":"2024-03-30T13:08:25.253407+0000","last_fullsized":"2024-03-30T13:08:25.253407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:55:06.360626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.251956+0000","last_change":"2024-03-30T13:08:25.246374+0000","last_active":"2024-03-30T13:08:25.251956+0000","last_peered":"2024-03-30T13:08:25.251956+0000","last_clean":"2024-03-30T13:08:25.251956+0000","last_became_active":"2024-03-30T13:08:25.246054+0000","last_became_peered":"2024-03-30T13:08:25.246054+0000","last_unstale":"2024-03-30T13:08:25.251956+0000","last_undegraded":"2024-03-30T13:08:25.251956+0000","last_fullsized":"2024-03-30T13:08:25.251956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:47.553831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.275531+0000","last_change":"2024-03-30T13:08:25.273872+0000","last_active":"2024-03-30T13:08:25.275531+0000","last_peered":"2024-03-30T13:08:25.275531+0000","last_clean":"2024-03-30T13:08:25.275531+0000","last_became_active":"2024-03-30T13:08:25.273570+0000","last_became_peered":"2024-03-30T13:08:25.273570+0000","last_unstale":"2024-03-30T13:08:25.275531+0000","last_undegraded":"2024-03-30T13:08:25.275531+0000","last_fullsized":"2024-03-30T13:08:25.275531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:08:47.439600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-30T13:08:14.329046+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:08:14.329046+0000","last_peered":"2024-03-30T13:08:14.329046+0000","last_clean":"2024-03-30T13:08:14.329046+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:08:14.329046+0000","last_undegraded":"2024-03-30T13:08:14.329046+0000","last_fullsized":"2024-03-30T13:08:14.329046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.244441+0000","last_change":"2024-03-30T13:08:25.240103+0000","last_active":"2024-03-30T13:08:25.244441+0000","last_peered":"2024-03-30T13:08:25.244441+0000","last_clean":"2024-03-30T13:08:25.244441+0000","last_became_active":"2024-03-30T13:08:25.239719+0000","last_became_peered":"2024-03-30T13:08:25.239719+0000","last_unstale":"2024-03-30T13:08:25.244441+0000","last_undegraded":"2024-03-30T13:08:25.244441+0000","last_fullsized":"2024-03-30T13:08:25.244441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:03:41.112581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.235385+0000","last_change":"2024-03-30T13:08:25.235385+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.235385+0000","last_undegraded":"2024-03-30T13:08:25.235385+0000","last_fullsized":"2024-03-30T13:08:25.235385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.230491+0000","last_change":"2024-03-30T13:08:25.230491+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.230491+0000","last_undegraded":"2024-03-30T13:08:25.230491+0000","last_fullsized":"2024-03-30T13:08:25.230491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":638334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":638334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":60058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":60058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:08:29.266 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:08:29.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2183c71640 1 Processor -- start 2024-03-30T13:08:29.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2183c71640 1 -- start start 2024-03-30T13:08:29.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2183c71640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c0730e0 0x7f217c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2183c71640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f217c0b4bb0 0x7f217c15f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2183c71640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c0734c0 con 0x7f217c06f140 2024-03-30T13:08:29.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2183c71640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f217c15c2a0 con 0x7f217c0b4bb0 2024-03-30T13:08:29.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2183c71640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f217c15c580 con 0x7f217c0730e0 2024-03-30T13:08:29.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2181a0d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c0730e0 0x7f217c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2181a0d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c0730e0 0x7f217c15b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:50206/0 (socket says 172.21.15.83:50206) 2024-03-30T13:08:29.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f218120c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f217c0b4bb0 0x7f217c15f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2181a0d640 1 -- 172.21.15.83:0/2855554316 learned_addr learned my addr 172.21.15.83:0/2855554316 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:29.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2181a0d640 1 -- 172.21.15.83:0/2855554316 >> v2:172.21.15.153:3300/0 conn(0x7f217c0b4bb0 msgr2=0x7f217c15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:29.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2181a0d640 1 --2- 172.21.15.83:0/2855554316 >> v2:172.21.15.153:3300/0 conn(0x7f217c0b4bb0 0x7f217c15f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2181a0d640 1 -- 172.21.15.83:0/2855554316 >> v1:172.21.15.153:6789/0 conn(0x7f217c06f140 legacy=0x7f217c0b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.409+0000 7f2181a0d640 1 -- 172.21.15.83:0/2855554316 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c15c860 con 0x7f217c0730e0 2024-03-30T13:08:29.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2181a0d640 1 --2- 172.21.15.83:0/2855554316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c0730e0 0x7f217c15b950 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f217800bb10 tx=0x7f217801ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3114e4c3e11b224d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:29.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2180a0b640 1 -- 172.21.15.83:0/2855554316 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21780b4070 con 0x7f217c0730e0 2024-03-30T13:08:29.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2180a0b640 1 -- 172.21.15.83:0/2855554316 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21780a7ae0 con 0x7f217c0730e0 2024-03-30T13:08:29.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2180a0b640 1 -- 172.21.15.83:0/2855554316 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21780af440 con 0x7f217c0730e0 2024-03-30T13:08:29.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 -- 172.21.15.83:0/2855554316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c0730e0 msgr2=0x7f217c15b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 --2- 172.21.15.83:0/2855554316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c0730e0 0x7f217c15b950 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f217800bb10 tx=0x7f217801ec00 comp rx=0 tx=0).stop 2024-03-30T13:08:29.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 -- 172.21.15.83:0/2855554316 shutdown_connections 2024-03-30T13:08:29.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 --2- 172.21.15.83:0/2855554316 >> v2:172.21.15.153:3300/0 conn(0x7f217c0b4bb0 0x7f217c15f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 --2- 172.21.15.83:0/2855554316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c0730e0 0x7f217c15b950 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 -- 172.21.15.83:0/2855554316 >> 172.21.15.83:0/2855554316 conn(0x7f217c0b1d60 msgr2=0x7f217c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:29.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 -- 172.21.15.83:0/2855554316 shutdown_connections 2024-03-30T13:08:29.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 -- 172.21.15.83:0/2855554316 wait complete. 2024-03-30T13:08:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 Processor -- start 2024-03-30T13:08:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 -- start start 2024-03-30T13:08:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c06f140 0x7f217c148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f217c0730e0 0x7f217c0cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f217c0b4bb0 0x7f217c14d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f217c15c010 con 0x7f217c0b4bb0 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f217c15be90 con 0x7f217c0730e0 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2183c71640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f217c15fd00 con 0x7f217c06f140 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f218220e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f217c0b4bb0 0x7f217c14d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f218220e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f217c0b4bb0 0x7f217c14d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43312/0 (socket says 172.21.15.83:43312) 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f218220e640 1 -- 172.21.15.83:0/3596904510 learned_addr learned my addr 172.21.15.83:0/3596904510 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2181a0d640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c06f140 0x7f217c148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f218120c640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f217c0730e0 0x7f217c0cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f218220e640 1 -- 172.21.15.83:0/3596904510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c06f140 msgr2=0x7f217c148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f218220e640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c06f140 0x7f217c148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f218220e640 1 -- 172.21.15.83:0/3596904510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f217c0730e0 msgr2=0x7f217c0cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f218220e640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f217c0730e0 0x7f217c0cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f218220e640 1 -- 172.21.15.83:0/3596904510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c14f750 con 0x7f217c0b4bb0 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.413+0000 7f2181a0d640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c06f140 0x7f217c148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.417+0000 7f218220e640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f217c0b4bb0 0x7f217c14d9a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f217400c760 tx=0x7f217400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.417+0000 7f21727fc640 1 -- 172.21.15.83:0/3596904510 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174016020 con 0x7f217c0b4bb0 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.417+0000 7f21727fc640 1 -- 172.21.15.83:0/3596904510 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2174006d60 con 0x7f217c0b4bb0 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.417+0000 7f21727fc640 1 -- 172.21.15.83:0/3596904510 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174003bc0 con 0x7f217c0b4bb0 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.417+0000 7f2183c71640 1 -- 172.21.15.83:0/3596904510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217c14fa30 con 0x7f217c0b4bb0 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.417+0000 7f2183c71640 1 -- 172.21.15.83:0/3596904510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217c14fff0 con 0x7f217c0b4bb0 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.417+0000 7f2183c71640 1 -- 172.21.15.83:0/3596904510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f217c0686c0 con 0x7f217c0b4bb0 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.417+0000 7f21727fc640 1 -- 172.21.15.83:0/3596904510 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f21740050d0 con 0x7f217c0b4bb0 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.417+0000 7f21727fc640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2160067fc0 0x7f216006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.417+0000 7f21727fc640 1 -- 172.21.15.83:0/3596904510 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2174086000 con 0x7f217c0b4bb0 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.417+0000 7f2181a0d640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2160067fc0 0x7f216006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.417+0000 7f2181a0d640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2160067fc0 0x7f216006a480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f21780b1000 tx=0x7f21780a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:29.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.421+0000 7f21727fc640 1 -- 172.21.15.83:0/3596904510 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f2174020020 con 0x7f217c0b4bb0 2024-03-30T13:08:29.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.581+0000 7f2183c71640 1 -- 172.21.15.83:0/3596904510 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f217c14e2a0 con 0x7f2160067fc0 2024-03-30T13:08:29.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.597+0000 7f21727fc640 1 -- 172.21.15.83:0/3596904510 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238818 (secure 0 0 0) 0x7f21780f9500 con 0x7f2160067fc0 2024-03-30T13:08:29.603 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:29.606 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:08:29.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.601+0000 7f2183c71640 1 -- 172.21.15.83:0/3596904510 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2160067fc0 msgr2=0x7f216006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.601+0000 7f2183c71640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2160067fc0 0x7f216006a480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f21780b1000 tx=0x7f21780a9070 comp rx=0 tx=0).stop 2024-03-30T13:08:29.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.601+0000 7f2183c71640 1 -- 172.21.15.83:0/3596904510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f217c0b4bb0 msgr2=0x7f217c14d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.601+0000 7f2183c71640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f217c0b4bb0 0x7f217c14d9a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f217400c760 tx=0x7f217400cc20 comp rx=0 tx=0).stop 2024-03-30T13:08:29.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.601+0000 7f2183c71640 1 -- 172.21.15.83:0/3596904510 shutdown_connections 2024-03-30T13:08:29.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.601+0000 7f2183c71640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2160067fc0 0x7f216006a480 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.601+0000 7f2183c71640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f217c0b4bb0 0x7f217c14d9a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.601+0000 7f2183c71640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f217c0730e0 0x7f217c0cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.601+0000 7f2183c71640 1 --2- 172.21.15.83:0/3596904510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f217c06f140 0x7f217c148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.601+0000 7f2183c71640 1 -- 172.21.15.83:0/3596904510 >> 172.21.15.83:0/3596904510 conn(0x7f217c0b1d60 msgr2=0x7f217c14eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:29.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.601+0000 7f2183c71640 1 -- 172.21.15.83:0/3596904510 shutdown_connections 2024-03-30T13:08:29.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.601+0000 7f2183c71640 1 -- 172.21.15.83:0/3596904510 wait complete. 2024-03-30T13:08:29.623 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-30T13:08:28.142013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":218624,"kb_used_data":2456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756096,"statfs":{"total":773094113280,"available":772870242304,"internally_reserved":0,"allocated":2514944,"data_stored":1588648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001219"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.234086+0000","last_change":"2024-03-30T13:08:25.234086+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.234086+0000","last_undegraded":"2024-03-30T13:08:25.234086+0000","last_fullsized":"2024-03-30T13:08:25.234086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.233892+0000","last_change":"2024-03-30T13:08:25.233892+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.233892+0000","last_undegraded":"2024-03-30T13:08:25.233892+0000","last_fullsized":"2024-03-30T13:08:25.233892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.232494+0000","last_change":"2024-03-30T13:08:25.232494+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.232494+0000","last_undegraded":"2024-03-30T13:08:25.232494+0000","last_fullsized":"2024-03-30T13:08:25.232494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.230376+0000","last_change":"2024-03-30T13:08:25.230376+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.230376+0000","last_undegraded":"2024-03-30T13:08:25.230376+0000","last_fullsized":"2024-03-30T13:08:25.230376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.230979+0000","last_change":"2024-03-30T13:08:25.230979+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.230979+0000","last_undegraded":"2024-03-30T13:08:25.230979+0000","last_fullsized":"2024-03-30T13:08:25.230979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.251866+0000","last_change":"2024-03-30T13:08:25.244929+0000","last_active":"2024-03-30T13:08:25.251866+0000","last_peered":"2024-03-30T13:08:25.251866+0000","last_clean":"2024-03-30T13:08:25.251866+0000","last_became_active":"2024-03-30T13:08:25.244565+0000","last_became_peered":"2024-03-30T13:08:25.244565+0000","last_unstale":"2024-03-30T13:08:25.251866+0000","last_undegraded":"2024-03-30T13:08:25.251866+0000","last_fullsized":"2024-03-30T13:08:25.251866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:55:06.360626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.253407+0000","last_change":"2024-03-30T13:08:25.247533+0000","last_active":"2024-03-30T13:08:25.253407+0000","last_peered":"2024-03-30T13:08:25.253407+0000","last_clean":"2024-03-30T13:08:25.253407+0000","last_became_active":"2024-03-30T13:08:25.246529+0000","last_became_peered":"2024-03-30T13:08:25.246529+0000","last_unstale":"2024-03-30T13:08:25.253407+0000","last_undegraded":"2024-03-30T13:08:25.253407+0000","last_fullsized":"2024-03-30T13:08:25.253407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:55:06.360626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.251956+0000","last_change":"2024-03-30T13:08:25.246374+0000","last_active":"2024-03-30T13:08:25.251956+0000","last_peered":"2024-03-30T13:08:25.251956+0000","last_clean":"2024-03-30T13:08:25.251956+0000","last_became_active":"2024-03-30T13:08:25.246054+0000","last_became_peered":"2024-03-30T13:08:25.246054+0000","last_unstale":"2024-03-30T13:08:25.251956+0000","last_undegraded":"2024-03-30T13:08:25.251956+0000","last_fullsized":"2024-03-30T13:08:25.251956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:47.553831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.275531+0000","last_change":"2024-03-30T13:08:25.273872+0000","last_active":"2024-03-30T13:08:25.275531+0000","last_peered":"2024-03-30T13:08:25.275531+0000","last_clean":"2024-03-30T13:08:25.275531+0000","last_became_active":"2024-03-30T13:08:25.273570+0000","last_became_peered":"2024-03-30T13:08:25.273570+0000","last_unstale":"2024-03-30T13:08:25.275531+0000","last_undegraded":"2024-03-30T13:08:25.275531+0000","last_fullsized":"2024-03-30T13:08:25.275531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:08:47.439600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-30T13:08:14.329046+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:08:14.329046+0000","last_peered":"2024-03-30T13:08:14.329046+0000","last_clean":"2024-03-30T13:08:14.329046+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:08:14.329046+0000","last_undegraded":"2024-03-30T13:08:14.329046+0000","last_fullsized":"2024-03-30T13:08:14.329046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.244441+0000","last_change":"2024-03-30T13:08:25.240103+0000","last_active":"2024-03-30T13:08:25.244441+0000","last_peered":"2024-03-30T13:08:25.244441+0000","last_clean":"2024-03-30T13:08:25.244441+0000","last_became_active":"2024-03-30T13:08:25.239719+0000","last_became_peered":"2024-03-30T13:08:25.239719+0000","last_unstale":"2024-03-30T13:08:25.244441+0000","last_undegraded":"2024-03-30T13:08:25.244441+0000","last_fullsized":"2024-03-30T13:08:25.244441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:03:41.112581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.235385+0000","last_change":"2024-03-30T13:08:25.235385+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.235385+0000","last_undegraded":"2024-03-30T13:08:25.235385+0000","last_fullsized":"2024-03-30T13:08:25.235385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.230491+0000","last_change":"2024-03-30T13:08:25.230491+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.230491+0000","last_undegraded":"2024-03-30T13:08:25.230491+0000","last_fullsized":"2024-03-30T13:08:25.230491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":638334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":638334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":60058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":60058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:08:29.627 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:08:29.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0aae8f8640 1 Processor -- start 2024-03-30T13:08:29.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0aae8f8640 1 -- start start 2024-03-30T13:08:29.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0aae8f8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0aa80b49c0 0x7f0aa809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0aae8f8640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0aa809af90 0x7f0aa80c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0aae8f8640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aa80ce2b0 con 0x7f0aa815c490 2024-03-30T13:08:29.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0aae8f8640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0aa80ce590 con 0x7f0aa809af90 2024-03-30T13:08:29.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0aae8f8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa80c5f30 con 0x7f0aa80b49c0 2024-03-30T13:08:29.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0a9ffff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0aa80b49c0 0x7f0aa809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0a9ffff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0aa80b49c0 0x7f0aa809aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:50224/0 (socket says 172.21.15.83:50224) 2024-03-30T13:08:29.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0a9ffff640 1 -- 172.21.15.83:0/345129086 learned_addr learned my addr 172.21.15.83:0/345129086 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:29.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0aace95640 1 --2- 172.21.15.83:0/345129086 >> v2:172.21.15.153:3300/0 conn(0x7f0aa809af90 0x7f0aa80c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0aa77fe640 1 -- 172.21.15.83:0/345129086 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 948557708 0 0) 0x7f0aa80ce2b0 con 0x7f0aa815c490 2024-03-30T13:08:29.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0aa77fe640 1 -- 172.21.15.83:0/345129086 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a94003530 con 0x7f0aa815c490 2024-03-30T13:08:29.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0a9ffff640 1 -- 172.21.15.83:0/345129086 >> v2:172.21.15.153:3300/0 conn(0x7f0aa809af90 msgr2=0x7f0aa80c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:29.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0a9ffff640 1 --2- 172.21.15.83:0/345129086 >> v2:172.21.15.153:3300/0 conn(0x7f0aa809af90 0x7f0aa80c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0a9ffff640 1 -- 172.21.15.83:0/345129086 >> v1:172.21.15.153:6789/0 conn(0x7f0aa815c490 legacy=0x7f0aa80cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.789+0000 7f0a9ffff640 1 -- 172.21.15.83:0/345129086 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa80c6210 con 0x7f0aa80b49c0 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0a9ffff640 1 --2- 172.21.15.83:0/345129086 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0aa80b49c0 0x7f0aa809aa50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009870 tx=0x7f0a9001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c9129e98aa4fab server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aa77fe640 1 -- 172.21.15.83:0/345129086 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900b2070 con 0x7f0aa80b49c0 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aa77fe640 1 -- 172.21.15.83:0/345129086 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a900a9070 con 0x7f0aa80b49c0 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aa77fe640 1 -- 172.21.15.83:0/345129086 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900ad860 con 0x7f0aa80b49c0 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 -- 172.21.15.83:0/345129086 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0aa80b49c0 msgr2=0x7f0aa809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 --2- 172.21.15.83:0/345129086 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0aa80b49c0 0x7f0aa809aa50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009870 tx=0x7f0a9001c560 comp rx=0 tx=0).stop 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 -- 172.21.15.83:0/345129086 shutdown_connections 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 --2- 172.21.15.83:0/345129086 >> v2:172.21.15.153:3300/0 conn(0x7f0aa809af90 0x7f0aa80c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 --2- 172.21.15.83:0/345129086 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0aa80b49c0 0x7f0aa809aa50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 -- 172.21.15.83:0/345129086 >> 172.21.15.83:0/345129086 conn(0x7f0aa80b3da0 msgr2=0x7f0aa80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 -- 172.21.15.83:0/345129086 shutdown_connections 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 -- 172.21.15.83:0/345129086 wait complete. 2024-03-30T13:08:29.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 Processor -- start 2024-03-30T13:08:29.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 -- start start 2024-03-30T13:08:29.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0aa809af90 0x7f0aa80b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aa80b49c0 0x7f0aa8158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0aa815c490 0x7f0aa815f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa80c7810 con 0x7f0aa80b49c0 2024-03-30T13:08:29.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa80c7690 con 0x7f0aa815c490 2024-03-30T13:08:29.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aae8f8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa80c7990 con 0x7f0aa809af90 2024-03-30T13:08:29.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0a9ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aa80b49c0 0x7f0aa8158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0a9ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aa80b49c0 0x7f0aa8158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43320/0 (socket says 172.21.15.83:43320) 2024-03-30T13:08:29.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0a9ffff640 1 -- 172.21.15.83:0/75099183 learned_addr learned my addr 172.21.15.83:0/75099183 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:29.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aa7fff640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0aa809af90 0x7f0aa80b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.793+0000 7f0aace95640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0aa815c490 0x7f0aa815f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0a9ffff640 1 -- 172.21.15.83:0/75099183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0aa809af90 msgr2=0x7f0aa80b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0a9ffff640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0aa809af90 0x7f0aa80b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0a9ffff640 1 -- 172.21.15.83:0/75099183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0aa815c490 msgr2=0x7f0aa815f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0a9ffff640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0aa815c490 0x7f0aa815f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0a9ffff640 1 -- 172.21.15.83:0/75099183 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa8158d50 con 0x7f0aa80b49c0 2024-03-30T13:08:29.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0a9ffff640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aa80b49c0 0x7f0aa8158810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0a900b0040 tx=0x7f0a90019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:29.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0aa57fa640 1 -- 172.21.15.83:0/75099183 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900ba020 con 0x7f0aa80b49c0 2024-03-30T13:08:29.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0aa57fa640 1 -- 172.21.15.83:0/75099183 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a900adcd0 con 0x7f0aa80b49c0 2024-03-30T13:08:29.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0aae8f8640 1 -- 172.21.15.83:0/75099183 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa80c9fe0 con 0x7f0aa80b49c0 2024-03-30T13:08:29.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0aa57fa640 1 -- 172.21.15.83:0/75099183 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900b2040 con 0x7f0aa80b49c0 2024-03-30T13:08:29.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0aae8f8640 1 -- 172.21.15.83:0/75099183 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa80ca5a0 con 0x7f0aa80b49c0 2024-03-30T13:08:29.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0aae8f8640 1 -- 172.21.15.83:0/75099183 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa8074f30 con 0x7f0aa80b49c0 2024-03-30T13:08:29.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0aa57fa640 1 -- 172.21.15.83:0/75099183 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f0a900bd020 con 0x7f0aa80b49c0 2024-03-30T13:08:29.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0aa57fa640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0a88067ff0 0x7f0a8806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:29.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0aa57fa640 1 -- 172.21.15.83:0/75099183 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0a9011fd60 con 0x7f0aa80b49c0 2024-03-30T13:08:29.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0aa7fff640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0a88067ff0 0x7f0a8806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:29.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.797+0000 7f0aa7fff640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0a88067ff0 0x7f0a8806a4b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a980011f0 tx=0x7f0a98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:29.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.801+0000 7f0aa57fa640 1 -- 172.21.15.83:0/75099183 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f0a900c4030 con 0x7f0aa80b49c0 2024-03-30T13:08:29.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.949+0000 7f0aae8f8640 1 -- 172.21.15.83:0/75099183 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0aa80c9d90 con 0x7f0a88067ff0 2024-03-30T13:08:29.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.957+0000 7f0aa57fa640 1 -- 172.21.15.83:0/75099183 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238818 (secure 0 0 0) 0x7f0aa80c9d90 con 0x7f0a88067ff0 2024-03-30T13:08:29.966 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:29.967 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:08:29.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.961+0000 7f0aae8f8640 1 -- 172.21.15.83:0/75099183 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0a88067ff0 msgr2=0x7f0a8806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.961+0000 7f0aae8f8640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0a88067ff0 0x7f0a8806a4b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a980011f0 tx=0x7f0a98009040 comp rx=0 tx=0).stop 2024-03-30T13:08:29.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.961+0000 7f0aae8f8640 1 -- 172.21.15.83:0/75099183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aa80b49c0 msgr2=0x7f0aa8158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:29.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.961+0000 7f0aae8f8640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aa80b49c0 0x7f0aa8158810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0a900b0040 tx=0x7f0a90019300 comp rx=0 tx=0).stop 2024-03-30T13:08:29.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.961+0000 7f0aae8f8640 1 -- 172.21.15.83:0/75099183 shutdown_connections 2024-03-30T13:08:29.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.961+0000 7f0aae8f8640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0a88067ff0 0x7f0a8806a4b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.961+0000 7f0aae8f8640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0aa815c490 0x7f0aa815f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.961+0000 7f0aae8f8640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aa80b49c0 0x7f0aa8158810 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.961+0000 7f0aae8f8640 1 --2- 172.21.15.83:0/75099183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0aa809af90 0x7f0aa80b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:29.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.961+0000 7f0aae8f8640 1 -- 172.21.15.83:0/75099183 >> 172.21.15.83:0/75099183 conn(0x7f0aa80b3da0 msgr2=0x7f0aa81662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:29.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.961+0000 7f0aae8f8640 1 -- 172.21.15.83:0/75099183 shutdown_connections 2024-03-30T13:08:29.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:29.961+0000 7f0aae8f8640 1 -- 172.21.15.83:0/75099183 wait complete. 2024-03-30T13:08:29.982 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-30T13:08:28.142013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":218624,"kb_used_data":2456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756096,"statfs":{"total":773094113280,"available":772870242304,"internally_reserved":0,"allocated":2514944,"data_stored":1588648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001219"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.234086+0000","last_change":"2024-03-30T13:08:25.234086+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.234086+0000","last_undegraded":"2024-03-30T13:08:25.234086+0000","last_fullsized":"2024-03-30T13:08:25.234086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.233892+0000","last_change":"2024-03-30T13:08:25.233892+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.233892+0000","last_undegraded":"2024-03-30T13:08:25.233892+0000","last_fullsized":"2024-03-30T13:08:25.233892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.232494+0000","last_change":"2024-03-30T13:08:25.232494+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.232494+0000","last_undegraded":"2024-03-30T13:08:25.232494+0000","last_fullsized":"2024-03-30T13:08:25.232494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.230376+0000","last_change":"2024-03-30T13:08:25.230376+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.230376+0000","last_undegraded":"2024-03-30T13:08:25.230376+0000","last_fullsized":"2024-03-30T13:08:25.230376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.230979+0000","last_change":"2024-03-30T13:08:25.230979+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.230979+0000","last_undegraded":"2024-03-30T13:08:25.230979+0000","last_fullsized":"2024-03-30T13:08:25.230979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.251866+0000","last_change":"2024-03-30T13:08:25.244929+0000","last_active":"2024-03-30T13:08:25.251866+0000","last_peered":"2024-03-30T13:08:25.251866+0000","last_clean":"2024-03-30T13:08:25.251866+0000","last_became_active":"2024-03-30T13:08:25.244565+0000","last_became_peered":"2024-03-30T13:08:25.244565+0000","last_unstale":"2024-03-30T13:08:25.251866+0000","last_undegraded":"2024-03-30T13:08:25.251866+0000","last_fullsized":"2024-03-30T13:08:25.251866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:55:06.360626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.253407+0000","last_change":"2024-03-30T13:08:25.247533+0000","last_active":"2024-03-30T13:08:25.253407+0000","last_peered":"2024-03-30T13:08:25.253407+0000","last_clean":"2024-03-30T13:08:25.253407+0000","last_became_active":"2024-03-30T13:08:25.246529+0000","last_became_peered":"2024-03-30T13:08:25.246529+0000","last_unstale":"2024-03-30T13:08:25.253407+0000","last_undegraded":"2024-03-30T13:08:25.253407+0000","last_fullsized":"2024-03-30T13:08:25.253407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:55:06.360626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.251956+0000","last_change":"2024-03-30T13:08:25.246374+0000","last_active":"2024-03-30T13:08:25.251956+0000","last_peered":"2024-03-30T13:08:25.251956+0000","last_clean":"2024-03-30T13:08:25.251956+0000","last_became_active":"2024-03-30T13:08:25.246054+0000","last_became_peered":"2024-03-30T13:08:25.246054+0000","last_unstale":"2024-03-30T13:08:25.251956+0000","last_undegraded":"2024-03-30T13:08:25.251956+0000","last_fullsized":"2024-03-30T13:08:25.251956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:47.553831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.275531+0000","last_change":"2024-03-30T13:08:25.273872+0000","last_active":"2024-03-30T13:08:25.275531+0000","last_peered":"2024-03-30T13:08:25.275531+0000","last_clean":"2024-03-30T13:08:25.275531+0000","last_became_active":"2024-03-30T13:08:25.273570+0000","last_became_peered":"2024-03-30T13:08:25.273570+0000","last_unstale":"2024-03-30T13:08:25.275531+0000","last_undegraded":"2024-03-30T13:08:25.275531+0000","last_fullsized":"2024-03-30T13:08:25.275531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:08:47.439600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-30T13:08:14.329046+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:08:14.329046+0000","last_peered":"2024-03-30T13:08:14.329046+0000","last_clean":"2024-03-30T13:08:14.329046+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:08:14.329046+0000","last_undegraded":"2024-03-30T13:08:14.329046+0000","last_fullsized":"2024-03-30T13:08:14.329046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.244441+0000","last_change":"2024-03-30T13:08:25.240103+0000","last_active":"2024-03-30T13:08:25.244441+0000","last_peered":"2024-03-30T13:08:25.244441+0000","last_clean":"2024-03-30T13:08:25.244441+0000","last_became_active":"2024-03-30T13:08:25.239719+0000","last_became_peered":"2024-03-30T13:08:25.239719+0000","last_unstale":"2024-03-30T13:08:25.244441+0000","last_undegraded":"2024-03-30T13:08:25.244441+0000","last_fullsized":"2024-03-30T13:08:25.244441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:03:41.112581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.235385+0000","last_change":"2024-03-30T13:08:25.235385+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.235385+0000","last_undegraded":"2024-03-30T13:08:25.235385+0000","last_fullsized":"2024-03-30T13:08:25.235385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.230491+0000","last_change":"2024-03-30T13:08:25.230491+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.230491+0000","last_undegraded":"2024-03-30T13:08:25.230491+0000","last_fullsized":"2024-03-30T13:08:25.230491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:25.214237+0000","last_change":"2024-03-30T13:08:25.214237+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.214237+0000","last_undegraded":"2024-03-30T13:08:25.214237+0000","last_fullsized":"2024-03-30T13:08:25.214237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:08:24.204939+0000","last_change":"2024-03-30T13:08:24.204939+0000","last_active":"2024-03-30T13:08:24.204939+0000","last_peered":"2024-03-30T13:08:24.204939+0000","last_clean":"2024-03-30T13:08:24.204939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:24.204939+0000","last_undegraded":"2024-03-30T13:08:24.204939+0000","last_fullsized":"2024-03-30T13:08:24.204939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":638334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":638334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":60058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":60058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:08:29.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-03-30T13:08:29.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-03-30T13:08:29.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-03-30T13:08:29.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-03-30T13:08:29.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-03-30T13:08:29.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-03-30T13:08:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-03-30T13:08:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-03-30T13:08:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-03-30T13:08:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-03-30T13:08:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-03-30T13:08:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-03-30T13:08:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:08:25.234086+0000', 'last_change': '2024-03-30T13:08:25.234086+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.234086+0000', 'last_undegraded': '2024-03-30T13:08:25.234086+0000', 'last_fullsized': '2024-03-30T13:08:25.234086+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-30T13:08:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-03-30T13:08:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-03-30T13:08:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-03-30T13:08:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-03-30T13:08:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-03-30T13:08:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-03-30T13:08:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:08:25.233892+0000', 'last_change': '2024-03-30T13:08:25.233892+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.233892+0000', 'last_undegraded': '2024-03-30T13:08:25.233892+0000', 'last_fullsized': '2024-03-30T13:08:25.233892+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:08:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-03-30T13:08:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-03-30T13:08:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-03-30T13:08:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-03-30T13:08:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-03-30T13:08:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-03-30T13:08:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-03-30T13:08:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-03-30T13:08:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-03-30T13:08:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-03-30T13:08:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-03-30T13:08:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-03-30T13:08:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-03-30T13:08:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:08:25.232494+0000', 'last_change': '2024-03-30T13:08:25.232494+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.232494+0000', 'last_undegraded': '2024-03-30T13:08:25.232494+0000', 'last_fullsized': '2024-03-30T13:08:25.232494+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:08:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-03-30T13:08:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-03-30T13:08:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:08:25.230376+0000', 'last_change': '2024-03-30T13:08:25.230376+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.230376+0000', 'last_undegraded': '2024-03-30T13:08:25.230376+0000', 'last_fullsized': '2024-03-30T13:08:25.230376+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-30T13:08:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-03-30T13:08:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-03-30T13:08:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-03-30T13:08:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-03-30T13:08:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-03-30T13:08:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-03-30T13:08:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-03-30T13:08:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-03-30T13:08:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-03-30T13:08:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-03-30T13:08:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-03-30T13:08:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-03-30T13:08:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-03-30T13:08:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:08:25.230979+0000', 'last_change': '2024-03-30T13:08:25.230979+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.230979+0000', 'last_undegraded': '2024-03-30T13:08:25.230979+0000', 'last_fullsized': '2024-03-30T13:08:25.230979+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-30T13:08:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-03-30T13:08:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-03-30T13:08:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-03-30T13:08:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-03-30T13:08:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-03-30T13:08:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-03-30T13:08:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-03-30T13:08:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-03-30T13:08:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-03-30T13:08:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-03-30T13:08:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-03-30T13:08:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-03-30T13:08:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-03-30T13:08:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-03-30T13:08:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-03-30T13:08:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-03-30T13:08:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-03-30T13:08:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-03-30T13:08:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-03-30T13:08:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-03-30T13:08:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-03-30T13:08:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:08:25.235385+0000', 'last_change': '2024-03-30T13:08:25.235385+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.235385+0000', 'last_undegraded': '2024-03-30T13:08:25.235385+0000', 'last_fullsized': '2024-03-30T13:08:25.235385+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-30T13:08:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-03-30T13:08:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-03-30T13:08:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-03-30T13:08:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-03-30T13:08:30.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-03-30T13:08:30.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-03-30T13:08:30.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-03-30T13:08:30.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-03-30T13:08:30.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-03-30T13:08:30.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-03-30T13:08:30.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:08:25.230491+0000', 'last_change': '2024-03-30T13:08:25.230491+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.230491+0000', 'last_undegraded': '2024-03-30T13:08:25.230491+0000', 'last_fullsized': '2024-03-30T13:08:25.230491+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-30T13:08:30.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-03-30T13:08:30.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-03-30T13:08:30.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-03-30T13:08:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-03-30T13:08:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-03-30T13:08:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-03-30T13:08:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-03-30T13:08:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-03-30T13:08:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-03-30T13:08:30.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-03-30T13:08:30.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-03-30T13:08:30.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-03-30T13:08:30.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-03-30T13:08:30.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:25.214237+0000', 'last_change': '2024-03-30T13:08:25.214237+0000', 'last_active': '2024-03-30T13:08:25.214237+0000', 'last_peered': '2024-03-30T13:08:25.214237+0000', 'last_clean': '2024-03-30T13:08:25.214237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:25.214237+0000', 'last_undegraded': '2024-03-30T13:08:25.214237+0000', 'last_fullsized': '2024-03-30T13:08:25.214237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:25.214237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-03-30T13:08:30.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T13:08:24.204939+0000', 'last_change': '2024-03-30T13:08:24.204939+0000', 'last_active': '2024-03-30T13:08:24.204939+0000', 'last_peered': '2024-03-30T13:08:24.204939+0000', 'last_clean': '2024-03-30T13:08:24.204939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:08:24.204939+0000', 'last_undegraded': '2024-03-30T13:08:24.204939+0000', 'last_fullsized': '2024-03-30T13:08:24.204939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'last_clean_scrub_stamp': '2024-03-30T13:08:24.204939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T13:08:30.005 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-30T13:08:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.137+0000 7f8ea836c640 1 Processor -- start 2024-03-30T13:08:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.137+0000 7f8ea836c640 1 -- start start 2024-03-30T13:08:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.137+0000 7f8ea836c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8ea00aed20 0x7f8ea00af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.137+0000 7f8ea836c640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea00cfcb0 con 0x7f8ea006dfe0 2024-03-30T13:08:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.137+0000 7f8ea836c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea00ad290 con 0x7f8ea00b4830 2024-03-30T13:08:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.137+0000 7f8ea836c640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f8ea0156e00 con 0x7f8ea00aed20 2024-03-30T13:08:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.137+0000 7f8ea5907640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8ea00aed20 0x7f8ea00af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.137+0000 7f8ea6909640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f8ea006dfe0 0x7f8ea006e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40186/0 (socket says 172.21.15.83:40186) 2024-03-30T13:08:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.137+0000 7f8ea6909640 1 -- 172.21.15.83:0/3729757635 learned_addr learned my addr 172.21.15.83:0/3729757635 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.137+0000 7f8ea5907640 1 -- 172.21.15.83:0/3729757635 >> v1:172.21.15.153:6789/0 conn(0x7f8ea00b4830 legacy=0x7f8ea015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.137+0000 7f8ea5907640 1 -- 172.21.15.83:0/3729757635 >> v1:172.21.15.83:6789/0 conn(0x7f8ea006dfe0 legacy=0x7f8ea006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.137+0000 7f8ea5907640 1 -- 172.21.15.83:0/3729757635 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea00ad570 con 0x7f8ea00aed20 2024-03-30T13:08:30.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.141+0000 7f8ea5907640 1 --2- 172.21.15.83:0/3729757635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00aed20 0x7f8ea00af1d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8e900097c0 tx=0x7f8e9001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae50a09ca58142bb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:30.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.141+0000 7f8ea5106640 1 -- 172.21.15.83:0/3729757635 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e900b0070 con 0x7f8ea00aed20 2024-03-30T13:08:30.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.141+0000 7f8ea5106640 1 -- 172.21.15.83:0/3729757635 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e900ab600 con 0x7f8ea00aed20 2024-03-30T13:08:30.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.141+0000 7f8ea5106640 1 -- 172.21.15.83:0/3729757635 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e900ab9d0 con 0x7f8ea00aed20 2024-03-30T13:08:30.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.141+0000 7f8ea836c640 1 -- 172.21.15.83:0/3729757635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00aed20 msgr2=0x7f8ea00af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.141+0000 7f8ea836c640 1 --2- 172.21.15.83:0/3729757635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00aed20 0x7f8ea00af1d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8e900097c0 tx=0x7f8e9001c380 comp rx=0 tx=0).stop 2024-03-30T13:08:30.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.141+0000 7f8ea836c640 1 -- 172.21.15.83:0/3729757635 shutdown_connections 2024-03-30T13:08:30.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.141+0000 7f8ea836c640 1 --2- 172.21.15.83:0/3729757635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00aed20 0x7f8ea00af1d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.141+0000 7f8ea836c640 1 -- 172.21.15.83:0/3729757635 >> 172.21.15.83:0/3729757635 conn(0x7f8ea00b1d60 msgr2=0x7f8ea00b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:30.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.141+0000 7f8ea836c640 1 -- 172.21.15.83:0/3729757635 shutdown_connections 2024-03-30T13:08:30.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.141+0000 7f8ea836c640 1 -- 172.21.15.83:0/3729757635 wait complete. 2024-03-30T13:08:30.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea836c640 1 Processor -- start 2024-03-30T13:08:30.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea836c640 1 -- start start 2024-03-30T13:08:30.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea836c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ea006dfe0 0x7f8ea009de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea836c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ea00aed20 0x7f8ea0155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea836c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00b4830 0x7f8ea015b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea836c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00cf9e0 con 0x7f8ea00b4830 2024-03-30T13:08:30.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea836c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00cf860 con 0x7f8ea006dfe0 2024-03-30T13:08:30.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea836c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea016a290 con 0x7f8ea00aed20 2024-03-30T13:08:30.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea6909640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00b4830 0x7f8ea015b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea6909640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00b4830 0x7f8ea015b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43346/0 (socket says 172.21.15.83:43346) 2024-03-30T13:08:30.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea6909640 1 -- 172.21.15.83:0/936939110 learned_addr learned my addr 172.21.15.83:0/936939110 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:30.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea5907640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ea00aed20 0x7f8ea0155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea6108640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ea006dfe0 0x7f8ea009de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea6909640 1 -- 172.21.15.83:0/936939110 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ea00aed20 msgr2=0x7f8ea0155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea6909640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ea00aed20 0x7f8ea0155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea6909640 1 -- 172.21.15.83:0/936939110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ea006dfe0 msgr2=0x7f8ea009de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea6909640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ea006dfe0 0x7f8ea009de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea6909640 1 -- 172.21.15.83:0/936939110 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea0157ec0 con 0x7f8ea00b4830 2024-03-30T13:08:30.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea6108640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ea006dfe0 0x7f8ea009de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:30.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea6909640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00b4830 0x7f8ea015b250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800caa0 tx=0x7f8e9800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:30.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8e96ffd640 1 -- 172.21.15.83:0/936939110 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98017070 con 0x7f8ea00b4830 2024-03-30T13:08:30.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8e96ffd640 1 -- 172.21.15.83:0/936939110 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9800ab40 con 0x7f8ea00b4830 2024-03-30T13:08:30.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea836c640 1 -- 172.21.15.83:0/936939110 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea01581a0 con 0x7f8ea00b4830 2024-03-30T13:08:30.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8e96ffd640 1 -- 172.21.15.83:0/936939110 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98012400 con 0x7f8ea00b4830 2024-03-30T13:08:30.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea836c640 1 -- 172.21.15.83:0/936939110 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea009b740 con 0x7f8ea00b4830 2024-03-30T13:08:30.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8ea836c640 1 -- 172.21.15.83:0/936939110 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea00686c0 con 0x7f8ea00b4830 2024-03-30T13:08:30.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8e96ffd640 1 -- 172.21.15.83:0/936939110 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f8e9801a070 con 0x7f8ea00b4830 2024-03-30T13:08:30.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.145+0000 7f8e96ffd640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8e84067fc0 0x7f8e8406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.149+0000 7f8e96ffd640 1 -- 172.21.15.83:0/936939110 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8e98086000 con 0x7f8ea00b4830 2024-03-30T13:08:30.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.149+0000 7f8ea6108640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8e84067fc0 0x7f8e8406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.149+0000 7f8ea6108640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8e84067fc0 0x7f8e8406a480 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ea009cd70 tx=0x7f8e9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:30.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.153+0000 7f8e96ffd640 1 -- 172.21.15.83:0/936939110 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f8e980561f0 con 0x7f8ea00b4830 2024-03-30T13:08:30.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.373+0000 7f8ea836c640 1 -- 172.21.15.83:0/936939110 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8ea00b4ca0 con 0x7f8ea00b4830 2024-03-30T13:08:30.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.373+0000 7f8e96ffd640 1 -- 172.21.15.83:0/936939110 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1097 (secure 0 0 0) 0x7f8e9805a4f0 con 0x7f8ea00b4830 2024-03-30T13:08:30.379 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:30.380 INFO:teuthology.orchestra.run.smithi083.stdout:{"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1711804092,"num_in_osds":8,"osd_in_since":1711804083,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":90},{"state_name":"creating+peering","count":7}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":592756,"bytes_used":224182272,"bytes_avail":772869931008,"bytes_total":773094113280,"inactive_pgs_ratio":0.072164945304393768,"write_bytes_sec":2245,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4279}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-03-30T13:08:01.395636+0000","services":{}},"progress_events":{}} 2024-03-30T13:08:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.377+0000 7f8ea836c640 1 -- 172.21.15.83:0/936939110 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8e84067fc0 msgr2=0x7f8e8406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.377+0000 7f8ea836c640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8e84067fc0 0x7f8e8406a480 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ea009cd70 tx=0x7f8e9c009040 comp rx=0 tx=0).stop 2024-03-30T13:08:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.377+0000 7f8ea836c640 1 -- 172.21.15.83:0/936939110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00b4830 msgr2=0x7f8ea015b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.377+0000 7f8ea836c640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00b4830 0x7f8ea015b250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800caa0 tx=0x7f8e9800cf60 comp rx=0 tx=0).stop 2024-03-30T13:08:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.377+0000 7f8ea836c640 1 -- 172.21.15.83:0/936939110 shutdown_connections 2024-03-30T13:08:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.377+0000 7f8ea836c640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8e84067fc0 0x7f8e8406a480 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.377+0000 7f8ea836c640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00b4830 0x7f8ea015b250 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.377+0000 7f8ea836c640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ea00aed20 0x7f8ea0155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.377+0000 7f8ea836c640 1 --2- 172.21.15.83:0/936939110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ea006dfe0 0x7f8ea009de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.377+0000 7f8ea836c640 1 -- 172.21.15.83:0/936939110 >> 172.21.15.83:0/936939110 conn(0x7f8ea00b1d60 msgr2=0x7f8ea015da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.377+0000 7f8ea836c640 1 -- 172.21.15.83:0/936939110 shutdown_connections 2024-03-30T13:08:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.377+0000 7f8ea836c640 1 -- 172.21.15.83:0/936939110 wait complete. 2024-03-30T13:08:30.398 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-30T13:08:30.399 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:08:30.409 INFO:tasks.ceph.mds.d.smithi153.stderr:2024-03-30T13:08:30.401+0000 7fc55eee6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T13:08:30.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.513+0000 7f138ed19640 1 Processor -- start 2024-03-30T13:08:30.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.513+0000 7f138ed19640 1 -- start start 2024-03-30T13:08:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138ed19640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880b4830 0x7f138815d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138ed19640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f138815d880 con 0x7f138806dfe0 2024-03-30T13:08:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138ed19640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13880cfcb0 con 0x7f13880aed20 2024-03-30T13:08:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138ed19640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1388156e00 con 0x7f13880b4830 2024-03-30T13:08:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138d2b6640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f138806dfe0 0x7f138806e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40196/0 (socket says 172.21.15.83:40196) 2024-03-30T13:08:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138d2b6640 1 -- 172.21.15.83:0/1458866337 learned_addr learned my addr 172.21.15.83:0/1458866337 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138cab5640 1 --2- 172.21.15.83:0/1458866337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880b4830 0x7f138815d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301383743 0 0) 0x7f138815d880 con 0x7f138806dfe0 2024-03-30T13:08:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1370003530 con 0x7f138806dfe0 2024-03-30T13:08:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3157884437 0 0) 0x7f1370003530 con 0x7f138806dfe0 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880b4830 msgr2=0x7f138815d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 --2- 172.21.15.83:0/1458866337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880b4830 0x7f138815d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 >> v1:172.21.15.153:6789/0 conn(0x7f13880aed20 legacy=0x7f13880af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13880ad290 con 0x7f138806dfe0 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f1380001a00 con 0x7f138806dfe0 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 >> v1:172.21.15.83:6789/0 conn(0x7f138806dfe0 legacy=0x7f138806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 --2- 172.21.15.83:0/1458866337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880b4830 0x7f13700039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 --2- 172.21.15.83:0/1458866337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1370003f70 0x7f1370004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 --2- 172.21.15.83:0/1458866337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1370004d50 0x7f13700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1388156e00 con 0x7f1370004d50 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f137000bc10 con 0x7f1370003f70 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f137000be10 con 0x7f13880b4830 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138d2b6640 1 --2- 172.21.15.83:0/1458866337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1370004d50 0x7f13700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138cab5640 1 --2- 172.21.15.83:0/1458866337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880b4830 0x7f13700039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138d2b6640 1 -- 172.21.15.83:0/1458866337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880b4830 msgr2=0x7f13700039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138d2b6640 1 --2- 172.21.15.83:0/1458866337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f13880b4830 0x7f13700039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f1387fff640 1 --2- 172.21.15.83:0/1458866337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1370003f70 0x7f1370004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138d2b6640 1 -- 172.21.15.83:0/1458866337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1370003f70 msgr2=0x7f1370004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138d2b6640 1 --2- 172.21.15.83:0/1458866337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1370003f70 0x7f1370004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138d2b6640 1 -- 172.21.15.83:0/1458866337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1370003530 con 0x7f1370004d50 2024-03-30T13:08:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f138d2b6640 1 --2- 172.21.15.83:0/1458866337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1370004d50 0x7f13700051d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f138000a860 tx=0x7f138001d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1537b127a1ecdee server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.517+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138000a480 con 0x7f1370004d50 2024-03-30T13:08:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13800ad630 con 0x7f1370004d50 2024-03-30T13:08:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f13877fe640 1 -- 172.21.15.83:0/1458866337 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13800adaa0 con 0x7f1370004d50 2024-03-30T13:08:30.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 -- 172.21.15.83:0/1458866337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1370004d50 msgr2=0x7f13700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 --2- 172.21.15.83:0/1458866337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1370004d50 0x7f13700051d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f138000a860 tx=0x7f138001d380 comp rx=0 tx=0).stop 2024-03-30T13:08:30.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138d2b6640 1 -- 172.21.15.83:0/1458866337 reap_dead start 2024-03-30T13:08:30.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 -- 172.21.15.83:0/1458866337 shutdown_connections 2024-03-30T13:08:30.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 -- 172.21.15.83:0/1458866337 >> 172.21.15.83:0/1458866337 conn(0x7f13880b1d60 msgr2=0x7f13880b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:30.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 -- 172.21.15.83:0/1458866337 shutdown_connections 2024-03-30T13:08:30.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 -- 172.21.15.83:0/1458866337 wait complete. 2024-03-30T13:08:30.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 Processor -- start 2024-03-30T13:08:30.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 -- start start 2024-03-30T13:08:30.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1370004d50 0x7f1388160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f138809bc20 0x7f138814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f138809d4a0 0x7f138809d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f13880cf9e0 con 0x7f138809d4a0 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13880cf860 con 0x7f138809bc20 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1388168280 con 0x7f1370004d50 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138d2b6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f138809d4a0 0x7f138809d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138d2b6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f138809d4a0 0x7f138809d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43358/0 (socket says 172.21.15.83:43358) 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138d2b6640 1 -- 172.21.15.83:0/551175427 learned_addr learned my addr 172.21.15.83:0/551175427 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138cab5640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1370004d50 0x7f1388160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f1387fff640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f138809bc20 0x7f138814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138d2b6640 1 -- 172.21.15.83:0/551175427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1370004d50 msgr2=0x7f1388160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138d2b6640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1370004d50 0x7f1388160490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138d2b6640 1 -- 172.21.15.83:0/551175427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f138809bc20 msgr2=0x7f138814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138d2b6640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f138809bc20 0x7f138814a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138d2b6640 1 -- 172.21.15.83:0/551175427 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138809c190 con 0x7f138809d4a0 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138cab5640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1370004d50 0x7f1388160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138d2b6640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f138809d4a0 0x7f138809d900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f138000a860 tx=0x7f1370005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f13857fa640 1 -- 172.21.15.83:0/551175427 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13800bb070 con 0x7f138809d4a0 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f13857fa640 1 -- 172.21.15.83:0/551175427 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13800ad430 con 0x7f138809d4a0 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 -- 172.21.15.83:0/551175427 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138809c470 con 0x7f138809d4a0 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f13857fa640 1 -- 172.21.15.83:0/551175427 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138000a480 con 0x7f138809d4a0 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.521+0000 7f138ed19640 1 -- 172.21.15.83:0/551175427 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13880719a0 con 0x7f138809d4a0 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.525+0000 7f138ed19640 1 -- 172.21.15.83:0/551175427 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138809c990 con 0x7f138809d4a0 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.525+0000 7f13857fa640 1 -- 172.21.15.83:0/551175427 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f13800be070 con 0x7f138809d4a0 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.525+0000 7f13857fa640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1374067fc0 0x7f137406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.525+0000 7f138cab5640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1374067fc0 0x7f137406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.525+0000 7f13857fa640 1 -- 172.21.15.83:0/551175427 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1380120280 con 0x7f138809d4a0 2024-03-30T13:08:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.525+0000 7f138cab5640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1374067fc0 0x7f137406a480 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1378009af0 tx=0x7f1378008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:30.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.529+0000 7f13857fa640 1 -- 172.21.15.83:0/551175427 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f138809c990 con 0x7f138809d4a0 2024-03-30T13:08:30.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.673+0000 7f138ed19640 1 -- 172.21.15.83:0/551175427 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f13880686c0 con 0x7f1374067fc0 2024-03-30T13:08:30.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.689+0000 7f13857fa640 1 -- 172.21.15.83:0/551175427 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251355 (secure 0 0 0) 0x7f13880686c0 con 0x7f1374067fc0 2024-03-30T13:08:30.699 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:30.700 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:08:30.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.693+0000 7f138ed19640 1 -- 172.21.15.83:0/551175427 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1374067fc0 msgr2=0x7f137406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.693+0000 7f138ed19640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1374067fc0 0x7f137406a480 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1378009af0 tx=0x7f1378008040 comp rx=0 tx=0).stop 2024-03-30T13:08:30.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.693+0000 7f138ed19640 1 -- 172.21.15.83:0/551175427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f138809d4a0 msgr2=0x7f138809d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:30.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.693+0000 7f138ed19640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f138809d4a0 0x7f138809d900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f138000a860 tx=0x7f1370005840 comp rx=0 tx=0).stop 2024-03-30T13:08:30.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.693+0000 7f138ed19640 1 -- 172.21.15.83:0/551175427 shutdown_connections 2024-03-30T13:08:30.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.693+0000 7f138ed19640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1374067fc0 0x7f137406a480 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.693+0000 7f138ed19640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f138809d4a0 0x7f138809d900 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.693+0000 7f138ed19640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f138809bc20 0x7f138814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.693+0000 7f138ed19640 1 --2- 172.21.15.83:0/551175427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1370004d50 0x7f1388160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:30.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.693+0000 7f138ed19640 1 -- 172.21.15.83:0/551175427 >> 172.21.15.83:0/551175427 conn(0x7f13880b1d60 msgr2=0x7f138815cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:30.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.693+0000 7f138ed19640 1 -- 172.21.15.83:0/551175427 shutdown_connections 2024-03-30T13:08:30.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:30.693+0000 7f138ed19640 1 -- 172.21.15.83:0/551175427 wait complete. 2024-03-30T13:08:30.715 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-30T13:08:30.142562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218928,"kb_used_data":2748,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755792,"statfs":{"total":773094113280,"available":772869931008,"internally_reserved":0,"allocated":2813952,"data_stored":1719144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.927584"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847699+0000","last_change":"2024-03-30T13:08:26.268523+0000","last_active":"2024-03-30T13:08:27.847699+0000","last_peered":"2024-03-30T13:08:27.847699+0000","last_clean":"2024-03-30T13:08:27.847699+0000","last_became_active":"2024-03-30T13:08:26.267614+0000","last_became_peered":"2024-03-30T13:08:26.267614+0000","last_unstale":"2024-03-30T13:08:27.847699+0000","last_undegraded":"2024-03-30T13:08:27.847699+0000","last_fullsized":"2024-03-30T13:08:27.847699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:07.743621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246696+0000","last_change":"2024-03-30T13:08:26.263035+0000","last_active":"2024-03-30T13:08:27.246696+0000","last_peered":"2024-03-30T13:08:27.246696+0000","last_clean":"2024-03-30T13:08:27.246696+0000","last_became_active":"2024-03-30T13:08:26.262669+0000","last_became_peered":"2024-03-30T13:08:26.262669+0000","last_unstale":"2024-03-30T13:08:27.246696+0000","last_undegraded":"2024-03-30T13:08:27.246696+0000","last_fullsized":"2024-03-30T13:08:27.246696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433514+0000","last_change":"2024-03-30T13:08:26.247241+0000","last_active":"2024-03-30T13:08:27.433514+0000","last_peered":"2024-03-30T13:08:27.433514+0000","last_clean":"2024-03-30T13:08:27.433514+0000","last_became_active":"2024-03-30T13:08:26.246633+0000","last_became_peered":"2024-03-30T13:08:26.246633+0000","last_unstale":"2024-03-30T13:08:27.433514+0000","last_undegraded":"2024-03-30T13:08:27.433514+0000","last_fullsized":"2024-03-30T13:08:27.433514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247342+0000","last_change":"2024-03-30T13:08:26.267093+0000","last_active":"2024-03-30T13:08:27.247342+0000","last_peered":"2024-03-30T13:08:27.247342+0000","last_clean":"2024-03-30T13:08:27.247342+0000","last_became_active":"2024-03-30T13:08:26.266648+0000","last_became_peered":"2024-03-30T13:08:26.266648+0000","last_unstale":"2024-03-30T13:08:27.247342+0000","last_undegraded":"2024-03-30T13:08:27.247342+0000","last_fullsized":"2024-03-30T13:08:27.247342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847414+0000","last_change":"2024-03-30T13:08:26.268233+0000","last_active":"2024-03-30T13:08:27.847414+0000","last_peered":"2024-03-30T13:08:27.847414+0000","last_clean":"2024-03-30T13:08:27.847414+0000","last_became_active":"2024-03-30T13:08:26.267934+0000","last_became_peered":"2024-03-30T13:08:26.267934+0000","last_unstale":"2024-03-30T13:08:27.847414+0000","last_undegraded":"2024-03-30T13:08:27.847414+0000","last_fullsized":"2024-03-30T13:08:27.847414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:33.096715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247522+0000","last_change":"2024-03-30T13:08:26.262334+0000","last_active":"2024-03-30T13:08:27.247522+0000","last_peered":"2024-03-30T13:08:27.247522+0000","last_clean":"2024-03-30T13:08:27.247522+0000","last_became_active":"2024-03-30T13:08:26.262065+0000","last_became_peered":"2024-03-30T13:08:26.262065+0000","last_unstale":"2024-03-30T13:08:27.247522+0000","last_undegraded":"2024-03-30T13:08:27.247522+0000","last_fullsized":"2024-03-30T13:08:27.247522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:38.839595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847119+0000","last_change":"2024-03-30T13:08:26.266561+0000","last_active":"2024-03-30T13:08:27.847119+0000","last_peered":"2024-03-30T13:08:27.847119+0000","last_clean":"2024-03-30T13:08:27.847119+0000","last_became_active":"2024-03-30T13:08:26.266102+0000","last_became_peered":"2024-03-30T13:08:26.266102+0000","last_unstale":"2024-03-30T13:08:27.847119+0000","last_undegraded":"2024-03-30T13:08:27.847119+0000","last_fullsized":"2024-03-30T13:08:27.847119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846133+0000","last_change":"2024-03-30T13:08:26.260829+0000","last_active":"2024-03-30T13:08:27.846133+0000","last_peered":"2024-03-30T13:08:27.846133+0000","last_clean":"2024-03-30T13:08:27.846133+0000","last_became_active":"2024-03-30T13:08:26.254325+0000","last_became_peered":"2024-03-30T13:08:26.254325+0000","last_unstale":"2024-03-30T13:08:27.846133+0000","last_undegraded":"2024-03-30T13:08:27.846133+0000","last_fullsized":"2024-03-30T13:08:27.846133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:06:18.572457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847837+0000","last_change":"2024-03-30T13:08:26.270155+0000","last_active":"2024-03-30T13:08:27.847837+0000","last_peered":"2024-03-30T13:08:27.847837+0000","last_clean":"2024-03-30T13:08:27.847837+0000","last_became_active":"2024-03-30T13:08:26.268095+0000","last_became_peered":"2024-03-30T13:08:26.268095+0000","last_unstale":"2024-03-30T13:08:27.847837+0000","last_undegraded":"2024-03-30T13:08:27.847837+0000","last_fullsized":"2024-03-30T13:08:27.847837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:11:06.559848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845477+0000","last_change":"2024-03-30T13:08:26.254361+0000","last_active":"2024-03-30T13:08:27.845477+0000","last_peered":"2024-03-30T13:08:27.845477+0000","last_clean":"2024-03-30T13:08:27.845477+0000","last_became_active":"2024-03-30T13:08:26.253497+0000","last_became_peered":"2024-03-30T13:08:26.253497+0000","last_unstale":"2024-03-30T13:08:27.845477+0000","last_undegraded":"2024-03-30T13:08:27.845477+0000","last_fullsized":"2024-03-30T13:08:27.845477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845664+0000","last_change":"2024-03-30T13:08:26.252884+0000","last_active":"2024-03-30T13:08:27.845664+0000","last_peered":"2024-03-30T13:08:27.845664+0000","last_clean":"2024-03-30T13:08:27.845664+0000","last_became_active":"2024-03-30T13:08:26.252506+0000","last_became_peered":"2024-03-30T13:08:26.252506+0000","last_unstale":"2024-03-30T13:08:27.845664+0000","last_undegraded":"2024-03-30T13:08:27.845664+0000","last_fullsized":"2024-03-30T13:08:27.845664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.234086+0000","last_change":"2024-03-30T13:08:25.234086+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.234086+0000","last_undegraded":"2024-03-30T13:08:25.234086+0000","last_fullsized":"2024-03-30T13:08:25.234086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847088+0000","last_change":"2024-03-30T13:08:26.266434+0000","last_active":"2024-03-30T13:08:27.847088+0000","last_peered":"2024-03-30T13:08:27.847088+0000","last_clean":"2024-03-30T13:08:27.847088+0000","last_became_active":"2024-03-30T13:08:26.266165+0000","last_became_peered":"2024-03-30T13:08:26.266165+0000","last_unstale":"2024-03-30T13:08:27.847088+0000","last_undegraded":"2024-03-30T13:08:27.847088+0000","last_fullsized":"2024-03-30T13:08:27.847088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433251+0000","last_change":"2024-03-30T13:08:26.260199+0000","last_active":"2024-03-30T13:08:27.433251+0000","last_peered":"2024-03-30T13:08:27.433251+0000","last_clean":"2024-03-30T13:08:27.433251+0000","last_became_active":"2024-03-30T13:08:26.259816+0000","last_became_peered":"2024-03-30T13:08:26.259816+0000","last_unstale":"2024-03-30T13:08:27.433251+0000","last_undegraded":"2024-03-30T13:08:27.433251+0000","last_fullsized":"2024-03-30T13:08:27.433251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:25:49.517498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246122+0000","last_change":"2024-03-30T13:08:26.253691+0000","last_active":"2024-03-30T13:08:27.246122+0000","last_peered":"2024-03-30T13:08:27.246122+0000","last_clean":"2024-03-30T13:08:27.246122+0000","last_became_active":"2024-03-30T13:08:26.253423+0000","last_became_peered":"2024-03-30T13:08:26.253423+0000","last_unstale":"2024-03-30T13:08:27.246122+0000","last_undegraded":"2024-03-30T13:08:27.246122+0000","last_fullsized":"2024-03-30T13:08:27.246122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246924+0000","last_change":"2024-03-30T13:08:26.256141+0000","last_active":"2024-03-30T13:08:27.246924+0000","last_peered":"2024-03-30T13:08:27.246924+0000","last_clean":"2024-03-30T13:08:27.246924+0000","last_became_active":"2024-03-30T13:08:26.255881+0000","last_became_peered":"2024-03-30T13:08:26.255881+0000","last_unstale":"2024-03-30T13:08:27.246924+0000","last_undegraded":"2024-03-30T13:08:27.246924+0000","last_fullsized":"2024-03-30T13:08:27.246924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250662+0000","last_change":"2024-03-30T13:08:26.258857+0000","last_active":"2024-03-30T13:08:27.250662+0000","last_peered":"2024-03-30T13:08:27.250662+0000","last_clean":"2024-03-30T13:08:27.250662+0000","last_became_active":"2024-03-30T13:08:26.258537+0000","last_became_peered":"2024-03-30T13:08:26.258537+0000","last_unstale":"2024-03-30T13:08:27.250662+0000","last_undegraded":"2024-03-30T13:08:27.250662+0000","last_fullsized":"2024-03-30T13:08:27.250662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:52:03.940597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.233892+0000","last_change":"2024-03-30T13:08:25.233892+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.233892+0000","last_undegraded":"2024-03-30T13:08:25.233892+0000","last_fullsized":"2024-03-30T13:08:25.233892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847955+0000","last_change":"2024-03-30T13:08:26.263617+0000","last_active":"2024-03-30T13:08:27.847955+0000","last_peered":"2024-03-30T13:08:27.847955+0000","last_clean":"2024-03-30T13:08:27.847955+0000","last_became_active":"2024-03-30T13:08:26.262858+0000","last_became_peered":"2024-03-30T13:08:26.262858+0000","last_unstale":"2024-03-30T13:08:27.847955+0000","last_undegraded":"2024-03-30T13:08:27.847955+0000","last_fullsized":"2024-03-30T13:08:27.847955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:17.381480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845439+0000","last_change":"2024-03-30T13:08:26.267101+0000","last_active":"2024-03-30T13:08:27.845439+0000","last_peered":"2024-03-30T13:08:27.845439+0000","last_clean":"2024-03-30T13:08:27.845439+0000","last_became_active":"2024-03-30T13:08:26.266836+0000","last_became_peered":"2024-03-30T13:08:26.266836+0000","last_unstale":"2024-03-30T13:08:27.845439+0000","last_undegraded":"2024-03-30T13:08:27.845439+0000","last_fullsized":"2024-03-30T13:08:27.845439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433468+0000","last_change":"2024-03-30T13:08:26.263715+0000","last_active":"2024-03-30T13:08:27.433468+0000","last_peered":"2024-03-30T13:08:27.433468+0000","last_clean":"2024-03-30T13:08:27.433468+0000","last_became_active":"2024-03-30T13:08:26.263309+0000","last_became_peered":"2024-03-30T13:08:26.263309+0000","last_unstale":"2024-03-30T13:08:27.433468+0000","last_undegraded":"2024-03-30T13:08:27.433468+0000","last_fullsized":"2024-03-30T13:08:27.433468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247889+0000","last_change":"2024-03-30T13:08:26.255497+0000","last_active":"2024-03-30T13:08:27.247889+0000","last_peered":"2024-03-30T13:08:27.247889+0000","last_clean":"2024-03-30T13:08:27.247889+0000","last_became_active":"2024-03-30T13:08:26.255198+0000","last_became_peered":"2024-03-30T13:08:26.255198+0000","last_unstale":"2024-03-30T13:08:27.247889+0000","last_undegraded":"2024-03-30T13:08:27.247889+0000","last_fullsized":"2024-03-30T13:08:27.247889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:33.096715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846623+0000","last_change":"2024-03-30T13:08:26.267231+0000","last_active":"2024-03-30T13:08:27.846623+0000","last_peered":"2024-03-30T13:08:27.846623+0000","last_clean":"2024-03-30T13:08:27.846623+0000","last_became_active":"2024-03-30T13:08:26.266897+0000","last_became_peered":"2024-03-30T13:08:26.266897+0000","last_unstale":"2024-03-30T13:08:27.846623+0000","last_undegraded":"2024-03-30T13:08:27.846623+0000","last_fullsized":"2024-03-30T13:08:27.846623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246893+0000","last_change":"2024-03-30T13:08:26.254581+0000","last_active":"2024-03-30T13:08:27.246893+0000","last_peered":"2024-03-30T13:08:27.246893+0000","last_clean":"2024-03-30T13:08:27.246893+0000","last_became_active":"2024-03-30T13:08:26.254315+0000","last_became_peered":"2024-03-30T13:08:26.254315+0000","last_unstale":"2024-03-30T13:08:27.246893+0000","last_undegraded":"2024-03-30T13:08:27.246893+0000","last_fullsized":"2024-03-30T13:08:27.246893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846776+0000","last_change":"2024-03-30T13:08:26.261482+0000","last_active":"2024-03-30T13:08:27.846776+0000","last_peered":"2024-03-30T13:08:27.846776+0000","last_clean":"2024-03-30T13:08:27.846776+0000","last_became_active":"2024-03-30T13:08:26.260033+0000","last_became_peered":"2024-03-30T13:08:26.260033+0000","last_unstale":"2024-03-30T13:08:27.846776+0000","last_undegraded":"2024-03-30T13:08:27.846776+0000","last_fullsized":"2024-03-30T13:08:27.846776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845559+0000","last_change":"2024-03-30T13:08:26.256864+0000","last_active":"2024-03-30T13:08:27.845559+0000","last_peered":"2024-03-30T13:08:27.845559+0000","last_clean":"2024-03-30T13:08:27.845559+0000","last_became_active":"2024-03-30T13:08:26.256473+0000","last_became_peered":"2024-03-30T13:08:26.256473+0000","last_unstale":"2024-03-30T13:08:27.845559+0000","last_undegraded":"2024-03-30T13:08:27.845559+0000","last_fullsized":"2024-03-30T13:08:27.845559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246353+0000","last_change":"2024-03-30T13:08:26.258095+0000","last_active":"2024-03-30T13:08:27.246353+0000","last_peered":"2024-03-30T13:08:27.246353+0000","last_clean":"2024-03-30T13:08:27.246353+0000","last_became_active":"2024-03-30T13:08:26.257730+0000","last_became_peered":"2024-03-30T13:08:26.257730+0000","last_unstale":"2024-03-30T13:08:27.246353+0000","last_undegraded":"2024-03-30T13:08:27.246353+0000","last_fullsized":"2024-03-30T13:08:27.246353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847781+0000","last_change":"2024-03-30T13:08:26.273733+0000","last_active":"2024-03-30T13:08:27.847781+0000","last_peered":"2024-03-30T13:08:27.847781+0000","last_clean":"2024-03-30T13:08:27.847781+0000","last_became_active":"2024-03-30T13:08:26.273292+0000","last_became_peered":"2024-03-30T13:08:26.273292+0000","last_unstale":"2024-03-30T13:08:27.847781+0000","last_undegraded":"2024-03-30T13:08:27.847781+0000","last_fullsized":"2024-03-30T13:08:27.847781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:09:50.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433604+0000","last_change":"2024-03-30T13:08:26.268609+0000","last_active":"2024-03-30T13:08:27.433604+0000","last_peered":"2024-03-30T13:08:27.433604+0000","last_clean":"2024-03-30T13:08:27.433604+0000","last_became_active":"2024-03-30T13:08:26.267927+0000","last_became_peered":"2024-03-30T13:08:26.267927+0000","last_unstale":"2024-03-30T13:08:27.433604+0000","last_undegraded":"2024-03-30T13:08:27.433604+0000","last_fullsized":"2024-03-30T13:08:27.433604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248242+0000","last_change":"2024-03-30T13:08:26.266866+0000","last_active":"2024-03-30T13:08:27.248242+0000","last_peered":"2024-03-30T13:08:27.248242+0000","last_clean":"2024-03-30T13:08:27.248242+0000","last_became_active":"2024-03-30T13:08:26.266575+0000","last_became_peered":"2024-03-30T13:08:26.266575+0000","last_unstale":"2024-03-30T13:08:27.248242+0000","last_undegraded":"2024-03-30T13:08:27.248242+0000","last_fullsized":"2024-03-30T13:08:27.248242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:09:50.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.232494+0000","last_change":"2024-03-30T13:08:25.232494+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.232494+0000","last_undegraded":"2024-03-30T13:08:25.232494+0000","last_fullsized":"2024-03-30T13:08:25.232494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845227+0000","last_change":"2024-03-30T13:08:26.262550+0000","last_active":"2024-03-30T13:08:27.845227+0000","last_peered":"2024-03-30T13:08:27.845227+0000","last_clean":"2024-03-30T13:08:27.845227+0000","last_became_active":"2024-03-30T13:08:26.262229+0000","last_became_peered":"2024-03-30T13:08:26.262229+0000","last_unstale":"2024-03-30T13:08:27.845227+0000","last_undegraded":"2024-03-30T13:08:27.845227+0000","last_fullsized":"2024-03-30T13:08:27.845227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:00:23.772051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.230376+0000","last_change":"2024-03-30T13:08:25.230376+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.230376+0000","last_undegraded":"2024-03-30T13:08:25.230376+0000","last_fullsized":"2024-03-30T13:08:25.230376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847372+0000","last_change":"2024-03-30T13:08:25.270817+0000","last_active":"2024-03-30T13:08:27.847372+0000","last_peered":"2024-03-30T13:08:27.847372+0000","last_clean":"2024-03-30T13:08:27.847372+0000","last_became_active":"2024-03-30T13:08:25.270460+0000","last_became_peered":"2024-03-30T13:08:25.270460+0000","last_unstale":"2024-03-30T13:08:27.847372+0000","last_undegraded":"2024-03-30T13:08:27.847372+0000","last_fullsized":"2024-03-30T13:08:27.847372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:07:26.410219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433632+0000","last_change":"2024-03-30T13:08:26.267853+0000","last_active":"2024-03-30T13:08:27.433632+0000","last_peered":"2024-03-30T13:08:27.433632+0000","last_clean":"2024-03-30T13:08:27.433632+0000","last_became_active":"2024-03-30T13:08:26.267527+0000","last_became_peered":"2024-03-30T13:08:26.267527+0000","last_unstale":"2024-03-30T13:08:27.433632+0000","last_undegraded":"2024-03-30T13:08:27.433632+0000","last_fullsized":"2024-03-30T13:08:27.433632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845594+0000","last_change":"2024-03-30T13:08:25.253579+0000","last_active":"2024-03-30T13:08:27.845594+0000","last_peered":"2024-03-30T13:08:27.845594+0000","last_clean":"2024-03-30T13:08:27.845594+0000","last_became_active":"2024-03-30T13:08:25.252838+0000","last_became_peered":"2024-03-30T13:08:25.252838+0000","last_unstale":"2024-03-30T13:08:27.845594+0000","last_undegraded":"2024-03-30T13:08:27.845594+0000","last_fullsized":"2024-03-30T13:08:27.845594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:35:44.891908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847051+0000","last_change":"2024-03-30T13:08:25.255081+0000","last_active":"2024-03-30T13:08:27.847051+0000","last_peered":"2024-03-30T13:08:27.847051+0000","last_clean":"2024-03-30T13:08:27.847051+0000","last_became_active":"2024-03-30T13:08:25.254790+0000","last_became_peered":"2024-03-30T13:08:25.254790+0000","last_unstale":"2024-03-30T13:08:27.847051+0000","last_undegraded":"2024-03-30T13:08:27.847051+0000","last_fullsized":"2024-03-30T13:08:27.847051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846524+0000","last_change":"2024-03-30T13:08:26.269902+0000","last_active":"2024-03-30T13:08:27.846524+0000","last_peered":"2024-03-30T13:08:27.846524+0000","last_clean":"2024-03-30T13:08:27.846524+0000","last_became_active":"2024-03-30T13:08:26.269503+0000","last_became_peered":"2024-03-30T13:08:26.269503+0000","last_unstale":"2024-03-30T13:08:27.846524+0000","last_undegraded":"2024-03-30T13:08:27.846524+0000","last_fullsized":"2024-03-30T13:08:27.846524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247045+0000","last_change":"2024-03-30T13:08:25.273212+0000","last_active":"2024-03-30T13:08:27.247045+0000","last_peered":"2024-03-30T13:08:27.247045+0000","last_clean":"2024-03-30T13:08:27.247045+0000","last_became_active":"2024-03-30T13:08:25.269863+0000","last_became_peered":"2024-03-30T13:08:25.269863+0000","last_unstale":"2024-03-30T13:08:27.247045+0000","last_undegraded":"2024-03-30T13:08:27.247045+0000","last_fullsized":"2024-03-30T13:08:27.247045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:39.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246339+0000","last_change":"2024-03-30T13:08:26.270878+0000","last_active":"2024-03-30T13:08:27.246339+0000","last_peered":"2024-03-30T13:08:27.246339+0000","last_clean":"2024-03-30T13:08:27.246339+0000","last_became_active":"2024-03-30T13:08:26.270607+0000","last_became_peered":"2024-03-30T13:08:26.270607+0000","last_unstale":"2024-03-30T13:08:27.246339+0000","last_undegraded":"2024-03-30T13:08:27.246339+0000","last_fullsized":"2024-03-30T13:08:27.246339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845448+0000","last_change":"2024-03-30T13:08:25.271725+0000","last_active":"2024-03-30T13:08:27.845448+0000","last_peered":"2024-03-30T13:08:27.845448+0000","last_clean":"2024-03-30T13:08:27.845448+0000","last_became_active":"2024-03-30T13:08:25.271059+0000","last_became_peered":"2024-03-30T13:08:25.271059+0000","last_unstale":"2024-03-30T13:08:27.845448+0000","last_undegraded":"2024-03-30T13:08:27.845448+0000","last_fullsized":"2024-03-30T13:08:27.845448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249536+0000","last_change":"2024-03-30T13:08:26.256649+0000","last_active":"2024-03-30T13:08:27.249536+0000","last_peered":"2024-03-30T13:08:27.249536+0000","last_clean":"2024-03-30T13:08:27.249536+0000","last_became_active":"2024-03-30T13:08:26.256365+0000","last_became_peered":"2024-03-30T13:08:26.256365+0000","last_unstale":"2024-03-30T13:08:27.249536+0000","last_undegraded":"2024-03-30T13:08:27.249536+0000","last_fullsized":"2024-03-30T13:08:27.249536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:34:59.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249749+0000","last_change":"2024-03-30T13:08:25.258848+0000","last_active":"2024-03-30T13:08:27.249749+0000","last_peered":"2024-03-30T13:08:27.249749+0000","last_clean":"2024-03-30T13:08:27.249749+0000","last_became_active":"2024-03-30T13:08:25.258153+0000","last_became_peered":"2024-03-30T13:08:25.258153+0000","last_unstale":"2024-03-30T13:08:27.249749+0000","last_undegraded":"2024-03-30T13:08:27.249749+0000","last_fullsized":"2024-03-30T13:08:27.249749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:24:11.686334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433812+0000","last_change":"2024-03-30T13:08:26.248994+0000","last_active":"2024-03-30T13:08:27.433812+0000","last_peered":"2024-03-30T13:08:27.433812+0000","last_clean":"2024-03-30T13:08:27.433812+0000","last_became_active":"2024-03-30T13:08:26.248649+0000","last_became_peered":"2024-03-30T13:08:26.248649+0000","last_unstale":"2024-03-30T13:08:27.433812+0000","last_undegraded":"2024-03-30T13:08:27.433812+0000","last_fullsized":"2024-03-30T13:08:27.433812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246424+0000","last_change":"2024-03-30T13:08:25.271938+0000","last_active":"2024-03-30T13:08:27.246424+0000","last_peered":"2024-03-30T13:08:27.246424+0000","last_clean":"2024-03-30T13:08:27.246424+0000","last_became_active":"2024-03-30T13:08:25.271537+0000","last_became_peered":"2024-03-30T13:08:25.271537+0000","last_unstale":"2024-03-30T13:08:27.246424+0000","last_undegraded":"2024-03-30T13:08:27.246424+0000","last_fullsized":"2024-03-30T13:08:27.246424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:25:11.691446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.230979+0000","last_change":"2024-03-30T13:08:25.230979+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.230979+0000","last_undegraded":"2024-03-30T13:08:25.230979+0000","last_fullsized":"2024-03-30T13:08:25.230979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845682+0000","last_change":"2024-03-30T13:08:25.257898+0000","last_active":"2024-03-30T13:08:27.845682+0000","last_peered":"2024-03-30T13:08:27.845682+0000","last_clean":"2024-03-30T13:08:27.845682+0000","last_became_active":"2024-03-30T13:08:25.257311+0000","last_became_peered":"2024-03-30T13:08:25.257311+0000","last_unstale":"2024-03-30T13:08:27.845682+0000","last_undegraded":"2024-03-30T13:08:27.845682+0000","last_fullsized":"2024-03-30T13:08:27.845682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847509+0000","last_change":"2024-03-30T13:08:26.263276+0000","last_active":"2024-03-30T13:08:27.847509+0000","last_peered":"2024-03-30T13:08:27.847509+0000","last_clean":"2024-03-30T13:08:27.847509+0000","last_became_active":"2024-03-30T13:08:26.262279+0000","last_became_peered":"2024-03-30T13:08:26.262279+0000","last_unstale":"2024-03-30T13:08:27.847509+0000","last_undegraded":"2024-03-30T13:08:27.847509+0000","last_fullsized":"2024-03-30T13:08:27.847509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:09:50.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433714+0000","last_change":"2024-03-30T13:08:25.247025+0000","last_active":"2024-03-30T13:08:27.433714+0000","last_peered":"2024-03-30T13:08:27.433714+0000","last_clean":"2024-03-30T13:08:27.433714+0000","last_became_active":"2024-03-30T13:08:25.246656+0000","last_became_peered":"2024-03-30T13:08:25.246656+0000","last_unstale":"2024-03-30T13:08:27.433714+0000","last_undegraded":"2024-03-30T13:08:27.433714+0000","last_fullsized":"2024-03-30T13:08:27.433714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433293+0000","last_change":"2024-03-30T13:08:26.260804+0000","last_active":"2024-03-30T13:08:27.433293+0000","last_peered":"2024-03-30T13:08:27.433293+0000","last_clean":"2024-03-30T13:08:27.433293+0000","last_became_active":"2024-03-30T13:08:26.260342+0000","last_became_peered":"2024-03-30T13:08:26.260342+0000","last_unstale":"2024-03-30T13:08:27.433293+0000","last_undegraded":"2024-03-30T13:08:27.433293+0000","last_fullsized":"2024-03-30T13:08:27.433293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:00:23.772051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248471+0000","last_change":"2024-03-30T13:08:25.266076+0000","last_active":"2024-03-30T13:08:27.248471+0000","last_peered":"2024-03-30T13:08:27.248471+0000","last_clean":"2024-03-30T13:08:27.248471+0000","last_became_active":"2024-03-30T13:08:25.264628+0000","last_became_peered":"2024-03-30T13:08:25.264628+0000","last_unstale":"2024-03-30T13:08:27.248471+0000","last_undegraded":"2024-03-30T13:08:27.248471+0000","last_fullsized":"2024-03-30T13:08:27.248471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847623+0000","last_change":"2024-03-30T13:08:26.272989+0000","last_active":"2024-03-30T13:08:27.847623+0000","last_peered":"2024-03-30T13:08:27.847623+0000","last_clean":"2024-03-30T13:08:27.847623+0000","last_became_active":"2024-03-30T13:08:26.272715+0000","last_became_peered":"2024-03-30T13:08:26.272715+0000","last_unstale":"2024-03-30T13:08:27.847623+0000","last_undegraded":"2024-03-30T13:08:27.847623+0000","last_fullsized":"2024-03-30T13:08:27.847623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:51:01.414724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845237+0000","last_change":"2024-03-30T13:08:25.255530+0000","last_active":"2024-03-30T13:08:27.845237+0000","last_peered":"2024-03-30T13:08:27.845237+0000","last_clean":"2024-03-30T13:08:27.845237+0000","last_became_active":"2024-03-30T13:08:25.254828+0000","last_became_peered":"2024-03-30T13:08:25.254828+0000","last_unstale":"2024-03-30T13:08:27.845237+0000","last_undegraded":"2024-03-30T13:08:27.845237+0000","last_fullsized":"2024-03-30T13:08:27.845237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:07:26.410219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845374+0000","last_change":"2024-03-30T13:08:26.262416+0000","last_active":"2024-03-30T13:08:27.845374+0000","last_peered":"2024-03-30T13:08:27.845374+0000","last_clean":"2024-03-30T13:08:27.845374+0000","last_became_active":"2024-03-30T13:08:26.262147+0000","last_became_peered":"2024-03-30T13:08:26.262147+0000","last_unstale":"2024-03-30T13:08:27.845374+0000","last_undegraded":"2024-03-30T13:08:27.845374+0000","last_fullsized":"2024-03-30T13:08:27.845374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:06:18.572457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.251866+0000","last_change":"2024-03-30T13:08:25.244929+0000","last_active":"2024-03-30T13:08:25.251866+0000","last_peered":"2024-03-30T13:08:25.251866+0000","last_clean":"2024-03-30T13:08:25.251866+0000","last_became_active":"2024-03-30T13:08:25.244565+0000","last_became_peered":"2024-03-30T13:08:25.244565+0000","last_unstale":"2024-03-30T13:08:25.251866+0000","last_undegraded":"2024-03-30T13:08:25.251866+0000","last_fullsized":"2024-03-30T13:08:25.251866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:55:06.360626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847184+0000","last_change":"2024-03-30T13:08:26.270298+0000","last_active":"2024-03-30T13:08:27.847184+0000","last_peered":"2024-03-30T13:08:27.847184+0000","last_clean":"2024-03-30T13:08:27.847184+0000","last_became_active":"2024-03-30T13:08:26.270008+0000","last_became_peered":"2024-03-30T13:08:26.270008+0000","last_unstale":"2024-03-30T13:08:27.847184+0000","last_undegraded":"2024-03-30T13:08:27.847184+0000","last_fullsized":"2024-03-30T13:08:27.847184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:38.839595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.253407+0000","last_change":"2024-03-30T13:08:25.247533+0000","last_active":"2024-03-30T13:08:25.253407+0000","last_peered":"2024-03-30T13:08:25.253407+0000","last_clean":"2024-03-30T13:08:25.253407+0000","last_became_active":"2024-03-30T13:08:25.246529+0000","last_became_peered":"2024-03-30T13:08:25.246529+0000","last_unstale":"2024-03-30T13:08:25.253407+0000","last_undegraded":"2024-03-30T13:08:25.253407+0000","last_fullsized":"2024-03-30T13:08:25.253407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:55:06.360626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.848594+0000","last_change":"2024-03-30T13:08:26.273076+0000","last_active":"2024-03-30T13:08:27.848594+0000","last_peered":"2024-03-30T13:08:27.848594+0000","last_clean":"2024-03-30T13:08:27.848594+0000","last_became_active":"2024-03-30T13:08:26.272648+0000","last_became_peered":"2024-03-30T13:08:26.272648+0000","last_unstale":"2024-03-30T13:08:27.848594+0000","last_undegraded":"2024-03-30T13:08:27.848594+0000","last_fullsized":"2024-03-30T13:08:27.848594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:38:27.246797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.251956+0000","last_change":"2024-03-30T13:08:25.246374+0000","last_active":"2024-03-30T13:08:25.251956+0000","last_peered":"2024-03-30T13:08:25.251956+0000","last_clean":"2024-03-30T13:08:25.251956+0000","last_became_active":"2024-03-30T13:08:25.246054+0000","last_became_peered":"2024-03-30T13:08:25.246054+0000","last_unstale":"2024-03-30T13:08:25.251956+0000","last_undegraded":"2024-03-30T13:08:25.251956+0000","last_fullsized":"2024-03-30T13:08:25.251956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:47.553831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.848301+0000","last_change":"2024-03-30T13:08:26.272977+0000","last_active":"2024-03-30T13:08:27.848301+0000","last_peered":"2024-03-30T13:08:27.848301+0000","last_clean":"2024-03-30T13:08:27.848301+0000","last_became_active":"2024-03-30T13:08:26.272484+0000","last_became_peered":"2024-03-30T13:08:26.272484+0000","last_unstale":"2024-03-30T13:08:27.848301+0000","last_undegraded":"2024-03-30T13:08:27.848301+0000","last_fullsized":"2024-03-30T13:08:27.848301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:52:03.940597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246440+0000","last_change":"2024-03-30T13:08:25.247470+0000","last_active":"2024-03-30T13:08:27.246440+0000","last_peered":"2024-03-30T13:08:27.246440+0000","last_clean":"2024-03-30T13:08:27.246440+0000","last_became_active":"2024-03-30T13:08:25.247147+0000","last_became_peered":"2024-03-30T13:08:25.247147+0000","last_unstale":"2024-03-30T13:08:27.246440+0000","last_undegraded":"2024-03-30T13:08:27.246440+0000","last_fullsized":"2024-03-30T13:08:27.246440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:07.835197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249178+0000","last_change":"2024-03-30T13:08:26.261671+0000","last_active":"2024-03-30T13:08:27.249178+0000","last_peered":"2024-03-30T13:08:27.249178+0000","last_clean":"2024-03-30T13:08:27.249178+0000","last_became_active":"2024-03-30T13:08:26.261411+0000","last_became_peered":"2024-03-30T13:08:26.261411+0000","last_unstale":"2024-03-30T13:08:27.249178+0000","last_undegraded":"2024-03-30T13:08:27.249178+0000","last_fullsized":"2024-03-30T13:08:27.249178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:07.743621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.275531+0000","last_change":"2024-03-30T13:08:25.273872+0000","last_active":"2024-03-30T13:08:25.275531+0000","last_peered":"2024-03-30T13:08:25.275531+0000","last_clean":"2024-03-30T13:08:25.275531+0000","last_became_active":"2024-03-30T13:08:25.273570+0000","last_became_peered":"2024-03-30T13:08:25.273570+0000","last_unstale":"2024-03-30T13:08:25.275531+0000","last_undegraded":"2024-03-30T13:08:25.275531+0000","last_fullsized":"2024-03-30T13:08:25.275531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:08:47.439600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847718+0000","last_change":"2024-03-30T13:08:26.257523+0000","last_active":"2024-03-30T13:08:27.847718+0000","last_peered":"2024-03-30T13:08:27.847718+0000","last_clean":"2024-03-30T13:08:27.847718+0000","last_became_active":"2024-03-30T13:08:26.257150+0000","last_became_peered":"2024-03-30T13:08:26.257150+0000","last_unstale":"2024-03-30T13:08:27.847718+0000","last_undegraded":"2024-03-30T13:08:27.847718+0000","last_fullsized":"2024-03-30T13:08:27.847718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:34:59.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847028+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:08:27.847028+0000","last_peered":"2024-03-30T13:08:27.847028+0000","last_clean":"2024-03-30T13:08:27.847028+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:08:27.847028+0000","last_undegraded":"2024-03-30T13:08:27.847028+0000","last_fullsized":"2024-03-30T13:08:27.847028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247294+0000","last_change":"2024-03-30T13:08:25.258621+0000","last_active":"2024-03-30T13:08:27.247294+0000","last_peered":"2024-03-30T13:08:27.247294+0000","last_clean":"2024-03-30T13:08:27.247294+0000","last_became_active":"2024-03-30T13:08:25.257931+0000","last_became_peered":"2024-03-30T13:08:25.257931+0000","last_unstale":"2024-03-30T13:08:27.247294+0000","last_undegraded":"2024-03-30T13:08:27.247294+0000","last_fullsized":"2024-03-30T13:08:27.247294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847645+0000","last_change":"2024-03-30T13:08:26.260707+0000","last_active":"2024-03-30T13:08:27.847645+0000","last_peered":"2024-03-30T13:08:27.847645+0000","last_clean":"2024-03-30T13:08:27.847645+0000","last_became_active":"2024-03-30T13:08:26.254479+0000","last_became_peered":"2024-03-30T13:08:26.254479+0000","last_unstale":"2024-03-30T13:08:27.847645+0000","last_undegraded":"2024-03-30T13:08:27.847645+0000","last_fullsized":"2024-03-30T13:08:27.847645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:33.096715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846876+0000","last_change":"2024-03-30T13:08:25.266025+0000","last_active":"2024-03-30T13:08:27.846876+0000","last_peered":"2024-03-30T13:08:27.846876+0000","last_clean":"2024-03-30T13:08:27.846876+0000","last_became_active":"2024-03-30T13:08:25.265377+0000","last_became_peered":"2024-03-30T13:08:25.265377+0000","last_unstale":"2024-03-30T13:08:27.846876+0000","last_undegraded":"2024-03-30T13:08:27.846876+0000","last_fullsized":"2024-03-30T13:08:27.846876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:39.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433360+0000","last_change":"2024-03-30T13:08:26.267267+0000","last_active":"2024-03-30T13:08:27.433360+0000","last_peered":"2024-03-30T13:08:27.433360+0000","last_clean":"2024-03-30T13:08:27.433360+0000","last_became_active":"2024-03-30T13:08:26.266946+0000","last_became_peered":"2024-03-30T13:08:26.266946+0000","last_unstale":"2024-03-30T13:08:27.433360+0000","last_undegraded":"2024-03-30T13:08:27.433360+0000","last_fullsized":"2024-03-30T13:08:27.433360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:06:18.572457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:08:25.244441+0000","last_change":"2024-03-30T13:08:25.240103+0000","last_active":"2024-03-30T13:08:25.244441+0000","last_peered":"2024-03-30T13:08:25.244441+0000","last_clean":"2024-03-30T13:08:25.244441+0000","last_became_active":"2024-03-30T13:08:25.239719+0000","last_became_peered":"2024-03-30T13:08:25.239719+0000","last_unstale":"2024-03-30T13:08:25.244441+0000","last_undegraded":"2024-03-30T13:08:25.244441+0000","last_fullsized":"2024-03-30T13:08:25.244441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:03:41.112581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246239+0000","last_change":"2024-03-30T13:08:26.253339+0000","last_active":"2024-03-30T13:08:27.246239+0000","last_peered":"2024-03-30T13:08:27.246239+0000","last_clean":"2024-03-30T13:08:27.246239+0000","last_became_active":"2024-03-30T13:08:26.243687+0000","last_became_peered":"2024-03-30T13:08:26.243687+0000","last_unstale":"2024-03-30T13:08:27.246239+0000","last_undegraded":"2024-03-30T13:08:27.246239+0000","last_fullsized":"2024-03-30T13:08:27.246239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248693+0000","last_change":"2024-03-30T13:08:25.265220+0000","last_active":"2024-03-30T13:08:27.248693+0000","last_peered":"2024-03-30T13:08:27.248693+0000","last_clean":"2024-03-30T13:08:27.248693+0000","last_became_active":"2024-03-30T13:08:25.263916+0000","last_became_peered":"2024-03-30T13:08:25.263916+0000","last_unstale":"2024-03-30T13:08:27.248693+0000","last_undegraded":"2024-03-30T13:08:27.248693+0000","last_fullsized":"2024-03-30T13:08:27.248693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:25:11.691446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.235385+0000","last_change":"2024-03-30T13:08:25.235385+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.235385+0000","last_undegraded":"2024-03-30T13:08:25.235385+0000","last_fullsized":"2024-03-30T13:08:25.235385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246596+0000","last_change":"2024-03-30T13:08:25.248845+0000","last_active":"2024-03-30T13:08:27.246596+0000","last_peered":"2024-03-30T13:08:27.246596+0000","last_clean":"2024-03-30T13:08:27.246596+0000","last_became_active":"2024-03-30T13:08:25.248455+0000","last_became_peered":"2024-03-30T13:08:25.248455+0000","last_unstale":"2024-03-30T13:08:27.246596+0000","last_undegraded":"2024-03-30T13:08:27.246596+0000","last_fullsized":"2024-03-30T13:08:27.246596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:39.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249863+0000","last_change":"2024-03-30T13:08:26.254255+0000","last_active":"2024-03-30T13:08:27.249863+0000","last_peered":"2024-03-30T13:08:27.249863+0000","last_clean":"2024-03-30T13:08:27.249863+0000","last_became_active":"2024-03-30T13:08:26.253990+0000","last_became_peered":"2024-03-30T13:08:26.253990+0000","last_unstale":"2024-03-30T13:08:27.249863+0000","last_undegraded":"2024-03-30T13:08:27.249863+0000","last_fullsized":"2024-03-30T13:08:27.249863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:17.381480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.848028+0000","last_change":"2024-03-30T13:08:25.275050+0000","last_active":"2024-03-30T13:08:27.848028+0000","last_peered":"2024-03-30T13:08:27.848028+0000","last_clean":"2024-03-30T13:08:27.848028+0000","last_became_active":"2024-03-30T13:08:25.270650+0000","last_became_peered":"2024-03-30T13:08:25.270650+0000","last_unstale":"2024-03-30T13:08:27.848028+0000","last_undegraded":"2024-03-30T13:08:27.848028+0000","last_fullsized":"2024-03-30T13:08:27.848028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:11.754124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246448+0000","last_change":"2024-03-30T13:08:26.252864+0000","last_active":"2024-03-30T13:08:27.246448+0000","last_peered":"2024-03-30T13:08:27.246448+0000","last_clean":"2024-03-30T13:08:27.246448+0000","last_became_active":"2024-03-30T13:08:26.252487+0000","last_became_peered":"2024-03-30T13:08:26.252487+0000","last_unstale":"2024-03-30T13:08:27.246448+0000","last_undegraded":"2024-03-30T13:08:27.246448+0000","last_fullsized":"2024-03-30T13:08:27.246448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246596+0000","last_change":"2024-03-30T13:08:25.256761+0000","last_active":"2024-03-30T13:08:27.246596+0000","last_peered":"2024-03-30T13:08:27.246596+0000","last_clean":"2024-03-30T13:08:27.246596+0000","last_became_active":"2024-03-30T13:08:25.256423+0000","last_became_peered":"2024-03-30T13:08:25.256423+0000","last_unstale":"2024-03-30T13:08:27.246596+0000","last_undegraded":"2024-03-30T13:08:27.246596+0000","last_fullsized":"2024-03-30T13:08:27.246596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:11.754124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847010+0000","last_change":"2024-03-30T13:08:26.266237+0000","last_active":"2024-03-30T13:08:27.847010+0000","last_peered":"2024-03-30T13:08:27.847010+0000","last_clean":"2024-03-30T13:08:27.847010+0000","last_became_active":"2024-03-30T13:08:26.265651+0000","last_became_peered":"2024-03-30T13:08:26.265651+0000","last_unstale":"2024-03-30T13:08:27.847010+0000","last_undegraded":"2024-03-30T13:08:27.847010+0000","last_fullsized":"2024-03-30T13:08:27.847010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845790+0000","last_change":"2024-03-30T13:08:25.277163+0000","last_active":"2024-03-30T13:08:27.845790+0000","last_peered":"2024-03-30T13:08:27.845790+0000","last_clean":"2024-03-30T13:08:27.845790+0000","last_became_active":"2024-03-30T13:08:25.276378+0000","last_became_peered":"2024-03-30T13:08:25.276378+0000","last_unstale":"2024-03-30T13:08:27.845790+0000","last_undegraded":"2024-03-30T13:08:27.845790+0000","last_fullsized":"2024-03-30T13:08:27.845790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:24:11.686334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433709+0000","last_change":"2024-03-30T13:08:26.260918+0000","last_active":"2024-03-30T13:08:27.433709+0000","last_peered":"2024-03-30T13:08:27.433709+0000","last_clean":"2024-03-30T13:08:27.433709+0000","last_became_active":"2024-03-30T13:08:26.260191+0000","last_became_peered":"2024-03-30T13:08:26.260191+0000","last_unstale":"2024-03-30T13:08:27.433709+0000","last_undegraded":"2024-03-30T13:08:27.433709+0000","last_fullsized":"2024-03-30T13:08:27.433709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846849+0000","last_change":"2024-03-30T13:08:25.261497+0000","last_active":"2024-03-30T13:08:27.846849+0000","last_peered":"2024-03-30T13:08:27.846849+0000","last_clean":"2024-03-30T13:08:27.846849+0000","last_became_active":"2024-03-30T13:08:25.260478+0000","last_became_peered":"2024-03-30T13:08:25.260478+0000","last_unstale":"2024-03-30T13:08:27.846849+0000","last_undegraded":"2024-03-30T13:08:27.846849+0000","last_fullsized":"2024-03-30T13:08:27.846849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:08:25.230491+0000","last_change":"2024-03-30T13:08:25.230491+0000","last_active":"2024-03-30T13:08:25.214237+0000","last_peered":"2024-03-30T13:08:25.214237+0000","last_clean":"2024-03-30T13:08:25.214237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:08:25.230491+0000","last_undegraded":"2024-03-30T13:08:25.230491+0000","last_fullsized":"2024-03-30T13:08:25.230491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246220+0000","last_change":"2024-03-30T13:08:25.271738+0000","last_active":"2024-03-30T13:08:27.246220+0000","last_peered":"2024-03-30T13:08:27.246220+0000","last_clean":"2024-03-30T13:08:27.246220+0000","last_became_active":"2024-03-30T13:08:25.271345+0000","last_became_peered":"2024-03-30T13:08:25.271345+0000","last_unstale":"2024-03-30T13:08:27.246220+0000","last_undegraded":"2024-03-30T13:08:27.246220+0000","last_fullsized":"2024-03-30T13:08:27.246220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846920+0000","last_change":"2024-03-30T13:08:26.269105+0000","last_active":"2024-03-30T13:08:27.846920+0000","last_peered":"2024-03-30T13:08:27.846920+0000","last_clean":"2024-03-30T13:08:27.846920+0000","last_became_active":"2024-03-30T13:08:26.260812+0000","last_became_peered":"2024-03-30T13:08:26.260812+0000","last_unstale":"2024-03-30T13:08:27.846920+0000","last_undegraded":"2024-03-30T13:08:27.846920+0000","last_fullsized":"2024-03-30T13:08:27.846920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246299+0000","last_change":"2024-03-30T13:08:25.248839+0000","last_active":"2024-03-30T13:08:27.246299+0000","last_peered":"2024-03-30T13:08:27.246299+0000","last_clean":"2024-03-30T13:08:27.246299+0000","last_became_active":"2024-03-30T13:08:25.248429+0000","last_became_peered":"2024-03-30T13:08:25.248429+0000","last_unstale":"2024-03-30T13:08:27.246299+0000","last_undegraded":"2024-03-30T13:08:27.246299+0000","last_fullsized":"2024-03-30T13:08:27.246299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:24:11.686334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847416+0000","last_change":"2024-03-30T13:08:26.269026+0000","last_active":"2024-03-30T13:08:27.847416+0000","last_peered":"2024-03-30T13:08:27.847416+0000","last_clean":"2024-03-30T13:08:27.847416+0000","last_became_active":"2024-03-30T13:08:26.268626+0000","last_became_peered":"2024-03-30T13:08:26.268626+0000","last_unstale":"2024-03-30T13:08:27.847416+0000","last_undegraded":"2024-03-30T13:08:27.847416+0000","last_fullsized":"2024-03-30T13:08:27.847416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:38.839595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847773+0000","last_change":"2024-03-30T13:08:25.277478+0000","last_active":"2024-03-30T13:08:27.847773+0000","last_peered":"2024-03-30T13:08:27.847773+0000","last_clean":"2024-03-30T13:08:27.847773+0000","last_became_active":"2024-03-30T13:08:25.276694+0000","last_became_peered":"2024-03-30T13:08:25.276694+0000","last_unstale":"2024-03-30T13:08:27.847773+0000","last_undegraded":"2024-03-30T13:08:27.847773+0000","last_fullsized":"2024-03-30T13:08:27.847773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:13:51.325672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845058+0000","last_change":"2024-03-30T13:08:26.268719+0000","last_active":"2024-03-30T13:08:27.845058+0000","last_peered":"2024-03-30T13:08:27.845058+0000","last_clean":"2024-03-30T13:08:27.845058+0000","last_became_active":"2024-03-30T13:08:26.268461+0000","last_became_peered":"2024-03-30T13:08:26.268461+0000","last_unstale":"2024-03-30T13:08:27.845058+0000","last_undegraded":"2024-03-30T13:08:27.845058+0000","last_fullsized":"2024-03-30T13:08:27.845058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:25:49.517498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249613+0000","last_change":"2024-03-30T13:08:26.249193+0000","last_active":"2024-03-30T13:08:27.249613+0000","last_peered":"2024-03-30T13:08:27.249613+0000","last_clean":"2024-03-30T13:08:27.249613+0000","last_became_active":"2024-03-30T13:08:26.248772+0000","last_became_peered":"2024-03-30T13:08:26.248772+0000","last_unstale":"2024-03-30T13:08:27.249613+0000","last_undegraded":"2024-03-30T13:08:27.249613+0000","last_fullsized":"2024-03-30T13:08:27.249613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:11:06.559848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847285+0000","last_change":"2024-03-30T13:08:25.281959+0000","last_active":"2024-03-30T13:08:27.847285+0000","last_peered":"2024-03-30T13:08:27.847285+0000","last_clean":"2024-03-30T13:08:27.847285+0000","last_became_active":"2024-03-30T13:08:25.281274+0000","last_became_peered":"2024-03-30T13:08:25.281274+0000","last_unstale":"2024-03-30T13:08:27.847285+0000","last_undegraded":"2024-03-30T13:08:27.847285+0000","last_fullsized":"2024-03-30T13:08:27.847285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:25:11.691446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249036+0000","last_change":"2024-03-30T13:08:26.249258+0000","last_active":"2024-03-30T13:08:27.249036+0000","last_peered":"2024-03-30T13:08:27.249036+0000","last_clean":"2024-03-30T13:08:27.249036+0000","last_became_active":"2024-03-30T13:08:26.248751+0000","last_became_peered":"2024-03-30T13:08:26.248751+0000","last_unstale":"2024-03-30T13:08:27.249036+0000","last_undegraded":"2024-03-30T13:08:27.249036+0000","last_fullsized":"2024-03-30T13:08:27.249036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:51:01.414724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847841+0000","last_change":"2024-03-30T13:08:25.277430+0000","last_active":"2024-03-30T13:08:27.847841+0000","last_peered":"2024-03-30T13:08:27.847841+0000","last_clean":"2024-03-30T13:08:27.847841+0000","last_became_active":"2024-03-30T13:08:25.276574+0000","last_became_peered":"2024-03-30T13:08:25.276574+0000","last_unstale":"2024-03-30T13:08:27.847841+0000","last_undegraded":"2024-03-30T13:08:27.847841+0000","last_fullsized":"2024-03-30T13:08:27.847841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:07.835197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433517+0000","last_change":"2024-03-30T13:08:26.249242+0000","last_active":"2024-03-30T13:08:27.433517+0000","last_peered":"2024-03-30T13:08:27.433517+0000","last_clean":"2024-03-30T13:08:27.433517+0000","last_became_active":"2024-03-30T13:08:26.248878+0000","last_became_peered":"2024-03-30T13:08:26.248878+0000","last_unstale":"2024-03-30T13:08:27.433517+0000","last_undegraded":"2024-03-30T13:08:27.433517+0000","last_fullsized":"2024-03-30T13:08:27.433517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847382+0000","last_change":"2024-03-30T13:08:25.244866+0000","last_active":"2024-03-30T13:08:27.847382+0000","last_peered":"2024-03-30T13:08:27.847382+0000","last_clean":"2024-03-30T13:08:27.847382+0000","last_became_active":"2024-03-30T13:08:25.244502+0000","last_became_peered":"2024-03-30T13:08:25.244502+0000","last_unstale":"2024-03-30T13:08:27.847382+0000","last_undegraded":"2024-03-30T13:08:27.847382+0000","last_fullsized":"2024-03-30T13:08:27.847382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:35:44.891908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847055+0000","last_change":"2024-03-30T13:08:26.265904+0000","last_active":"2024-03-30T13:08:27.847055+0000","last_peered":"2024-03-30T13:08:27.847055+0000","last_clean":"2024-03-30T13:08:27.847055+0000","last_became_active":"2024-03-30T13:08:26.265600+0000","last_became_peered":"2024-03-30T13:08:26.265600+0000","last_unstale":"2024-03-30T13:08:27.847055+0000","last_undegraded":"2024-03-30T13:08:27.847055+0000","last_fullsized":"2024-03-30T13:08:27.847055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433661+0000","last_change":"2024-03-30T13:08:25.271879+0000","last_active":"2024-03-30T13:08:27.433661+0000","last_peered":"2024-03-30T13:08:27.433661+0000","last_clean":"2024-03-30T13:08:27.433661+0000","last_became_active":"2024-03-30T13:08:25.270729+0000","last_became_peered":"2024-03-30T13:08:25.270729+0000","last_unstale":"2024-03-30T13:08:27.433661+0000","last_undegraded":"2024-03-30T13:08:27.433661+0000","last_fullsized":"2024-03-30T13:08:27.433661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:45:33.842798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":657783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":68445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":73223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":68445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":657839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":60058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":60058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:08:33.720 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:08:33.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef4637640 1 Processor -- start 2024-03-30T13:08:33.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef4637640 1 -- start start 2024-03-30T13:08:33.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef4637640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec0b4830 0x7f0eec15d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:33.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef4637640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eec15d880 con 0x7f0eec06dfe0 2024-03-30T13:08:33.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef4637640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eec0cfcb0 con 0x7f0eec0aed20 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef4637640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0eec156e00 con 0x7f0eec0b4830 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef2bd4640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f0eec06dfe0 0x7f0eec06e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40206/0 (socket says 172.21.15.83:40206) 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef2bd4640 1 -- 172.21.15.83:0/1914137830 learned_addr learned my addr 172.21.15.83:0/1914137830 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef23d3640 1 --2- 172.21.15.83:0/1914137830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec0b4830 0x7f0eec15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2625926682 0 0) 0x7f0eec15d880 con 0x7f0eec06dfe0 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ed4003530 con 0x7f0eec06dfe0 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818033715 0 0) 0x7f0eec0cfcb0 con 0x7f0eec0aed20 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0eec15d880 con 0x7f0eec0aed20 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3109403019 0 0) 0x7f0ed4003530 con 0x7f0eec06dfe0 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec0b4830 msgr2=0x7f0eec15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 --2- 172.21.15.83:0/1914137830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec0b4830 0x7f0eec15d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 >> v1:172.21.15.153:6789/0 conn(0x7f0eec0aed20 legacy=0x7f0eec0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eec0ad290 con 0x7f0eec06dfe0 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f0edc001680 con 0x7f0eec06dfe0 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 >> v1:172.21.15.83:6789/0 conn(0x7f0eec06dfe0 legacy=0x7f0eec06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 --2- 172.21.15.83:0/1914137830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed4003b80 0x7f0ed4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 --2- 172.21.15.83:0/1914137830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec0b4830 0x7f0ed4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 --2- 172.21.15.83:0/1914137830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ed4004d50 0x7f0ed40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec156e00 con 0x7f0ed4004d50 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed400bb90 con 0x7f0ed4003b80 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed400bd90 con 0x7f0eec0b4830 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef2bd4640 1 --2- 172.21.15.83:0/1914137830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ed4004d50 0x7f0ed40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef23d3640 1 --2- 172.21.15.83:0/1914137830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed4003b80 0x7f0ed4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef1bd2640 1 --2- 172.21.15.83:0/1914137830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec0b4830 0x7f0ed4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef2bd4640 1 -- 172.21.15.83:0/1914137830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec0b4830 msgr2=0x7f0ed4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef2bd4640 1 --2- 172.21.15.83:0/1914137830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec0b4830 0x7f0ed4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:33.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef2bd4640 1 -- 172.21.15.83:0/1914137830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed4003b80 msgr2=0x7f0ed4003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:33.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef2bd4640 1 --2- 172.21.15.83:0/1914137830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed4003b80 0x7f0ed4003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:33.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.845+0000 7f0ef2bd4640 1 -- 172.21.15.83:0/1914137830 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed4003530 con 0x7f0ed4004d50 2024-03-30T13:08:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef2bd4640 1 --2- 172.21.15.83:0/1914137830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ed4004d50 0x7f0ed40051d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00c190 tx=0x7f0edc01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97022cbcc3880c13 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc007cd0 con 0x7f0ed4004d50 2024-03-30T13:08:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0edc0a9020 con 0x7f0ed4004d50 2024-03-30T13:08:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef13d1640 1 -- 172.21.15.83:0/1914137830 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc005ae0 con 0x7f0ed4004d50 2024-03-30T13:08:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef4637640 1 -- 172.21.15.83:0/1914137830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ed4004d50 msgr2=0x7f0ed40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef4637640 1 --2- 172.21.15.83:0/1914137830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ed4004d50 0x7f0ed40051d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00c190 tx=0x7f0edc01cc00 comp rx=0 tx=0).stop 2024-03-30T13:08:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef2bd4640 1 -- 172.21.15.83:0/1914137830 reap_dead start 2024-03-30T13:08:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef4637640 1 -- 172.21.15.83:0/1914137830 shutdown_connections 2024-03-30T13:08:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef4637640 1 -- 172.21.15.83:0/1914137830 >> 172.21.15.83:0/1914137830 conn(0x7f0eec0b1d60 msgr2=0x7f0eec0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef4637640 1 -- 172.21.15.83:0/1914137830 shutdown_connections 2024-03-30T13:08:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef4637640 1 -- 172.21.15.83:0/1914137830 wait complete. 2024-03-30T13:08:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef4637640 1 Processor -- start 2024-03-30T13:08:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.849+0000 7f0ef4637640 1 -- start start 2024-03-30T13:08:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef4637640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed4004d50 0x7f0eec099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef4637640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec071e40 0x7f0eec0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef4637640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0eec1543d0 0x7f0eec154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef4637640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec0cf9e0 con 0x7f0eec1543d0 2024-03-30T13:08:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef4637640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec0cf860 con 0x7f0ed4004d50 2024-03-30T13:08:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef4637640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0eec168280 con 0x7f0eec071e40 2024-03-30T13:08:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef2bd4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0eec1543d0 0x7f0eec154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef2bd4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0eec1543d0 0x7f0eec154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43388/0 (socket says 172.21.15.83:43388) 2024-03-30T13:08:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef2bd4640 1 -- 172.21.15.83:0/3212712362 learned_addr learned my addr 172.21.15.83:0/3212712362 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef23d3640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed4004d50 0x7f0eec099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef1bd2640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec071e40 0x7f0eec0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:33.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef2bd4640 1 -- 172.21.15.83:0/3212712362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec071e40 msgr2=0x7f0eec0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:33.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef2bd4640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec071e40 0x7f0eec0722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:33.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef2bd4640 1 -- 172.21.15.83:0/3212712362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed4004d50 msgr2=0x7f0eec099900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:33.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef2bd4640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed4004d50 0x7f0eec099900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:33.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef2bd4640 1 -- 172.21.15.83:0/3212712362 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eec154d90 con 0x7f0eec1543d0 2024-03-30T13:08:33.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef1bd2640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec071e40 0x7f0eec0722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef2bd4640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0eec1543d0 0x7f0eec154850 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0edc007040 tx=0x7f0ed4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0eeaffd640 1 -- 172.21.15.83:0/3212712362 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc000e50 con 0x7f0eec1543d0 2024-03-30T13:08:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0eeaffd640 1 -- 172.21.15.83:0/3212712362 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0edc001480 con 0x7f0eec1543d0 2024-03-30T13:08:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef4637640 1 -- 172.21.15.83:0/3212712362 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eec072900 con 0x7f0eec1543d0 2024-03-30T13:08:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0eeaffd640 1 -- 172.21.15.83:0/3212712362 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc001c10 con 0x7f0eec1543d0 2024-03-30T13:08:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef4637640 1 -- 172.21.15.83:0/3212712362 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eec072ec0 con 0x7f0eec1543d0 2024-03-30T13:08:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef4637640 1 -- 172.21.15.83:0/3212712362 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eec0686c0 con 0x7f0eec1543d0 2024-03-30T13:08:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0eeaffd640 1 -- 172.21.15.83:0/3212712362 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f0edc0072d0 con 0x7f0eec1543d0 2024-03-30T13:08:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0eeaffd640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0ed8067fc0 0x7f0ed806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0eeaffd640 1 -- 172.21.15.83:0/3212712362 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0edc11f7a0 con 0x7f0eec1543d0 2024-03-30T13:08:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef23d3640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0ed8067fc0 0x7f0ed806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.853+0000 7f0ef23d3640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0ed8067fc0 0x7f0ed806a480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0003c10 tx=0x7f0ee000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:33.861+0000 7f0eeaffd640 1 -- 172.21.15.83:0/3212712362 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f0edc016910 con 0x7f0eec1543d0 2024-03-30T13:08:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.017+0000 7f0ef4637640 1 -- 172.21.15.83:0/3212712362 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0eec0b4ca0 con 0x7f0ed8067fc0 2024-03-30T13:08:34.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0eeaffd640 1 -- 172.21.15.83:0/3212712362 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f0eec0b4ca0 con 0x7f0ed8067fc0 2024-03-30T13:08:34.043 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:08:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0ef4637640 1 -- 172.21.15.83:0/3212712362 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0ed8067fc0 msgr2=0x7f0ed806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0ef4637640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0ed8067fc0 0x7f0ed806a480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0003c10 tx=0x7f0ee000b040 comp rx=0 tx=0).stop 2024-03-30T13:08:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0ef4637640 1 -- 172.21.15.83:0/3212712362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0eec1543d0 msgr2=0x7f0eec154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0ef4637640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0eec1543d0 0x7f0eec154850 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0edc007040 tx=0x7f0ed4005840 comp rx=0 tx=0).stop 2024-03-30T13:08:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0ef4637640 1 -- 172.21.15.83:0/3212712362 shutdown_connections 2024-03-30T13:08:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0ef4637640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0ed8067fc0 0x7f0ed806a480 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0ef4637640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0eec1543d0 0x7f0eec154850 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0ef4637640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0eec071e40 0x7f0eec0722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0ef4637640 1 --2- 172.21.15.83:0/3212712362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed4004d50 0x7f0eec099900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0ef4637640 1 -- 172.21.15.83:0/3212712362 >> 172.21.15.83:0/3212712362 conn(0x7f0eec0b1d60 msgr2=0x7f0eec15e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:34.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0ef4637640 1 -- 172.21.15.83:0/3212712362 shutdown_connections 2024-03-30T13:08:34.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.037+0000 7f0ef4637640 1 -- 172.21.15.83:0/3212712362 wait complete. 2024-03-30T13:08:34.062 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-30T13:08:32.143059+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2808,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2875392,"data_stored":1745420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.917096"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847699+0000","last_change":"2024-03-30T13:08:26.268523+0000","last_active":"2024-03-30T13:08:27.847699+0000","last_peered":"2024-03-30T13:08:27.847699+0000","last_clean":"2024-03-30T13:08:27.847699+0000","last_became_active":"2024-03-30T13:08:26.267614+0000","last_became_peered":"2024-03-30T13:08:26.267614+0000","last_unstale":"2024-03-30T13:08:27.847699+0000","last_undegraded":"2024-03-30T13:08:27.847699+0000","last_fullsized":"2024-03-30T13:08:27.847699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:07.743621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246696+0000","last_change":"2024-03-30T13:08:26.263035+0000","last_active":"2024-03-30T13:08:27.246696+0000","last_peered":"2024-03-30T13:08:27.246696+0000","last_clean":"2024-03-30T13:08:27.246696+0000","last_became_active":"2024-03-30T13:08:26.262669+0000","last_became_peered":"2024-03-30T13:08:26.262669+0000","last_unstale":"2024-03-30T13:08:27.246696+0000","last_undegraded":"2024-03-30T13:08:27.246696+0000","last_fullsized":"2024-03-30T13:08:27.246696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433514+0000","last_change":"2024-03-30T13:08:26.247241+0000","last_active":"2024-03-30T13:08:27.433514+0000","last_peered":"2024-03-30T13:08:27.433514+0000","last_clean":"2024-03-30T13:08:27.433514+0000","last_became_active":"2024-03-30T13:08:26.246633+0000","last_became_peered":"2024-03-30T13:08:26.246633+0000","last_unstale":"2024-03-30T13:08:27.433514+0000","last_undegraded":"2024-03-30T13:08:27.433514+0000","last_fullsized":"2024-03-30T13:08:27.433514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247342+0000","last_change":"2024-03-30T13:08:26.267093+0000","last_active":"2024-03-30T13:08:27.247342+0000","last_peered":"2024-03-30T13:08:27.247342+0000","last_clean":"2024-03-30T13:08:27.247342+0000","last_became_active":"2024-03-30T13:08:26.266648+0000","last_became_peered":"2024-03-30T13:08:26.266648+0000","last_unstale":"2024-03-30T13:08:27.247342+0000","last_undegraded":"2024-03-30T13:08:27.247342+0000","last_fullsized":"2024-03-30T13:08:27.247342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847414+0000","last_change":"2024-03-30T13:08:26.268233+0000","last_active":"2024-03-30T13:08:27.847414+0000","last_peered":"2024-03-30T13:08:27.847414+0000","last_clean":"2024-03-30T13:08:27.847414+0000","last_became_active":"2024-03-30T13:08:26.267934+0000","last_became_peered":"2024-03-30T13:08:26.267934+0000","last_unstale":"2024-03-30T13:08:27.847414+0000","last_undegraded":"2024-03-30T13:08:27.847414+0000","last_fullsized":"2024-03-30T13:08:27.847414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:33.096715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247522+0000","last_change":"2024-03-30T13:08:26.262334+0000","last_active":"2024-03-30T13:08:27.247522+0000","last_peered":"2024-03-30T13:08:27.247522+0000","last_clean":"2024-03-30T13:08:27.247522+0000","last_became_active":"2024-03-30T13:08:26.262065+0000","last_became_peered":"2024-03-30T13:08:26.262065+0000","last_unstale":"2024-03-30T13:08:27.247522+0000","last_undegraded":"2024-03-30T13:08:27.247522+0000","last_fullsized":"2024-03-30T13:08:27.247522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:38.839595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847119+0000","last_change":"2024-03-30T13:08:26.266561+0000","last_active":"2024-03-30T13:08:27.847119+0000","last_peered":"2024-03-30T13:08:27.847119+0000","last_clean":"2024-03-30T13:08:27.847119+0000","last_became_active":"2024-03-30T13:08:26.266102+0000","last_became_peered":"2024-03-30T13:08:26.266102+0000","last_unstale":"2024-03-30T13:08:27.847119+0000","last_undegraded":"2024-03-30T13:08:27.847119+0000","last_fullsized":"2024-03-30T13:08:27.847119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846133+0000","last_change":"2024-03-30T13:08:26.260829+0000","last_active":"2024-03-30T13:08:27.846133+0000","last_peered":"2024-03-30T13:08:27.846133+0000","last_clean":"2024-03-30T13:08:27.846133+0000","last_became_active":"2024-03-30T13:08:26.254325+0000","last_became_peered":"2024-03-30T13:08:26.254325+0000","last_unstale":"2024-03-30T13:08:27.846133+0000","last_undegraded":"2024-03-30T13:08:27.846133+0000","last_fullsized":"2024-03-30T13:08:27.846133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:06:18.572457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847837+0000","last_change":"2024-03-30T13:08:26.270155+0000","last_active":"2024-03-30T13:08:27.847837+0000","last_peered":"2024-03-30T13:08:27.847837+0000","last_clean":"2024-03-30T13:08:27.847837+0000","last_became_active":"2024-03-30T13:08:26.268095+0000","last_became_peered":"2024-03-30T13:08:26.268095+0000","last_unstale":"2024-03-30T13:08:27.847837+0000","last_undegraded":"2024-03-30T13:08:27.847837+0000","last_fullsized":"2024-03-30T13:08:27.847837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:11:06.559848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845477+0000","last_change":"2024-03-30T13:08:26.254361+0000","last_active":"2024-03-30T13:08:27.845477+0000","last_peered":"2024-03-30T13:08:27.845477+0000","last_clean":"2024-03-30T13:08:27.845477+0000","last_became_active":"2024-03-30T13:08:26.253497+0000","last_became_peered":"2024-03-30T13:08:26.253497+0000","last_unstale":"2024-03-30T13:08:27.845477+0000","last_undegraded":"2024-03-30T13:08:27.845477+0000","last_fullsized":"2024-03-30T13:08:27.845477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845664+0000","last_change":"2024-03-30T13:08:26.252884+0000","last_active":"2024-03-30T13:08:27.845664+0000","last_peered":"2024-03-30T13:08:27.845664+0000","last_clean":"2024-03-30T13:08:27.845664+0000","last_became_active":"2024-03-30T13:08:26.252506+0000","last_became_peered":"2024-03-30T13:08:26.252506+0000","last_unstale":"2024-03-30T13:08:27.845664+0000","last_undegraded":"2024-03-30T13:08:27.845664+0000","last_fullsized":"2024-03-30T13:08:27.845664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250505+0000","last_change":"2024-03-30T13:08:26.260415+0000","last_active":"2024-03-30T13:08:27.250505+0000","last_peered":"2024-03-30T13:08:27.250505+0000","last_clean":"2024-03-30T13:08:27.250505+0000","last_became_active":"2024-03-30T13:08:26.259953+0000","last_became_peered":"2024-03-30T13:08:26.259953+0000","last_unstale":"2024-03-30T13:08:27.250505+0000","last_undegraded":"2024-03-30T13:08:27.250505+0000","last_fullsized":"2024-03-30T13:08:27.250505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:15:20.022778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847088+0000","last_change":"2024-03-30T13:08:26.266434+0000","last_active":"2024-03-30T13:08:27.847088+0000","last_peered":"2024-03-30T13:08:27.847088+0000","last_clean":"2024-03-30T13:08:27.847088+0000","last_became_active":"2024-03-30T13:08:26.266165+0000","last_became_peered":"2024-03-30T13:08:26.266165+0000","last_unstale":"2024-03-30T13:08:27.847088+0000","last_undegraded":"2024-03-30T13:08:27.847088+0000","last_fullsized":"2024-03-30T13:08:27.847088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433251+0000","last_change":"2024-03-30T13:08:26.260199+0000","last_active":"2024-03-30T13:08:27.433251+0000","last_peered":"2024-03-30T13:08:27.433251+0000","last_clean":"2024-03-30T13:08:27.433251+0000","last_became_active":"2024-03-30T13:08:26.259816+0000","last_became_peered":"2024-03-30T13:08:26.259816+0000","last_unstale":"2024-03-30T13:08:27.433251+0000","last_undegraded":"2024-03-30T13:08:27.433251+0000","last_fullsized":"2024-03-30T13:08:27.433251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:25:49.517498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246122+0000","last_change":"2024-03-30T13:08:26.253691+0000","last_active":"2024-03-30T13:08:27.246122+0000","last_peered":"2024-03-30T13:08:27.246122+0000","last_clean":"2024-03-30T13:08:27.246122+0000","last_became_active":"2024-03-30T13:08:26.253423+0000","last_became_peered":"2024-03-30T13:08:26.253423+0000","last_unstale":"2024-03-30T13:08:27.246122+0000","last_undegraded":"2024-03-30T13:08:27.246122+0000","last_fullsized":"2024-03-30T13:08:27.246122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246924+0000","last_change":"2024-03-30T13:08:26.256141+0000","last_active":"2024-03-30T13:08:27.246924+0000","last_peered":"2024-03-30T13:08:27.246924+0000","last_clean":"2024-03-30T13:08:27.246924+0000","last_became_active":"2024-03-30T13:08:26.255881+0000","last_became_peered":"2024-03-30T13:08:26.255881+0000","last_unstale":"2024-03-30T13:08:27.246924+0000","last_undegraded":"2024-03-30T13:08:27.246924+0000","last_fullsized":"2024-03-30T13:08:27.246924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250662+0000","last_change":"2024-03-30T13:08:26.258857+0000","last_active":"2024-03-30T13:08:27.250662+0000","last_peered":"2024-03-30T13:08:27.250662+0000","last_clean":"2024-03-30T13:08:27.250662+0000","last_became_active":"2024-03-30T13:08:26.258537+0000","last_became_peered":"2024-03-30T13:08:26.258537+0000","last_unstale":"2024-03-30T13:08:27.250662+0000","last_undegraded":"2024-03-30T13:08:27.250662+0000","last_fullsized":"2024-03-30T13:08:27.250662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:52:03.940597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846186+0000","last_change":"2024-03-30T13:08:26.256951+0000","last_active":"2024-03-30T13:08:27.846186+0000","last_peered":"2024-03-30T13:08:27.846186+0000","last_clean":"2024-03-30T13:08:27.846186+0000","last_became_active":"2024-03-30T13:08:26.256610+0000","last_became_peered":"2024-03-30T13:08:26.256610+0000","last_unstale":"2024-03-30T13:08:27.846186+0000","last_undegraded":"2024-03-30T13:08:27.846186+0000","last_fullsized":"2024-03-30T13:08:27.846186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:32.954292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847955+0000","last_change":"2024-03-30T13:08:26.263617+0000","last_active":"2024-03-30T13:08:27.847955+0000","last_peered":"2024-03-30T13:08:27.847955+0000","last_clean":"2024-03-30T13:08:27.847955+0000","last_became_active":"2024-03-30T13:08:26.262858+0000","last_became_peered":"2024-03-30T13:08:26.262858+0000","last_unstale":"2024-03-30T13:08:27.847955+0000","last_undegraded":"2024-03-30T13:08:27.847955+0000","last_fullsized":"2024-03-30T13:08:27.847955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:17.381480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845439+0000","last_change":"2024-03-30T13:08:26.267101+0000","last_active":"2024-03-30T13:08:27.845439+0000","last_peered":"2024-03-30T13:08:27.845439+0000","last_clean":"2024-03-30T13:08:27.845439+0000","last_became_active":"2024-03-30T13:08:26.266836+0000","last_became_peered":"2024-03-30T13:08:26.266836+0000","last_unstale":"2024-03-30T13:08:27.845439+0000","last_undegraded":"2024-03-30T13:08:27.845439+0000","last_fullsized":"2024-03-30T13:08:27.845439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433468+0000","last_change":"2024-03-30T13:08:26.263715+0000","last_active":"2024-03-30T13:08:27.433468+0000","last_peered":"2024-03-30T13:08:27.433468+0000","last_clean":"2024-03-30T13:08:27.433468+0000","last_became_active":"2024-03-30T13:08:26.263309+0000","last_became_peered":"2024-03-30T13:08:26.263309+0000","last_unstale":"2024-03-30T13:08:27.433468+0000","last_undegraded":"2024-03-30T13:08:27.433468+0000","last_fullsized":"2024-03-30T13:08:27.433468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247889+0000","last_change":"2024-03-30T13:08:26.255497+0000","last_active":"2024-03-30T13:08:27.247889+0000","last_peered":"2024-03-30T13:08:27.247889+0000","last_clean":"2024-03-30T13:08:27.247889+0000","last_became_active":"2024-03-30T13:08:26.255198+0000","last_became_peered":"2024-03-30T13:08:26.255198+0000","last_unstale":"2024-03-30T13:08:27.247889+0000","last_undegraded":"2024-03-30T13:08:27.247889+0000","last_fullsized":"2024-03-30T13:08:27.247889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:33.096715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846623+0000","last_change":"2024-03-30T13:08:26.267231+0000","last_active":"2024-03-30T13:08:27.846623+0000","last_peered":"2024-03-30T13:08:27.846623+0000","last_clean":"2024-03-30T13:08:27.846623+0000","last_became_active":"2024-03-30T13:08:26.266897+0000","last_became_peered":"2024-03-30T13:08:26.266897+0000","last_unstale":"2024-03-30T13:08:27.846623+0000","last_undegraded":"2024-03-30T13:08:27.846623+0000","last_fullsized":"2024-03-30T13:08:27.846623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246893+0000","last_change":"2024-03-30T13:08:26.254581+0000","last_active":"2024-03-30T13:08:27.246893+0000","last_peered":"2024-03-30T13:08:27.246893+0000","last_clean":"2024-03-30T13:08:27.246893+0000","last_became_active":"2024-03-30T13:08:26.254315+0000","last_became_peered":"2024-03-30T13:08:26.254315+0000","last_unstale":"2024-03-30T13:08:27.246893+0000","last_undegraded":"2024-03-30T13:08:27.246893+0000","last_fullsized":"2024-03-30T13:08:27.246893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846776+0000","last_change":"2024-03-30T13:08:26.261482+0000","last_active":"2024-03-30T13:08:27.846776+0000","last_peered":"2024-03-30T13:08:27.846776+0000","last_clean":"2024-03-30T13:08:27.846776+0000","last_became_active":"2024-03-30T13:08:26.260033+0000","last_became_peered":"2024-03-30T13:08:26.260033+0000","last_unstale":"2024-03-30T13:08:27.846776+0000","last_undegraded":"2024-03-30T13:08:27.846776+0000","last_fullsized":"2024-03-30T13:08:27.846776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845559+0000","last_change":"2024-03-30T13:08:26.256864+0000","last_active":"2024-03-30T13:08:27.845559+0000","last_peered":"2024-03-30T13:08:27.845559+0000","last_clean":"2024-03-30T13:08:27.845559+0000","last_became_active":"2024-03-30T13:08:26.256473+0000","last_became_peered":"2024-03-30T13:08:26.256473+0000","last_unstale":"2024-03-30T13:08:27.845559+0000","last_undegraded":"2024-03-30T13:08:27.845559+0000","last_fullsized":"2024-03-30T13:08:27.845559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246353+0000","last_change":"2024-03-30T13:08:26.258095+0000","last_active":"2024-03-30T13:08:27.246353+0000","last_peered":"2024-03-30T13:08:27.246353+0000","last_clean":"2024-03-30T13:08:27.246353+0000","last_became_active":"2024-03-30T13:08:26.257730+0000","last_became_peered":"2024-03-30T13:08:26.257730+0000","last_unstale":"2024-03-30T13:08:27.246353+0000","last_undegraded":"2024-03-30T13:08:27.246353+0000","last_fullsized":"2024-03-30T13:08:27.246353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847781+0000","last_change":"2024-03-30T13:08:26.273733+0000","last_active":"2024-03-30T13:08:27.847781+0000","last_peered":"2024-03-30T13:08:27.847781+0000","last_clean":"2024-03-30T13:08:27.847781+0000","last_became_active":"2024-03-30T13:08:26.273292+0000","last_became_peered":"2024-03-30T13:08:26.273292+0000","last_unstale":"2024-03-30T13:08:27.847781+0000","last_undegraded":"2024-03-30T13:08:27.847781+0000","last_fullsized":"2024-03-30T13:08:27.847781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:09:50.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433604+0000","last_change":"2024-03-30T13:08:26.268609+0000","last_active":"2024-03-30T13:08:27.433604+0000","last_peered":"2024-03-30T13:08:27.433604+0000","last_clean":"2024-03-30T13:08:27.433604+0000","last_became_active":"2024-03-30T13:08:26.267927+0000","last_became_peered":"2024-03-30T13:08:26.267927+0000","last_unstale":"2024-03-30T13:08:27.433604+0000","last_undegraded":"2024-03-30T13:08:27.433604+0000","last_fullsized":"2024-03-30T13:08:27.433604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248242+0000","last_change":"2024-03-30T13:08:26.266866+0000","last_active":"2024-03-30T13:08:27.248242+0000","last_peered":"2024-03-30T13:08:27.248242+0000","last_clean":"2024-03-30T13:08:27.248242+0000","last_became_active":"2024-03-30T13:08:26.266575+0000","last_became_peered":"2024-03-30T13:08:26.266575+0000","last_unstale":"2024-03-30T13:08:27.248242+0000","last_undegraded":"2024-03-30T13:08:27.248242+0000","last_fullsized":"2024-03-30T13:08:27.248242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:09:50.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845802+0000","last_change":"2024-03-30T13:08:26.254723+0000","last_active":"2024-03-30T13:08:27.845802+0000","last_peered":"2024-03-30T13:08:27.845802+0000","last_clean":"2024-03-30T13:08:27.845802+0000","last_became_active":"2024-03-30T13:08:26.254265+0000","last_became_peered":"2024-03-30T13:08:26.254265+0000","last_unstale":"2024-03-30T13:08:27.845802+0000","last_undegraded":"2024-03-30T13:08:27.845802+0000","last_fullsized":"2024-03-30T13:08:27.845802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:15:20.022778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845227+0000","last_change":"2024-03-30T13:08:26.262550+0000","last_active":"2024-03-30T13:08:27.845227+0000","last_peered":"2024-03-30T13:08:27.845227+0000","last_clean":"2024-03-30T13:08:27.845227+0000","last_became_active":"2024-03-30T13:08:26.262229+0000","last_became_peered":"2024-03-30T13:08:26.262229+0000","last_unstale":"2024-03-30T13:08:27.845227+0000","last_undegraded":"2024-03-30T13:08:27.845227+0000","last_fullsized":"2024-03-30T13:08:27.845227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:00:23.772051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247533+0000","last_change":"2024-03-30T13:08:26.243305+0000","last_active":"2024-03-30T13:08:27.247533+0000","last_peered":"2024-03-30T13:08:27.247533+0000","last_clean":"2024-03-30T13:08:27.247533+0000","last_became_active":"2024-03-30T13:08:26.242498+0000","last_became_peered":"2024-03-30T13:08:26.242498+0000","last_unstale":"2024-03-30T13:08:27.247533+0000","last_undegraded":"2024-03-30T13:08:27.247533+0000","last_fullsized":"2024-03-30T13:08:27.247533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:33.361760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847372+0000","last_change":"2024-03-30T13:08:25.270817+0000","last_active":"2024-03-30T13:08:27.847372+0000","last_peered":"2024-03-30T13:08:27.847372+0000","last_clean":"2024-03-30T13:08:27.847372+0000","last_became_active":"2024-03-30T13:08:25.270460+0000","last_became_peered":"2024-03-30T13:08:25.270460+0000","last_unstale":"2024-03-30T13:08:27.847372+0000","last_undegraded":"2024-03-30T13:08:27.847372+0000","last_fullsized":"2024-03-30T13:08:27.847372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:07:26.410219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433632+0000","last_change":"2024-03-30T13:08:26.267853+0000","last_active":"2024-03-30T13:08:27.433632+0000","last_peered":"2024-03-30T13:08:27.433632+0000","last_clean":"2024-03-30T13:08:27.433632+0000","last_became_active":"2024-03-30T13:08:26.267527+0000","last_became_peered":"2024-03-30T13:08:26.267527+0000","last_unstale":"2024-03-30T13:08:27.433632+0000","last_undegraded":"2024-03-30T13:08:27.433632+0000","last_fullsized":"2024-03-30T13:08:27.433632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845594+0000","last_change":"2024-03-30T13:08:25.253579+0000","last_active":"2024-03-30T13:08:27.845594+0000","last_peered":"2024-03-30T13:08:27.845594+0000","last_clean":"2024-03-30T13:08:27.845594+0000","last_became_active":"2024-03-30T13:08:25.252838+0000","last_became_peered":"2024-03-30T13:08:25.252838+0000","last_unstale":"2024-03-30T13:08:27.845594+0000","last_undegraded":"2024-03-30T13:08:27.845594+0000","last_fullsized":"2024-03-30T13:08:27.845594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:35:44.891908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847051+0000","last_change":"2024-03-30T13:08:25.255081+0000","last_active":"2024-03-30T13:08:27.847051+0000","last_peered":"2024-03-30T13:08:27.847051+0000","last_clean":"2024-03-30T13:08:27.847051+0000","last_became_active":"2024-03-30T13:08:25.254790+0000","last_became_peered":"2024-03-30T13:08:25.254790+0000","last_unstale":"2024-03-30T13:08:27.847051+0000","last_undegraded":"2024-03-30T13:08:27.847051+0000","last_fullsized":"2024-03-30T13:08:27.847051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846524+0000","last_change":"2024-03-30T13:08:26.269902+0000","last_active":"2024-03-30T13:08:27.846524+0000","last_peered":"2024-03-30T13:08:27.846524+0000","last_clean":"2024-03-30T13:08:27.846524+0000","last_became_active":"2024-03-30T13:08:26.269503+0000","last_became_peered":"2024-03-30T13:08:26.269503+0000","last_unstale":"2024-03-30T13:08:27.846524+0000","last_undegraded":"2024-03-30T13:08:27.846524+0000","last_fullsized":"2024-03-30T13:08:27.846524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247045+0000","last_change":"2024-03-30T13:08:25.273212+0000","last_active":"2024-03-30T13:08:27.247045+0000","last_peered":"2024-03-30T13:08:27.247045+0000","last_clean":"2024-03-30T13:08:27.247045+0000","last_became_active":"2024-03-30T13:08:25.269863+0000","last_became_peered":"2024-03-30T13:08:25.269863+0000","last_unstale":"2024-03-30T13:08:27.247045+0000","last_undegraded":"2024-03-30T13:08:27.247045+0000","last_fullsized":"2024-03-30T13:08:27.247045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:39.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246339+0000","last_change":"2024-03-30T13:08:26.270878+0000","last_active":"2024-03-30T13:08:27.246339+0000","last_peered":"2024-03-30T13:08:27.246339+0000","last_clean":"2024-03-30T13:08:27.246339+0000","last_became_active":"2024-03-30T13:08:26.270607+0000","last_became_peered":"2024-03-30T13:08:26.270607+0000","last_unstale":"2024-03-30T13:08:27.246339+0000","last_undegraded":"2024-03-30T13:08:27.246339+0000","last_fullsized":"2024-03-30T13:08:27.246339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845448+0000","last_change":"2024-03-30T13:08:25.271725+0000","last_active":"2024-03-30T13:08:27.845448+0000","last_peered":"2024-03-30T13:08:27.845448+0000","last_clean":"2024-03-30T13:08:27.845448+0000","last_became_active":"2024-03-30T13:08:25.271059+0000","last_became_peered":"2024-03-30T13:08:25.271059+0000","last_unstale":"2024-03-30T13:08:27.845448+0000","last_undegraded":"2024-03-30T13:08:27.845448+0000","last_fullsized":"2024-03-30T13:08:27.845448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249536+0000","last_change":"2024-03-30T13:08:26.256649+0000","last_active":"2024-03-30T13:08:27.249536+0000","last_peered":"2024-03-30T13:08:27.249536+0000","last_clean":"2024-03-30T13:08:27.249536+0000","last_became_active":"2024-03-30T13:08:26.256365+0000","last_became_peered":"2024-03-30T13:08:26.256365+0000","last_unstale":"2024-03-30T13:08:27.249536+0000","last_undegraded":"2024-03-30T13:08:27.249536+0000","last_fullsized":"2024-03-30T13:08:27.249536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:34:59.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249749+0000","last_change":"2024-03-30T13:08:25.258848+0000","last_active":"2024-03-30T13:08:27.249749+0000","last_peered":"2024-03-30T13:08:27.249749+0000","last_clean":"2024-03-30T13:08:27.249749+0000","last_became_active":"2024-03-30T13:08:25.258153+0000","last_became_peered":"2024-03-30T13:08:25.258153+0000","last_unstale":"2024-03-30T13:08:27.249749+0000","last_undegraded":"2024-03-30T13:08:27.249749+0000","last_fullsized":"2024-03-30T13:08:27.249749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:24:11.686334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433812+0000","last_change":"2024-03-30T13:08:26.248994+0000","last_active":"2024-03-30T13:08:27.433812+0000","last_peered":"2024-03-30T13:08:27.433812+0000","last_clean":"2024-03-30T13:08:27.433812+0000","last_became_active":"2024-03-30T13:08:26.248649+0000","last_became_peered":"2024-03-30T13:08:26.248649+0000","last_unstale":"2024-03-30T13:08:27.433812+0000","last_undegraded":"2024-03-30T13:08:27.433812+0000","last_fullsized":"2024-03-30T13:08:27.433812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246424+0000","last_change":"2024-03-30T13:08:25.271938+0000","last_active":"2024-03-30T13:08:27.246424+0000","last_peered":"2024-03-30T13:08:27.246424+0000","last_clean":"2024-03-30T13:08:27.246424+0000","last_became_active":"2024-03-30T13:08:25.271537+0000","last_became_peered":"2024-03-30T13:08:25.271537+0000","last_unstale":"2024-03-30T13:08:27.246424+0000","last_undegraded":"2024-03-30T13:08:27.246424+0000","last_fullsized":"2024-03-30T13:08:27.246424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:25:11.691446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250784+0000","last_change":"2024-03-30T13:08:26.258598+0000","last_active":"2024-03-30T13:08:27.250784+0000","last_peered":"2024-03-30T13:08:27.250784+0000","last_clean":"2024-03-30T13:08:27.250784+0000","last_became_active":"2024-03-30T13:08:26.258283+0000","last_became_peered":"2024-03-30T13:08:26.258283+0000","last_unstale":"2024-03-30T13:08:27.250784+0000","last_undegraded":"2024-03-30T13:08:27.250784+0000","last_fullsized":"2024-03-30T13:08:27.250784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:32.954292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845682+0000","last_change":"2024-03-30T13:08:25.257898+0000","last_active":"2024-03-30T13:08:27.845682+0000","last_peered":"2024-03-30T13:08:27.845682+0000","last_clean":"2024-03-30T13:08:27.845682+0000","last_became_active":"2024-03-30T13:08:25.257311+0000","last_became_peered":"2024-03-30T13:08:25.257311+0000","last_unstale":"2024-03-30T13:08:27.845682+0000","last_undegraded":"2024-03-30T13:08:27.845682+0000","last_fullsized":"2024-03-30T13:08:27.845682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847509+0000","last_change":"2024-03-30T13:08:26.263276+0000","last_active":"2024-03-30T13:08:27.847509+0000","last_peered":"2024-03-30T13:08:27.847509+0000","last_clean":"2024-03-30T13:08:27.847509+0000","last_became_active":"2024-03-30T13:08:26.262279+0000","last_became_peered":"2024-03-30T13:08:26.262279+0000","last_unstale":"2024-03-30T13:08:27.847509+0000","last_undegraded":"2024-03-30T13:08:27.847509+0000","last_fullsized":"2024-03-30T13:08:27.847509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:09:50.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433714+0000","last_change":"2024-03-30T13:08:25.247025+0000","last_active":"2024-03-30T13:08:27.433714+0000","last_peered":"2024-03-30T13:08:27.433714+0000","last_clean":"2024-03-30T13:08:27.433714+0000","last_became_active":"2024-03-30T13:08:25.246656+0000","last_became_peered":"2024-03-30T13:08:25.246656+0000","last_unstale":"2024-03-30T13:08:27.433714+0000","last_undegraded":"2024-03-30T13:08:27.433714+0000","last_fullsized":"2024-03-30T13:08:27.433714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433293+0000","last_change":"2024-03-30T13:08:26.260804+0000","last_active":"2024-03-30T13:08:27.433293+0000","last_peered":"2024-03-30T13:08:27.433293+0000","last_clean":"2024-03-30T13:08:27.433293+0000","last_became_active":"2024-03-30T13:08:26.260342+0000","last_became_peered":"2024-03-30T13:08:26.260342+0000","last_unstale":"2024-03-30T13:08:27.433293+0000","last_undegraded":"2024-03-30T13:08:27.433293+0000","last_fullsized":"2024-03-30T13:08:27.433293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:00:23.772051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248471+0000","last_change":"2024-03-30T13:08:25.266076+0000","last_active":"2024-03-30T13:08:27.248471+0000","last_peered":"2024-03-30T13:08:27.248471+0000","last_clean":"2024-03-30T13:08:27.248471+0000","last_became_active":"2024-03-30T13:08:25.264628+0000","last_became_peered":"2024-03-30T13:08:25.264628+0000","last_unstale":"2024-03-30T13:08:27.248471+0000","last_undegraded":"2024-03-30T13:08:27.248471+0000","last_fullsized":"2024-03-30T13:08:27.248471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847623+0000","last_change":"2024-03-30T13:08:26.272989+0000","last_active":"2024-03-30T13:08:27.847623+0000","last_peered":"2024-03-30T13:08:27.847623+0000","last_clean":"2024-03-30T13:08:27.847623+0000","last_became_active":"2024-03-30T13:08:26.272715+0000","last_became_peered":"2024-03-30T13:08:26.272715+0000","last_unstale":"2024-03-30T13:08:27.847623+0000","last_undegraded":"2024-03-30T13:08:27.847623+0000","last_fullsized":"2024-03-30T13:08:27.847623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:51:01.414724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845237+0000","last_change":"2024-03-30T13:08:25.255530+0000","last_active":"2024-03-30T13:08:27.845237+0000","last_peered":"2024-03-30T13:08:27.845237+0000","last_clean":"2024-03-30T13:08:27.845237+0000","last_became_active":"2024-03-30T13:08:25.254828+0000","last_became_peered":"2024-03-30T13:08:25.254828+0000","last_unstale":"2024-03-30T13:08:27.845237+0000","last_undegraded":"2024-03-30T13:08:27.845237+0000","last_fullsized":"2024-03-30T13:08:27.845237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:07:26.410219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845374+0000","last_change":"2024-03-30T13:08:26.262416+0000","last_active":"2024-03-30T13:08:27.845374+0000","last_peered":"2024-03-30T13:08:27.845374+0000","last_clean":"2024-03-30T13:08:27.845374+0000","last_became_active":"2024-03-30T13:08:26.262147+0000","last_became_peered":"2024-03-30T13:08:26.262147+0000","last_unstale":"2024-03-30T13:08:27.845374+0000","last_undegraded":"2024-03-30T13:08:27.845374+0000","last_fullsized":"2024-03-30T13:08:27.845374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:06:18.572457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845499+0000","last_change":"2024-03-30T13:08:25.244929+0000","last_active":"2024-03-30T13:08:27.845499+0000","last_peered":"2024-03-30T13:08:27.845499+0000","last_clean":"2024-03-30T13:08:27.845499+0000","last_became_active":"2024-03-30T13:08:25.244565+0000","last_became_peered":"2024-03-30T13:08:25.244565+0000","last_unstale":"2024-03-30T13:08:27.845499+0000","last_undegraded":"2024-03-30T13:08:27.845499+0000","last_fullsized":"2024-03-30T13:08:27.845499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:24.519549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847184+0000","last_change":"2024-03-30T13:08:26.270298+0000","last_active":"2024-03-30T13:08:27.847184+0000","last_peered":"2024-03-30T13:08:27.847184+0000","last_clean":"2024-03-30T13:08:27.847184+0000","last_became_active":"2024-03-30T13:08:26.270008+0000","last_became_peered":"2024-03-30T13:08:26.270008+0000","last_unstale":"2024-03-30T13:08:27.847184+0000","last_undegraded":"2024-03-30T13:08:27.847184+0000","last_fullsized":"2024-03-30T13:08:27.847184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:38.839595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250765+0000","last_change":"2024-03-30T13:08:25.247533+0000","last_active":"2024-03-30T13:08:27.250765+0000","last_peered":"2024-03-30T13:08:27.250765+0000","last_clean":"2024-03-30T13:08:27.250765+0000","last_became_active":"2024-03-30T13:08:25.246529+0000","last_became_peered":"2024-03-30T13:08:25.246529+0000","last_unstale":"2024-03-30T13:08:27.250765+0000","last_undegraded":"2024-03-30T13:08:27.250765+0000","last_fullsized":"2024-03-30T13:08:27.250765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:47.553831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.848594+0000","last_change":"2024-03-30T13:08:26.273076+0000","last_active":"2024-03-30T13:08:27.848594+0000","last_peered":"2024-03-30T13:08:27.848594+0000","last_clean":"2024-03-30T13:08:27.848594+0000","last_became_active":"2024-03-30T13:08:26.272648+0000","last_became_peered":"2024-03-30T13:08:26.272648+0000","last_unstale":"2024-03-30T13:08:27.848594+0000","last_undegraded":"2024-03-30T13:08:27.848594+0000","last_fullsized":"2024-03-30T13:08:27.848594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:38:27.246797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846430+0000","last_change":"2024-03-30T13:08:25.246374+0000","last_active":"2024-03-30T13:08:27.846430+0000","last_peered":"2024-03-30T13:08:27.846430+0000","last_clean":"2024-03-30T13:08:27.846430+0000","last_became_active":"2024-03-30T13:08:25.246054+0000","last_became_peered":"2024-03-30T13:08:25.246054+0000","last_unstale":"2024-03-30T13:08:27.846430+0000","last_undegraded":"2024-03-30T13:08:27.846430+0000","last_fullsized":"2024-03-30T13:08:27.846430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:35:16.864101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.848301+0000","last_change":"2024-03-30T13:08:26.272977+0000","last_active":"2024-03-30T13:08:27.848301+0000","last_peered":"2024-03-30T13:08:27.848301+0000","last_clean":"2024-03-30T13:08:27.848301+0000","last_became_active":"2024-03-30T13:08:26.272484+0000","last_became_peered":"2024-03-30T13:08:26.272484+0000","last_unstale":"2024-03-30T13:08:27.848301+0000","last_undegraded":"2024-03-30T13:08:27.848301+0000","last_fullsized":"2024-03-30T13:08:27.848301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:52:03.940597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246440+0000","last_change":"2024-03-30T13:08:25.247470+0000","last_active":"2024-03-30T13:08:27.246440+0000","last_peered":"2024-03-30T13:08:27.246440+0000","last_clean":"2024-03-30T13:08:27.246440+0000","last_became_active":"2024-03-30T13:08:25.247147+0000","last_became_peered":"2024-03-30T13:08:25.247147+0000","last_unstale":"2024-03-30T13:08:27.246440+0000","last_undegraded":"2024-03-30T13:08:27.246440+0000","last_fullsized":"2024-03-30T13:08:27.246440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:07.835197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249178+0000","last_change":"2024-03-30T13:08:26.261671+0000","last_active":"2024-03-30T13:08:27.249178+0000","last_peered":"2024-03-30T13:08:27.249178+0000","last_clean":"2024-03-30T13:08:27.249178+0000","last_became_active":"2024-03-30T13:08:26.261411+0000","last_became_peered":"2024-03-30T13:08:26.261411+0000","last_unstale":"2024-03-30T13:08:27.249178+0000","last_undegraded":"2024-03-30T13:08:27.249178+0000","last_fullsized":"2024-03-30T13:08:27.249178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:07.743621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845955+0000","last_change":"2024-03-30T13:08:25.273872+0000","last_active":"2024-03-30T13:08:27.845955+0000","last_peered":"2024-03-30T13:08:27.845955+0000","last_clean":"2024-03-30T13:08:27.845955+0000","last_became_active":"2024-03-30T13:08:25.273570+0000","last_became_peered":"2024-03-30T13:08:25.273570+0000","last_unstale":"2024-03-30T13:08:27.845955+0000","last_undegraded":"2024-03-30T13:08:27.845955+0000","last_fullsized":"2024-03-30T13:08:27.845955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:32.352462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847718+0000","last_change":"2024-03-30T13:08:26.257523+0000","last_active":"2024-03-30T13:08:27.847718+0000","last_peered":"2024-03-30T13:08:27.847718+0000","last_clean":"2024-03-30T13:08:27.847718+0000","last_became_active":"2024-03-30T13:08:26.257150+0000","last_became_peered":"2024-03-30T13:08:26.257150+0000","last_unstale":"2024-03-30T13:08:27.847718+0000","last_undegraded":"2024-03-30T13:08:27.847718+0000","last_fullsized":"2024-03-30T13:08:27.847718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:34:59.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847028+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:08:27.847028+0000","last_peered":"2024-03-30T13:08:27.847028+0000","last_clean":"2024-03-30T13:08:27.847028+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:08:27.847028+0000","last_undegraded":"2024-03-30T13:08:27.847028+0000","last_fullsized":"2024-03-30T13:08:27.847028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247294+0000","last_change":"2024-03-30T13:08:25.258621+0000","last_active":"2024-03-30T13:08:27.247294+0000","last_peered":"2024-03-30T13:08:27.247294+0000","last_clean":"2024-03-30T13:08:27.247294+0000","last_became_active":"2024-03-30T13:08:25.257931+0000","last_became_peered":"2024-03-30T13:08:25.257931+0000","last_unstale":"2024-03-30T13:08:27.247294+0000","last_undegraded":"2024-03-30T13:08:27.247294+0000","last_fullsized":"2024-03-30T13:08:27.247294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847645+0000","last_change":"2024-03-30T13:08:26.260707+0000","last_active":"2024-03-30T13:08:27.847645+0000","last_peered":"2024-03-30T13:08:27.847645+0000","last_clean":"2024-03-30T13:08:27.847645+0000","last_became_active":"2024-03-30T13:08:26.254479+0000","last_became_peered":"2024-03-30T13:08:26.254479+0000","last_unstale":"2024-03-30T13:08:27.847645+0000","last_undegraded":"2024-03-30T13:08:27.847645+0000","last_fullsized":"2024-03-30T13:08:27.847645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:33.096715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846876+0000","last_change":"2024-03-30T13:08:25.266025+0000","last_active":"2024-03-30T13:08:27.846876+0000","last_peered":"2024-03-30T13:08:27.846876+0000","last_clean":"2024-03-30T13:08:27.846876+0000","last_became_active":"2024-03-30T13:08:25.265377+0000","last_became_peered":"2024-03-30T13:08:25.265377+0000","last_unstale":"2024-03-30T13:08:27.846876+0000","last_undegraded":"2024-03-30T13:08:27.846876+0000","last_fullsized":"2024-03-30T13:08:27.846876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:39.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433360+0000","last_change":"2024-03-30T13:08:26.267267+0000","last_active":"2024-03-30T13:08:27.433360+0000","last_peered":"2024-03-30T13:08:27.433360+0000","last_clean":"2024-03-30T13:08:27.433360+0000","last_became_active":"2024-03-30T13:08:26.266946+0000","last_became_peered":"2024-03-30T13:08:26.266946+0000","last_unstale":"2024-03-30T13:08:27.433360+0000","last_undegraded":"2024-03-30T13:08:27.433360+0000","last_fullsized":"2024-03-30T13:08:27.433360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:06:18.572457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845756+0000","last_change":"2024-03-30T13:08:25.240103+0000","last_active":"2024-03-30T13:08:27.845756+0000","last_peered":"2024-03-30T13:08:27.845756+0000","last_clean":"2024-03-30T13:08:27.845756+0000","last_became_active":"2024-03-30T13:08:25.239719+0000","last_became_peered":"2024-03-30T13:08:25.239719+0000","last_unstale":"2024-03-30T13:08:27.845756+0000","last_undegraded":"2024-03-30T13:08:27.845756+0000","last_fullsized":"2024-03-30T13:08:27.845756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:33:02.419995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246239+0000","last_change":"2024-03-30T13:08:26.253339+0000","last_active":"2024-03-30T13:08:27.246239+0000","last_peered":"2024-03-30T13:08:27.246239+0000","last_clean":"2024-03-30T13:08:27.246239+0000","last_became_active":"2024-03-30T13:08:26.243687+0000","last_became_peered":"2024-03-30T13:08:26.243687+0000","last_unstale":"2024-03-30T13:08:27.246239+0000","last_undegraded":"2024-03-30T13:08:27.246239+0000","last_fullsized":"2024-03-30T13:08:27.246239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248693+0000","last_change":"2024-03-30T13:08:25.265220+0000","last_active":"2024-03-30T13:08:27.248693+0000","last_peered":"2024-03-30T13:08:27.248693+0000","last_clean":"2024-03-30T13:08:27.248693+0000","last_became_active":"2024-03-30T13:08:25.263916+0000","last_became_peered":"2024-03-30T13:08:25.263916+0000","last_unstale":"2024-03-30T13:08:27.248693+0000","last_undegraded":"2024-03-30T13:08:27.248693+0000","last_fullsized":"2024-03-30T13:08:27.248693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:25:11.691446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249508+0000","last_change":"2024-03-30T13:08:26.266484+0000","last_active":"2024-03-30T13:08:27.249508+0000","last_peered":"2024-03-30T13:08:27.249508+0000","last_clean":"2024-03-30T13:08:27.249508+0000","last_became_active":"2024-03-30T13:08:26.266155+0000","last_became_peered":"2024-03-30T13:08:26.266155+0000","last_unstale":"2024-03-30T13:08:27.249508+0000","last_undegraded":"2024-03-30T13:08:27.249508+0000","last_fullsized":"2024-03-30T13:08:27.249508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:31:26.132649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246596+0000","last_change":"2024-03-30T13:08:25.248845+0000","last_active":"2024-03-30T13:08:27.246596+0000","last_peered":"2024-03-30T13:08:27.246596+0000","last_clean":"2024-03-30T13:08:27.246596+0000","last_became_active":"2024-03-30T13:08:25.248455+0000","last_became_peered":"2024-03-30T13:08:25.248455+0000","last_unstale":"2024-03-30T13:08:27.246596+0000","last_undegraded":"2024-03-30T13:08:27.246596+0000","last_fullsized":"2024-03-30T13:08:27.246596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:39.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249863+0000","last_change":"2024-03-30T13:08:26.254255+0000","last_active":"2024-03-30T13:08:27.249863+0000","last_peered":"2024-03-30T13:08:27.249863+0000","last_clean":"2024-03-30T13:08:27.249863+0000","last_became_active":"2024-03-30T13:08:26.253990+0000","last_became_peered":"2024-03-30T13:08:26.253990+0000","last_unstale":"2024-03-30T13:08:27.249863+0000","last_undegraded":"2024-03-30T13:08:27.249863+0000","last_fullsized":"2024-03-30T13:08:27.249863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:17.381480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.848028+0000","last_change":"2024-03-30T13:08:25.275050+0000","last_active":"2024-03-30T13:08:27.848028+0000","last_peered":"2024-03-30T13:08:27.848028+0000","last_clean":"2024-03-30T13:08:27.848028+0000","last_became_active":"2024-03-30T13:08:25.270650+0000","last_became_peered":"2024-03-30T13:08:25.270650+0000","last_unstale":"2024-03-30T13:08:27.848028+0000","last_undegraded":"2024-03-30T13:08:27.848028+0000","last_fullsized":"2024-03-30T13:08:27.848028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:11.754124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246448+0000","last_change":"2024-03-30T13:08:26.252864+0000","last_active":"2024-03-30T13:08:27.246448+0000","last_peered":"2024-03-30T13:08:27.246448+0000","last_clean":"2024-03-30T13:08:27.246448+0000","last_became_active":"2024-03-30T13:08:26.252487+0000","last_became_peered":"2024-03-30T13:08:26.252487+0000","last_unstale":"2024-03-30T13:08:27.246448+0000","last_undegraded":"2024-03-30T13:08:27.246448+0000","last_fullsized":"2024-03-30T13:08:27.246448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246596+0000","last_change":"2024-03-30T13:08:25.256761+0000","last_active":"2024-03-30T13:08:27.246596+0000","last_peered":"2024-03-30T13:08:27.246596+0000","last_clean":"2024-03-30T13:08:27.246596+0000","last_became_active":"2024-03-30T13:08:25.256423+0000","last_became_peered":"2024-03-30T13:08:25.256423+0000","last_unstale":"2024-03-30T13:08:27.246596+0000","last_undegraded":"2024-03-30T13:08:27.246596+0000","last_fullsized":"2024-03-30T13:08:27.246596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:11.754124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847010+0000","last_change":"2024-03-30T13:08:26.266237+0000","last_active":"2024-03-30T13:08:27.847010+0000","last_peered":"2024-03-30T13:08:27.847010+0000","last_clean":"2024-03-30T13:08:27.847010+0000","last_became_active":"2024-03-30T13:08:26.265651+0000","last_became_peered":"2024-03-30T13:08:26.265651+0000","last_unstale":"2024-03-30T13:08:27.847010+0000","last_undegraded":"2024-03-30T13:08:27.847010+0000","last_fullsized":"2024-03-30T13:08:27.847010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845790+0000","last_change":"2024-03-30T13:08:25.277163+0000","last_active":"2024-03-30T13:08:27.845790+0000","last_peered":"2024-03-30T13:08:27.845790+0000","last_clean":"2024-03-30T13:08:27.845790+0000","last_became_active":"2024-03-30T13:08:25.276378+0000","last_became_peered":"2024-03-30T13:08:25.276378+0000","last_unstale":"2024-03-30T13:08:27.845790+0000","last_undegraded":"2024-03-30T13:08:27.845790+0000","last_fullsized":"2024-03-30T13:08:27.845790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:24:11.686334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433709+0000","last_change":"2024-03-30T13:08:26.260918+0000","last_active":"2024-03-30T13:08:27.433709+0000","last_peered":"2024-03-30T13:08:27.433709+0000","last_clean":"2024-03-30T13:08:27.433709+0000","last_became_active":"2024-03-30T13:08:26.260191+0000","last_became_peered":"2024-03-30T13:08:26.260191+0000","last_unstale":"2024-03-30T13:08:27.433709+0000","last_undegraded":"2024-03-30T13:08:27.433709+0000","last_fullsized":"2024-03-30T13:08:27.433709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846849+0000","last_change":"2024-03-30T13:08:25.261497+0000","last_active":"2024-03-30T13:08:27.846849+0000","last_peered":"2024-03-30T13:08:27.846849+0000","last_clean":"2024-03-30T13:08:27.846849+0000","last_became_active":"2024-03-30T13:08:25.260478+0000","last_became_peered":"2024-03-30T13:08:25.260478+0000","last_unstale":"2024-03-30T13:08:27.846849+0000","last_undegraded":"2024-03-30T13:08:27.846849+0000","last_fullsized":"2024-03-30T13:08:27.846849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248615+0000","last_change":"2024-03-30T13:08:26.248004+0000","last_active":"2024-03-30T13:08:27.248615+0000","last_peered":"2024-03-30T13:08:27.248615+0000","last_clean":"2024-03-30T13:08:27.248615+0000","last_became_active":"2024-03-30T13:08:26.247256+0000","last_became_peered":"2024-03-30T13:08:26.247256+0000","last_unstale":"2024-03-30T13:08:27.248615+0000","last_undegraded":"2024-03-30T13:08:27.248615+0000","last_fullsized":"2024-03-30T13:08:27.248615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:00:34.966299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246220+0000","last_change":"2024-03-30T13:08:25.271738+0000","last_active":"2024-03-30T13:08:27.246220+0000","last_peered":"2024-03-30T13:08:27.246220+0000","last_clean":"2024-03-30T13:08:27.246220+0000","last_became_active":"2024-03-30T13:08:25.271345+0000","last_became_peered":"2024-03-30T13:08:25.271345+0000","last_unstale":"2024-03-30T13:08:27.246220+0000","last_undegraded":"2024-03-30T13:08:27.246220+0000","last_fullsized":"2024-03-30T13:08:27.246220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846920+0000","last_change":"2024-03-30T13:08:26.269105+0000","last_active":"2024-03-30T13:08:27.846920+0000","last_peered":"2024-03-30T13:08:27.846920+0000","last_clean":"2024-03-30T13:08:27.846920+0000","last_became_active":"2024-03-30T13:08:26.260812+0000","last_became_peered":"2024-03-30T13:08:26.260812+0000","last_unstale":"2024-03-30T13:08:27.846920+0000","last_undegraded":"2024-03-30T13:08:27.846920+0000","last_fullsized":"2024-03-30T13:08:27.846920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246299+0000","last_change":"2024-03-30T13:08:25.248839+0000","last_active":"2024-03-30T13:08:27.246299+0000","last_peered":"2024-03-30T13:08:27.246299+0000","last_clean":"2024-03-30T13:08:27.246299+0000","last_became_active":"2024-03-30T13:08:25.248429+0000","last_became_peered":"2024-03-30T13:08:25.248429+0000","last_unstale":"2024-03-30T13:08:27.246299+0000","last_undegraded":"2024-03-30T13:08:27.246299+0000","last_fullsized":"2024-03-30T13:08:27.246299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:24:11.686334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847416+0000","last_change":"2024-03-30T13:08:26.269026+0000","last_active":"2024-03-30T13:08:27.847416+0000","last_peered":"2024-03-30T13:08:27.847416+0000","last_clean":"2024-03-30T13:08:27.847416+0000","last_became_active":"2024-03-30T13:08:26.268626+0000","last_became_peered":"2024-03-30T13:08:26.268626+0000","last_unstale":"2024-03-30T13:08:27.847416+0000","last_undegraded":"2024-03-30T13:08:27.847416+0000","last_fullsized":"2024-03-30T13:08:27.847416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:38.839595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847773+0000","last_change":"2024-03-30T13:08:25.277478+0000","last_active":"2024-03-30T13:08:27.847773+0000","last_peered":"2024-03-30T13:08:27.847773+0000","last_clean":"2024-03-30T13:08:27.847773+0000","last_became_active":"2024-03-30T13:08:25.276694+0000","last_became_peered":"2024-03-30T13:08:25.276694+0000","last_unstale":"2024-03-30T13:08:27.847773+0000","last_undegraded":"2024-03-30T13:08:27.847773+0000","last_fullsized":"2024-03-30T13:08:27.847773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:13:51.325672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845058+0000","last_change":"2024-03-30T13:08:26.268719+0000","last_active":"2024-03-30T13:08:27.845058+0000","last_peered":"2024-03-30T13:08:27.845058+0000","last_clean":"2024-03-30T13:08:27.845058+0000","last_became_active":"2024-03-30T13:08:26.268461+0000","last_became_peered":"2024-03-30T13:08:26.268461+0000","last_unstale":"2024-03-30T13:08:27.845058+0000","last_undegraded":"2024-03-30T13:08:27.845058+0000","last_fullsized":"2024-03-30T13:08:27.845058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:25:49.517498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249613+0000","last_change":"2024-03-30T13:08:26.249193+0000","last_active":"2024-03-30T13:08:27.249613+0000","last_peered":"2024-03-30T13:08:27.249613+0000","last_clean":"2024-03-30T13:08:27.249613+0000","last_became_active":"2024-03-30T13:08:26.248772+0000","last_became_peered":"2024-03-30T13:08:26.248772+0000","last_unstale":"2024-03-30T13:08:27.249613+0000","last_undegraded":"2024-03-30T13:08:27.249613+0000","last_fullsized":"2024-03-30T13:08:27.249613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:11:06.559848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847285+0000","last_change":"2024-03-30T13:08:25.281959+0000","last_active":"2024-03-30T13:08:27.847285+0000","last_peered":"2024-03-30T13:08:27.847285+0000","last_clean":"2024-03-30T13:08:27.847285+0000","last_became_active":"2024-03-30T13:08:25.281274+0000","last_became_peered":"2024-03-30T13:08:25.281274+0000","last_unstale":"2024-03-30T13:08:27.847285+0000","last_undegraded":"2024-03-30T13:08:27.847285+0000","last_fullsized":"2024-03-30T13:08:27.847285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:25:11.691446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249036+0000","last_change":"2024-03-30T13:08:26.249258+0000","last_active":"2024-03-30T13:08:27.249036+0000","last_peered":"2024-03-30T13:08:27.249036+0000","last_clean":"2024-03-30T13:08:27.249036+0000","last_became_active":"2024-03-30T13:08:26.248751+0000","last_became_peered":"2024-03-30T13:08:26.248751+0000","last_unstale":"2024-03-30T13:08:27.249036+0000","last_undegraded":"2024-03-30T13:08:27.249036+0000","last_fullsized":"2024-03-30T13:08:27.249036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:51:01.414724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847841+0000","last_change":"2024-03-30T13:08:25.277430+0000","last_active":"2024-03-30T13:08:27.847841+0000","last_peered":"2024-03-30T13:08:27.847841+0000","last_clean":"2024-03-30T13:08:27.847841+0000","last_became_active":"2024-03-30T13:08:25.276574+0000","last_became_peered":"2024-03-30T13:08:25.276574+0000","last_unstale":"2024-03-30T13:08:27.847841+0000","last_undegraded":"2024-03-30T13:08:27.847841+0000","last_fullsized":"2024-03-30T13:08:27.847841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:07.835197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433517+0000","last_change":"2024-03-30T13:08:26.249242+0000","last_active":"2024-03-30T13:08:27.433517+0000","last_peered":"2024-03-30T13:08:27.433517+0000","last_clean":"2024-03-30T13:08:27.433517+0000","last_became_active":"2024-03-30T13:08:26.248878+0000","last_became_peered":"2024-03-30T13:08:26.248878+0000","last_unstale":"2024-03-30T13:08:27.433517+0000","last_undegraded":"2024-03-30T13:08:27.433517+0000","last_fullsized":"2024-03-30T13:08:27.433517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847382+0000","last_change":"2024-03-30T13:08:25.244866+0000","last_active":"2024-03-30T13:08:27.847382+0000","last_peered":"2024-03-30T13:08:27.847382+0000","last_clean":"2024-03-30T13:08:27.847382+0000","last_became_active":"2024-03-30T13:08:25.244502+0000","last_became_peered":"2024-03-30T13:08:25.244502+0000","last_unstale":"2024-03-30T13:08:27.847382+0000","last_undegraded":"2024-03-30T13:08:27.847382+0000","last_fullsized":"2024-03-30T13:08:27.847382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:35:44.891908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847055+0000","last_change":"2024-03-30T13:08:26.265904+0000","last_active":"2024-03-30T13:08:27.847055+0000","last_peered":"2024-03-30T13:08:27.847055+0000","last_clean":"2024-03-30T13:08:27.847055+0000","last_became_active":"2024-03-30T13:08:26.265600+0000","last_became_peered":"2024-03-30T13:08:26.265600+0000","last_unstale":"2024-03-30T13:08:27.847055+0000","last_undegraded":"2024-03-30T13:08:27.847055+0000","last_fullsized":"2024-03-30T13:08:27.847055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433661+0000","last_change":"2024-03-30T13:08:25.271879+0000","last_active":"2024-03-30T13:08:27.433661+0000","last_peered":"2024-03-30T13:08:27.433661+0000","last_clean":"2024-03-30T13:08:27.433661+0000","last_became_active":"2024-03-30T13:08:25.270729+0000","last_became_peered":"2024-03-30T13:08:25.270729+0000","last_unstale":"2024-03-30T13:08:27.433661+0000","last_undegraded":"2024-03-30T13:08:27.433661+0000","last_fullsized":"2024-03-30T13:08:27.433661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:45:33.842798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":657783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":68445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":73223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":68445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":657839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":73133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:08:34.066 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-30T13:08:34.066 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-30T13:08:34.067 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-30T13:08:34.067 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-30T13:08:34.067 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-30T13:08:34.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30bb91d640 1 Processor -- start 2024-03-30T13:08:34.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30bb91d640 1 -- start start 2024-03-30T13:08:34.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30bb91d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f30b415e500 0x7f30b415e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30bb91d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f30b40d4240 0x7f30b40d4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30bb91d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b40cee20 0x7f30b40cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30bb91d640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f30b40d2340 con 0x7f30b415e500 2024-03-30T13:08:34.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30bb91d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f30b406c6a0 con 0x7f30b40d4240 2024-03-30T13:08:34.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30bb91d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f30b40cfb30 con 0x7f30b40cee20 2024-03-30T13:08:34.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30b96b9640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f30b415e500 0x7f30b415e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30b96b9640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f30b415e500 0x7f30b415e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43392/0 (socket says 172.21.15.83:43392) 2024-03-30T13:08:34.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30b96b9640 1 -- 172.21.15.83:0/2176791848 learned_addr learned my addr 172.21.15.83:0/2176791848 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:34.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30b8eb8640 1 --2- 172.21.15.83:0/2176791848 >> v2:172.21.15.153:3300/0 conn(0x7f30b40d4240 0x7f30b40d4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30b9eba640 1 --2- 172.21.15.83:0/2176791848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b40cee20 0x7f30b40cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30b96b9640 1 -- 172.21.15.83:0/2176791848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b40cee20 msgr2=0x7f30b40cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:34.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30b96b9640 1 --2- 172.21.15.83:0/2176791848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b40cee20 0x7f30b40cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30b96b9640 1 -- 172.21.15.83:0/2176791848 >> v2:172.21.15.153:3300/0 conn(0x7f30b40d4240 msgr2=0x7f30b40d4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:34.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30b96b9640 1 --2- 172.21.15.83:0/2176791848 >> v2:172.21.15.153:3300/0 conn(0x7f30b40d4240 0x7f30b40d4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30b96b9640 1 -- 172.21.15.83:0/2176791848 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b40cfe10 con 0x7f30b415e500 2024-03-30T13:08:34.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30b9eba640 1 --2- 172.21.15.83:0/2176791848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b40cee20 0x7f30b40cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:34.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.221+0000 7f30b8eb8640 1 --2- 172.21.15.83:0/2176791848 >> v2:172.21.15.153:3300/0 conn(0x7f30b40d4240 0x7f30b40d4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:34.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30b96b9640 1 --2- 172.21.15.83:0/2176791848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b415e500 0x7f30b415e8e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f30b406e730 tx=0x7f30b001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6267a16bf9909a67 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:34.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30abfff640 1 -- 172.21.15.83:0/2176791848 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b00aa610 con 0x7f30b415e500 2024-03-30T13:08:34.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30abfff640 1 -- 172.21.15.83:0/2176791848 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b00af070 con 0x7f30b415e500 2024-03-30T13:08:34.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30abfff640 1 -- 172.21.15.83:0/2176791848 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b00aa9d0 con 0x7f30b415e500 2024-03-30T13:08:34.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30bb91d640 1 -- 172.21.15.83:0/2176791848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b415e500 msgr2=0x7f30b415e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30bb91d640 1 --2- 172.21.15.83:0/2176791848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b415e500 0x7f30b415e8e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f30b406e730 tx=0x7f30b001c4f0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30bb91d640 1 -- 172.21.15.83:0/2176791848 shutdown_connections 2024-03-30T13:08:34.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30bb91d640 1 --2- 172.21.15.83:0/2176791848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b40cee20 0x7f30b40cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30bb91d640 1 --2- 172.21.15.83:0/2176791848 >> v2:172.21.15.153:3300/0 conn(0x7f30b40d4240 0x7f30b40d4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30bb91d640 1 --2- 172.21.15.83:0/2176791848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b415e500 0x7f30b415e8e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30bb91d640 1 -- 172.21.15.83:0/2176791848 >> 172.21.15.83:0/2176791848 conn(0x7f30b408bfe0 msgr2=0x7f30b409d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:34.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30bb91d640 1 -- 172.21.15.83:0/2176791848 shutdown_connections 2024-03-30T13:08:34.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.225+0000 7f30bb91d640 1 -- 172.21.15.83:0/2176791848 wait complete. 2024-03-30T13:08:34.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30bb91d640 1 Processor -- start 2024-03-30T13:08:34.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30bb91d640 1 -- start start 2024-03-30T13:08:34.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30bb91d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b40cee20 0x7f30b40b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30bb91d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b40d4240 0x7f30b4155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30bb91d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b415e500 0x7f30b415d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30bb91d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40d14f0 con 0x7f30b40d4240 2024-03-30T13:08:34.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30bb91d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40cf7f0 con 0x7f30b40cee20 2024-03-30T13:08:34.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30bb91d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f30b40d1670 con 0x7f30b415e500 2024-03-30T13:08:34.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b8eb8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b40d4240 0x7f30b4155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b8eb8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b40d4240 0x7f30b4155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43398/0 (socket says 172.21.15.83:43398) 2024-03-30T13:08:34.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b8eb8640 1 -- 172.21.15.83:0/2942749547 learned_addr learned my addr 172.21.15.83:0/2942749547 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:34.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b96b9640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b40cee20 0x7f30b40b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b9eba640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b415e500 0x7f30b415d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b8eb8640 1 -- 172.21.15.83:0/2942749547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b415e500 msgr2=0x7f30b415d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b8eb8640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b415e500 0x7f30b415d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b8eb8640 1 -- 172.21.15.83:0/2942749547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b40cee20 msgr2=0x7f30b40b81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b8eb8640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b40cee20 0x7f30b40b81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b8eb8640 1 -- 172.21.15.83:0/2942749547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b415c540 con 0x7f30b40d4240 2024-03-30T13:08:34.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b96b9640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b40cee20 0x7f30b40b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:34.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b9eba640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b415e500 0x7f30b415d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:34.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b8eb8640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b40d4240 0x7f30b4155700 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30a400e730 tx=0x7f30a400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:34.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30a9ffb640 1 -- 172.21.15.83:0/2942749547 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a400f040 con 0x7f30b40d4240 2024-03-30T13:08:34.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30a9ffb640 1 -- 172.21.15.83:0/2942749547 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a4005ba0 con 0x7f30b40d4240 2024-03-30T13:08:34.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30bb91d640 1 -- 172.21.15.83:0/2942749547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b415c820 con 0x7f30b40d4240 2024-03-30T13:08:34.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30a9ffb640 1 -- 172.21.15.83:0/2942749547 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a400ee40 con 0x7f30b40d4240 2024-03-30T13:08:34.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30bb91d640 1 -- 172.21.15.83:0/2942749547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b415d0c0 con 0x7f30b40d4240 2024-03-30T13:08:34.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30bb91d640 1 -- 172.21.15.83:0/2942749547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b40686c0 con 0x7f30b40d4240 2024-03-30T13:08:34.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30a9ffb640 1 -- 172.21.15.83:0/2942749547 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f30a4004030 con 0x7f30b40d4240 2024-03-30T13:08:34.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30a9ffb640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3098067fc0 0x7f309806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30a9ffb640 1 -- 172.21.15.83:0/2942749547 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f30a4086280 con 0x7f30b40d4240 2024-03-30T13:08:34.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.229+0000 7f30b96b9640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3098067fc0 0x7f309806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.233+0000 7f30b96b9640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3098067fc0 0x7f309806a480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30b00ae000 tx=0x7f30b00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:34.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.237+0000 7f30a9ffb640 1 -- 172.21.15.83:0/2942749547 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f30a4020030 con 0x7f30b40d4240 2024-03-30T13:08:34.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.441+0000 7f30bb91d640 1 -- 172.21.15.83:0/2942749547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f30b415c9f0 con 0x7f30b40d4240 2024-03-30T13:08:34.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.445+0000 7f30a9ffb640 1 -- 172.21.15.83:0/2942749547 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+167683 (secure 0 0 0) 0x7f30a4017030 con 0x7f30b40d4240 2024-03-30T13:08:34.451 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:34.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.449+0000 7f30bb91d640 1 -- 172.21.15.83:0/2942749547 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3098067fc0 msgr2=0x7f309806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.449+0000 7f30bb91d640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3098067fc0 0x7f309806a480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30b00ae000 tx=0x7f30b00a7000 comp rx=0 tx=0).stop 2024-03-30T13:08:34.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.449+0000 7f30bb91d640 1 -- 172.21.15.83:0/2942749547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b40d4240 msgr2=0x7f30b4155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.449+0000 7f30bb91d640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b40d4240 0x7f30b4155700 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30a400e730 tx=0x7f30a400ebf0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.449+0000 7f30bb91d640 1 -- 172.21.15.83:0/2942749547 shutdown_connections 2024-03-30T13:08:34.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.449+0000 7f30bb91d640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3098067fc0 0x7f309806a480 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.449+0000 7f30bb91d640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30b415e500 0x7f30b415d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.449+0000 7f30bb91d640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b40d4240 0x7f30b4155700 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.449+0000 7f30bb91d640 1 --2- 172.21.15.83:0/2942749547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b40cee20 0x7f30b40b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.449+0000 7f30bb91d640 1 -- 172.21.15.83:0/2942749547 >> 172.21.15.83:0/2942749547 conn(0x7f30b408bfe0 msgr2=0x7f30b40b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:34.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.449+0000 7f30bb91d640 1 -- 172.21.15.83:0/2942749547 shutdown_connections 2024-03-30T13:08:34.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.449+0000 7f30bb91d640 1 -- 172.21.15.83:0/2942749547 wait complete. 2024-03-30T13:08:34.470 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1589047293},{"type":"v1","addr":"172.21.15.83:6833","nonce":1589047293}]},"active_addr":"172.21.15.83:6833/1589047293","active_change":"2024-03-30T13:08:06.126482+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":2214860009}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":4291487227}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":3989951142}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":1962036930}]}]} 2024-03-30T13:08:34.474 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-30T13:08:34.474 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-30T13:08:34.474 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:34.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.585+0000 7fa50581d640 1 Processor -- start 2024-03-30T13:08:34.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa50581d640 1 -- start start 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa50581d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa5000b4830 0x7fa50015d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa50581d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa50006dfe0 0x7fa50006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa50581d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa50015d880 con 0x7fa5000aed20 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa50581d640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fa500156e00 con 0x7fa5000b4830 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa50581d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa5000ad040 con 0x7fa50006dfe0 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa4feffd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa5000b4830 0x7fa50015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa4feffd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa5000b4830 0x7fa50015d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43404/0 (socket says 172.21.15.83:43404) 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa4feffd640 1 -- 172.21.15.83:0/2025501458 learned_addr learned my addr 172.21.15.83:0/2025501458 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa4ff7fe640 1 --2- 172.21.15.83:0/2025501458 >> v2:172.21.15.153:3300/0 conn(0x7fa50006dfe0 0x7fa50006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa4feffd640 1 -- 172.21.15.83:0/2025501458 >> v2:172.21.15.153:3300/0 conn(0x7fa50006dfe0 msgr2=0x7fa50006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa4feffd640 1 --2- 172.21.15.83:0/2025501458 >> v2:172.21.15.153:3300/0 conn(0x7fa50006dfe0 0x7fa50006e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa4feffd640 1 -- 172.21.15.83:0/2025501458 >> v1:172.21.15.153:6789/0 conn(0x7fa5000aed20 legacy=0x7fa5000af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:34.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa4feffd640 1 -- 172.21.15.83:0/2025501458 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5000cfcb0 con 0x7fa5000b4830 2024-03-30T13:08:34.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.589+0000 7fa4feffd640 1 --2- 172.21.15.83:0/2025501458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5000b4830 0x7fa50015d340 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa500074fc0 tx=0x7fa4f001c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb28f1cfed97197a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:34.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4fdffb640 1 -- 172.21.15.83:0/2025501458 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00a5720 con 0x7fa5000b4830 2024-03-30T13:08:34.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4fdffb640 1 -- 172.21.15.83:0/2025501458 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f00a58c0 con 0x7fa5000b4830 2024-03-30T13:08:34.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4fdffb640 1 -- 172.21.15.83:0/2025501458 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00a5c90 con 0x7fa5000b4830 2024-03-30T13:08:34.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 -- 172.21.15.83:0/2025501458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5000b4830 msgr2=0x7fa50015d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 --2- 172.21.15.83:0/2025501458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5000b4830 0x7fa50015d340 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa500074fc0 tx=0x7fa4f001c860 comp rx=0 tx=0).stop 2024-03-30T13:08:34.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 -- 172.21.15.83:0/2025501458 shutdown_connections 2024-03-30T13:08:34.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 --2- 172.21.15.83:0/2025501458 >> v2:172.21.15.153:3300/0 conn(0x7fa50006dfe0 0x7fa50006e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 --2- 172.21.15.83:0/2025501458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5000b4830 0x7fa50015d340 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 -- 172.21.15.83:0/2025501458 >> 172.21.15.83:0/2025501458 conn(0x7fa5000b1d60 msgr2=0x7fa5000b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:34.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 -- 172.21.15.83:0/2025501458 shutdown_connections 2024-03-30T13:08:34.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 -- 172.21.15.83:0/2025501458 wait complete. 2024-03-30T13:08:34.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 Processor -- start 2024-03-30T13:08:34.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 -- start start 2024-03-30T13:08:34.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa50006dfe0 0x7fa5000cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5000aed20 0x7fa5001f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5000b4830 0x7fa5001f9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa5000cf860 con 0x7fa50006dfe0 2024-03-30T13:08:34.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa50006fa90 con 0x7fa5000b4830 2024-03-30T13:08:34.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa50581d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa5000cf9e0 con 0x7fa5000aed20 2024-03-30T13:08:34.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4feffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa50006dfe0 0x7fa5000cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4feffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa50006dfe0 0x7fa5000cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43416/0 (socket says 172.21.15.83:43416) 2024-03-30T13:08:34.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4feffd640 1 -- 172.21.15.83:0/1050897561 learned_addr learned my addr 172.21.15.83:0/1050897561 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:34.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4ff7fe640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5000b4830 0x7fa5001f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4fe7fc640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5000aed20 0x7fa5001f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4feffd640 1 -- 172.21.15.83:0/1050897561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5000aed20 msgr2=0x7fa5001f8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4feffd640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5000aed20 0x7fa5001f8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4feffd640 1 -- 172.21.15.83:0/1050897561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5000b4830 msgr2=0x7fa5001f9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4feffd640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5000b4830 0x7fa5001f9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.593+0000 7fa4feffd640 1 -- 172.21.15.83:0/1050897561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5000cde50 con 0x7fa50006dfe0 2024-03-30T13:08:34.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.597+0000 7fa4feffd640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa50006dfe0 0x7fa5000cd470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa4f001af10 tx=0x7fa4f0019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:34.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.597+0000 7fa4f7fff640 1 -- 172.21.15.83:0/1050897561 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00bc020 con 0x7fa50006dfe0 2024-03-30T13:08:34.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.597+0000 7fa4f7fff640 1 -- 172.21.15.83:0/1050897561 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f00b8670 con 0x7fa50006dfe0 2024-03-30T13:08:34.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.597+0000 7fa50581d640 1 -- 172.21.15.83:0/1050897561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5000ce130 con 0x7fa50006dfe0 2024-03-30T13:08:34.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.597+0000 7fa4f7fff640 1 -- 172.21.15.83:0/1050897561 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00b8a20 con 0x7fa50006dfe0 2024-03-30T13:08:34.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.597+0000 7fa50581d640 1 -- 172.21.15.83:0/1050897561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5000ce6f0 con 0x7fa50006dfe0 2024-03-30T13:08:34.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.597+0000 7fa50581d640 1 -- 172.21.15.83:0/1050897561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5000cead0 con 0x7fa50006dfe0 2024-03-30T13:08:34.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.597+0000 7fa4f7fff640 1 -- 172.21.15.83:0/1050897561 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa4f00bf020 con 0x7fa50006dfe0 2024-03-30T13:08:34.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.597+0000 7fa4f7fff640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa4e0067fc0 0x7fa4e006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.597+0000 7fa4f7fff640 1 -- 172.21.15.83:0/1050897561 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa4f01213f0 con 0x7fa50006dfe0 2024-03-30T13:08:34.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.597+0000 7fa4fe7fc640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa4e0067fc0 0x7fa4e006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.597+0000 7fa4fe7fc640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa4e0067fc0 0x7fa4e006a480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5000b0b80 tx=0x7fa4e8007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:34.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.601+0000 7fa4f7fff640 1 -- 172.21.15.83:0/1050897561 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fa4f00c6030 con 0x7fa50006dfe0 2024-03-30T13:08:34.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.761+0000 7fa50581d640 1 -- 172.21.15.83:0/1050897561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5000b3aa0 con 0x7fa50006dfe0 2024-03-30T13:08:34.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.765+0000 7fa4f7fff640 1 -- 172.21.15.83:0/1050897561 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7fa4f00165a0 con 0x7fa50006dfe0 2024-03-30T13:08:34.772 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:34.772 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:34.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.769+0000 7fa50581d640 1 -- 172.21.15.83:0/1050897561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa4e0067fc0 msgr2=0x7fa4e006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.769+0000 7fa50581d640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa4e0067fc0 0x7fa4e006a480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5000b0b80 tx=0x7fa4e8007e40 comp rx=0 tx=0).stop 2024-03-30T13:08:34.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.769+0000 7fa50581d640 1 -- 172.21.15.83:0/1050897561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa50006dfe0 msgr2=0x7fa5000cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.769+0000 7fa50581d640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa50006dfe0 0x7fa5000cd470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa4f001af10 tx=0x7fa4f0019600 comp rx=0 tx=0).stop 2024-03-30T13:08:34.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.769+0000 7fa50581d640 1 -- 172.21.15.83:0/1050897561 shutdown_connections 2024-03-30T13:08:34.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.769+0000 7fa50581d640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa4e0067fc0 0x7fa4e006a480 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.769+0000 7fa50581d640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5000b4830 0x7fa5001f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.769+0000 7fa50581d640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5000aed20 0x7fa5001f8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.769+0000 7fa50581d640 1 --2- 172.21.15.83:0/1050897561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa50006dfe0 0x7fa5000cd470 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.769+0000 7fa50581d640 1 -- 172.21.15.83:0/1050897561 >> 172.21.15.83:0/1050897561 conn(0x7fa5000b1d60 msgr2=0x7fa50015ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:34.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.769+0000 7fa50581d640 1 -- 172.21.15.83:0/1050897561 shutdown_connections 2024-03-30T13:08:34.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.769+0000 7fa50581d640 1 -- 172.21.15.83:0/1050897561 wait complete. 2024-03-30T13:08:34.790 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-30T13:08:34.790 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:34.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.889+0000 7f5df2909640 1 Processor -- start 2024-03-30T13:08:34.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.889+0000 7f5df2909640 1 -- start start 2024-03-30T13:08:34.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5dec0730e0 0x7f5dec15b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5dec0b4bb0 0x7f5dec15f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5dec06f140 0x7f5dec06f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f5dec06faf0 con 0x7f5dec06f140 2024-03-30T13:08:34.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5dec0734c0 con 0x7f5dec0730e0 2024-03-30T13:08:34.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5dec15c2a0 con 0x7f5dec0b4bb0 2024-03-30T13:08:34.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df0ea6640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5dec06f140 0x7f5dec06f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df0ea6640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5dec06f140 0x7f5dec06f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43430/0 (socket says 172.21.15.83:43430) 2024-03-30T13:08:34.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df0ea6640 1 -- 172.21.15.83:0/349671470 learned_addr learned my addr 172.21.15.83:0/349671470 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:34.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5de37fe640 1 --2- 172.21.15.83:0/349671470 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5dec0b4bb0 0x7f5dec15f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5debfff640 1 --2- 172.21.15.83:0/349671470 >> v2:172.21.15.153:3300/0 conn(0x7f5dec0730e0 0x7f5dec15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df0ea6640 1 -- 172.21.15.83:0/349671470 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5dec0b4bb0 msgr2=0x7f5dec15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:34.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df0ea6640 1 --2- 172.21.15.83:0/349671470 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5dec0b4bb0 0x7f5dec15f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df0ea6640 1 -- 172.21.15.83:0/349671470 >> v2:172.21.15.153:3300/0 conn(0x7f5dec0730e0 msgr2=0x7f5dec15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:34.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df0ea6640 1 --2- 172.21.15.83:0/349671470 >> v2:172.21.15.153:3300/0 conn(0x7f5dec0730e0 0x7f5dec15b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df0ea6640 1 -- 172.21.15.83:0/349671470 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec15c580 con 0x7f5dec06f140 2024-03-30T13:08:34.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df0ea6640 1 --2- 172.21.15.83:0/349671470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec06f140 0x7f5dec06f5b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5dec070f30 tx=0x7f5de401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b58d03b1a3c6a78 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:34.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5deb7fe640 1 -- 172.21.15.83:0/349671470 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de40a5840 con 0x7f5dec06f140 2024-03-30T13:08:34.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5deb7fe640 1 -- 172.21.15.83:0/349671470 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de40a59e0 con 0x7f5dec06f140 2024-03-30T13:08:34.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5deb7fe640 1 -- 172.21.15.83:0/349671470 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de40a5db0 con 0x7f5dec06f140 2024-03-30T13:08:34.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 -- 172.21.15.83:0/349671470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec06f140 msgr2=0x7f5dec06f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 --2- 172.21.15.83:0/349671470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec06f140 0x7f5dec06f5b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5dec070f30 tx=0x7f5de401c9c0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 -- 172.21.15.83:0/349671470 shutdown_connections 2024-03-30T13:08:34.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 --2- 172.21.15.83:0/349671470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec06f140 0x7f5dec06f5b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 --2- 172.21.15.83:0/349671470 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5dec0b4bb0 0x7f5dec15f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 --2- 172.21.15.83:0/349671470 >> v2:172.21.15.153:3300/0 conn(0x7f5dec0730e0 0x7f5dec15b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 -- 172.21.15.83:0/349671470 >> 172.21.15.83:0/349671470 conn(0x7f5dec0b1d60 msgr2=0x7f5dec0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:34.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 -- 172.21.15.83:0/349671470 shutdown_connections 2024-03-30T13:08:34.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.893+0000 7f5df2909640 1 -- 172.21.15.83:0/349671470 wait complete. 2024-03-30T13:08:34.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df2909640 1 Processor -- start 2024-03-30T13:08:34.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df2909640 1 -- start start 2024-03-30T13:08:34.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df2909640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5dec06f140 0x7f5dec15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df2909640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dec0730e0 0x7f5dec151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df2909640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec0b4bb0 0x7f5dec14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df2909640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec15c010 con 0x7f5dec0b4bb0 2024-03-30T13:08:34.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df2909640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec15be90 con 0x7f5dec0730e0 2024-03-30T13:08:34.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df2909640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5dec15fd00 con 0x7f5dec06f140 2024-03-30T13:08:34.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df0ea6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec0b4bb0 0x7f5dec14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df0ea6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec0b4bb0 0x7f5dec14ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43434/0 (socket says 172.21.15.83:43434) 2024-03-30T13:08:34.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df0ea6640 1 -- 172.21.15.83:0/1602194251 learned_addr learned my addr 172.21.15.83:0/1602194251 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5debfff640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5dec06f140 0x7f5dec15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5de37fe640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dec0730e0 0x7f5dec151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df0ea6640 1 -- 172.21.15.83:0/1602194251 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5dec06f140 msgr2=0x7f5dec15caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df0ea6640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5dec06f140 0x7f5dec15caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df0ea6640 1 -- 172.21.15.83:0/1602194251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dec0730e0 msgr2=0x7f5dec151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df0ea6640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dec0730e0 0x7f5dec151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df0ea6640 1 -- 172.21.15.83:0/1602194251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec152470 con 0x7f5dec0b4bb0 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df0ea6640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec0b4bb0 0x7f5dec14ff90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5de401d260 tx=0x7f5de4019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5de97fa640 1 -- 172.21.15.83:0/1602194251 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de40bc020 con 0x7f5dec0b4bb0 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5de97fa640 1 -- 172.21.15.83:0/1602194251 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de40b8690 con 0x7f5dec0b4bb0 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df2909640 1 -- 172.21.15.83:0/1602194251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dec0b02b0 con 0x7f5dec0b4bb0 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5de97fa640 1 -- 172.21.15.83:0/1602194251 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de40b8a80 con 0x7f5dec0b4bb0 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df2909640 1 -- 172.21.15.83:0/1602194251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dec0b0870 con 0x7f5dec0b4bb0 2024-03-30T13:08:34.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5df2909640 1 -- 172.21.15.83:0/1602194251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dec0686c0 con 0x7f5dec0b4bb0 2024-03-30T13:08:34.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.897+0000 7f5de97fa640 1 -- 172.21.15.83:0/1602194251 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5de40bf020 con 0x7f5dec0b4bb0 2024-03-30T13:08:34.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.901+0000 7f5de97fa640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5dcc067fc0 0x7f5dcc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:34.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.901+0000 7f5de97fa640 1 -- 172.21.15.83:0/1602194251 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5de41215d0 con 0x7f5dec0b4bb0 2024-03-30T13:08:34.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.901+0000 7f5debfff640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5dcc067fc0 0x7f5dcc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:34.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.901+0000 7f5debfff640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5dcc067fc0 0x7f5dcc06a480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00ba30 tx=0x7f5ddc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:34.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:34.905+0000 7f5de97fa640 1 -- 172.21.15.83:0/1602194251 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5de40c6030 con 0x7f5dec0b4bb0 2024-03-30T13:08:35.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.061+0000 7f5df2909640 1 -- 172.21.15.83:0/1602194251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5dec06da70 con 0x7f5dec0b4bb0 2024-03-30T13:08:35.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.061+0000 7f5de97fa640 1 -- 172.21.15.83:0/1602194251 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f5de40165e0 con 0x7f5dec0b4bb0 2024-03-30T13:08:35.067 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:35.067 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:35.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.061+0000 7f5df2909640 1 -- 172.21.15.83:0/1602194251 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5dcc067fc0 msgr2=0x7f5dcc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.061+0000 7f5df2909640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5dcc067fc0 0x7f5dcc06a480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00ba30 tx=0x7f5ddc008040 comp rx=0 tx=0).stop 2024-03-30T13:08:35.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.061+0000 7f5df2909640 1 -- 172.21.15.83:0/1602194251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec0b4bb0 msgr2=0x7f5dec14ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.061+0000 7f5df2909640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec0b4bb0 0x7f5dec14ff90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5de401d260 tx=0x7f5de4019760 comp rx=0 tx=0).stop 2024-03-30T13:08:35.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.065+0000 7f5df2909640 1 -- 172.21.15.83:0/1602194251 shutdown_connections 2024-03-30T13:08:35.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.065+0000 7f5df2909640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5dcc067fc0 0x7f5dcc06a480 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.065+0000 7f5df2909640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec0b4bb0 0x7f5dec14ff90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.065+0000 7f5df2909640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dec0730e0 0x7f5dec151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.065+0000 7f5df2909640 1 --2- 172.21.15.83:0/1602194251 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5dec06f140 0x7f5dec15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.065+0000 7f5df2909640 1 -- 172.21.15.83:0/1602194251 >> 172.21.15.83:0/1602194251 conn(0x7f5dec0b1d60 msgr2=0x7f5dec06e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.065+0000 7f5df2909640 1 -- 172.21.15.83:0/1602194251 shutdown_connections 2024-03-30T13:08:35.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.065+0000 7f5df2909640 1 -- 172.21.15.83:0/1602194251 wait complete. 2024-03-30T13:08:35.085 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-30T13:08:35.085 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-30T13:08:35.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-30T13:08:35.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-30T13:08:35.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-30T13:08:35.087 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-30T13:08:35.087 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-30T13:08:35.088 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-30T13:08:35.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a3fff640 1 Processor -- start 2024-03-30T13:08:35.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a3fff640 1 -- start start 2024-03-30T13:08:35.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.253+0000 7f3b55b6d640 1 Processor -- start 2024-03-30T13:08:35.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.253+0000 7f3b55b6d640 1 -- start start 2024-03-30T13:08:35.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b55b6d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3b500ad150 0x7f3b5006ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b55b6d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5006f220 0x7f3b5006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b55b6d640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5006f620 con 0x7f3b500aef30 2024-03-30T13:08:35.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b55b6d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f3b500d0fc0 con 0x7f3b500ad150 2024-03-30T13:08:35.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b55b6d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3b500d03b0 con 0x7f3b5006f220 2024-03-30T13:08:35.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b4f7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3b500aef30 0x7f3b500b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40212/0 (socket says 172.21.15.83:40212) 2024-03-30T13:08:35.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b4f7fe640 1 -- 172.21.15.83:0/1594178653 learned_addr learned my addr 172.21.15.83:0/1594178653 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:35.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a3fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f50a4072d90 0x7f50a415e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a3fff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f50a415e6b0 0x7f50a40ad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a3fff640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a415ab70 con 0x7f50a4158150 2024-03-30T13:08:35.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a3fff640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f50a406d580 con 0x7f50a4072d90 2024-03-30T13:08:35.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a3fff640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f50a415b4a0 con 0x7f50a415e6b0 2024-03-30T13:08:35.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b46ffd640 1 --2- 172.21.15.83:0/1594178653 >> v2:172.21.15.153:3300/0 conn(0x7f3b500ad150 0x7f3b5006ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b4ffff640 1 --2- 172.21.15.83:0/1594178653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5006f220 0x7f3b5006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b4effd640 1 -- 172.21.15.83:0/1594178653 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 932963466 0 0) 0x7f3b5006f620 con 0x7f3b500aef30 2024-03-30T13:08:35.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b4effd640 1 -- 172.21.15.83:0/1594178653 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b3c003530 con 0x7f3b500aef30 2024-03-30T13:08:35.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a2ffd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f50a4158150 0x7f50a4072680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40228/0 (socket says 172.21.15.83:40228) 2024-03-30T13:08:35.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a2ffd640 1 -- 172.21.15.83:0/1548992830 learned_addr learned my addr 172.21.15.83:0/1548992830 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:35.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a27fc640 1 --2- 172.21.15.83:0/1548992830 >> v2:172.21.15.83:3300/0 conn(0x7f50a4072d90 0x7f50a415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a37fe640 1 --2- 172.21.15.83:0/1548992830 >> v2:172.21.15.153:3300/0 conn(0x7f50a415e6b0 0x7f50a40ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b46ffd640 1 -- 172.21.15.83:0/1594178653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5006f220 msgr2=0x7f3b5006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b46ffd640 1 --2- 172.21.15.83:0/1594178653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5006f220 0x7f3b5006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b46ffd640 1 -- 172.21.15.83:0/1594178653 >> v1:172.21.15.83:6789/0 conn(0x7f3b500aef30 legacy=0x7f3b500b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b46ffd640 1 -- 172.21.15.83:0/1594178653 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b500d0690 con 0x7f3b500ad150 2024-03-30T13:08:35.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f3b4ffff640 1 --2- 172.21.15.83:0/1594178653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5006f220 0x7f3b5006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:35.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f2e46569640 1 Processor -- start 2024-03-30T13:08:35.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7fc077ba5640 1 Processor -- start 2024-03-30T13:08:35.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a27fc640 1 -- 172.21.15.83:0/1548992830 >> v2:172.21.15.153:3300/0 conn(0x7f50a415e6b0 msgr2=0x7f50a40ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7fc079d84640 1 Processor -- start 2024-03-30T13:08:35.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7fc077ba5640 1 -- start start 2024-03-30T13:08:35.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7fc079d84640 1 -- start start 2024-03-30T13:08:35.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f389aa8d640 1 Processor -- start 2024-03-30T13:08:35.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f389aa8d640 1 -- start start 2024-03-30T13:08:35.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f2e46569640 1 -- start start 2024-03-30T13:08:35.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f390de54640 1 Processor -- start 2024-03-30T13:08:35.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc077ba5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc070159c50 0x7fc07015d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc077ba5640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0700d02c0 0x7fc0700d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc077ba5640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0700aef90 con 0x7fc07015fc90 2024-03-30T13:08:35.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc077ba5640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc07015d630 con 0x7fc0700d02c0 2024-03-30T13:08:35.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc077ba5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc0700d0c60 con 0x7fc070159c50 2024-03-30T13:08:35.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e46569640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e38033e40 0x7f2e380eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e46569640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2e38047c20 0x7f2e380eb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e46569640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e38034220 con 0x7f2e380ebc00 2024-03-30T13:08:35.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e46569640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f2e38050210 con 0x7f2e38047c20 2024-03-30T13:08:35.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e46569640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2e38037bc0 con 0x7f2e38033e40 2024-03-30T13:08:35.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a1ffb640 1 -- 172.21.15.83:0/1548992830 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 53102996 0 0) 0x7f50a415ab70 con 0x7f50a4158150 2024-03-30T13:08:35.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a27fc640 1 --2- 172.21.15.83:0/1548992830 >> v2:172.21.15.153:3300/0 conn(0x7f50a415e6b0 0x7f50a40ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a27fc640 1 -- 172.21.15.83:0/1548992830 >> v1:172.21.15.83:6789/0 conn(0x7f50a4158150 legacy=0x7f50a4072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.257+0000 7f50a27fc640 1 -- 172.21.15.83:0/1548992830 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a415ae50 con 0x7f50a4072d90 2024-03-30T13:08:35.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc079d84640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0740af720 0x7fc07415e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f390de54640 1 -- start start 2024-03-30T13:08:35.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc079d84640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0740723a0 0x7fc07415a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc079d84640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc0740d0390 0x7fc0740d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f50a37fe640 1 --2- 172.21.15.83:0/1548992830 >> v2:172.21.15.153:3300/0 conn(0x7f50a415e6b0 0x7f50a40ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:35.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc076142640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc07015fc90 0x7fc070160100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:38502/0 (socket says 172.21.15.83:38502) 2024-03-30T13:08:35.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc076142640 1 -- 172.21.15.83:0/2717029444 learned_addr learned my addr 172.21.15.83:0/2717029444 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:35.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc075941640 1 --2- 172.21.15.83:0/2717029444 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc070159c50 0x7fc07015d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc075140640 1 --2- 172.21.15.83:0/2717029444 >> v2:172.21.15.153:3300/0 conn(0x7fc0700d02c0 0x7fc0700d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc0737fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0740af720 0x7fc07415e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc0737fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0740af720 0x7fc07415e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:50392/0 (socket says 172.21.15.83:50392) 2024-03-30T13:08:35.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc0737fe640 1 -- 172.21.15.83:0/555082396 learned_addr learned my addr 172.21.15.83:0/555082396 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc079d84640 1 -- 172.21.15.83:0/555082396 --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc07415b8c0 con 0x7fc0740d0390 2024-03-30T13:08:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc079d84640 1 -- 172.21.15.83:0/555082396 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc07415e440 con 0x7fc0740723a0 2024-03-30T13:08:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e3ffff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e38033e40 0x7f2e380eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e3ffff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e38033e40 0x7f2e380eb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:41182/0 (socket says 172.21.15.83:41182) 2024-03-30T13:08:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e3ffff640 1 -- 172.21.15.83:0/3813456781 learned_addr learned my addr 172.21.15.83:0/3813456781 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc079d84640 1 -- 172.21.15.83:0/555082396 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc07415ee10 con 0x7fc0740af720 2024-03-30T13:08:35.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc072ffd640 1 --2- 172.21.15.83:0/555082396 >> v2:172.21.15.153:3300/0 conn(0x7fc0740723a0 0x7fc07415a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc073fff640 1 --2- 172.21.15.83:0/555082396 >> v2:172.21.15.83:3300/0 conn(0x7fc0740d0390 0x7fc0740d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e3f7fe640 1 --2- 172.21.15.83:0/3813456781 >> v2:172.21.15.83:3300/0 conn(0x7f2e38047c20 0x7f2e380eb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc0737fe640 1 -- 172.21.15.83:0/555082396 >> v2:172.21.15.153:3300/0 conn(0x7fc0740723a0 msgr2=0x7fc07415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc0737fe640 1 --2- 172.21.15.83:0/555082396 >> v2:172.21.15.153:3300/0 conn(0x7fc0740723a0 0x7fc07415a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc0737fe640 1 -- 172.21.15.83:0/555082396 >> v2:172.21.15.83:3300/0 conn(0x7fc0740d0390 msgr2=0x7fc0740d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc0737fe640 1 --2- 172.21.15.83:0/555082396 >> v2:172.21.15.83:3300/0 conn(0x7fc0740d0390 0x7fc0740d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc0737fe640 1 -- 172.21.15.83:0/555082396 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07415b300 con 0x7fc0740af720 2024-03-30T13:08:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc075941640 1 -- 172.21.15.83:0/2717029444 >> v2:172.21.15.153:3300/0 conn(0x7fc0700d02c0 msgr2=0x7fc0700d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc075941640 1 --2- 172.21.15.83:0/2717029444 >> v2:172.21.15.153:3300/0 conn(0x7fc0700d02c0 0x7fc0700d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc075941640 1 -- 172.21.15.83:0/2717029444 >> v1:172.21.15.153:6789/0 conn(0x7fc07015fc90 legacy=0x7fc070160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7fc075941640 1 -- 172.21.15.83:0/2717029444 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0700af270 con 0x7fc070159c50 2024-03-30T13:08:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3b46ffd640 1 --2- 172.21.15.83:0/1594178653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b500ad150 0x7f3b5006ece0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800b860 tx=0x7f3b3801c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e65e8eb6fa60a456 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e3f7fe640 1 -- 172.21.15.83:0/3813456781 >> v2:172.21.15.153:3300/0 conn(0x7f2e38033e40 msgr2=0x7f2e380eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e3f7fe640 1 --2- 172.21.15.83:0/3813456781 >> v2:172.21.15.153:3300/0 conn(0x7f2e38033e40 0x7f2e380eb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e3f7fe640 1 -- 172.21.15.83:0/3813456781 >> v1:172.21.15.153:6789/0 conn(0x7f2e380ebc00 legacy=0x7f2e38052f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f2e3f7fe640 1 -- 172.21.15.83:0/3813456781 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3804fa30 con 0x7f2e38047c20 2024-03-30T13:08:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f390de54640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39080723a0 0x7f390815a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3b4effd640 1 -- 172.21.15.83:0/1594178653 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b40001320 con 0x7f3b500ad150 2024-03-30T13:08:35.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3b4effd640 1 -- 172.21.15.83:0/1594178653 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b380a64b0 con 0x7f3b500ad150 2024-03-30T13:08:35.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3b4effd640 1 -- 172.21.15.83:0/1594178653 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b380a6660 con 0x7f3b500ad150 2024-03-30T13:08:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f390de54640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39080d0390 0x7f39080d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f39077fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f39080af720 0x7f390815e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40230/0 (socket says 172.21.15.83:40230) 2024-03-30T13:08:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f390de54640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f390815b300 con 0x7f39080af720 2024-03-30T13:08:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f390de54640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f390815b8c0 con 0x7f39080d0390 2024-03-30T13:08:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f390de54640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f390815e440 con 0x7f39080723a0 2024-03-30T13:08:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f39077fe640 1 -- 172.21.15.83:0/992321039 learned_addr learned my addr 172.21.15.83:0/992321039 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3906ffd640 1 --2- 172.21.15.83:0/992321039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39080723a0 0x7f390815a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3907fff640 1 --2- 172.21.15.83:0/992321039 >> v2:172.21.15.153:3300/0 conn(0x7f39080d0390 0x7f39080d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f389aa8d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f389406f490 0x7f3894072430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f389aa8d640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f389406f8e0 con 0x7f389415a360 2024-03-30T13:08:35.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f389aa8d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38940b3860 con 0x7f38940b2820 2024-03-30T13:08:35.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f389aa8d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3894072970 con 0x7f389406f490 2024-03-30T13:08:35.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f50a27fc640 1 --2- 172.21.15.83:0/1548992830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50a4072d90 0x7f50a415e170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f50a40aee00 tx=0x7f509401d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d914444d9ed317b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3893fff640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f38940b2820 0x7f389406dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:38524/0 (socket says 172.21.15.83:38524) 2024-03-30T13:08:35.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3893fff640 1 -- 172.21.15.83:0/2903979198 learned_addr learned my addr 172.21.15.83:0/2903979198 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:35.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3b55b6d640 1 -- 172.21.15.83:0/1594178653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b500ad150 msgr2=0x7f3b5006ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3b55b6d640 1 --2- 172.21.15.83:0/1594178653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b500ad150 0x7f3b5006ece0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800b860 tx=0x7f3b3801c770 comp rx=0 tx=0).stop 2024-03-30T13:08:35.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f389902a640 1 --2- 172.21.15.83:0/2903979198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f389406f490 0x7f3894072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f39067fc640 1 -- 172.21.15.83:0/992321039 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868166555 0 0) 0x7f390815b300 con 0x7f39080af720 2024-03-30T13:08:35.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f39067fc640 1 -- 172.21.15.83:0/992321039 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38f0003530 con 0x7f39080af720 2024-03-30T13:08:35.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3906ffd640 1 -- 172.21.15.83:0/992321039 >> v2:172.21.15.153:3300/0 conn(0x7f39080d0390 msgr2=0x7f39080d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3906ffd640 1 --2- 172.21.15.83:0/992321039 >> v2:172.21.15.153:3300/0 conn(0x7f39080d0390 0x7f39080d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3906ffd640 1 -- 172.21.15.83:0/992321039 >> v1:172.21.15.83:6789/0 conn(0x7f39080af720 legacy=0x7f390815e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f3906ffd640 1 -- 172.21.15.83:0/992321039 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390815b5e0 con 0x7f39080723a0 2024-03-30T13:08:35.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f50a1ffb640 1 -- 172.21.15.83:0/1548992830 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50940ac600 con 0x7f50a4072d90 2024-03-30T13:08:35.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f50a1ffb640 1 -- 172.21.15.83:0/1548992830 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50940b1070 con 0x7f50a4072d90 2024-03-30T13:08:35.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.261+0000 7f50a1ffb640 1 -- 172.21.15.83:0/1548992830 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50940ac9c0 con 0x7f50a4072d90 2024-03-30T13:08:35.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 -- 172.21.15.83:0/1594178653 shutdown_connections 2024-03-30T13:08:35.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 --2- 172.21.15.83:0/1594178653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5006f220 0x7f3b5006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 --2- 172.21.15.83:0/1594178653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b500ad150 0x7f3b5006ece0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 -- 172.21.15.83:0/1594178653 >> 172.21.15.83:0/1594178653 conn(0x7f3b500b5690 msgr2=0x7f3b500b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780344804 0 0) 0x7f389406f8e0 con 0x7f389415a360 2024-03-30T13:08:35.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f387c003450 con 0x7f389415a360 2024-03-30T13:08:35.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 -- 172.21.15.83:0/1594178653 shutdown_connections 2024-03-30T13:08:35.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 -- 172.21.15.83:0/1594178653 wait complete. 2024-03-30T13:08:35.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1111783992 0 0) 0x7f387c003450 con 0x7f389415a360 2024-03-30T13:08:35.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f389406f490 msgr2=0x7f3894072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 --2- 172.21.15.83:0/2903979198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f389406f490 0x7f3894072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 >> v1:172.21.15.153:6789/0 conn(0x7f38940b2820 legacy=0x7f389406dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38940b3fc0 con 0x7f389415a360 2024-03-30T13:08:35.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f3888001660 con 0x7f389415a360 2024-03-30T13:08:35.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 >> v1:172.21.15.83:6789/0 conn(0x7f389415a360 legacy=0x7f38940b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc075941640 1 --2- 172.21.15.83:0/2717029444 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc070159c50 0x7fc07015d0f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0097c0 tx=0x7fc06c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a10efd9f3a5741 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f50a3fff640 1 -- 172.21.15.83:0/1548992830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50a4072d90 msgr2=0x7f50a415e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f50a3fff640 1 --2- 172.21.15.83:0/1548992830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50a4072d90 0x7f50a415e170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f50a40aee00 tx=0x7f509401d5a0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 --2- 172.21.15.83:0/2903979198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387c003b20 0x7f387c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 --2- 172.21.15.83:0/2903979198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f387c008910 0x7f387c00ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 --2- 172.21.15.83:0/2903979198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f387c00b5c0 0x7f387c00da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3894072970 con 0x7f387c008910 2024-03-30T13:08:35.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f387c004670 con 0x7f387c003b20 2024-03-30T13:08:35.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f387c004870 con 0x7f387c00b5c0 2024-03-30T13:08:35.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f50a3fff640 1 -- 172.21.15.83:0/1548992830 shutdown_connections 2024-03-30T13:08:35.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f50a3fff640 1 --2- 172.21.15.83:0/1548992830 >> v2:172.21.15.153:3300/0 conn(0x7f50a415e6b0 0x7f50a40ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f50a3fff640 1 --2- 172.21.15.83:0/1548992830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50a4072d90 0x7f50a415e170 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f50a40aee00 tx=0x7f509401d5a0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f50a3fff640 1 -- 172.21.15.83:0/1548992830 >> 172.21.15.83:0/1548992830 conn(0x7f50a40cfef0 msgr2=0x7f50a40d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f50a3fff640 1 -- 172.21.15.83:0/1548992830 shutdown_connections 2024-03-30T13:08:35.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3898829640 1 --2- 172.21.15.83:0/2903979198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387c003b20 0x7f387c003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 Processor -- start 2024-03-30T13:08:35.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc07493f640 1 -- 172.21.15.83:0/2717029444 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0a7070 con 0x7fc070159c50 2024-03-30T13:08:35.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc07493f640 1 -- 172.21.15.83:0/2717029444 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc06c0b0070 con 0x7fc070159c50 2024-03-30T13:08:35.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc07493f640 1 -- 172.21.15.83:0/2717029444 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0ab690 con 0x7fc070159c50 2024-03-30T13:08:35.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 -- start start 2024-03-30T13:08:35.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc077ba5640 1 -- 172.21.15.83:0/2717029444 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc070159c50 msgr2=0x7fc07015d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc077ba5640 1 --2- 172.21.15.83:0/2717029444 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc070159c50 0x7fc07015d0f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0097c0 tx=0x7fc06c01c470 comp rx=0 tx=0).stop 2024-03-30T13:08:35.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc0737fe640 1 --2- 172.21.15.83:0/555082396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0740af720 0x7fc07415e8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc07406c550 tx=0x7fc06c01db00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcc13f59f34b336a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f50a3fff640 1 -- 172.21.15.83:0/1548992830 wait complete. 2024-03-30T13:08:35.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f50a3fff640 1 Processor -- start 2024-03-30T13:08:35.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b5006f220 0x7f3b50091990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b500ad150 0x7f3b500b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b500aef30 0x7f3b500b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3b500d0150 con 0x7f3b5006f220 2024-03-30T13:08:35.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3b500cffd0 con 0x7f3b500ad150 2024-03-30T13:08:35.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b55b6d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3b500af310 con 0x7f3b500aef30 2024-03-30T13:08:35.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc0727fc640 1 -- 172.21.15.83:0/555082396 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0a6870 con 0x7fc0740af720 2024-03-30T13:08:35.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc0727fc640 1 -- 172.21.15.83:0/555082396 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc06c0a6a10 con 0x7fc0740af720 2024-03-30T13:08:35.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc0727fc640 1 -- 172.21.15.83:0/555082396 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0a6de0 con 0x7fc0740af720 2024-03-30T13:08:35.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc077ba5640 1 -- 172.21.15.83:0/2717029444 shutdown_connections 2024-03-30T13:08:35.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc077ba5640 1 --2- 172.21.15.83:0/2717029444 >> v2:172.21.15.153:3300/0 conn(0x7fc0700d02c0 0x7fc0700d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc077ba5640 1 --2- 172.21.15.83:0/2717029444 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc070159c50 0x7fc07015d0f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc077ba5640 1 -- 172.21.15.83:0/2717029444 >> 172.21.15.83:0/2717029444 conn(0x7fc07006b830 msgr2=0x7fc07006bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc077ba5640 1 -- 172.21.15.83:0/2717029444 shutdown_connections 2024-03-30T13:08:35.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f50a3fff640 1 -- start start 2024-03-30T13:08:35.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b4f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b5006f220 0x7f3b50091990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b4f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b5006f220 0x7f3b50091990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43490/0 (socket says 172.21.15.83:43490) 2024-03-30T13:08:35.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b46ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b500ad150 0x7f3b500b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b4f7fe640 1 -- 172.21.15.83:0/2535009653 learned_addr learned my addr 172.21.15.83:0/2535009653 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3b4ffff640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b500aef30 0x7f3b500b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f2e3f7fe640 1 --2- 172.21.15.83:0/3813456781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e38047c20 0x7f2e380eb6c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2e4006a4b0 tx=0x7f2e4009a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466800d91280988b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7fc077ba5640 1 -- 172.21.15.83:0/2717029444 wait complete. 2024-03-30T13:08:35.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50a4158150 0x7f50a4203c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a3fff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50a415e6b0 0x7f50a409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50a414bd40 0x7f50a41490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a3fff640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f50a415ec80 con 0x7f50a4158150 2024-03-30T13:08:35.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a3fff640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f50a415eb00 con 0x7f50a414bd40 2024-03-30T13:08:35.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a3fff640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f50a40addc0 con 0x7f50a415e6b0 2024-03-30T13:08:35.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f3b4f7fe640 1 -- 172.21.15.83:0/2535009653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b500aef30 msgr2=0x7f3b500b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f3b4f7fe640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b500aef30 0x7f3b500b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f3b4f7fe640 1 -- 172.21.15.83:0/2535009653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b500ad150 msgr2=0x7f3b500b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f3b4f7fe640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b500ad150 0x7f3b500b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f3b4f7fe640 1 -- 172.21.15.83:0/2535009653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b50094ff0 con 0x7f3b5006f220 2024-03-30T13:08:35.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f3b4ffff640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b500aef30 0x7f3b500b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:35.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f3b46ffd640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b500ad150 0x7f3b500b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:35.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 -- 172.21.15.83:0/555082396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0740af720 msgr2=0x7fc07415e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 --2- 172.21.15.83:0/555082396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0740af720 0x7fc07415e8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc07406c550 tx=0x7fc06c01db00 comp rx=0 tx=0).stop 2024-03-30T13:08:35.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 -- 172.21.15.83:0/555082396 shutdown_connections 2024-03-30T13:08:35.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 --2- 172.21.15.83:0/555082396 >> v2:172.21.15.83:3300/0 conn(0x7fc0740d0390 0x7fc0740d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 --2- 172.21.15.83:0/555082396 >> v2:172.21.15.153:3300/0 conn(0x7fc0740723a0 0x7fc07415a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 --2- 172.21.15.83:0/555082396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0740af720 0x7fc07415e8d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 -- 172.21.15.83:0/555082396 >> 172.21.15.83:0/555082396 conn(0x7fc07406b830 msgr2=0x7fc07406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3906ffd640 1 --2- 172.21.15.83:0/992321039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39080723a0 0x7f390815a950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f38fc008260 tx=0x7f38fc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7efffb9833bf8e19 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f39067fc640 1 -- 172.21.15.83:0/992321039 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0b1070 con 0x7f39080723a0 2024-03-30T13:08:35.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f39067fc640 1 -- 172.21.15.83:0/992321039 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38fc008be0 con 0x7f39080723a0 2024-03-30T13:08:35.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f39067fc640 1 -- 172.21.15.83:0/992321039 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00a0d0 con 0x7f39080723a0 2024-03-30T13:08:35.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a27fc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50a415e6b0 0x7f50a409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a27fc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50a415e6b0 0x7f50a409aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:50410/0 (socket says 172.21.15.83:50410) 2024-03-30T13:08:35.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a27fc640 1 -- 172.21.15.83:0/3890106113 learned_addr learned my addr 172.21.15.83:0/3890106113 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3898829640 1 -- 172.21.15.83:0/2903979198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f387c00b5c0 msgr2=0x7f387c00da50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:08:35.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3898829640 1 --2- 172.21.15.83:0/2903979198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f387c00b5c0 0x7f387c00da50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3898829640 1 -- 172.21.15.83:0/2903979198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f387c008910 msgr2=0x7f387c00ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3898829640 1 --2- 172.21.15.83:0/2903979198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f387c008910 0x7f387c00ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.265+0000 7f3898829640 1 -- 172.21.15.83:0/2903979198 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38940b3fc0 con 0x7f387c003b20 2024-03-30T13:08:35.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f3b4f7fe640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b5006f220 0x7f3b50091990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000cb40 tx=0x7f3b4000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f390de54640 1 -- 172.21.15.83:0/992321039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39080723a0 msgr2=0x7f390815a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f390de54640 1 --2- 172.21.15.83:0/992321039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39080723a0 0x7f390815a950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f38fc008260 tx=0x7f38fc01c3c0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 -- 172.21.15.83:0/555082396 shutdown_connections 2024-03-30T13:08:35.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 -- 172.21.15.83:0/555082396 wait complete. 2024-03-30T13:08:35.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a37fe640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50a414bd40 0x7f50a41490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a2ffd640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50a4158150 0x7f50a4203c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f390de54640 1 -- 172.21.15.83:0/992321039 shutdown_connections 2024-03-30T13:08:35.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a27fc640 1 -- 172.21.15.83:0/3890106113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50a414bd40 msgr2=0x7f50a41490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a27fc640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50a414bd40 0x7f50a41490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a27fc640 1 -- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50a4158150 msgr2=0x7f50a4203c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a27fc640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50a4158150 0x7f50a4203c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a27fc640 1 -- 172.21.15.83:0/3890106113 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a40cd650 con 0x7f50a415e6b0 2024-03-30T13:08:35.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f390de54640 1 --2- 172.21.15.83:0/992321039 >> v2:172.21.15.153:3300/0 conn(0x7f39080d0390 0x7f39080d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f390de54640 1 --2- 172.21.15.83:0/992321039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39080723a0 0x7f390815a950 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f3898829640 1 --2- 172.21.15.83:0/2903979198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387c003b20 0x7f387c003f60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f388800c1b0 tx=0x7f388801cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ddf19a82ca0bfa1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f2e3effd640 1 -- 172.21.15.83:0/3813456781 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4012f070 con 0x7f2e38047c20 2024-03-30T13:08:35.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f2e3effd640 1 -- 172.21.15.83:0/3813456781 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e40123e50 con 0x7f2e38047c20 2024-03-30T13:08:35.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f2e3effd640 1 -- 172.21.15.83:0/3813456781 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4012a900 con 0x7f2e38047c20 2024-03-30T13:08:35.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f390de54640 1 -- 172.21.15.83:0/992321039 >> 172.21.15.83:0/992321039 conn(0x7f390806b830 msgr2=0x7f390806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc077ba5640 1 Processor -- start 2024-03-30T13:08:35.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a27fc640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50a415e6b0 0x7f50a409aa50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5094098f50 tx=0x7f509401bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f390de54640 1 -- 172.21.15.83:0/992321039 shutdown_connections 2024-03-30T13:08:35.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888007c90 con 0x7f387c003b20 2024-03-30T13:08:35.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f390de54640 1 -- 172.21.15.83:0/992321039 wait complete. 2024-03-30T13:08:35.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f2e46569640 1 -- 172.21.15.83:0/3813456781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e38047c20 msgr2=0x7f2e380eb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f2e46569640 1 --2- 172.21.15.83:0/3813456781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e38047c20 0x7f2e380eb6c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2e4006a4b0 tx=0x7f2e4009a550 comp rx=0 tx=0).stop 2024-03-30T13:08:35.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f508b7fe640 1 -- 172.21.15.83:0/3890106113 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50940bc070 con 0x7f50a415e6b0 2024-03-30T13:08:35.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 Processor -- start 2024-03-30T13:08:35.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 -- start start 2024-03-30T13:08:35.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38880a9070 con 0x7f387c003b20 2024-03-30T13:08:35.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f38937fe640 1 -- 172.21.15.83:0/2903979198 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888006c20 con 0x7f387c003b20 2024-03-30T13:08:35.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f389aa8d640 1 -- 172.21.15.83:0/2903979198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387c003b20 msgr2=0x7f387c003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f389aa8d640 1 --2- 172.21.15.83:0/2903979198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387c003b20 0x7f387c003f60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f388800c1b0 tx=0x7f388801cc40 comp rx=0 tx=0).stop 2024-03-30T13:08:35.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f389902a640 1 -- 172.21.15.83:0/2903979198 reap_dead start 2024-03-30T13:08:35.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f389aa8d640 1 -- 172.21.15.83:0/2903979198 shutdown_connections 2024-03-30T13:08:35.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f389aa8d640 1 -- 172.21.15.83:0/2903979198 >> 172.21.15.83:0/2903979198 conn(0x7f38940d03d0 msgr2=0x7f38940d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f389aa8d640 1 -- 172.21.15.83:0/2903979198 shutdown_connections 2024-03-30T13:08:35.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f389aa8d640 1 -- 172.21.15.83:0/2903979198 wait complete. 2024-03-30T13:08:35.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc077ba5640 1 -- start start 2024-03-30T13:08:35.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f2e46569640 1 -- 172.21.15.83:0/3813456781 shutdown_connections 2024-03-30T13:08:35.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f2e46569640 1 --2- 172.21.15.83:0/3813456781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e38047c20 0x7f2e380eb6c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f2e46569640 1 --2- 172.21.15.83:0/3813456781 >> v2:172.21.15.153:3300/0 conn(0x7f2e38033e40 0x7f2e380eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f2e46569640 1 -- 172.21.15.83:0/3813456781 >> 172.21.15.83:0/3813456781 conn(0x7f2e38009fc0 msgr2=0x7f2e3800a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0740723a0 0x7fc07414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0740af720 0x7fc07414d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0740d0390 0x7fc07414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc07415b010 con 0x7fc0740723a0 2024-03-30T13:08:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc07415ae90 con 0x7fc0740d0390 2024-03-30T13:08:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7fc079d84640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc074151490 con 0x7fc0740af720 2024-03-30T13:08:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f508b7fe640 1 -- 172.21.15.83:0/3890106113 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5094004230 con 0x7f50a415e6b0 2024-03-30T13:08:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f508b7fe640 1 -- 172.21.15.83:0/3890106113 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5094007430 con 0x7f50a415e6b0 2024-03-30T13:08:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a3fff640 1 -- 172.21.15.83:0/3890106113 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a40cd930 con 0x7f50a415e6b0 2024-03-30T13:08:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a3fff640 1 -- 172.21.15.83:0/3890106113 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a40cdef0 con 0x7f50a415e6b0 2024-03-30T13:08:35.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f50a3fff640 1 -- 172.21.15.83:0/3890106113 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5084001040 con 0x7f50a415e6b0 2024-03-30T13:08:35.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f3b4cff9640 1 -- 172.21.15.83:0/2535009653 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b40018070 con 0x7f3b5006f220 2024-03-30T13:08:35.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f3b4cff9640 1 -- 172.21.15.83:0/2535009653 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4000aca0 con 0x7f3b5006f220 2024-03-30T13:08:35.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f3b4cff9640 1 -- 172.21.15.83:0/2535009653 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b400072f0 con 0x7f3b5006f220 2024-03-30T13:08:35.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f2e46569640 1 -- 172.21.15.83:0/3813456781 shutdown_connections 2024-03-30T13:08:35.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc077ba5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0700d02c0 0x7fc0701fc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f3b55b6d640 1 -- 172.21.15.83:0/2535009653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b500952d0 con 0x7f3b5006f220 2024-03-30T13:08:35.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f3b55b6d640 1 -- 172.21.15.83:0/2535009653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b50095890 con 0x7f3b5006f220 2024-03-30T13:08:35.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f390de54640 1 Processor -- start 2024-03-30T13:08:35.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f3b55b6d640 1 -- 172.21.15.83:0/2535009653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b5004f900 con 0x7f3b5006f220 2024-03-30T13:08:35.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f508b7fe640 1 -- 172.21.15.83:0/3890106113 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f50940bf070 con 0x7f50a415e6b0 2024-03-30T13:08:35.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f390de54640 1 -- start start 2024-03-30T13:08:35.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389aa8d640 1 Processor -- start 2024-03-30T13:08:35.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389aa8d640 1 -- start start 2024-03-30T13:08:35.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc077ba5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc070159c50 0x7fc0701559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f508b7fe640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5090068010 0x7f509006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc075941640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0700d02c0 0x7fc0701fc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc075941640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0700d02c0 0x7fc0701fc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:50428/0 (socket says 172.21.15.83:50428) 2024-03-30T13:08:35.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc075941640 1 -- 172.21.15.83:0/242519967 learned_addr learned my addr 172.21.15.83:0/242519967 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f508b7fe640 1 -- 172.21.15.83:0/3890106113 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f509411f840 con 0x7f50a415e6b0 2024-03-30T13:08:35.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc077ba5640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07015fc90 0x7fc07015a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.269+0000 7f2e46569640 1 -- 172.21.15.83:0/3813456781 wait complete. 2024-03-30T13:08:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f2e46569640 1 Processor -- start 2024-03-30T13:08:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc073fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0740d0390 0x7fc07414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f508b7fe640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] conn(0x7f5090070230 0x7f5090072650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f508b7fe640 1 -- 172.21.15.83:0/3890106113 --> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5094001d40 con 0x7f5090070230 2024-03-30T13:08:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f508b7fe640 1 -- 172.21.15.83:0/3890106113 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f509411fd20 con 0x7f50a415e6b0 2024-03-30T13:08:35.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc077ba5640 1 -- 172.21.15.83:0/242519967 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc0700ad370 con 0x7fc070159c50 2024-03-30T13:08:35.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc072ffd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0740af720 0x7fc07414d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc077ba5640 1 -- 172.21.15.83:0/242519967 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc0700afb10 con 0x7fc07015fc90 2024-03-30T13:08:35.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc077ba5640 1 -- 172.21.15.83:0/242519967 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc070071800 con 0x7fc0700d02c0 2024-03-30T13:08:35.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc073fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0740d0390 0x7fc07414d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:41248/0 (socket says 172.21.15.83:41248) 2024-03-30T13:08:35.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc073fff640 1 -- 172.21.15.83:0/3976069927 learned_addr learned my addr 172.21.15.83:0/3976069927 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc076142640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07015fc90 0x7fc07015a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f50a37fe640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] conn(0x7f5090070230 0x7f5090072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f50a2ffd640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5090068010 0x7f509006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389aa8d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3894204110 0x7f3894205170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389aa8d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f389415cc50 0x7f38940b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389aa8d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f389415d0d0 0x7f38940b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389aa8d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f38940b3600 con 0x7f3894204110 2024-03-30T13:08:35.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389aa8d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38940b3480 con 0x7f389415cc50 2024-03-30T13:08:35.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389aa8d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f389406e3a0 con 0x7f389415d0d0 2024-03-30T13:08:35.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f390de54640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39080723a0 0x7f3908149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f390de54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39080af720 0x7f39080b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f390de54640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39080d0390 0x7f39080b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f390de54640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3908151490 con 0x7f39080af720 2024-03-30T13:08:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f390de54640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f390815b0a0 con 0x7f39080d0390 2024-03-30T13:08:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f390de54640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3908151610 con 0x7f39080723a0 2024-03-30T13:08:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f3906ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39080af720 0x7f39080b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f3906ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39080af720 0x7f39080b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43542/0 (socket says 172.21.15.83:43542) 2024-03-30T13:08:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f3906ffd640 1 -- 172.21.15.83:0/1275728203 learned_addr learned my addr 172.21.15.83:0/1275728203 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc075941640 1 -- 172.21.15.83:0/242519967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07015fc90 msgr2=0x7fc07015a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc075941640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07015fc90 0x7fc07015a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc075941640 1 -- 172.21.15.83:0/242519967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc070159c50 msgr2=0x7fc0701559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc075941640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc070159c50 0x7fc0701559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc075941640 1 -- 172.21.15.83:0/242519967 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc070155f30 con 0x7fc0700d02c0 2024-03-30T13:08:35.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc075941640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0700d02c0 0x7fc0701fc2e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc06c01a0a0 tx=0x7fc06c01acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389902a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f389415d0d0 0x7f38940b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389902a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f389415d0d0 0x7f38940b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:50438/0 (socket says 172.21.15.83:50438) 2024-03-30T13:08:35.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389902a640 1 -- 172.21.15.83:0/613424891 learned_addr learned my addr 172.21.15.83:0/613424891 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc0667fc640 1 -- 172.21.15.83:0/242519967 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0bf610 con 0x7fc0700d02c0 2024-03-30T13:08:35.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc0667fc640 1 -- 172.21.15.83:0/242519967 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc06c0bf7b0 con 0x7fc0700d02c0 2024-03-30T13:08:35.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc0667fc640 1 -- 172.21.15.83:0/242519967 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0bfb60 con 0x7fc0700d02c0 2024-03-30T13:08:35.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f39077fe640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39080723a0 0x7f3908149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f50a2ffd640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5090068010 0x7f509006a4d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f509c009230 tx=0x7f509c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc073fff640 1 -- 172.21.15.83:0/3976069927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0740af720 msgr2=0x7fc07414d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc073fff640 1 --2- 172.21.15.83:0/3976069927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0740af720 0x7fc07414d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc073fff640 1 -- 172.21.15.83:0/3976069927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0740723a0 msgr2=0x7fc07414eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc073fff640 1 --2- 172.21.15.83:0/3976069927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0740723a0 0x7fc07414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc073fff640 1 -- 172.21.15.83:0/3976069927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0740ae5d0 con 0x7fc0740d0390 2024-03-30T13:08:35.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f3893fff640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f389415cc50 0x7f38940b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f3906ffd640 1 -- 172.21.15.83:0/1275728203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39080723a0 msgr2=0x7f3908149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f3906ffd640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39080723a0 0x7f3908149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f3906ffd640 1 -- 172.21.15.83:0/1275728203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39080d0390 msgr2=0x7f39080b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f3906ffd640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39080d0390 0x7f39080b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f3906ffd640 1 -- 172.21.15.83:0/1275728203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390814f440 con 0x7f39080af720 2024-03-30T13:08:35.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc073fff640 1 --2- 172.21.15.83:0/3976069927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0740d0390 0x7fc07414d720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc06400d560 tx=0x7fc06400da20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389902a640 1 -- 172.21.15.83:0/613424891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f389415cc50 msgr2=0x7f38940b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389902a640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f389415cc50 0x7f38940b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389902a640 1 -- 172.21.15.83:0/613424891 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3894204110 msgr2=0x7f3894205170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389902a640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3894204110 0x7f3894205170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389902a640 1 -- 172.21.15.83:0/613424891 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389415f0a0 con 0x7f389415d0d0 2024-03-30T13:08:35.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc05bfff640 1 -- 172.21.15.83:0/3976069927 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0640125f0 con 0x7fc0740d0390 2024-03-30T13:08:35.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc05bfff640 1 -- 172.21.15.83:0/3976069927 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc064019070 con 0x7fc0740d0390 2024-03-30T13:08:35.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc05bfff640 1 -- 172.21.15.83:0/3976069927 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0640129d0 con 0x7fc0740d0390 2024-03-30T13:08:35.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f50a37fe640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] conn(0x7f5090070230 0x7f5090072650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc079d84640 1 -- 172.21.15.83:0/3976069927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0740ad530 con 0x7fc0740d0390 2024-03-30T13:08:35.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389902a640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f389415d0d0 0x7f38940b1810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3894073e50 tx=0x7f388400d8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7fc079d84640 1 -- 172.21.15.83:0/3976069927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0740addd0 con 0x7fc0740d0390 2024-03-30T13:08:35.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f3906ffd640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39080af720 0x7f39080b1e50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f38fc01aa70 tx=0x7f38fc00ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc079d84640 1 -- 172.21.15.83:0/3976069927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc07404f900 con 0x7fc0740d0390 2024-03-30T13:08:35.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc077ba5640 1 -- 172.21.15.83:0/242519967 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0701fb840 con 0x7fc0700d02c0 2024-03-30T13:08:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f38917fa640 1 -- 172.21.15.83:0/613424891 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884004020 con 0x7f389415d0d0 2024-03-30T13:08:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389aa8d640 1 -- 172.21.15.83:0/613424891 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389415c710 con 0x7f389415d0d0 2024-03-30T13:08:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.273+0000 7f389aa8d640 1 -- 172.21.15.83:0/613424891 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f389415f620 con 0x7f389415d0d0 2024-03-30T13:08:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f389aa8d640 1 -- 172.21.15.83:0/613424891 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f389404f900 con 0x7f389415d0d0 2024-03-30T13:08:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f38917fa640 1 -- 172.21.15.83:0/613424891 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38840041c0 con 0x7f389415d0d0 2024-03-30T13:08:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f38917fa640 1 -- 172.21.15.83:0/613424891 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884004390 con 0x7f389415d0d0 2024-03-30T13:08:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f38effff640 1 -- 172.21.15.83:0/1275728203 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0bd020 con 0x7f39080af720 2024-03-30T13:08:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f38effff640 1 -- 172.21.15.83:0/1275728203 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38fc0b6660 con 0x7f39080af720 2024-03-30T13:08:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f38effff640 1 -- 172.21.15.83:0/1275728203 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0b1040 con 0x7f39080af720 2024-03-30T13:08:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc077ba5640 1 -- 172.21.15.83:0/242519967 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0701fbae0 con 0x7fc0700d02c0 2024-03-30T13:08:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f508b7fe640 1 -- 172.21.15.83:0/3890106113 <== osd.3 v2:172.21.15.83:6816/3821265814 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5094001d40 con 0x7f5090070230 2024-03-30T13:08:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f390de54640 1 -- 172.21.15.83:0/1275728203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390814f720 con 0x7f39080af720 2024-03-30T13:08:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f390de54640 1 -- 172.21.15.83:0/1275728203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3908149cb0 con 0x7f39080af720 2024-03-30T13:08:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f390de54640 1 -- 172.21.15.83:0/1275728203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38e8001040 con 0x7f39080af720 2024-03-30T13:08:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f3b4cff9640 1 -- 172.21.15.83:0/2535009653 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f3b40007490 con 0x7f3b5006f220 2024-03-30T13:08:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f3b4cff9640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3b30067fc0 0x7f3b3006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f3b4cff9640 1 -- 172.21.15.83:0/2535009653 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3b40086890 con 0x7f3b5006f220 2024-03-30T13:08:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f3b4cff9640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] conn(0x7f3b300701e0 0x7f3b30072600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f3b4cff9640 1 -- 172.21.15.83:0/2535009653 --> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b30072cb0 con 0x7f3b300701e0 2024-03-30T13:08:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f3b4cff9640 1 -- 172.21.15.83:0/2535009653 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3b40086c80 con 0x7f3b5006f220 2024-03-30T13:08:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f3b46ffd640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3b30067fc0 0x7f3b3006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f38917fa640 1 -- 172.21.15.83:0/613424891 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f388401a020 con 0x7f389415d0d0 2024-03-30T13:08:35.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f38917fa640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3880067ff0 0x7f388006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f2e46569640 1 -- start start 2024-03-30T13:08:35.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f2e46569640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e38033e40 0x7f2e380dc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f2e46569640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e38047c20 0x7f2e380e9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc05bfff640 1 -- 172.21.15.83:0/3976069927 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc064012b70 con 0x7fc0740d0390 2024-03-30T13:08:35.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc05bfff640 1 --2- 172.21.15.83:0/3976069927 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc060068090 0x7fc06006a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc05bfff640 1 -- 172.21.15.83:0/3976069927 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc064087340 con 0x7fc0740d0390 2024-03-30T13:08:35.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc0737fe640 1 --2- 172.21.15.83:0/3976069927 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc060068090 0x7fc06006a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc05bfff640 1 --2- 172.21.15.83:0/3976069927 >> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] conn(0x7fc0600702b0 0x7fc0600726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc05bfff640 1 -- 172.21.15.83:0/3976069927 --> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc064001d40 con 0x7fc0600702b0 2024-03-30T13:08:35.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f3b46ffd640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3b30067fc0 0x7f3b3006a480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b380b0000 tx=0x7f3b380a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f38917fa640 1 -- 172.21.15.83:0/613424891 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3884086800 con 0x7f389415d0d0 2024-03-30T13:08:35.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f3b4ffff640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] conn(0x7f3b300701e0 0x7f3b30072600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc072ffd640 1 --2- 172.21.15.83:0/3976069927 >> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] conn(0x7fc0600702b0 0x7fc0600726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f2e3ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e38033e40 0x7f2e380dc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f2e3ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e38033e40 0x7f2e380dc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43558/0 (socket says 172.21.15.83:43558) 2024-03-30T13:08:35.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f38effff640 1 -- 172.21.15.83:0/1275728203 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f38fc0b4070 con 0x7f39080af720 2024-03-30T13:08:35.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f38effff640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f38f4068010 0x7f38f406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f39077fe640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f38f4068010 0x7f38f406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc0737fe640 1 --2- 172.21.15.83:0/3976069927 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc060068090 0x7fc06006a550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0af000 tx=0x7fc06c00d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc0667fc640 1 -- 172.21.15.83:0/242519967 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc06c0bd020 con 0x7fc0700d02c0 2024-03-30T13:08:35.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7fc0667fc640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc054067fc0 0x7fc05406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7fc0667fc640 1 -- 172.21.15.83:0/242519967 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc06c120870 con 0x7fc0700d02c0 2024-03-30T13:08:35.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7fc077ba5640 1 -- 172.21.15.83:0/242519967 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0701fb650 con 0x7fc0700d02c0 2024-03-30T13:08:35.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7fc075140640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc054067fc0 0x7fc05406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f3b4ffff640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] conn(0x7f3b300701e0 0x7f3b30072600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f38917fa640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] conn(0x7f3880070190 0x7f38800725b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f38917fa640 1 -- 172.21.15.83:0/613424891 --> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3880072c60 con 0x7f3880070190 2024-03-30T13:08:35.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.277+0000 7f3893fff640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] conn(0x7f3880070190 0x7f38800725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f3898829640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3880067ff0 0x7f388006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f3893fff640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] conn(0x7f3880070190 0x7f38800725b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7fc075140640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc054067fc0 0x7fc05406a480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc0700cf5d0 tx=0x7fc06000f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f39077fe640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f38f4068010 0x7f38f406a4d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38f8007fd0 tx=0x7f38f8007c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f3898829640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3880067ff0 0x7f388006a4b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f38880ac000 tx=0x7f3888001a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7fc0667fc640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] conn(0x7fc054070160 0x7fc054072580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7fc0667fc640 1 -- 172.21.15.83:0/242519967 --> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc06c0b7e50 con 0x7fc054070160 2024-03-30T13:08:35.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7fc076142640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] conn(0x7fc054070160 0x7fc054072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7fc076142640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] conn(0x7fc054070160 0x7fc054072580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f38917fa640 1 -- 172.21.15.83:0/613424891 <== osd.6 v2:172.21.15.153:6801/3641147652 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3880072c60 con 0x7f3880070190 2024-03-30T13:08:35.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7fc0667fc640 1 -- 172.21.15.83:0/242519967 <== osd.2 v2:172.21.15.83:6800/75156071 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc06c0b7e50 con 0x7fc054070160 2024-03-30T13:08:35.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f38effff640 1 -- 172.21.15.83:0/1275728203 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f38fc0ee6a0 con 0x7f39080af720 2024-03-30T13:08:35.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f38effff640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] conn(0x7f38f40701b0 0x7f38f40725d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f38effff640 1 -- 172.21.15.83:0/1275728203 --> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38fc0ade50 con 0x7f38f40701b0 2024-03-30T13:08:35.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f38effff640 1 -- 172.21.15.83:0/1275728203 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f38fc0ec8a0 con 0x7f39080af720 2024-03-30T13:08:35.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f3907fff640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] conn(0x7f38f40701b0 0x7f38f40725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f3907fff640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] conn(0x7f38f40701b0 0x7f38f40725d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.281+0000 7f1a48c29640 1 Processor -- start 2024-03-30T13:08:35.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f3b4cff9640 1 -- 172.21.15.83:0/2535009653 <== osd.5 v2:172.21.15.153:6806/2082548959 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b30072cb0 con 0x7f3b300701e0 2024-03-30T13:08:35.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f38effff640 1 -- 172.21.15.83:0/1275728203 <== osd.1 v2:172.21.15.83:6808/2476462919 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38fc0ade50 con 0x7f38f40701b0 2024-03-30T13:08:35.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a48c29640 1 -- start start 2024-03-30T13:08:35.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a48c29640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1a3c035030 0x7f1a3c050270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a48c29640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1a3c052eb0 0x7f1a3c056540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a48c29640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a3c0507b0 con 0x7f1a3c035410 2024-03-30T13:08:35.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a48c29640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f1a3c007c70 con 0x7f1a3c052eb0 2024-03-30T13:08:35.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a48c29640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1a3c053400 con 0x7f1a3c035030 2024-03-30T13:08:35.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e3ffff640 1 -- 172.21.15.83:0/1227374572 learned_addr learned my addr 172.21.15.83:0/1227374572 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e46569640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e380ebc00 0x7f2e380e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e46569640 1 -- 172.21.15.83:0/1227374572 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3804fd80 con 0x7f2e38033e40 2024-03-30T13:08:35.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e46569640 1 -- 172.21.15.83:0/1227374572 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3804f090 con 0x7f2e380ebc00 2024-03-30T13:08:35.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e46569640 1 -- 172.21.15.83:0/1227374572 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3804f5c0 con 0x7f2e38047c20 2024-03-30T13:08:35.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7fc05bfff640 1 -- 172.21.15.83:0/3976069927 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc064087730 con 0x7fc0740d0390 2024-03-30T13:08:35.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e3f7fe640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e38047c20 0x7f2e380e9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7fc072ffd640 1 --2- 172.21.15.83:0/3976069927 >> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] conn(0x7fc0600702b0 0x7fc0600726d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7fc0667fc640 1 -- 172.21.15.83:0/242519967 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc06c0ecbd0 con 0x7fc0700d02c0 2024-03-30T13:08:35.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e44b06640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e380ebc00 0x7f2e380e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e3f7fe640 1 -- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e380ebc00 msgr2=0x7f2e380e9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e3f7fe640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e380ebc00 0x7f2e380e9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e3f7fe640 1 -- 172.21.15.83:0/1227374572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e38033e40 msgr2=0x7f2e380dc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e3f7fe640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e38033e40 0x7f2e380dc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e3f7fe640 1 -- 172.21.15.83:0/1227374572 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e38036450 con 0x7f2e38047c20 2024-03-30T13:08:35.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f38917fa640 1 -- 172.21.15.83:0/613424891 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3884052a30 con 0x7f389415d0d0 2024-03-30T13:08:35.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e3ffff640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e38033e40 0x7f2e380dc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:35.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e3f7fe640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e38047c20 0x7f2e380e9910 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2e40069ea0 tx=0x7f2e40098de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e3cff9640 1 -- 172.21.15.83:0/1227374572 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4012f040 con 0x7f2e38047c20 2024-03-30T13:08:35.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e46569640 1 -- 172.21.15.83:0/1227374572 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e380dd600 con 0x7f2e38047c20 2024-03-30T13:08:35.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e46569640 1 -- 172.21.15.83:0/1227374572 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e380ddbc0 con 0x7f2e38047c20 2024-03-30T13:08:35.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7fc05bfff640 1 -- 172.21.15.83:0/3976069927 <== osd.0 v2:172.21.15.83:6818/3103341004 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc064001d40 con 0x7fc0600702b0 2024-03-30T13:08:35.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e3cff9640 1 -- 172.21.15.83:0/1227374572 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e40123e50 con 0x7f2e38047c20 2024-03-30T13:08:35.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f2e3cff9640 1 -- 172.21.15.83:0/1227374572 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40133440 con 0x7f2e38047c20 2024-03-30T13:08:35.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a437fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1a3c035030 0x7f1a3c050270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a437fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1a3c035030 0x7f1a3c050270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:41306/0 (socket says 172.21.15.83:41306) 2024-03-30T13:08:35.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a437fe640 1 -- 172.21.15.83:0/2591333036 learned_addr learned my addr 172.21.15.83:0/2591333036 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a437fe640 1 -- 172.21.15.83:0/2591333036 >> v2:172.21.15.83:3300/0 conn(0x7f1a3c052eb0 msgr2=0x7f1a3c056540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:08:35.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a437fe640 1 --2- 172.21.15.83:0/2591333036 >> v2:172.21.15.83:3300/0 conn(0x7f1a3c052eb0 0x7f1a3c056540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a437fe640 1 -- 172.21.15.83:0/2591333036 >> v1:172.21.15.153:6789/0 conn(0x7f1a3c035410 legacy=0x7f1a3c0089a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.285+0000 7f1a437fe640 1 -- 172.21.15.83:0/2591333036 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c007ec0 con 0x7f1a3c035030 2024-03-30T13:08:35.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f1a437fe640 1 --2- 172.21.15.83:0/2591333036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c035030 0x7f1a3c050270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00d9d0 tx=0x7f1a38027710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5391db134b45aa75 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f1a427fc640 1 -- 172.21.15.83:0/2591333036 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a380b9070 con 0x7f1a3c035030 2024-03-30T13:08:35.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f1a427fc640 1 -- 172.21.15.83:0/2591333036 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a380b5640 con 0x7f1a3c035030 2024-03-30T13:08:35.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.289+0000 7f1a427fc640 1 -- 172.21.15.83:0/2591333036 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a380b5a50 con 0x7f1a3c035030 2024-03-30T13:08:35.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.293+0000 7f2e3cff9640 1 -- 172.21.15.83:0/1227374572 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2e4013a030 con 0x7f2e38047c20 2024-03-30T13:08:35.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.293+0000 7f1a48c29640 1 -- 172.21.15.83:0/2591333036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c035030 msgr2=0x7f1a3c050270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.293+0000 7f1a48c29640 1 --2- 172.21.15.83:0/2591333036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c035030 0x7f1a3c050270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00d9d0 tx=0x7f1a38027710 comp rx=0 tx=0).stop 2024-03-30T13:08:35.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.293+0000 7f1a48c29640 1 -- 172.21.15.83:0/2591333036 shutdown_connections 2024-03-30T13:08:35.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.293+0000 7f1a48c29640 1 --2- 172.21.15.83:0/2591333036 >> v2:172.21.15.83:3300/0 conn(0x7f1a3c052eb0 0x7f1a3c056540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.293+0000 7f1a48c29640 1 --2- 172.21.15.83:0/2591333036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c035030 0x7f1a3c050270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.293+0000 7f1a48c29640 1 -- 172.21.15.83:0/2591333036 >> 172.21.15.83:0/2591333036 conn(0x7f1a3c01ef80 msgr2=0x7f1a3c055c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.293+0000 7f2e3cff9640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2e24067ff0 0x7f2e2406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.293+0000 7f2e3cff9640 1 -- 172.21.15.83:0/1227374572 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2e4019e260 con 0x7f2e38047c20 2024-03-30T13:08:35.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f1a48c29640 1 -- 172.21.15.83:0/2591333036 shutdown_connections 2024-03-30T13:08:35.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f2e46569640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] conn(0x7f2e20001660 0x7f2e20003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f2e46569640 1 -- 172.21.15.83:0/1227374572 --> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e20006bc0 con 0x7f2e20001660 2024-03-30T13:08:35.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f2e3ffff640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2e24067ff0 0x7f2e2406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f2e44b06640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] conn(0x7f2e20001660 0x7f2e20003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f2e3ffff640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2e24067ff0 0x7f2e2406a4b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c006aa0 tx=0x7f2e2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f2e44b06640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] conn(0x7f2e20001660 0x7f2e20003b20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f1a48c29640 1 -- 172.21.15.83:0/2591333036 wait complete. 2024-03-30T13:08:35.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f1a48c29640 1 Processor -- start 2024-03-30T13:08:35.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f2e3cff9640 1 -- 172.21.15.83:0/1227374572 <== osd.7 v2:172.21.15.153:6800/1008345868 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2e20006bc0 con 0x7f2e20001660 2024-03-30T13:08:35.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f1a48c29640 1 -- start start 2024-03-30T13:08:35.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f1a48c29640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a3c035030 0x7f1a3c04bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f1a48c29640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c035410 0x7f1a3c1859e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f1a48c29640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a3c051200 0x7f1a3c189700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f1a437fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a3c035030 0x7f1a3c04bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f1a437fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a3c035030 0x7f1a3c04bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43568/0 (socket says 172.21.15.83:43568) 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f1a437fe640 1 -- 172.21.15.83:0/2153795378 learned_addr learned my addr 172.21.15.83:0/2153795378 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.297+0000 7f1a48c29640 1 -- 172.21.15.83:0/2153795378 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c056a80 con 0x7f1a3c035030 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a48c29640 1 -- 172.21.15.83:0/2153795378 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c008480 con 0x7f1a3c035410 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a48c29640 1 -- 172.21.15.83:0/2153795378 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3c0e3740 con 0x7f1a3c051200 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a43fff640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a3c051200 0x7f1a3c189700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a43fff640 1 -- 172.21.15.83:0/2153795378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c035410 msgr2=0x7f1a3c1859e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a43fff640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c035410 0x7f1a3c1859e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a43fff640 1 -- 172.21.15.83:0/2153795378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a3c035030 msgr2=0x7f1a3c04bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a43fff640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a3c035030 0x7f1a3c04bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a43fff640 1 -- 172.21.15.83:0/2153795378 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c186180 con 0x7f1a3c051200 2024-03-30T13:08:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a43fff640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a3c051200 0x7f1a3c189700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a44068d70 tx=0x7f1a4406ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a2ffff640 1 -- 172.21.15.83:0/2153795378 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44093600 con 0x7f1a3c051200 2024-03-30T13:08:35.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a2ffff640 1 -- 172.21.15.83:0/2153795378 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a440937a0 con 0x7f1a3c051200 2024-03-30T13:08:35.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a2ffff640 1 -- 172.21.15.83:0/2153795378 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44093b90 con 0x7f1a3c051200 2024-03-30T13:08:35.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a48c29640 1 -- 172.21.15.83:0/2153795378 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3c186460 con 0x7f1a3c051200 2024-03-30T13:08:35.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a48c29640 1 -- 172.21.15.83:0/2153795378 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a3c1891e0 con 0x7f1a3c051200 2024-03-30T13:08:35.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.301+0000 7f1a2dffb640 1 -- 172.21.15.83:0/2153795378 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a1c001040 con 0x7f1a3c051200 2024-03-30T13:08:35.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f50a3fff640 1 -- 172.21.15.83:0/3890106113 --> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5084002d60 con 0x7f5090070230 2024-03-30T13:08:35.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc077ba5640 1 -- 172.21.15.83:0/242519967 --> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc07004f900 con 0x7fc054070160 2024-03-30T13:08:35.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f508b7fe640 1 -- 172.21.15.83:0/3890106113 <== osd.3 v2:172.21.15.83:6816/3821265814 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5084002d60 con 0x7f5090070230 2024-03-30T13:08:35.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f1a2ffff640 1 -- 172.21.15.83:0/2153795378 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f1a4409d3f0 con 0x7f1a3c051200 2024-03-30T13:08:35.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f1a2ffff640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1a28067fc0 0x7f1a2806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f1a2ffff640 1 -- 172.21.15.83:0/2153795378 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1a44101200 con 0x7f1a3c051200 2024-03-30T13:08:35.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f1a2ffff640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] conn(0x7f1a28070160 0x7f1a28072580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f1a2ffff640 1 -- 172.21.15.83:0/2153795378 --> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a4406ee50 con 0x7f1a28070160 2024-03-30T13:08:35.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f3b55b6d640 1 -- 172.21.15.83:0/2535009653 --> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b5016c490 con 0x7f3b300701e0 2024-03-30T13:08:35.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc0667fc640 1 -- 172.21.15.83:0/242519967 <== osd.2 v2:172.21.15.83:6800/75156071 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc07004f900 con 0x7fc054070160 2024-03-30T13:08:35.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f50897fa640 1 -- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] conn(0x7f5090070230 msgr2=0x7f5090072650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f50897fa640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] conn(0x7f5090070230 0x7f5090072650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f50897fa640 1 -- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5090068010 msgr2=0x7f509006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f50897fa640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5090068010 0x7f509006a4d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f509c009230 tx=0x7f509c0091a0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f50897fa640 1 -- 172.21.15.83:0/3890106113 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50a415e6b0 msgr2=0x7f50a409aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f50897fa640 1 --2- 172.21.15.83:0/3890106113 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50a415e6b0 0x7f50a409aa50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5094098f50 tx=0x7f509401bde0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f50a37fe640 1 -- 172.21.15.83:0/3890106113 reap_dead start 2024-03-30T13:08:35.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f50897fa640 1 -- 172.21.15.83:0/3890106113 shutdown_connections 2024-03-30T13:08:35.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f50897fa640 1 -- 172.21.15.83:0/3890106113 >> 172.21.15.83:0/3890106113 conn(0x7f50a40cfef0 msgr2=0x7f50a40d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f50897fa640 1 -- 172.21.15.83:0/3890106113 shutdown_connections 2024-03-30T13:08:35.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f50897fa640 1 -- 172.21.15.83:0/3890106113 wait complete. 2024-03-30T13:08:35.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f1a437fe640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1a28067fc0 0x7f1a2806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f3b4cff9640 1 -- 172.21.15.83:0/2535009653 <== osd.5 v2:172.21.15.153:6806/2082548959 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b5016c490 con 0x7f3b300701e0 2024-03-30T13:08:35.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f1a2ffff640 1 -- 172.21.15.83:0/2153795378 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1a44108050 con 0x7f1a3c051200 2024-03-30T13:08:35.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f3b45ffb640 1 -- 172.21.15.83:0/2535009653 >> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] conn(0x7f3b300701e0 msgr2=0x7f3b30072600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f3b45ffb640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] conn(0x7f3b300701e0 0x7f3b30072600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f389aa8d640 1 -- 172.21.15.83:0/613424891 --> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f38940d1170 con 0x7f3880070190 2024-03-30T13:08:35.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f3b45ffb640 1 -- 172.21.15.83:0/2535009653 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3b30067fc0 msgr2=0x7f3b3006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc053fff640 1 -- 172.21.15.83:0/242519967 >> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] conn(0x7fc054070160 msgr2=0x7fc054072580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc053fff640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] conn(0x7fc054070160 0x7fc054072580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f1a42ffd640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] conn(0x7f1a28070160 0x7f1a28072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f1a437fe640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1a28067fc0 0x7f1a2806a480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a38027750 tx=0x7f1a38012040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f3b45ffb640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3b30067fc0 0x7f3b3006a480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b380b0000 tx=0x7f3b380a7000 comp rx=0 tx=0).stop 2024-03-30T13:08:35.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc053fff640 1 -- 172.21.15.83:0/242519967 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc054067fc0 msgr2=0x7fc05406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc053fff640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc054067fc0 0x7fc05406a480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc0700cf5d0 tx=0x7fc06000f040 comp rx=0 tx=0).stop 2024-03-30T13:08:35.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc053fff640 1 -- 172.21.15.83:0/242519967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0700d02c0 msgr2=0x7fc0701fc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc053fff640 1 --2- 172.21.15.83:0/242519967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0700d02c0 0x7fc0701fc2e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc06c01a0a0 tx=0x7fc06c01acb0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc076142640 1 -- 172.21.15.83:0/242519967 reap_dead start 2024-03-30T13:08:35.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f3b45ffb640 1 -- 172.21.15.83:0/2535009653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b5006f220 msgr2=0x7f3b50091990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f3b45ffb640 1 --2- 172.21.15.83:0/2535009653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b5006f220 0x7f3b50091990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000cb40 tx=0x7f3b4000a060 comp rx=0 tx=0).stop 2024-03-30T13:08:35.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f3b4ffff640 1 -- 172.21.15.83:0/2535009653 reap_dead start 2024-03-30T13:08:35.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f3b45ffb640 1 -- 172.21.15.83:0/2535009653 shutdown_connections 2024-03-30T13:08:35.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc053fff640 1 -- 172.21.15.83:0/242519967 shutdown_connections 2024-03-30T13:08:35.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f38917fa640 1 -- 172.21.15.83:0/613424891 <== osd.6 v2:172.21.15.153:6801/3641147652 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f38940d1170 con 0x7f3880070190 2024-03-30T13:08:35.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc053fff640 1 -- 172.21.15.83:0/242519967 >> 172.21.15.83:0/242519967 conn(0x7fc07006b830 msgr2=0x7fc0700b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc053fff640 1 -- 172.21.15.83:0/242519967 shutdown_connections 2024-03-30T13:08:35.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f3b45ffb640 1 -- 172.21.15.83:0/2535009653 >> 172.21.15.83:0/2535009653 conn(0x7f3b500b5690 msgr2=0x7f3b5016b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7fc053fff640 1 -- 172.21.15.83:0/242519967 wait complete. 2024-03-30T13:08:35.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f1a42ffd640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] conn(0x7f1a28070160 0x7f1a28072580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.305+0000 7f3b45ffb640 1 -- 172.21.15.83:0/2535009653 shutdown_connections 2024-03-30T13:08:35.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f3b45ffb640 1 -- 172.21.15.83:0/2535009653 wait complete. 2024-03-30T13:08:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f389aa8d640 1 -- 172.21.15.83:0/613424891 >> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] conn(0x7f3880070190 msgr2=0x7f38800725b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f389aa8d640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] conn(0x7f3880070190 0x7f38800725b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f389aa8d640 1 -- 172.21.15.83:0/613424891 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3880067ff0 msgr2=0x7f388006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f389aa8d640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3880067ff0 0x7f388006a4b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f38880ac000 tx=0x7f3888001a30 comp rx=0 tx=0).stop 2024-03-30T13:08:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f389aa8d640 1 -- 172.21.15.83:0/613424891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f389415d0d0 msgr2=0x7f38940b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f389aa8d640 1 --2- 172.21.15.83:0/613424891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f389415d0d0 0x7f38940b1810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3894073e50 tx=0x7f388400d8a0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f389902a640 1 -- 172.21.15.83:0/613424891 reap_dead start 2024-03-30T13:08:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f389aa8d640 1 -- 172.21.15.83:0/613424891 shutdown_connections 2024-03-30T13:08:35.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f389aa8d640 1 -- 172.21.15.83:0/613424891 >> 172.21.15.83:0/613424891 conn(0x7f38940d03d0 msgr2=0x7f38940cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f1a2ffff640 1 -- 172.21.15.83:0/2153795378 <== osd.4 v2:172.21.15.153:6824/258447987 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a4406ee50 con 0x7f1a28070160 2024-03-30T13:08:35.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f389aa8d640 1 -- 172.21.15.83:0/613424891 shutdown_connections 2024-03-30T13:08:35.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.309+0000 7f389aa8d640 1 -- 172.21.15.83:0/613424891 wait complete. 2024-03-30T13:08:35.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.313+0000 7fc079d84640 1 -- 172.21.15.83:0/3976069927 --> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0740b3710 con 0x7fc0600702b0 2024-03-30T13:08:35.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.313+0000 7fc05bfff640 1 -- 172.21.15.83:0/3976069927 <== osd.0 v2:172.21.15.83:6818/3103341004 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc0740b3710 con 0x7fc0600702b0 2024-03-30T13:08:35.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.313+0000 7fc079d84640 1 -- 172.21.15.83:0/3976069927 >> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] conn(0x7fc0600702b0 msgr2=0x7fc0600726d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.313+0000 7fc079d84640 1 --2- 172.21.15.83:0/3976069927 >> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] conn(0x7fc0600702b0 0x7fc0600726d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.313+0000 7fc079d84640 1 -- 172.21.15.83:0/3976069927 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc060068090 msgr2=0x7fc06006a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.313+0000 7fc079d84640 1 --2- 172.21.15.83:0/3976069927 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc060068090 0x7fc06006a550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0af000 tx=0x7fc06c00d040 comp rx=0 tx=0).stop 2024-03-30T13:08:35.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.313+0000 7fc079d84640 1 -- 172.21.15.83:0/3976069927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0740d0390 msgr2=0x7fc07414d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.317+0000 7fc079d84640 1 --2- 172.21.15.83:0/3976069927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0740d0390 0x7fc07414d720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc06400d560 tx=0x7fc06400da20 comp rx=0 tx=0).stop 2024-03-30T13:08:35.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.317+0000 7fc073fff640 1 -- 172.21.15.83:0/3976069927 reap_dead start 2024-03-30T13:08:35.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.317+0000 7fc079d84640 1 -- 172.21.15.83:0/3976069927 shutdown_connections 2024-03-30T13:08:35.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.317+0000 7fc079d84640 1 -- 172.21.15.83:0/3976069927 >> 172.21.15.83:0/3976069927 conn(0x7fc07406b830 msgr2=0x7fc0740b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.317+0000 7fc079d84640 1 -- 172.21.15.83:0/3976069927 shutdown_connections 2024-03-30T13:08:35.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.317+0000 7fc079d84640 1 -- 172.21.15.83:0/3976069927 wait complete. 2024-03-30T13:08:35.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.317+0000 7f390de54640 1 -- 172.21.15.83:0/1275728203 --> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f38e8002de0 con 0x7f38f40701b0 2024-03-30T13:08:35.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.317+0000 7f38effff640 1 -- 172.21.15.83:0/1275728203 <== osd.1 v2:172.21.15.83:6808/2476462919 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f38e8002de0 con 0x7f38f40701b0 2024-03-30T13:08:35.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f390de54640 1 -- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] conn(0x7f38f40701b0 msgr2=0x7f38f40725d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f390de54640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] conn(0x7f38f40701b0 0x7f38f40725d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f390de54640 1 -- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f38f4068010 msgr2=0x7f38f406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f390de54640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f38f4068010 0x7f38f406a4d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38f8007fd0 tx=0x7f38f8007c20 comp rx=0 tx=0).stop 2024-03-30T13:08:35.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f390de54640 1 -- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39080af720 msgr2=0x7f39080b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f390de54640 1 --2- 172.21.15.83:0/1275728203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39080af720 0x7f39080b1e50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f38fc01aa70 tx=0x7f38fc00ab30 comp rx=0 tx=0).stop 2024-03-30T13:08:35.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f3907fff640 1 -- 172.21.15.83:0/1275728203 reap_dead start 2024-03-30T13:08:35.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f390de54640 1 -- 172.21.15.83:0/1275728203 shutdown_connections 2024-03-30T13:08:35.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f390de54640 1 -- 172.21.15.83:0/1275728203 >> 172.21.15.83:0/1275728203 conn(0x7f390806b830 msgr2=0x7f390806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f2e46569640 1 -- 172.21.15.83:0/1227374572 --> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2e20005ca0 con 0x7f2e20001660 2024-03-30T13:08:35.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f390de54640 1 -- 172.21.15.83:0/1275728203 shutdown_connections 2024-03-30T13:08:35.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f390de54640 1 -- 172.21.15.83:0/1275728203 wait complete. 2024-03-30T13:08:35.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.325+0000 7f2e3cff9640 1 -- 172.21.15.83:0/1227374572 <== osd.7 v2:172.21.15.153:6800/1008345868 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2e20005ca0 con 0x7f2e20001660 2024-03-30T13:08:35.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.329+0000 7f2e2a7fc640 1 -- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] conn(0x7f2e20001660 msgr2=0x7f2e20003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.329+0000 7f2e2a7fc640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] conn(0x7f2e20001660 0x7f2e20003b20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.329+0000 7f2e2a7fc640 1 -- 172.21.15.83:0/1227374572 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2e24067ff0 msgr2=0x7f2e2406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.329+0000 7f2e2a7fc640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2e24067ff0 0x7f2e2406a4b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c006aa0 tx=0x7f2e2c008040 comp rx=0 tx=0).stop 2024-03-30T13:08:35.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.329+0000 7f2e2a7fc640 1 -- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e38047c20 msgr2=0x7f2e380e9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.329+0000 7f2e2a7fc640 1 --2- 172.21.15.83:0/1227374572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e38047c20 0x7f2e380e9910 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2e40069ea0 tx=0x7f2e40098de0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.329+0000 7f2e44b06640 1 -- 172.21.15.83:0/1227374572 reap_dead start 2024-03-30T13:08:35.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.329+0000 7f2e2a7fc640 1 -- 172.21.15.83:0/1227374572 shutdown_connections 2024-03-30T13:08:35.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.329+0000 7f2e2a7fc640 1 -- 172.21.15.83:0/1227374572 >> 172.21.15.83:0/1227374572 conn(0x7f2e38009fc0 msgr2=0x7f2e38039e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.329+0000 7f2e2a7fc640 1 -- 172.21.15.83:0/1227374572 shutdown_connections 2024-03-30T13:08:35.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.329+0000 7f2e2a7fc640 1 -- 172.21.15.83:0/1227374572 wait complete. 2024-03-30T13:08:35.372 INFO:teuthology.orchestra.run.smithi083.stdout:64424509448 2024-03-30T13:08:35.373 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-30T13:08:35.374 INFO:teuthology.orchestra.run.smithi083.stdout:55834574855 2024-03-30T13:08:35.374 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-30T13:08:35.375 INFO:teuthology.orchestra.run.smithi083.stdout:64424509447 2024-03-30T13:08:35.375 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-30T13:08:35.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a2dffb640 1 -- 172.21.15.83:0/2153795378 --> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a1c002de0 con 0x7f1a28070160 2024-03-30T13:08:35.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a2ffff640 1 -- 172.21.15.83:0/2153795378 <== osd.4 v2:172.21.15.153:6824/258447987 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1a1c002de0 con 0x7f1a28070160 2024-03-30T13:08:35.376 INFO:teuthology.orchestra.run.smithi083.stdout:64424509449 2024-03-30T13:08:35.377 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-30T13:08:35.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a2dffb640 1 -- 172.21.15.83:0/2153795378 >> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] conn(0x7f1a28070160 msgr2=0x7f1a28072580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a2dffb640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] conn(0x7f1a28070160 0x7f1a28072580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a2dffb640 1 -- 172.21.15.83:0/2153795378 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1a28067fc0 msgr2=0x7f1a2806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a2dffb640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1a28067fc0 0x7f1a2806a480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a38027750 tx=0x7f1a38012040 comp rx=0 tx=0).stop 2024-03-30T13:08:35.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a2dffb640 1 -- 172.21.15.83:0/2153795378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a3c051200 msgr2=0x7f1a3c189700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a2dffb640 1 --2- 172.21.15.83:0/2153795378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a3c051200 0x7f1a3c189700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a44068d70 tx=0x7f1a4406ca40 comp rx=0 tx=0).stop 2024-03-30T13:08:35.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a43fff640 1 -- 172.21.15.83:0/2153795378 reap_dead start 2024-03-30T13:08:35.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a2dffb640 1 -- 172.21.15.83:0/2153795378 shutdown_connections 2024-03-30T13:08:35.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a2dffb640 1 -- 172.21.15.83:0/2153795378 >> 172.21.15.83:0/2153795378 conn(0x7f1a3c01ef80 msgr2=0x7f1a3c0e2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a2dffb640 1 -- 172.21.15.83:0/2153795378 shutdown_connections 2024-03-30T13:08:35.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.345+0000 7f1a2dffb640 1 -- 172.21.15.83:0/2153795378 wait complete. 2024-03-30T13:08:35.379 INFO:teuthology.orchestra.run.smithi083.stdout:64424509447 2024-03-30T13:08:35.379 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-30T13:08:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:64424509448 2024-03-30T13:08:35.380 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-30T13:08:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:64424509446 2024-03-30T13:08:35.381 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-30T13:08:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:55834574855 2024-03-30T13:08:35.382 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-30T13:08:35.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa98b59e640 1 Processor -- start 2024-03-30T13:08:35.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa98b59e640 1 -- start start 2024-03-30T13:08:35.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa98b59e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa98c072d90 0x7fa98c15e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa98b59e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c0d0a10 0x7fa98c15e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa98b59e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa98c15ab70 con 0x7fa98c158150 2024-03-30T13:08:35.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa98b59e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa98c06d580 con 0x7fa98c072d90 2024-03-30T13:08:35.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa98b59e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa98c15b4a0 con 0x7fa98c0d0a10 2024-03-30T13:08:35.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa98ad9d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c0d0a10 0x7fa98c15e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa98ad9d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c0d0a10 0x7fa98c15e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:50488/0 (socket says 172.21.15.83:50488) 2024-03-30T13:08:35.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa98ad9d640 1 -- 172.21.15.83:0/1536447329 learned_addr learned my addr 172.21.15.83:0/1536447329 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa989d9b640 1 --2- 172.21.15.83:0/1536447329 >> v2:172.21.15.153:3300/0 conn(0x7fa98c072d90 0x7fa98c15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7f25333c0640 1 Processor -- start 2024-03-30T13:08:35.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7f25333c0640 1 -- start start 2024-03-30T13:08:35.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa02a5ed640 1 Processor -- start 2024-03-30T13:08:35.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa02a5ed640 1 -- start start 2024-03-30T13:08:35.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa989d9b640 1 -- 172.21.15.83:0/1536447329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c0d0a10 msgr2=0x7fa98c15e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa989d9b640 1 --2- 172.21.15.83:0/1536447329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c0d0a10 0x7fa98c15e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa989d9b640 1 -- 172.21.15.83:0/1536447329 >> v1:172.21.15.153:6789/0 conn(0x7fa98c158150 legacy=0x7fa98c072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.581+0000 7fa989d9b640 1 -- 172.21.15.83:0/1536447329 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98c15ae50 con 0x7fa98c072d90 2024-03-30T13:08:35.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f25333c0640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f252c161d30 0x7f252c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f25333c0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f252c06bd70 0x7f252c147620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f32a3546640 1 Processor -- start 2024-03-30T13:08:35.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa02a5ed640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa02415e460 0x7fa0240cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f253115c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f252c161d30 0x7f252c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f253115c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f252c161d30 0x7f252c15ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:41338/0 (socket says 172.21.15.83:41338) 2024-03-30T13:08:35.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e73722640 1 Processor -- start 2024-03-30T13:08:35.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f32a3546640 1 -- start start 2024-03-30T13:08:35.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f253095b640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f252c0b2430 0x7f252c06b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:38558/0 (socket says 172.21.15.83:38558) 2024-03-30T13:08:35.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f253115c640 1 -- 172.21.15.83:0/3931673787 learned_addr learned my addr 172.21.15.83:0/3931673787 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa0295eb640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa02415e460 0x7fa0240cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa0295eb640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa02415e460 0x7fa0240cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:41340/0 (socket says 172.21.15.83:41340) 2024-03-30T13:08:35.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa0295eb640 1 -- 172.21.15.83:0/2369511699 learned_addr learned my addr 172.21.15.83:0/2369511699 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa02a5ed640 1 --2- 172.21.15.83:0/2369511699 >> v2:172.21.15.83:3300/0 conn(0x7fa0240b63f0 0x7fa0240b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f253195d640 1 --2- 172.21.15.83:0/3931673787 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f252c06bd70 0x7f252c147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2369511699 --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0240d2e80 con 0x7fa02415e840 2024-03-30T13:08:35.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2369511699 --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fa0240d3120 con 0x7fa0240b63f0 2024-03-30T13:08:35.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2369511699 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa0240d3400 con 0x7fa02415e460 2024-03-30T13:08:35.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f25333c0640 1 -- 172.21.15.83:0/3931673787 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f252c146580 con 0x7f252c0b2430 2024-03-30T13:08:35.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f25333c0640 1 -- 172.21.15.83:0/3931673787 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f252c146860 con 0x7f252c161d30 2024-03-30T13:08:35.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f25333c0640 1 -- 172.21.15.83:0/3931673787 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f252c146b40 con 0x7f252c06bd70 2024-03-30T13:08:35.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e73722640 1 -- start start 2024-03-30T13:08:35.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f32a3546640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f329c15e250 0x7f329c06f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e73722640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9e6c0736a0 0x7f9e6c06d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e73722640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9e6c0b31e0 0x7f9e6c0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f820779f640 1 Processor -- start 2024-03-30T13:08:35.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f820779f640 1 -- start start 2024-03-30T13:08:35.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa029dec640 1 --2- 172.21.15.83:0/2369511699 >> v2:172.21.15.83:3300/0 conn(0x7fa0240b63f0 0x7fa0240b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f32a3546640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f329c162110 con 0x7f329c15e630 2024-03-30T13:08:35.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f32a3546640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f329c1623f0 con 0x7f329c0d06e0 2024-03-30T13:08:35.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f32a3546640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f329c1626d0 con 0x7f329c15e250 2024-03-30T13:08:35.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f2523fff640 1 -- 172.21.15.83:0/3931673787 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659034004 0 0) 0x7f252c146580 con 0x7f252c0b2430 2024-03-30T13:08:35.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f2523fff640 1 -- 172.21.15.83:0/3931673787 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2518003530 con 0x7f252c0b2430 2024-03-30T13:08:35.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e73722640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e6c0b40a0 con 0x7f9e6c0b4750 2024-03-30T13:08:35.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e73722640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f9e6c15aa50 con 0x7f9e6c0b31e0 2024-03-30T13:08:35.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e73722640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9e6c0b4350 con 0x7f9e6c0736a0 2024-03-30T13:08:35.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa989d9b640 1 --2- 172.21.15.83:0/1536447329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa98c072d90 0x7fa98c15e170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa984009d90 tx=0x7fa98401c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d83c6d4d6d69af32 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f32a0ae1640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f329c15e630 0x7f329c0cffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40258/0 (socket says 172.21.15.83:40258) 2024-03-30T13:08:35.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f32a0ae1640 1 -- 172.21.15.83:0/2051134005 learned_addr learned my addr 172.21.15.83:0/2051134005 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:35.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f32a12e2640 1 --2- 172.21.15.83:0/2051134005 >> v2:172.21.15.153:3300/0 conn(0x7f329c15e250 0x7f329c06f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e71cbf640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9e6c0b31e0 0x7f9e6c0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e71cbf640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9e6c0b31e0 0x7f9e6c0af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43584/0 (socket says 172.21.15.83:43584) 2024-03-30T13:08:35.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e71cbf640 1 -- 172.21.15.83:0/1640535792 learned_addr learned my addr 172.21.15.83:0/1640535792 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e70cbd640 1 --2- 172.21.15.83:0/1640535792 >> v2:172.21.15.153:3300/0 conn(0x7f9e6c0736a0 0x7f9e6c06d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa01bfff640 1 -- 172.21.15.83:0/2369511699 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412893475 0 0) 0x7fa0240d2e80 con 0x7fa02415e840 2024-03-30T13:08:35.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa01bfff640 1 -- 172.21.15.83:0/2369511699 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa010003530 con 0x7fa02415e840 2024-03-30T13:08:35.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f253115c640 1 -- 172.21.15.83:0/3931673787 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f252c06bd70 msgr2=0x7f252c147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f253115c640 1 --2- 172.21.15.83:0/3931673787 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f252c06bd70 0x7f252c147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f253115c640 1 -- 172.21.15.83:0/3931673787 >> v1:172.21.15.153:6789/0 conn(0x7f252c0b2430 legacy=0x7f252c06b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f253115c640 1 -- 172.21.15.83:0/3931673787 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252c146e20 con 0x7f252c161d30 2024-03-30T13:08:35.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e70cbd640 1 -- 172.21.15.83:0/1640535792 >> v2:172.21.15.83:3300/0 conn(0x7f9e6c0b31e0 msgr2=0x7f9e6c0af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa98959a640 1 -- 172.21.15.83:0/1536447329 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9840b2070 con 0x7fa98c072d90 2024-03-30T13:08:35.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa98959a640 1 -- 172.21.15.83:0/1536447329 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9840a5770 con 0x7fa98c072d90 2024-03-30T13:08:35.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa98959a640 1 -- 172.21.15.83:0/1536447329 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9840a5b80 con 0x7fa98c072d90 2024-03-30T13:08:35.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f32a12e2640 1 -- 172.21.15.83:0/2051134005 >> v1:172.21.15.153:6789/0 conn(0x7f329c0d06e0 legacy=0x7f329c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f32a12e2640 1 -- 172.21.15.83:0/2051134005 >> v1:172.21.15.83:6789/0 conn(0x7f329c15e630 legacy=0x7f329c0cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f32a12e2640 1 -- 172.21.15.83:0/2051134005 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329c1629b0 con 0x7f329c15e250 2024-03-30T13:08:35.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa029dec640 1 -- 172.21.15.83:0/2369511699 >> v2:172.21.15.153:3300/0 conn(0x7fa02415e460 msgr2=0x7fa0240cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa029dec640 1 --2- 172.21.15.83:0/2369511699 >> v2:172.21.15.153:3300/0 conn(0x7fa02415e460 0x7fa0240cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa029dec640 1 -- 172.21.15.83:0/2369511699 >> v1:172.21.15.83:6789/0 conn(0x7fa02415e840 legacy=0x7fa0240b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7fa029dec640 1 -- 172.21.15.83:0/2369511699 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0240d36e0 con 0x7fa0240b63f0 2024-03-30T13:08:35.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa98b59e640 1 -- 172.21.15.83:0/1536447329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa98c072d90 msgr2=0x7fa98c15e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa98b59e640 1 --2- 172.21.15.83:0/1536447329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa98c072d90 0x7fa98c15e170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa984009d90 tx=0x7fa98401c9b0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa98b59e640 1 -- 172.21.15.83:0/1536447329 shutdown_connections 2024-03-30T13:08:35.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa98b59e640 1 --2- 172.21.15.83:0/1536447329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c0d0a10 0x7fa98c15e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa98b59e640 1 --2- 172.21.15.83:0/1536447329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa98c072d90 0x7fa98c15e170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa98b59e640 1 -- 172.21.15.83:0/1536447329 >> 172.21.15.83:0/1536447329 conn(0x7fa98c0cfef0 msgr2=0x7fa98c0d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa98b59e640 1 -- 172.21.15.83:0/1536447329 shutdown_connections 2024-03-30T13:08:35.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f820779f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f820015c0f0 0x7f82000d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f820779f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f82000d0bc0 0x7f82000b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f820553b640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f820015bd10 0x7f820006fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:38594/0 (socket says 172.21.15.83:38594) 2024-03-30T13:08:35.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f8204d3a640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f820015c0f0 0x7f82000d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f8204d3a640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f820015c0f0 0x7f82000d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:41376/0 (socket says 172.21.15.83:41376) 2024-03-30T13:08:35.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f8205d3c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f82000d0bc0 0x7f82000b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f8205d3c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f82000d0bc0 0x7f82000b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43598/0 (socket says 172.21.15.83:43598) 2024-03-30T13:08:35.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f820553b640 1 -- 172.21.15.83:0/3733442086 learned_addr learned my addr 172.21.15.83:0/3733442086 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:35.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f820779f640 1 -- 172.21.15.83:0/3733442086 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8200070470 con 0x7f820015bd10 2024-03-30T13:08:35.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e70cbd640 1 --2- 172.21.15.83:0/1640535792 >> v2:172.21.15.83:3300/0 conn(0x7f9e6c0b31e0 0x7f9e6c0af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e70cbd640 1 -- 172.21.15.83:0/1640535792 >> v1:172.21.15.153:6789/0 conn(0x7f9e6c0b4750 legacy=0x7f9e6c0b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e70cbd640 1 -- 172.21.15.83:0/1640535792 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c0ae700 con 0x7f9e6c0736a0 2024-03-30T13:08:35.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.585+0000 7f9e71cbf640 1 --2- 172.21.15.83:0/1640535792 >> v2:172.21.15.83:3300/0 conn(0x7f9e6c0b31e0 0x7f9e6c0af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:35.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f820779f640 1 -- 172.21.15.83:0/3733442086 --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f82000d01f0 con 0x7f82000d0bc0 2024-03-30T13:08:35.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f820779f640 1 -- 172.21.15.83:0/3733442086 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f82000cfba0 con 0x7f820015c0f0 2024-03-30T13:08:35.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f253115c640 1 --2- 172.21.15.83:0/3931673787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f252c161d30 0x7f252c15ec80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2528009870 tx=0x7f252801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4daf69cb37d8cbf6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa029dec640 1 --2- 172.21.15.83:0/2369511699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0240b63f0 0x7fa0240b72f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa0240d1fc0 tx=0x7fa01c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995377fb8888ca04 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f32a12e2640 1 --2- 172.21.15.83:0/2051134005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f329c15e250 0x7f329c06f560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f328c0097c0 tx=0x7f328c01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a35139cac61008bf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f2523fff640 1 -- 172.21.15.83:0/3931673787 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25280b1070 con 0x7f252c161d30 2024-03-30T13:08:35.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa01bfff640 1 -- 172.21.15.83:0/2369511699 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c0b2070 con 0x7fa0240b63f0 2024-03-30T13:08:35.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f2523fff640 1 -- 172.21.15.83:0/3931673787 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25280ac410 con 0x7f252c161d30 2024-03-30T13:08:35.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f2523fff640 1 -- 172.21.15.83:0/3931673787 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25280ac7c0 con 0x7f252c161d30 2024-03-30T13:08:35.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f81f7fff640 1 -- 172.21.15.83:0/3733442086 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4064673797 0 0) 0x7f8200070470 con 0x7f820015bd10 2024-03-30T13:08:35.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f81f7fff640 1 -- 172.21.15.83:0/3733442086 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81ec003530 con 0x7f820015bd10 2024-03-30T13:08:35.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f8204d3a640 1 -- 172.21.15.83:0/3733442086 >> v2:172.21.15.83:3300/0 conn(0x7f82000d0bc0 msgr2=0x7f82000b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f8204d3a640 1 --2- 172.21.15.83:0/3733442086 >> v2:172.21.15.83:3300/0 conn(0x7f82000d0bc0 0x7f82000b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f8204d3a640 1 -- 172.21.15.83:0/3733442086 >> v1:172.21.15.153:6789/0 conn(0x7f820015bd10 legacy=0x7f820006fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f8204d3a640 1 -- 172.21.15.83:0/3733442086 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82000cfe80 con 0x7f820015c0f0 2024-03-30T13:08:35.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa98b59e640 1 -- 172.21.15.83:0/1536447329 wait complete. 2024-03-30T13:08:35.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa98b59e640 1 Processor -- start 2024-03-30T13:08:35.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f9e70cbd640 1 --2- 172.21.15.83:0/1640535792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0736a0 0x7f9e6c06d830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0708c0 tx=0x7f9e6801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2122e928f167c47e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa98b59e640 1 -- start start 2024-03-30T13:08:35.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f9e63fff640 1 -- 172.21.15.83:0/1640535792 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e680b0070 con 0x7f9e6c0736a0 2024-03-30T13:08:35.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fb22ba34640 1 Processor -- start 2024-03-30T13:08:35.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fb22ba34640 1 -- start start 2024-03-30T13:08:35.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fb22ba34640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2240b4680 0x7fb2240711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fb22ba34640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb224071f20 con 0x7fb2240716f0 2024-03-30T13:08:35.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fb22ba34640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb224163d50 con 0x7fb224159a10 2024-03-30T13:08:35.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fb22ba34640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb2240d1db0 con 0x7fb2240b4680 2024-03-30T13:08:35.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fb229fd1640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fb2240716f0 0x7fb22406d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40266/0 (socket says 172.21.15.83:40266) 2024-03-30T13:08:35.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fb229fd1640 1 -- 172.21.15.83:0/1000272386 learned_addr learned my addr 172.21.15.83:0/1000272386 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:35.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3562486868 0 0) 0x7fb224071f20 con 0x7fb2240716f0 2024-03-30T13:08:35.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f25333c0640 1 -- 172.21.15.83:0/3931673787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f252c161d30 msgr2=0x7f252c15ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f25333c0640 1 --2- 172.21.15.83:0/3931673787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f252c161d30 0x7f252c15ec80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2528009870 tx=0x7f252801c4a0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa01bfff640 1 -- 172.21.15.83:0/2369511699 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa01c0a5950 con 0x7fa0240b63f0 2024-03-30T13:08:35.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa01bfff640 1 -- 172.21.15.83:0/2369511699 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c0a5d00 con 0x7fa0240b63f0 2024-03-30T13:08:35.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2369511699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0240b63f0 msgr2=0x7fa0240b72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa02a5ed640 1 --2- 172.21.15.83:0/2369511699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0240b63f0 0x7fa0240b72f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa0240d1fc0 tx=0x7fa01c01c870 comp rx=0 tx=0).stop 2024-03-30T13:08:35.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f25333c0640 1 -- 172.21.15.83:0/3931673787 shutdown_connections 2024-03-30T13:08:35.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f25333c0640 1 --2- 172.21.15.83:0/3931673787 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f252c06bd70 0x7f252c147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f25333c0640 1 --2- 172.21.15.83:0/3931673787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f252c161d30 0x7f252c15ec80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f25333c0640 1 -- 172.21.15.83:0/3931673787 >> 172.21.15.83:0/3931673787 conn(0x7f252c09aa50 msgr2=0x7f252c0b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f25333c0640 1 -- 172.21.15.83:0/3931673787 shutdown_connections 2024-03-30T13:08:35.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2369511699 shutdown_connections 2024-03-30T13:08:35.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa02a5ed640 1 --2- 172.21.15.83:0/2369511699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0240b63f0 0x7fa0240b72f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa02a5ed640 1 --2- 172.21.15.83:0/2369511699 >> v2:172.21.15.153:3300/0 conn(0x7fa02415e460 0x7fa0240cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2369511699 >> 172.21.15.83:0/2369511699 conn(0x7fa024067970 msgr2=0x7fa0240d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2369511699 shutdown_connections 2024-03-30T13:08:35.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f9e63fff640 1 -- 172.21.15.83:0/1640535792 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e680ab600 con 0x7f9e6c0736a0 2024-03-30T13:08:35.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f9e63fff640 1 -- 172.21.15.83:0/1640535792 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e680ab9d0 con 0x7f9e6c0736a0 2024-03-30T13:08:35.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f9e73722640 1 -- 172.21.15.83:0/1640535792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0736a0 msgr2=0x7f9e6c06d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f9e73722640 1 --2- 172.21.15.83:0/1640535792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0736a0 0x7f9e6c06d830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0708c0 tx=0x7f9e6801c3e0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98b59e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c072d90 0x7fa98c164950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98b59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa98c0d0a10 0x7fa98c09b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98b59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa98c158150 0x7fa98c09bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98b59e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c163be0 con 0x7fa98c158150 2024-03-30T13:08:35.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98b59e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c15b930 con 0x7fa98c0d0a10 2024-03-30T13:08:35.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98b59e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa98c163d60 con 0x7fa98c072d90 2024-03-30T13:08:35.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f97da439640 1 Processor -- start 2024-03-30T13:08:35.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f97da439640 1 -- start start 2024-03-30T13:08:35.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f3293fff640 1 -- 172.21.15.83:0/2051134005 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c0b0070 con 0x7f329c15e250 2024-03-30T13:08:35.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f3293fff640 1 -- 172.21.15.83:0/2051134005 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f328c0ab600 con 0x7f329c15e250 2024-03-30T13:08:35.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f3293fff640 1 -- 172.21.15.83:0/2051134005 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c0ab9d0 con 0x7f329c15e250 2024-03-30T13:08:35.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f32a3546640 1 -- 172.21.15.83:0/2051134005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f329c15e250 msgr2=0x7f329c06f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f32a3546640 1 --2- 172.21.15.83:0/2051134005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f329c15e250 0x7f329c06f560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f328c0097c0 tx=0x7f328c01c380 comp rx=0 tx=0).stop 2024-03-30T13:08:35.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f9e73722640 1 -- 172.21.15.83:0/1640535792 shutdown_connections 2024-03-30T13:08:35.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f9e73722640 1 --2- 172.21.15.83:0/1640535792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0736a0 0x7f9e6c06d830 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f9e73722640 1 --2- 172.21.15.83:0/1640535792 >> v2:172.21.15.83:3300/0 conn(0x7f9e6c0b31e0 0x7f9e6c0af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f9e73722640 1 -- 172.21.15.83:0/1640535792 >> 172.21.15.83:0/1640535792 conn(0x7f9e6c072b80 msgr2=0x7f9e6c072f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98a59c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c072d90 0x7fa98c164950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98a59c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c072d90 0x7fa98c164950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:50520/0 (socket says 172.21.15.83:50520) 2024-03-30T13:08:35.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98a59c640 1 -- 172.21.15.83:0/3288036454 learned_addr learned my addr 172.21.15.83:0/3288036454 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f32a3546640 1 -- 172.21.15.83:0/2051134005 shutdown_connections 2024-03-30T13:08:35.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f32a3546640 1 --2- 172.21.15.83:0/2051134005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f329c15e250 0x7f329c06f560 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f32a3546640 1 -- 172.21.15.83:0/2051134005 >> 172.21.15.83:0/2051134005 conn(0x7f329c0b5690 msgr2=0x7f329c0b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb210003530 con 0x7fb2240716f0 2024-03-30T13:08:35.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.589+0000 7f25333c0640 1 -- 172.21.15.83:0/3931673787 wait complete. 2024-03-30T13:08:35.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2369511699 wait complete. 2024-03-30T13:08:35.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa989d9b640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa98c0d0a10 0x7fa98c09b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1704822427 0 0) 0x7fb210003530 con 0x7fb2240716f0 2024-03-30T13:08:35.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb228fcf640 1 --2- 172.21.15.83:0/1000272386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2240b4680 0x7fb2240711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2240b4680 msgr2=0x7fb2240711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:35.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 --2- 172.21.15.83:0/1000272386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2240b4680 0x7fb2240711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 >> v1:172.21.15.153:6789/0 conn(0x7fb224159a10 legacy=0x7fb2240b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f9e73722640 1 -- 172.21.15.83:0/1640535792 shutdown_connections 2024-03-30T13:08:35.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f25333c0640 1 Processor -- start 2024-03-30T13:08:35.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f32a3546640 1 -- 172.21.15.83:0/2051134005 shutdown_connections 2024-03-30T13:08:35.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f25333c0640 1 -- start start 2024-03-30T13:08:35.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98a59c640 1 -- 172.21.15.83:0/3288036454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa98c0d0a10 msgr2=0x7fa98c09b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98a59c640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa98c0d0a10 0x7fa98c09b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98a59c640 1 -- 172.21.15.83:0/3288036454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa98c158150 msgr2=0x7fa98c09bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98a59c640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa98c158150 0x7fa98c09bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98a59c640 1 -- 172.21.15.83:0/3288036454 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98c0ad8f0 con 0x7fa98c072d90 2024-03-30T13:08:35.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98a59c640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c072d90 0x7fa98c164950 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa98000c3a0 tx=0x7fa98000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f32a3546640 1 -- 172.21.15.83:0/2051134005 wait complete. 2024-03-30T13:08:35.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa02a5ed640 1 Processor -- start 2024-03-30T13:08:35.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f97da439640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f97d4162800 0x7f97d40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f97da439640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97d406d9d0 con 0x7f97d40af7e0 2024-03-30T13:08:35.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f97da439640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97d406dcb0 con 0x7f97d406ea70 2024-03-30T13:08:35.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f97da439640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f97d406e5e0 con 0x7f97d4162800 2024-03-30T13:08:35.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f8204d3a640 1 --2- 172.21.15.83:0/3733442086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820015c0f0 0x7f82000d0680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8200071e40 tx=0x7f81fc01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=624508c03b70748b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f97d3fff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f97d4162800 0x7f97d40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f97d3fff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f97d4162800 0x7f97d40b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:41394/0 (socket says 172.21.15.83:41394) 2024-03-30T13:08:35.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f97d3fff640 1 -- 172.21.15.83:0/3353474546 learned_addr learned my addr 172.21.15.83:0/3353474546 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa97affd640 1 -- 172.21.15.83:0/3288036454 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9800052d0 con 0x7fa98c072d90 2024-03-30T13:08:35.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa97affd640 1 -- 172.21.15.83:0/3288036454 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa980005470 con 0x7fa98c072d90 2024-03-30T13:08:35.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa97affd640 1 -- 172.21.15.83:0/3288036454 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980007260 con 0x7fa98c072d90 2024-03-30T13:08:35.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f81f7fff640 1 -- 172.21.15.83:0/3733442086 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0b2070 con 0x7f820015c0f0 2024-03-30T13:08:35.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98b59e640 1 -- 172.21.15.83:0/3288036454 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa98c09abf0 con 0x7fa98c072d90 2024-03-30T13:08:35.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98b59e640 1 -- 172.21.15.83:0/3288036454 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa98c09b1b0 con 0x7fa98c072d90 2024-03-30T13:08:35.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f25333c0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f252c06bd70 0x7f252c207400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f25333c0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f252c0b2430 0x7f252c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f25333c0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f252c161d30 0x7f252c06f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f25333c0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f252c16b600 con 0x7f252c0b2430 2024-03-30T13:08:35.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f25333c0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f252c16b480 con 0x7f252c06bd70 2024-03-30T13:08:35.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f25333c0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f252c16b780 con 0x7f252c161d30 2024-03-30T13:08:35.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f253095b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f252c0b2430 0x7f252c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f253095b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f252c0b2430 0x7f252c0d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43614/0 (socket says 172.21.15.83:43614) 2024-03-30T13:08:35.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f253095b640 1 -- 172.21.15.83:0/97478221 learned_addr learned my addr 172.21.15.83:0/97478221 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f32a3546640 1 Processor -- start 2024-03-30T13:08:35.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f9e73722640 1 -- 172.21.15.83:0/1640535792 wait complete. 2024-03-30T13:08:35.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f9e73722640 1 Processor -- start 2024-03-30T13:08:35.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb224162f90 con 0x7fb2240716f0 2024-03-30T13:08:35.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb228fcf640 1 --2- 172.21.15.83:0/1000272386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2240b4680 0x7fb2240711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:35.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fb21c001a00 con 0x7fb2240716f0 2024-03-30T13:08:35.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 >> v1:172.21.15.83:6789/0 conn(0x7fb2240716f0 legacy=0x7fb22406d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 --2- 172.21.15.83:0/1000272386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2100039f0 0x7fb210003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 --2- 172.21.15.83:0/1000272386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb210004810 0x7fb210004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 --2- 172.21.15.83:0/1000272386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2240b4680 0x7fb21000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb2240d1db0 con 0x7fb210004810 2024-03-30T13:08:35.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2100055d0 con 0x7fb2100039f0 2024-03-30T13:08:35.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb21000bf10 con 0x7fb2240b4680 2024-03-30T13:08:35.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb228fcf640 1 --2- 172.21.15.83:0/1000272386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb210004810 0x7fb210004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb228fcf640 1 -- 172.21.15.83:0/1000272386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2240b4680 msgr2=0x7fb21000b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:08:35.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb228fcf640 1 --2- 172.21.15.83:0/1000272386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2240b4680 0x7fb21000b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb228fcf640 1 -- 172.21.15.83:0/1000272386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2100039f0 msgr2=0x7fb210003e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-30T13:08:35.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb228fcf640 1 --2- 172.21.15.83:0/1000272386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2100039f0 0x7fb210003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fb228fcf640 1 -- 172.21.15.83:0/1000272386 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb224162f90 con 0x7fb210004810 2024-03-30T13:08:35.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa02a5ed640 1 -- start start 2024-03-30T13:08:35.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa02a5ed640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240b63f0 0x7fa0240cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa02a5ed640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa02415e460 0x7fa02415f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa02a5ed640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa02415e840 0x7fa0240b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa02a5ed640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa0240b81c0 con 0x7fa02415e840 2024-03-30T13:08:35.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa02a5ed640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0240b8040 con 0x7fa0240b63f0 2024-03-30T13:08:35.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa02a5ed640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa0240b8340 con 0x7fa02415e460 2024-03-30T13:08:35.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f253195d640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f252c161d30 0x7f252c06f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f253115c640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f252c06bd70 0x7f252c207400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f97d3fff640 1 -- 172.21.15.83:0/3353474546 >> v1:172.21.15.153:6789/0 conn(0x7f97d406ea70 legacy=0x7f97d40d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f97d3fff640 1 -- 172.21.15.83:0/3353474546 >> v1:172.21.15.83:6789/0 conn(0x7f97d40af7e0 legacy=0x7f97d40ad150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:08:35.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f32a3546640 1 -- start start 2024-03-30T13:08:35.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a3546640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f329c0d06e0 0x7f329c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f9e73722640 1 -- start start 2024-03-30T13:08:35.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa98b59e640 1 -- 172.21.15.83:0/3288036454 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa98c04f900 con 0x7fa98c072d90 2024-03-30T13:08:35.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa0295eb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240b63f0 0x7fa0240cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa0295eb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240b63f0 0x7fa0240cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:41424/0 (socket says 172.21.15.83:41424) 2024-03-30T13:08:35.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa0295eb640 1 -- 172.21.15.83:0/2602196926 learned_addr learned my addr 172.21.15.83:0/2602196926 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa029dec640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa02415e840 0x7fa0240b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7fa028dea640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa02415e460 0x7fa02415f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa029dec640 1 -- 172.21.15.83:0/2602196926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa02415e460 msgr2=0x7fa02415f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa029dec640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa02415e460 0x7fa02415f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa029dec640 1 -- 172.21.15.83:0/2602196926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240b63f0 msgr2=0x7fa0240cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa029dec640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240b63f0 0x7fa0240cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa029dec640 1 -- 172.21.15.83:0/2602196926 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0240ce190 con 0x7fa02415e840 2024-03-30T13:08:35.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f253195d640 1 -- 172.21.15.83:0/97478221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f252c06bd70 msgr2=0x7f252c207400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f253195d640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f252c06bd70 0x7f252c207400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f253195d640 1 -- 172.21.15.83:0/97478221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f252c0b2430 msgr2=0x7f252c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f253195d640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f252c0b2430 0x7f252c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f253195d640 1 -- 172.21.15.83:0/97478221 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252c207940 con 0x7f252c161d30 2024-03-30T13:08:35.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f253195d640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f252c161d30 0x7f252c06f8e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f252400eb70 tx=0x7f252400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f81f7fff640 1 -- 172.21.15.83:0/3733442086 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc0ad640 con 0x7f820015c0f0 2024-03-30T13:08:35.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f81f7fff640 1 -- 172.21.15.83:0/3733442086 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0ad9f0 con 0x7f820015c0f0 2024-03-30T13:08:35.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f820779f640 1 -- 172.21.15.83:0/3733442086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820015c0f0 msgr2=0x7f82000d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f820779f640 1 --2- 172.21.15.83:0/3733442086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820015c0f0 0x7f82000d0680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8200071e40 tx=0x7f81fc01c370 comp rx=0 tx=0).stop 2024-03-30T13:08:35.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f820779f640 1 -- 172.21.15.83:0/3733442086 shutdown_connections 2024-03-30T13:08:35.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f820779f640 1 --2- 172.21.15.83:0/3733442086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820015c0f0 0x7f82000d0680 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f820779f640 1 --2- 172.21.15.83:0/3733442086 >> v2:172.21.15.83:3300/0 conn(0x7f82000d0bc0 0x7f82000b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.593+0000 7f820779f640 1 -- 172.21.15.83:0/3733442086 >> 172.21.15.83:0/3733442086 conn(0x7f820006e6d0 msgr2=0x7f820006eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f820779f640 1 -- 172.21.15.83:0/3733442086 shutdown_connections 2024-03-30T13:08:35.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e73722640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0736a0 0x7f9e6c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e73722640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e6c0b31e0 0x7f9e6c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e73722640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e6c0b4750 0x7f9e6c0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e73722640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c0cff70 con 0x7f9e6c0b4750 2024-03-30T13:08:35.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e73722640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c0cfdf0 con 0x7f9e6c0736a0 2024-03-30T13:08:35.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e73722640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c06c3d0 con 0x7f9e6c0b31e0 2024-03-30T13:08:35.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e71cbf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e6c0b4750 0x7f9e6c0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e70cbd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e6c0b31e0 0x7f9e6c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e71cbf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e6c0b4750 0x7f9e6c0cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43636/0 (socket says 172.21.15.83:43636) 2024-03-30T13:08:35.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e71cbf640 1 -- 172.21.15.83:0/3118044669 learned_addr learned my addr 172.21.15.83:0/3118044669 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e714be640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0736a0 0x7f9e6c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a3546640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329c15e250 0x7f329c14c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa97affd640 1 -- 172.21.15.83:0/3288036454 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa980007400 con 0x7fa98c072d90 2024-03-30T13:08:35.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa97affd640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa96c068090 0x7fa96c06a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa97affd640 1 -- 172.21.15.83:0/3288036454 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa980085e60 con 0x7fa98c072d90 2024-03-30T13:08:35.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a12e2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f329c0d06e0 0x7f329c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a3546640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f329c15e630 0x7f329c0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a12e2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f329c0d06e0 0x7f329c15b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:41442/0 (socket says 172.21.15.83:41442) 2024-03-30T13:08:35.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a12e2640 1 -- 172.21.15.83:0/958632256 learned_addr learned my addr 172.21.15.83:0/958632256 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e71cbf640 1 -- 172.21.15.83:0/3118044669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e6c0b31e0 msgr2=0x7f9e6c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e71cbf640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e6c0b31e0 0x7f9e6c0cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e71cbf640 1 -- 172.21.15.83:0/3118044669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0736a0 msgr2=0x7f9e6c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e71cbf640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0736a0 0x7f9e6c0cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e71cbf640 1 -- 172.21.15.83:0/3118044669 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c1509c0 con 0x7f9e6c0b4750 2024-03-30T13:08:35.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a0ae1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329c15e250 0x7f329c14c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f329c16c510 con 0x7f329c15e250 2024-03-30T13:08:35.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f329c16c390 con 0x7f329c0d06e0 2024-03-30T13:08:35.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f329c16c690 con 0x7f329c15e630 2024-03-30T13:08:35.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a1ae3640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f329c15e630 0x7f329c0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f97d3fff640 1 -- 172.21.15.83:0/3353474546 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d406df90 con 0x7f97d4162800 2024-03-30T13:08:35.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f820779f640 1 -- 172.21.15.83:0/3733442086 wait complete. 2024-03-30T13:08:35.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f820779f640 1 Processor -- start 2024-03-30T13:08:35.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa989d9b640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa96c068090 0x7fa96c06a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a0ae1640 1 -- 172.21.15.83:0/958632256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f329c15e630 msgr2=0x7f329c0b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a0ae1640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f329c15e630 0x7f329c0b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a0ae1640 1 -- 172.21.15.83:0/958632256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f329c0d06e0 msgr2=0x7f329c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a0ae1640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f329c0d06e0 0x7f329c15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a0ae1640 1 -- 172.21.15.83:0/958632256 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329c15a750 con 0x7f329c15e250 2024-03-30T13:08:35.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa029dec640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa02415e840 0x7fa0240b41b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa01c0ac000 tx=0x7fa01c019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e71cbf640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e6c0b4750 0x7f9e6c0cd660 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c00e590 tx=0x7f9e5c00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa989d9b640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa96c068090 0x7fa96c06a550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa9840af000 tx=0x7fa9840a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa019ffb640 1 -- 172.21.15.83:0/2602196926 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c0b2050 con 0x7fa02415e840 2024-03-30T13:08:35.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa019ffb640 1 -- 172.21.15.83:0/2602196926 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa01c0be070 con 0x7fa02415e840 2024-03-30T13:08:35.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa019ffb640 1 -- 172.21.15.83:0/2602196926 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c004040 con 0x7fa02415e840 2024-03-30T13:08:35.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a0ae1640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329c15e250 0x7f329c14c6f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f329c0728a0 tx=0x7f329800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e61ffb640 1 -- 172.21.15.83:0/3118044669 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00f040 con 0x7f9e6c0b4750 2024-03-30T13:08:35.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f97d3fff640 1 --2- 172.21.15.83:0/3353474546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d4162800 0x7f97d40b4f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f97d406e760 tx=0x7f97c401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1bb6422846c0118 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fb228fcf640 1 --2- 172.21.15.83:0/1000272386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb210004810 0x7fb210004c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb22000aaa0 tx=0x7fb22001c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79848f28f59521be server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e61ffb640 1 -- 172.21.15.83:0/3118044669 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e5c004250 con 0x7f9e6c0b4750 2024-03-30T13:08:35.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e61ffb640 1 -- 172.21.15.83:0/3118044669 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c003620 con 0x7f9e6c0b4750 2024-03-30T13:08:35.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e73722640 1 -- 172.21.15.83:0/3118044669 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e6c150ca0 con 0x7f9e6c0b4750 2024-03-30T13:08:35.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f9e73722640 1 -- 172.21.15.83:0/3118044669 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e6c099a50 con 0x7f9e6c0b4750 2024-03-30T13:08:35.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2602196926 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa02415ba90 con 0x7fa02415e840 2024-03-30T13:08:35.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f3291ffb640 1 -- 172.21.15.83:0/958632256 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3298017070 con 0x7f329c15e250 2024-03-30T13:08:35.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329c15aa30 con 0x7f329c15e250 2024-03-30T13:08:35.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f329c0b2840 con 0x7f329c15e250 2024-03-30T13:08:35.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2602196926 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa02415c050 con 0x7fa02415e840 2024-03-30T13:08:35.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f820779f640 1 -- start start 2024-03-30T13:08:35.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f820779f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82000d0bc0 0x7f820013e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f820779f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820015bd10 0x7f8200151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f820779f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f820015c0f0 0x7f8200159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f820779f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f820006b9f0 con 0x7f820015c0f0 2024-03-30T13:08:35.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f820779f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f820006b870 con 0x7f820015bd10 2024-03-30T13:08:35.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f820779f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f820006bb70 con 0x7f82000d0bc0 2024-03-30T13:08:35.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f8205d3c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f820015c0f0 0x7f8200159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f8205d3c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f820015c0f0 0x7f8200159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43654/0 (socket says 172.21.15.83:43654) 2024-03-30T13:08:35.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f8205d3c640 1 -- 172.21.15.83:0/3084336020 learned_addr learned my addr 172.21.15.83:0/3084336020 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f8204d3a640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820015bd10 0x7f8200151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f820553b640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82000d0bc0 0x7f820013e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f3291ffb640 1 -- 172.21.15.83:0/958632256 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3298005cf0 con 0x7f329c15e250 2024-03-30T13:08:35.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f3291ffb640 1 -- 172.21.15.83:0/958632256 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32980072f0 con 0x7f329c15e250 2024-03-30T13:08:35.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f97d2ffd640 1 -- 172.21.15.83:0/3353474546 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c40ab660 con 0x7f97d4162800 2024-03-30T13:08:35.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f97d2ffd640 1 -- 172.21.15.83:0/3353474546 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c40b0070 con 0x7f97d4162800 2024-03-30T13:08:35.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.597+0000 7f97d2ffd640 1 -- 172.21.15.83:0/3353474546 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c40aba20 con 0x7f97d4162800 2024-03-30T13:08:35.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f9e73722640 1 -- 172.21.15.83:0/3118044669 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6c099d40 con 0x7f9e6c0b4750 2024-03-30T13:08:35.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f8205d3c640 1 -- 172.21.15.83:0/3084336020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82000d0bc0 msgr2=0x7f820013e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f8205d3c640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82000d0bc0 0x7f820013e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f8205d3c640 1 -- 172.21.15.83:0/3084336020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820015bd10 msgr2=0x7f8200151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f8205d3c640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820015bd10 0x7f8200151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f8205d3c640 1 -- 172.21.15.83:0/3084336020 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820013ee70 con 0x7f820015c0f0 2024-03-30T13:08:35.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f8205d3c640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f820015c0f0 0x7f8200159210 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f81f800bea0 tx=0x7f81f800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2602196926 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa02404f900 con 0x7fa02415e840 2024-03-30T13:08:35.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f97da439640 1 -- 172.21.15.83:0/3353474546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d4162800 msgr2=0x7f97d40b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f97da439640 1 --2- 172.21.15.83:0/3353474546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d4162800 0x7f97d40b4f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f97d406e760 tx=0x7f97c401c440 comp rx=0 tx=0).stop 2024-03-30T13:08:35.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f97da439640 1 -- 172.21.15.83:0/3353474546 shutdown_connections 2024-03-30T13:08:35.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f97da439640 1 --2- 172.21.15.83:0/3353474546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d4162800 0x7f97d40b4f30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f97da439640 1 -- 172.21.15.83:0/3353474546 >> 172.21.15.83:0/3353474546 conn(0x7f97d40b5690 msgr2=0x7f97d40b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f97da439640 1 -- 172.21.15.83:0/3353474546 shutdown_connections 2024-03-30T13:08:35.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f327c0052a0 con 0x7f329c15e250 2024-03-30T13:08:35.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f81f5ffb640 1 -- 172.21.15.83:0/3084336020 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f800b2d0 con 0x7f820015c0f0 2024-03-30T13:08:35.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f820779f640 1 -- 172.21.15.83:0/3084336020 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82000c70b0 con 0x7f820015c0f0 2024-03-30T13:08:35.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f820779f640 1 -- 172.21.15.83:0/3084336020 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82000c6810 con 0x7f820015c0f0 2024-03-30T13:08:35.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f9e61ffb640 1 -- 172.21.15.83:0/3118044669 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9e5c0037c0 con 0x7f9e6c0b4750 2024-03-30T13:08:35.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f97da439640 1 -- 172.21.15.83:0/3353474546 wait complete. 2024-03-30T13:08:35.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f9e61ffb640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9e50068010 0x7f9e5006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f9e61ffb640 1 -- 172.21.15.83:0/3118044669 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9e5c0864c0 con 0x7f9e6c0b4750 2024-03-30T13:08:35.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f9e714be640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9e50068010 0x7f9e5006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7fa019ffb640 1 -- 172.21.15.83:0/2602196926 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa01c0041e0 con 0x7fa02415e840 2024-03-30T13:08:35.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f820779f640 1 -- 172.21.15.83:0/3084336020 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f820004f900 con 0x7f820015c0f0 2024-03-30T13:08:35.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22000a670 con 0x7fb210004810 2024-03-30T13:08:35.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2200b0070 con 0x7fb210004810 2024-03-30T13:08:35.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7fb21bfff640 1 -- 172.21.15.83:0/1000272386 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2200a7070 con 0x7fb210004810 2024-03-30T13:08:35.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7fa019ffb640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa008068010 0x7fa00806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7fa019ffb640 1 -- 172.21.15.83:0/2602196926 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa01c1211f0 con 0x7fa02415e840 2024-03-30T13:08:35.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f9e714be640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9e50068010 0x7f9e5006a4d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9e640012f0 tx=0x7f9e64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7fa0295eb640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa008068010 0x7fa00806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f97da439640 1 Processor -- start 2024-03-30T13:08:35.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7fa0295eb640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa008068010 0x7fa00806a4d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa0140094a0 tx=0x7fa014008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.601+0000 7f97da439640 1 -- start start 2024-03-30T13:08:35.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f2521ffb640 1 -- 172.21.15.83:0/97478221 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2524018020 con 0x7f252c161d30 2024-03-30T13:08:35.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f2521ffb640 1 -- 172.21.15.83:0/97478221 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252400cd20 con 0x7f252c161d30 2024-03-30T13:08:35.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f25333c0640 1 -- 172.21.15.83:0/97478221 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f252c143e80 con 0x7f252c161d30 2024-03-30T13:08:35.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f25333c0640 1 -- 172.21.15.83:0/97478221 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f252c144440 con 0x7f252c161d30 2024-03-30T13:08:35.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97da439640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97d406ea70 0x7f97d41595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f2521ffb640 1 -- 172.21.15.83:0/97478221 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25240146c0 con 0x7f252c161d30 2024-03-30T13:08:35.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97da439640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d40af7e0 0x7f97d40ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7fa97affd640 1 -- 172.21.15.83:0/3288036454 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fa980056680 con 0x7fa98c072d90 2024-03-30T13:08:35.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97da439640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d4162800 0x7f97d4164230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7fb22ba34640 1 -- 172.21.15.83:0/1000272386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb210004810 msgr2=0x7fb210004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7fb22ba34640 1 --2- 172.21.15.83:0/1000272386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb210004810 0x7fb210004c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb22000aaa0 tx=0x7fb22001c630 comp rx=0 tx=0).stop 2024-03-30T13:08:35.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7fb229fd1640 1 -- 172.21.15.83:0/1000272386 reap_dead start 2024-03-30T13:08:35.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d40af7e0 0x7f97d40ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d40af7e0 0x7f97d40ce140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:41460/0 (socket says 172.21.15.83:41460) 2024-03-30T13:08:35.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d89d6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d4162800 0x7f97d4164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d89d6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d4162800 0x7f97d4164230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43668/0 (socket says 172.21.15.83:43668) 2024-03-30T13:08:35.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d3fff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97d406ea70 0x7f97d41595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d3fff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97d406ea70 0x7f97d41595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:50582/0 (socket says 172.21.15.83:50582) 2024-03-30T13:08:35.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7fb22ba34640 1 -- 172.21.15.83:0/1000272386 shutdown_connections 2024-03-30T13:08:35.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7fb22ba34640 1 -- 172.21.15.83:0/1000272386 >> 172.21.15.83:0/1000272386 conn(0x7fb224067540 msgr2=0x7fb224067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d37fe640 1 -- 172.21.15.83:0/3995359521 learned_addr learned my addr 172.21.15.83:0/3995359521 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f97d4162d60 con 0x7f97d4162800 2024-03-30T13:08:35.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97d4162be0 con 0x7f97d40af7e0 2024-03-30T13:08:35.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f97d40d0740 con 0x7f97d406ea70 2024-03-30T13:08:35.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f25333c0640 1 -- 172.21.15.83:0/97478221 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f250c0052a0 con 0x7f252c161d30 2024-03-30T13:08:35.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d89d6640 1 -- 172.21.15.83:0/3995359521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97d406ea70 msgr2=0x7f97d41595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d89d6640 1 --2- 172.21.15.83:0/3995359521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97d406ea70 0x7f97d41595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d89d6640 1 -- 172.21.15.83:0/3995359521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d40af7e0 msgr2=0x7f97d40ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d89d6640 1 --2- 172.21.15.83:0/3995359521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d40af7e0 0x7f97d40ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d89d6640 1 -- 172.21.15.83:0/3995359521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d40cd3a0 con 0x7f97d4162800 2024-03-30T13:08:35.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d89d6640 1 --2- 172.21.15.83:0/3995359521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d4162800 0x7f97d4164230 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00c730 tx=0x7f97cc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97d0ff9640 1 -- 172.21.15.83:0/3995359521 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc016020 con 0x7f97d4162800 2024-03-30T13:08:35.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d40cd680 con 0x7f97d4162800 2024-03-30T13:08:35.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d40cdc40 con 0x7f97d4162800 2024-03-30T13:08:35.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.605+0000 7f2521ffb640 1 -- 172.21.15.83:0/97478221 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f252401b020 con 0x7f252c161d30 2024-03-30T13:08:35.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.609+0000 7f2521ffb640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2510067fc0 0x7f251006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.609+0000 7f9e61ffb640 1 -- 172.21.15.83:0/3118044669 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9e5c017020 con 0x7f9e6c0b4750 2024-03-30T13:08:35.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.609+0000 7f81f5ffb640 1 -- 172.21.15.83:0/3084336020 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f801a070 con 0x7f820015c0f0 2024-03-30T13:08:35.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.609+0000 7f2521ffb640 1 -- 172.21.15.83:0/97478221 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2524087560 con 0x7f252c161d30 2024-03-30T13:08:35.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.609+0000 7f81f5ffb640 1 -- 172.21.15.83:0/3084336020 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8009740 con 0x7f820015c0f0 2024-03-30T13:08:35.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.609+0000 7fb22ba34640 1 -- 172.21.15.83:0/1000272386 shutdown_connections 2024-03-30T13:08:35.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.609+0000 7fb22ba34640 1 -- 172.21.15.83:0/1000272386 wait complete. 2024-03-30T13:08:35.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.609+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d404f900 con 0x7f97d4162800 2024-03-30T13:08:35.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7f253115c640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2510067fc0 0x7f251006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7f253115c640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2510067fc0 0x7f251006a480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f25280ae000 tx=0x7f2528009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7fb22ba34640 1 Processor -- start 2024-03-30T13:08:35.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7fa019ffb640 1 -- 172.21.15.83:0/2602196926 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fa01c0c8020 con 0x7fa02415e840 2024-03-30T13:08:35.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7f2521ffb640 1 -- 172.21.15.83:0/97478221 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f2524022030 con 0x7f252c161d30 2024-03-30T13:08:35.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7f81f5ffb640 1 -- 172.21.15.83:0/3084336020 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f81f80098e0 con 0x7f820015c0f0 2024-03-30T13:08:35.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7f81f5ffb640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f81e4067fc0 0x7f81e406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7f81f5ffb640 1 -- 172.21.15.83:0/3084336020 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f81f8087870 con 0x7f820015c0f0 2024-03-30T13:08:35.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7f97d0ff9640 1 -- 172.21.15.83:0/3995359521 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97cc006d60 con 0x7f97d4162800 2024-03-30T13:08:35.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7f97d0ff9640 1 -- 172.21.15.83:0/3995359521 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc001680 con 0x7f97d4162800 2024-03-30T13:08:35.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7f820553b640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f81e4067fc0 0x7f81e406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7fb22ba34640 1 -- start start 2024-03-30T13:08:35.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb22ba34640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb210004810 0x7fb2241583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb22ba34640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2240d0bf0 0x7fb224166540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb22ba34640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb224166a80 0x7fb22415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb22ba34640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb22416e780 con 0x7fb210004810 2024-03-30T13:08:35.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb22ba34640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2241638c0 con 0x7fb2240d0bf0 2024-03-30T13:08:35.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb22ba34640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb22416e900 con 0x7fb224166a80 2024-03-30T13:08:35.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.613+0000 7f97d0ff9640 1 -- 172.21.15.83:0/3995359521 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f97cc003c60 con 0x7f97d4162800 2024-03-30T13:08:35.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7f97d0ff9640 1 --2- 172.21.15.83:0/3995359521 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f97c0067fc0 0x7f97c006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7f3291ffb640 1 -- 172.21.15.83:0/958632256 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f329801a070 con 0x7f329c15e250 2024-03-30T13:08:35.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7f820553b640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f81e4067fc0 0x7f81e406a480 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81f0007fd0 tx=0x7f81f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb228fcf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2240d0bf0 0x7fb224166540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb228fcf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2240d0bf0 0x7fb224166540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:41470/0 (socket says 172.21.15.83:41470) 2024-03-30T13:08:35.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb228fcf640 1 -- 172.21.15.83:0/4284474690 learned_addr learned my addr 172.21.15.83:0/4284474690 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:35.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb229fd1640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb224166a80 0x7fb22415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7f3291ffb640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3280068090 0x7f328006a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb2297d0640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb210004810 0x7fb2241583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7f32a12e2640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3280068090 0x7f328006a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb228fcf640 1 -- 172.21.15.83:0/4284474690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb224166a80 msgr2=0x7fb22415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb228fcf640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb224166a80 0x7fb22415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb228fcf640 1 -- 172.21.15.83:0/4284474690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb210004810 msgr2=0x7fb2241583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb228fcf640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb210004810 0x7fb2241583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb228fcf640 1 -- 172.21.15.83:0/4284474690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2241610b0 con 0x7fb2240d0bf0 2024-03-30T13:08:35.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7f32a12e2640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3280068090 0x7f328006a550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f328c01c3c0 tx=0x7f328c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7f3291ffb640 1 -- 172.21.15.83:0/958632256 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3298085ae0 con 0x7f329c15e250 2024-03-30T13:08:35.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb228fcf640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2240d0bf0 0x7fb224166540 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb2200ad040 tx=0x7fb210005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7f97d3fff640 1 --2- 172.21.15.83:0/3995359521 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f97c0067fc0 0x7f97c006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7f97d3fff640 1 --2- 172.21.15.83:0/3995359521 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f97c0067fc0 0x7f97c006a480 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f97c40af000 tx=0x7f97c40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb219ffb640 1 -- 172.21.15.83:0/4284474690 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2200abd40 con 0x7fb2240d0bf0 2024-03-30T13:08:35.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb219ffb640 1 -- 172.21.15.83:0/4284474690 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2200c0480 con 0x7fb2240d0bf0 2024-03-30T13:08:35.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb219ffb640 1 -- 172.21.15.83:0/4284474690 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2200c0870 con 0x7fb2240d0bf0 2024-03-30T13:08:35.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb22ba34640 1 -- 172.21.15.83:0/4284474690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22415bc80 con 0x7fb2240d0bf0 2024-03-30T13:08:35.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.617+0000 7fb22ba34640 1 -- 172.21.15.83:0/4284474690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22415bf20 con 0x7fb2240d0bf0 2024-03-30T13:08:35.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.621+0000 7fb22ba34640 1 -- 172.21.15.83:0/4284474690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22415bab0 con 0x7fb2240d0bf0 2024-03-30T13:08:35.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.621+0000 7f3291ffb640 1 -- 172.21.15.83:0/958632256 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3298021020 con 0x7f329c15e250 2024-03-30T13:08:35.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.621+0000 7fb219ffb640 1 -- 172.21.15.83:0/4284474690 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb2200c0a10 con 0x7fb2240d0bf0 2024-03-30T13:08:35.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.621+0000 7fb219ffb640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb208067ff0 0x7fb20806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:35.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.621+0000 7fb2297d0640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb208067ff0 0x7fb20806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:35.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.621+0000 7fb219ffb640 1 -- 172.21.15.83:0/4284474690 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb220121590 con 0x7fb2240d0bf0 2024-03-30T13:08:35.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.621+0000 7fb2297d0640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb208067ff0 0x7fb20806a4b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb224169370 tx=0x7fb214009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:35.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.625+0000 7fb219ffb640 1 -- 172.21.15.83:0/4284474690 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb220016340 con 0x7fb2240d0bf0 2024-03-30T13:08:35.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.629+0000 7f97d0ff9640 1 -- 172.21.15.83:0/3995359521 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f97cc054eb0 con 0x7f97d4162800 2024-03-30T13:08:35.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.629+0000 7f81f5ffb640 1 -- 172.21.15.83:0/3084336020 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f81f80579b0 con 0x7f820015c0f0 2024-03-30T13:08:35.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.641+0000 7f97d0ff9640 1 -- 172.21.15.83:0/3995359521 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f97cc020020 con 0x7f97d4162800 2024-03-30T13:08:35.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.917+0000 7fa98b59e640 1 -- 172.21.15.83:0/3288036454 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa98c072240 con 0x7fa98c072d90 2024-03-30T13:08:35.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.921+0000 7fa97affd640 1 -- 172.21.15.83:0/3288036454 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa980055f80 con 0x7fa98c072d90 2024-03-30T13:08:35.928 INFO:teuthology.orchestra.run.smithi083.stdout:64424509446 2024-03-30T13:08:35.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7fa978ff9640 1 -- 172.21.15.83:0/3288036454 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa96c068090 msgr2=0x7fa96c06a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7fa978ff9640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa96c068090 0x7fa96c06a550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa9840af000 tx=0x7fa9840a7070 comp rx=0 tx=0).stop 2024-03-30T13:08:35.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7fa978ff9640 1 -- 172.21.15.83:0/3288036454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c072d90 msgr2=0x7fa98c164950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7fa978ff9640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c072d90 0x7fa98c164950 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa98000c3a0 tx=0x7fa98000c860 comp rx=0 tx=0).stop 2024-03-30T13:08:35.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7fa978ff9640 1 -- 172.21.15.83:0/3288036454 shutdown_connections 2024-03-30T13:08:35.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7fa978ff9640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa96c068090 0x7fa96c06a550 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7fa978ff9640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa98c158150 0x7fa98c09bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7fa978ff9640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa98c0d0a10 0x7fa98c09b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7fa978ff9640 1 --2- 172.21.15.83:0/3288036454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa98c072d90 0x7fa98c164950 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7fa978ff9640 1 -- 172.21.15.83:0/3288036454 >> 172.21.15.83:0/3288036454 conn(0x7fa98c0cfef0 msgr2=0x7fa98c0b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7fa978ff9640 1 -- 172.21.15.83:0/3288036454 shutdown_connections 2024-03-30T13:08:35.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7fa978ff9640 1 -- 172.21.15.83:0/3288036454 wait complete. 2024-03-30T13:08:35.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.925+0000 7f9e73722640 1 -- 172.21.15.83:0/3118044669 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9e6c09e540 con 0x7f9e6c0b4750 2024-03-30T13:08:35.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.929+0000 7f9e61ffb640 1 -- 172.21.15.83:0/3118044669 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9e5c056700 con 0x7f9e6c0b4750 2024-03-30T13:08:35.936 INFO:teuthology.orchestra.run.smithi083.stdout:64424509446 2024-03-30T13:08:35.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f25333c0640 1 -- 172.21.15.83:0/97478221 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f250c005860 con 0x7f252c161d30 2024-03-30T13:08:35.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f2521ffb640 1 -- 172.21.15.83:0/97478221 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2524010040 con 0x7f252c161d30 2024-03-30T13:08:35.938 INFO:teuthology.orchestra.run.smithi083.stdout:64424509445 2024-03-30T13:08:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f9e4f7fe640 1 -- 172.21.15.83:0/3118044669 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9e50068010 msgr2=0x7f9e5006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f9e4f7fe640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9e50068010 0x7f9e5006a4d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9e640012f0 tx=0x7f9e64009040 comp rx=0 tx=0).stop 2024-03-30T13:08:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f9e4f7fe640 1 -- 172.21.15.83:0/3118044669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e6c0b4750 msgr2=0x7f9e6c0cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f9e4f7fe640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e6c0b4750 0x7f9e6c0cd660 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c00e590 tx=0x7f9e5c00ea50 comp rx=0 tx=0).stop 2024-03-30T13:08:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f9e4f7fe640 1 -- 172.21.15.83:0/3118044669 shutdown_connections 2024-03-30T13:08:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f9e4f7fe640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9e50068010 0x7f9e5006a4d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f9e4f7fe640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e6c0b4750 0x7f9e6c0cd660 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f9e4f7fe640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e6c0b31e0 0x7f9e6c0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f9e4f7fe640 1 --2- 172.21.15.83:0/3118044669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0736a0 0x7f9e6c0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f9e4f7fe640 1 -- 172.21.15.83:0/3118044669 >> 172.21.15.83:0/3118044669 conn(0x7f9e6c072b80 msgr2=0x7f9e6c168820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f9e4f7fe640 1 -- 172.21.15.83:0/3118044669 shutdown_connections 2024-03-30T13:08:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.933+0000 7f9e4f7fe640 1 -- 172.21.15.83:0/3118044669 wait complete. 2024-03-30T13:08:35.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.937+0000 7f25333c0640 1 -- 172.21.15.83:0/97478221 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2510067fc0 msgr2=0x7f251006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.937+0000 7f25333c0640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2510067fc0 0x7f251006a480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f25280ae000 tx=0x7f2528009040 comp rx=0 tx=0).stop 2024-03-30T13:08:35.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.937+0000 7f25333c0640 1 -- 172.21.15.83:0/97478221 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f252c161d30 msgr2=0x7f252c06f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.937+0000 7f25333c0640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f252c161d30 0x7f252c06f8e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f252400eb70 tx=0x7f252400c490 comp rx=0 tx=0).stop 2024-03-30T13:08:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.937+0000 7f25333c0640 1 -- 172.21.15.83:0/97478221 shutdown_connections 2024-03-30T13:08:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.937+0000 7f25333c0640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2510067fc0 0x7f251006a480 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.937+0000 7f25333c0640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f252c161d30 0x7f252c06f8e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.937+0000 7f25333c0640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f252c0b2430 0x7f252c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.937+0000 7f25333c0640 1 --2- 172.21.15.83:0/97478221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f252c06bd70 0x7f252c207400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.937+0000 7f25333c0640 1 -- 172.21.15.83:0/97478221 >> 172.21.15.83:0/97478221 conn(0x7f252c09aa50 msgr2=0x7f252c160850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.937+0000 7f25333c0640 1 -- 172.21.15.83:0/97478221 shutdown_connections 2024-03-30T13:08:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.937+0000 7f25333c0640 1 -- 172.21.15.83:0/97478221 wait complete. 2024-03-30T13:08:35.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.945+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2602196926 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa0240d21b0 con 0x7fa02415e840 2024-03-30T13:08:35.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.945+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f327c005860 con 0x7f329c15e250 2024-03-30T13:08:35.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.945+0000 7f3291ffb640 1 -- 172.21.15.83:0/958632256 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3298055cb0 con 0x7f329c15e250 2024-03-30T13:08:35.950 INFO:teuthology.orchestra.run.smithi083.stdout:64424509447 2024-03-30T13:08:35.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.945+0000 7fa019ffb640 1 -- 172.21.15.83:0/2602196926 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa01c016520 con 0x7fa02415e840 2024-03-30T13:08:35.953 INFO:teuthology.orchestra.run.smithi083.stdout:64424509447 2024-03-30T13:08:35.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-03-30T13:08:35.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3280068090 msgr2=0x7f328006a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7f32a3546640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3280068090 0x7f328006a550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f328c01c3c0 tx=0x7f328c0a6000 comp rx=0 tx=0).stop 2024-03-30T13:08:35.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329c15e250 msgr2=0x7f329c14c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7f32a3546640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329c15e250 0x7f329c14c6f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f329c0728a0 tx=0x7f329800c820 comp rx=0 tx=0).stop 2024-03-30T13:08:35.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 shutdown_connections 2024-03-30T13:08:35.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7f32a3546640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3280068090 0x7f328006a550 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7f32a3546640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f329c15e630 0x7f329c0b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7f32a3546640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329c15e250 0x7f329c14c6f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7f32a3546640 1 --2- 172.21.15.83:0/958632256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f329c0d06e0 0x7f329c15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 >> 172.21.15.83:0/958632256 conn(0x7f329c0b5690 msgr2=0x7f329c0cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 shutdown_connections 2024-03-30T13:08:35.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7f32a3546640 1 -- 172.21.15.83:0/958632256 wait complete. 2024-03-30T13:08:35.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2602196926 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa008068010 msgr2=0x7fa00806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fa02a5ed640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa008068010 0x7fa00806a4d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa0140094a0 tx=0x7fa014008040 comp rx=0 tx=0).stop 2024-03-30T13:08:35.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2602196926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa02415e840 msgr2=0x7fa0240b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fa02a5ed640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa02415e840 0x7fa0240b41b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa01c0ac000 tx=0x7fa01c019610 comp rx=0 tx=0).stop 2024-03-30T13:08:35.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2602196926 shutdown_connections 2024-03-30T13:08:35.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fa02a5ed640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa008068010 0x7fa00806a4d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fa02a5ed640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa02415e840 0x7fa0240b41b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fa02a5ed640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa02415e460 0x7fa02415f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fa02a5ed640 1 --2- 172.21.15.83:0/2602196926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0240b63f0 0x7fa0240cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2602196926 >> 172.21.15.83:0/2602196926 conn(0x7fa024067970 msgr2=0x7fa0240d4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2602196926 shutdown_connections 2024-03-30T13:08:35.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fa02a5ed640 1 -- 172.21.15.83:0/2602196926 wait complete. 2024-03-30T13:08:35.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.949+0000 7fb22ba34640 1 -- 172.21.15.83:0/4284474690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb2240cfa70 con 0x7fb2240d0bf0 2024-03-30T13:08:35.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.953+0000 7fb219ffb640 1 -- 172.21.15.83:0/4284474690 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb2200f17f0 con 0x7fb2240d0bf0 2024-03-30T13:08:35.960 INFO:teuthology.orchestra.run.smithi083.stdout:64424509448 2024-03-30T13:08:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.953+0000 7f820779f640 1 -- 172.21.15.83:0/3084336020 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f820006f2f0 con 0x7f820015c0f0 2024-03-30T13:08:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.953+0000 7f81f5ffb640 1 -- 172.21.15.83:0/3084336020 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f81f805bcb0 con 0x7f820015c0f0 2024-03-30T13:08:35.961 INFO:teuthology.orchestra.run.smithi083.stdout:55834574854 2024-03-30T13:08:35.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2024-03-30T13:08:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7fb22ba34640 1 -- 172.21.15.83:0/4284474690 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb208067ff0 msgr2=0x7fb20806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7fb22ba34640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb208067ff0 0x7fb20806a4b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb224169370 tx=0x7fb214009040 comp rx=0 tx=0).stop 2024-03-30T13:08:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7fb22ba34640 1 -- 172.21.15.83:0/4284474690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2240d0bf0 msgr2=0x7fb224166540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7fb22ba34640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2240d0bf0 0x7fb224166540 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb2200ad040 tx=0x7fb210005840 comp rx=0 tx=0).stop 2024-03-30T13:08:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7fb22ba34640 1 -- 172.21.15.83:0/4284474690 shutdown_connections 2024-03-30T13:08:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7fb22ba34640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb208067ff0 0x7fb20806a4b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7fb22ba34640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb224166a80 0x7fb22415c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7fb22ba34640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2240d0bf0 0x7fb224166540 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7fb22ba34640 1 --2- 172.21.15.83:0/4284474690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb210004810 0x7fb2241583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7fb22ba34640 1 -- 172.21.15.83:0/4284474690 >> 172.21.15.83:0/4284474690 conn(0x7fb224067540 msgr2=0x7fb2240b6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7fb22ba34640 1 -- 172.21.15.83:0/4284474690 shutdown_connections 2024-03-30T13:08:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7fb22ba34640 1 -- 172.21.15.83:0/4284474690 wait complete. 2024-03-30T13:08:35.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f820779f640 1 -- 172.21.15.83:0/3084336020 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f81e4067fc0 msgr2=0x7f81e406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f820779f640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f81e4067fc0 0x7f81e406a480 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81f0007fd0 tx=0x7f81f0009040 comp rx=0 tx=0).stop 2024-03-30T13:08:35.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f820779f640 1 -- 172.21.15.83:0/3084336020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f820015c0f0 msgr2=0x7f8200159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f820779f640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f820015c0f0 0x7f8200159210 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f81f800bea0 tx=0x7f81f800bf90 comp rx=0 tx=0).stop 2024-03-30T13:08:35.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f820779f640 1 -- 172.21.15.83:0/3084336020 shutdown_connections 2024-03-30T13:08:35.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f820779f640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f81e4067fc0 0x7f81e406a480 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f820779f640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f820015c0f0 0x7f8200159210 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f820779f640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820015bd10 0x7f8200151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f820779f640 1 --2- 172.21.15.83:0/3084336020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82000d0bc0 0x7f820013e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f820779f640 1 -- 172.21.15.83:0/3084336020 >> 172.21.15.83:0/3084336020 conn(0x7f820006e6d0 msgr2=0x7f820015a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f820779f640 1 -- 172.21.15.83:0/3084336020 shutdown_connections 2024-03-30T13:08:35.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f820779f640 1 -- 172.21.15.83:0/3084336020 wait complete. 2024-03-30T13:08:35.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f97d415dec0 con 0x7f97d4162800 2024-03-30T13:08:35.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.957+0000 7f97d0ff9640 1 -- 172.21.15.83:0/3995359521 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f97cc056e10 con 0x7f97d4162800 2024-03-30T13:08:35.967 INFO:teuthology.orchestra.run.smithi083.stdout:55834574854 2024-03-30T13:08:35.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.961+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f97c0067fc0 msgr2=0x7f97c006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.961+0000 7f97da439640 1 --2- 172.21.15.83:0/3995359521 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f97c0067fc0 0x7f97c006a480 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f97c40af000 tx=0x7f97c40a7000 comp rx=0 tx=0).stop 2024-03-30T13:08:35.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.961+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d4162800 msgr2=0x7f97d4164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:35.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.961+0000 7f97da439640 1 --2- 172.21.15.83:0/3995359521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d4162800 0x7f97d4164230 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00c730 tx=0x7f97cc00cbf0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.961+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 shutdown_connections 2024-03-30T13:08:35.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.961+0000 7f97da439640 1 --2- 172.21.15.83:0/3995359521 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f97c0067fc0 0x7f97c006a480 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.961+0000 7f97da439640 1 --2- 172.21.15.83:0/3995359521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d4162800 0x7f97d4164230 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.961+0000 7f97da439640 1 --2- 172.21.15.83:0/3995359521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d40af7e0 0x7f97d40ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.961+0000 7f97da439640 1 --2- 172.21.15.83:0/3995359521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97d406ea70 0x7f97d41595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:35.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.961+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 >> 172.21.15.83:0/3995359521 conn(0x7f97d40b5690 msgr2=0x7f97d40b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:35.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.961+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 shutdown_connections 2024-03-30T13:08:35.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:35.961+0000 7f97da439640 1 -- 172.21.15.83:0/3995359521 wait complete. 2024-03-30T13:08:35.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-03-30T13:08:35.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.3 2024-03-30T13:08:35.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2024-03-30T13:08:35.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.6 2024-03-30T13:08:35.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-03-30T13:08:35.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-03-30T13:08:36.955 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-30T13:08:36.963 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-30T13:08:36.988 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-30T13:08:36.988 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-30T13:08:36.990 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-30T13:08:36.994 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-30T13:08:36.996 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-30T13:08:36.998 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-30T13:08:37.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.129+0000 7f4c26ef3640 1 Processor -- start 2024-03-30T13:08:37.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.129+0000 7f4c26ef3640 1 -- start start 2024-03-30T13:08:37.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c26ef3640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4c200b3170 0x7f4c2015e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c26ef3640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c20073240 0x7f4c200736d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c26ef3640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c2015e720 con 0x7f4c2015a370 2024-03-30T13:08:37.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c26ef3640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4c2015efc0 con 0x7f4c200b3170 2024-03-30T13:08:37.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c26ef3640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2015ea00 con 0x7f4c20073240 2024-03-30T13:08:37.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c1ffff640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4c2015a370 0x7f4c200ad150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:56942/0 (socket says 172.21.15.83:56942) 2024-03-30T13:08:37.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c1ffff640 1 -- 172.21.15.83:0/421718464 learned_addr learned my addr 172.21.15.83:0/421718464 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:37.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c25490640 1 --2- 172.21.15.83:0/421718464 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c20073240 0x7f4c200736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c24c8f640 1 --2- 172.21.15.83:0/421718464 >> v2:172.21.15.153:3300/0 conn(0x7f4c200b3170 0x7f4c2015e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c24c8f640 1 -- 172.21.15.83:0/421718464 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c20073240 msgr2=0x7f4c200736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c24c8f640 1 --2- 172.21.15.83:0/421718464 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c20073240 0x7f4c200736d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c24c8f640 1 -- 172.21.15.83:0/421718464 >> v1:172.21.15.153:6789/0 conn(0x7f4c2015a370 legacy=0x7f4c200ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.133+0000 7f4c24c8f640 1 -- 172.21.15.83:0/421718464 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2015ece0 con 0x7f4c200b3170 2024-03-30T13:08:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.137+0000 7f4c24c8f640 1 --2- 172.21.15.83:0/421718464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c200b3170 0x7f4c2015e020 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4c140097c0 tx=0x7f4c1401c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3d836fb20a51b38 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.137+0000 7f4c1f7fe640 1 -- 172.21.15.83:0/421718464 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c140ab640 con 0x7f4c200b3170 2024-03-30T13:08:37.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.137+0000 7f4c1f7fe640 1 -- 172.21.15.83:0/421718464 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c140b0070 con 0x7f4c200b3170 2024-03-30T13:08:37.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.137+0000 7f4c1f7fe640 1 -- 172.21.15.83:0/421718464 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c140aba40 con 0x7f4c200b3170 2024-03-30T13:08:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.137+0000 7f4c26ef3640 1 -- 172.21.15.83:0/421718464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c200b3170 msgr2=0x7f4c2015e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.137+0000 7f4c26ef3640 1 --2- 172.21.15.83:0/421718464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c200b3170 0x7f4c2015e020 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4c140097c0 tx=0x7f4c1401c4e0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.137+0000 7f4c26ef3640 1 -- 172.21.15.83:0/421718464 shutdown_connections 2024-03-30T13:08:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.137+0000 7f4c26ef3640 1 --2- 172.21.15.83:0/421718464 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c20073240 0x7f4c200736d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.137+0000 7f4c26ef3640 1 --2- 172.21.15.83:0/421718464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c200b3170 0x7f4c2015e020 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.137+0000 7f4c26ef3640 1 -- 172.21.15.83:0/421718464 >> 172.21.15.83:0/421718464 conn(0x7f4c200b5690 msgr2=0x7f4c200b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.137+0000 7f4c26ef3640 1 -- 172.21.15.83:0/421718464 shutdown_connections 2024-03-30T13:08:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c26ef3640 1 -- 172.21.15.83:0/421718464 wait complete. 2024-03-30T13:08:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c26ef3640 1 Processor -- start 2024-03-30T13:08:37.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c26ef3640 1 -- start start 2024-03-30T13:08:37.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c26ef3640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c20073240 0x7f4c2016bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c26ef3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c200b3170 0x7f4c2015d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c26ef3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c2015a370 0x7f4c200cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c26ef3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4c200d0a50 con 0x7f4c2015a370 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c26ef3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c200d08d0 con 0x7f4c200b3170 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c26ef3640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4c200d0bd0 con 0x7f4c20073240 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c25490640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c2015a370 0x7f4c200cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c25490640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c2015a370 0x7f4c200cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59358/0 (socket says 172.21.15.83:59358) 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c25490640 1 -- 172.21.15.83:0/2861914071 learned_addr learned my addr 172.21.15.83:0/2861914071 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c1ffff640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c200b3170 0x7f4c2015d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.141+0000 7f4c24c8f640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c20073240 0x7f4c2016bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c1ffff640 1 -- 172.21.15.83:0/2861914071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c20073240 msgr2=0x7f4c2016bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c1ffff640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c20073240 0x7f4c2016bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c1ffff640 1 -- 172.21.15.83:0/2861914071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c2015a370 msgr2=0x7f4c200cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c1ffff640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c2015a370 0x7f4c200cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c1ffff640 1 -- 172.21.15.83:0/2861914071 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c20159620 con 0x7f4c200b3170 2024-03-30T13:08:37.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c1ffff640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c200b3170 0x7f4c2015d500 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800cad0 tx=0x7f4c1800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c1d7fa640 1 -- 172.21.15.83:0/2861914071 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18017070 con 0x7f4c200b3170 2024-03-30T13:08:37.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c1d7fa640 1 -- 172.21.15.83:0/2861914071 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1800abd0 con 0x7f4c200b3170 2024-03-30T13:08:37.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c26ef3640 1 -- 172.21.15.83:0/2861914071 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c20159900 con 0x7f4c200b3170 2024-03-30T13:08:37.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c26ef3640 1 -- 172.21.15.83:0/2861914071 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c200ce9f0 con 0x7f4c200b3170 2024-03-30T13:08:37.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c1d7fa640 1 -- 172.21.15.83:0/2861914071 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18012400 con 0x7f4c200b3170 2024-03-30T13:08:37.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c26ef3640 1 -- 172.21.15.83:0/2861914071 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c000052a0 con 0x7f4c200b3170 2024-03-30T13:08:37.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.145+0000 7f4c1d7fa640 1 -- 172.21.15.83:0/2861914071 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f4c1801a070 con 0x7f4c200b3170 2024-03-30T13:08:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.149+0000 7f4c1d7fa640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4c0c067fc0 0x7f4c0c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.149+0000 7f4c1d7fa640 1 -- 172.21.15.83:0/2861914071 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4c18086590 con 0x7f4c200b3170 2024-03-30T13:08:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.149+0000 7f4c24c8f640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4c0c067fc0 0x7f4c0c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.149+0000 7f4c24c8f640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4c0c067fc0 0x7f4c0c06a480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c140af000 tx=0x7f4c140a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.161+0000 7f4c1d7fa640 1 -- 172.21.15.83:0/2861914071 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f4c180566d0 con 0x7f4c200b3170 2024-03-30T13:08:37.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f20770640 1 Processor -- start 2024-03-30T13:08:37.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f20770640 1 -- start start 2024-03-30T13:08:37.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f20770640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5f1815e5d0 0x7f5f180afe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f20770640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f180b4fd0 0x7f5f1806f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f20770640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1815e9b0 con 0x7f5f180b5430 2024-03-30T13:08:37.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f20770640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5f180b0390 con 0x7f5f1815e5d0 2024-03-30T13:08:37.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f20770640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5f180b05c0 con 0x7f5f180b4fd0 2024-03-30T13:08:37.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f1ed0d640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f5f180b5430 0x7f5f18162140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56382/0 (socket says 172.21.15.83:56382) 2024-03-30T13:08:37.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f1ed0d640 1 -- 172.21.15.83:0/3544898984 learned_addr learned my addr 172.21.15.83:0/3544898984 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:37.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f1dd0b640 1 --2- 172.21.15.83:0/3544898984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f180b4fd0 0x7f5f1806f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f1e50c640 1 --2- 172.21.15.83:0/3544898984 >> v2:172.21.15.153:3300/0 conn(0x7f5f1815e5d0 0x7f5f180afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f1dd0b640 1 -- 172.21.15.83:0/3544898984 >> v2:172.21.15.153:3300/0 conn(0x7f5f1815e5d0 msgr2=0x7f5f180afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f1dd0b640 1 --2- 172.21.15.83:0/3544898984 >> v2:172.21.15.153:3300/0 conn(0x7f5f1815e5d0 0x7f5f180afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.169+0000 7f5f1dd0b640 1 -- 172.21.15.83:0/3544898984 >> v1:172.21.15.83:6789/0 conn(0x7f5f180b5430 legacy=0x7f5f18162140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.173+0000 7f5f1dd0b640 1 -- 172.21.15.83:0/3544898984 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1806e2e0 con 0x7f5f180b4fd0 2024-03-30T13:08:37.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.173+0000 7f5f1dd0b640 1 --2- 172.21.15.83:0/3544898984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f180b4fd0 0x7f5f1806f0a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5f140097c0 tx=0x7f5f1401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b6ca2a004a046a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.173+0000 7f9c8759e640 1 Processor -- start 2024-03-30T13:08:37.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.173+0000 7f5f1d50a640 1 -- 172.21.15.83:0/3544898984 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f140b0070 con 0x7f5f180b4fd0 2024-03-30T13:08:37.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.173+0000 7f5f1d50a640 1 -- 172.21.15.83:0/3544898984 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f140ab600 con 0x7f5f180b4fd0 2024-03-30T13:08:37.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.173+0000 7f9c8759e640 1 -- start start 2024-03-30T13:08:37.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b91e5640 1 Processor -- start 2024-03-30T13:08:37.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b91e5640 1 -- start start 2024-03-30T13:08:37.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c8759e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9c880ce7e0 0x7f9c88160940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c8759e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 0x7f9c880b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c8759e640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c880b4b00 con 0x7f9c8815d510 2024-03-30T13:08:37.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c8759e640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f9c880b4820 con 0x7f9c880ce7e0 2024-03-30T13:08:37.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c8759e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9c8815ca30 con 0x7f9c880d1670 2024-03-30T13:08:37.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f5f1d50a640 1 -- 172.21.15.83:0/3544898984 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f140ab9d0 con 0x7f5f180b4fd0 2024-03-30T13:08:37.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c85d9b640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f9c8815d510 0x7f9c880d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56394/0 (socket says 172.21.15.83:56394) 2024-03-30T13:08:37.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c85d9b640 1 -- 172.21.15.83:0/2208429911 learned_addr learned my addr 172.21.15.83:0/2208429911 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:37.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c86d9d640 1 --2- 172.21.15.83:0/2208429911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 0x7f9c880b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c8659c640 1 --2- 172.21.15.83:0/2208429911 >> v2:172.21.15.83:3300/0 conn(0x7f9c880ce7e0 0x7f9c88160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f5f20770640 1 -- 172.21.15.83:0/3544898984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f180b4fd0 msgr2=0x7f5f1806f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f5f20770640 1 --2- 172.21.15.83:0/3544898984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f180b4fd0 0x7f5f1806f0a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5f140097c0 tx=0x7f5f1401c330 comp rx=0 tx=0).stop 2024-03-30T13:08:37.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b91e5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2b40b5b40 0x7fd2b40b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c8559a640 1 -- 172.21.15.83:0/2208429911 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884876384 0 0) 0x7f9c880b4b00 con 0x7f9c8815d510 2024-03-30T13:08:37.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c8559a640 1 -- 172.21.15.83:0/2208429911 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c70003530 con 0x7f9c8815d510 2024-03-30T13:08:37.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c86d9d640 1 -- 172.21.15.83:0/2208429911 >> v2:172.21.15.83:3300/0 conn(0x7f9c880ce7e0 msgr2=0x7f9c88160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c86d9d640 1 --2- 172.21.15.83:0/2208429911 >> v2:172.21.15.83:3300/0 conn(0x7f9c880ce7e0 0x7f9c88160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c86d9d640 1 -- 172.21.15.83:0/2208429911 >> v1:172.21.15.83:6789/0 conn(0x7f9c8815d510 legacy=0x7f9c880d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f9c86d9d640 1 -- 172.21.15.83:0/2208429911 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8815cd10 con 0x7f9c880d1670 2024-03-30T13:08:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f5f20770640 1 -- 172.21.15.83:0/3544898984 shutdown_connections 2024-03-30T13:08:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f5f20770640 1 --2- 172.21.15.83:0/3544898984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f180b4fd0 0x7f5f1806f0a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f5f20770640 1 --2- 172.21.15.83:0/3544898984 >> v2:172.21.15.153:3300/0 conn(0x7f5f1815e5d0 0x7f5f180afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f5f20770640 1 -- 172.21.15.83:0/3544898984 >> 172.21.15.83:0/3544898984 conn(0x7f5f18072ec0 msgr2=0x7f5f1806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f5f20770640 1 -- 172.21.15.83:0/3544898984 shutdown_connections 2024-03-30T13:08:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f5f20770640 1 -- 172.21.15.83:0/3544898984 wait complete. 2024-03-30T13:08:37.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b91e5640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b40ce8f0 con 0x7fd2b40b3e00 2024-03-30T13:08:37.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b91e5640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b40cebd0 con 0x7fd2b40cd0f0 2024-03-30T13:08:37.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b91e5640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b40b64e0 con 0x7fd2b40b5b40 2024-03-30T13:08:37.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b2d9d640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd2b40cd0f0 0x7fd2b41638d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:56944/0 (socket says 172.21.15.83:56944) 2024-03-30T13:08:37.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b2d9d640 1 -- 172.21.15.83:0/2337843528 learned_addr learned my addr 172.21.15.83:0/2337843528 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:37.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b259c640 1 --2- 172.21.15.83:0/2337843528 >> v2:172.21.15.83:3300/0 conn(0x7fd2b40b5b40 0x7fd2b40b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2465534469 0 0) 0x7fd2b40cebd0 con 0x7fd2b40cd0f0 2024-03-30T13:08:37.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd29c003530 con 0x7fd2b40cd0f0 2024-03-30T13:08:37.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802694798 0 0) 0x7fd2b40ce8f0 con 0x7fd2b40b3e00 2024-03-30T13:08:37.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2b40cebd0 con 0x7fd2b40b3e00 2024-03-30T13:08:37.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 588873784 0 0) 0x7fd2b40cebd0 con 0x7fd2b40b3e00 2024-03-30T13:08:37.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 >> v2:172.21.15.83:3300/0 conn(0x7fd2b40b5b40 msgr2=0x7fd2b40b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 --2- 172.21.15.83:0/2337843528 >> v2:172.21.15.83:3300/0 conn(0x7fd2b40b5b40 0x7fd2b40b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 >> v1:172.21.15.153:6789/0 conn(0x7fd2b40cd0f0 legacy=0x7fd2b41638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b40ceeb0 con 0x7fd2b40b3e00 2024-03-30T13:08:37.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b259c640 1 --2- 172.21.15.83:0/2337843528 >> v2:172.21.15.83:3300/0 conn(0x7fd2b40b5b40 0x7fd2b40b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:37.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fd2ac0019e0 con 0x7fd2b40b3e00 2024-03-30T13:08:37.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 >> v1:172.21.15.83:6789/0 conn(0x7fd2b40b3e00 legacy=0x7fd2b40b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 --2- 172.21.15.83:0/2337843528 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd29c003b50 0x7fd29c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 --2- 172.21.15.83:0/2337843528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd29c004810 0x7fd29c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 --2- 172.21.15.83:0/2337843528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd29c0051d0 0x7fd29c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c00c0a0 con 0x7fd29c0051d0 2024-03-30T13:08:37.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c00c220 con 0x7fd29c004810 2024-03-30T13:08:37.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd29c00c420 con 0x7fd29c003b50 2024-03-30T13:08:37.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f7d6c7c3640 1 Processor -- start 2024-03-30T13:08:37.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f7d6c7c3640 1 -- start start 2024-03-30T13:08:37.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b359e640 1 --2- 172.21.15.83:0/2337843528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd29c0051d0 0x7fd29c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f5f20770640 1 Processor -- start 2024-03-30T13:08:37.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7fd2b259c640 1 --2- 172.21.15.83:0/2337843528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd29c004810 0x7fd29c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7fd2b2d9d640 1 --2- 172.21.15.83:0/2337843528 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd29c003b50 0x7fd29c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f20770640 1 -- start start 2024-03-30T13:08:37.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7fd2b2d9d640 1 -- 172.21.15.83:0/2337843528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd29c004810 msgr2=0x7fd29c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7fd2b2d9d640 1 --2- 172.21.15.83:0/2337843528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd29c004810 0x7fd29c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7fd2b2d9d640 1 -- 172.21.15.83:0/2337843528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd29c0051d0 msgr2=0x7fd29c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7fd2b2d9d640 1 --2- 172.21.15.83:0/2337843528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd29c0051d0 0x7fd29c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7fd2b2d9d640 1 -- 172.21.15.83:0/2337843528 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29c00c6e0 con 0x7fd29c003b50 2024-03-30T13:08:37.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7fd2b359e640 1 --2- 172.21.15.83:0/2337843528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd29c0051d0 0x7fd29c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:37.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7fd2b359e640 1 -- 172.21.15.83:0/2337843528 reap_dead start 2024-03-30T13:08:37.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6c7c3640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7d64071f20 0x7f7d640d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6c7c3640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7d6415f410 0x7f7d641682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6c7c3640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d640b33c0 con 0x7f7d640d0880 2024-03-30T13:08:37.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6c7c3640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f7d64072300 con 0x7f7d6415f410 2024-03-30T13:08:37.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6c7c3640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7d640d0ce0 con 0x7f7d64071f20 2024-03-30T13:08:37.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f20770640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f180b4fd0 0x7f5f18160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f20770640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f180b5430 0x7f5f181e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f20770640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f1815e5d0 0x7f5f181e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f20770640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1806e8a0 con 0x7f5f180b5430 2024-03-30T13:08:37.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f20770640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1806ec10 con 0x7f5f180b4fd0 2024-03-30T13:08:37.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f20770640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1806f5e0 con 0x7f5f1815e5d0 2024-03-30T13:08:37.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6ad60640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7d6415f410 0x7f7d641682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6a55f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7d64071f20 0x7f7d640d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6ad60640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7d6415f410 0x7f7d641682e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59394/0 (socket says 172.21.15.83:59394) 2024-03-30T13:08:37.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6ad60640 1 -- 172.21.15.83:0/471259508 learned_addr learned my addr 172.21.15.83:0/471259508 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:37.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f9c86d9d640 1 --2- 172.21.15.83:0/2208429911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 0x7f9c880b40f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009d90 tx=0x7f9c8001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb4edb401f396f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f1dd0b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f180b5430 0x7f5f181e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f1dd0b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f180b5430 0x7f5f181e85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59402/0 (socket says 172.21.15.83:59402) 2024-03-30T13:08:37.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f1dd0b640 1 -- 172.21.15.83:0/3050573550 learned_addr learned my addr 172.21.15.83:0/3050573550 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:37.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f1e50c640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f180b4fd0 0x7f5f18160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f1ed0d640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f1815e5d0 0x7f5f181e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6ad60640 1 -- 172.21.15.83:0/471259508 >> v2:172.21.15.153:3300/0 conn(0x7f7d64071f20 msgr2=0x7f7d640d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6ad60640 1 --2- 172.21.15.83:0/471259508 >> v2:172.21.15.153:3300/0 conn(0x7f7d64071f20 0x7f7d640d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6ad60640 1 -- 172.21.15.83:0/471259508 >> v1:172.21.15.153:6789/0 conn(0x7f7d640d0880 legacy=0x7f7d6415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f7d6ad60640 1 -- 172.21.15.83:0/471259508 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d640b36a0 con 0x7f7d6415f410 2024-03-30T13:08:37.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f9c8559a640 1 -- 172.21.15.83:0/2208429911 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c800b2070 con 0x7f9c880d1670 2024-03-30T13:08:37.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f1dd0b640 1 -- 172.21.15.83:0/3050573550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f1815e5d0 msgr2=0x7f5f181e8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f1dd0b640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f1815e5d0 0x7f5f181e8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f1dd0b640 1 -- 172.21.15.83:0/3050573550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f180b4fd0 msgr2=0x7f5f18160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f1dd0b640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f180b4fd0 0x7f5f18160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f1dd0b640 1 -- 172.21.15.83:0/3050573550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f181615a0 con 0x7f5f180b5430 2024-03-30T13:08:37.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f9c8559a640 1 -- 172.21.15.83:0/2208429911 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c800a57a0 con 0x7f9c880d1670 2024-03-30T13:08:37.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f9c8559a640 1 -- 172.21.15.83:0/2208429911 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c800a5b50 con 0x7f9c880d1670 2024-03-30T13:08:37.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f1dd0b640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f180b5430 0x7f5f181e85c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5f140ae040 tx=0x7f5f140190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f0effd640 1 -- 172.21.15.83:0/3050573550 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f140b0040 con 0x7f5f180b5430 2024-03-30T13:08:37.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f9c8759e640 1 -- 172.21.15.83:0/2208429911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 msgr2=0x7f9c880b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f9c8759e640 1 --2- 172.21.15.83:0/2208429911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 0x7f9c880b40f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009d90 tx=0x7f9c8001c8e0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f9c8759e640 1 -- 172.21.15.83:0/2208429911 shutdown_connections 2024-03-30T13:08:37.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f9c8759e640 1 --2- 172.21.15.83:0/2208429911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 0x7f9c880b40f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f9c8759e640 1 --2- 172.21.15.83:0/2208429911 >> v2:172.21.15.83:3300/0 conn(0x7f9c880ce7e0 0x7f9c88160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f9c8759e640 1 -- 172.21.15.83:0/2208429911 >> 172.21.15.83:0/2208429911 conn(0x7f9c88067540 msgr2=0x7f9c88067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f20770640 1 -- 172.21.15.83:0/3050573550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f18160d00 con 0x7f5f180b5430 2024-03-30T13:08:37.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f20770640 1 -- 172.21.15.83:0/3050573550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f181612c0 con 0x7f5f180b5430 2024-03-30T13:08:37.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5f0effd640 1 -- 172.21.15.83:0/3050573550 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f140b9070 con 0x7f5f180b5430 2024-03-30T13:08:37.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7fd2b2d9d640 1 --2- 172.21.15.83:0/2337843528 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd29c003b50 0x7fd29c003f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8001a30 tx=0x7fd2a801c620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=120ba3efac4145e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8001620 con 0x7fd29c003b50 2024-03-30T13:08:37.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f5f0effd640 1 -- 172.21.15.83:0/3050573550 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f140aa9b0 con 0x7f5f180b5430 2024-03-30T13:08:37.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c8759e640 1 -- 172.21.15.83:0/2208429911 shutdown_connections 2024-03-30T13:08:37.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c8759e640 1 -- 172.21.15.83:0/2208429911 wait complete. 2024-03-30T13:08:37.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.177+0000 7f5388bf2640 1 Processor -- start 2024-03-30T13:08:37.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5388bf2640 1 -- start start 2024-03-30T13:08:37.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5388bf2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c04f3e0 0x7f537c04f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5388bf2640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f537c050140 con 0x7f537c100e30 2024-03-30T13:08:37.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5388bf2640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f537c053800 con 0x7f537c006280 2024-03-30T13:08:37.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a8004ab0 con 0x7fd29c003b50 2024-03-30T13:08:37.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7fd2b1d9b640 1 -- 172.21.15.83:0/2337843528 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8007070 con 0x7fd29c003b50 2024-03-30T13:08:37.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5388bf2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f537c037b30 con 0x7f537c04f3e0 2024-03-30T13:08:37.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5383fff640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f537c006280 0x7f537c006690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:56954/0 (socket says 172.21.15.83:56954) 2024-03-30T13:08:37.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f5383fff640 1 -- 172.21.15.83:0/4241780703 learned_addr learned my addr 172.21.15.83:0/4241780703 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:37.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.181+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192384703 0 0) 0x7f537c053800 con 0x7f537c006280 2024-03-30T13:08:37.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5374003980 con 0x7f537c006280 2024-03-30T13:08:37.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2442939446 0 0) 0x7f537c050140 con 0x7f537c100e30 2024-03-30T13:08:37.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f537c053800 con 0x7f537c100e30 2024-03-30T13:08:37.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f5382ffd640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c04f3e0 0x7f537c04f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7fd2b91e5640 1 -- 172.21.15.83:0/2337843528 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd29c003b50 msgr2=0x7fd29c003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7fd2b91e5640 1 --2- 172.21.15.83:0/2337843528 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd29c003b50 0x7fd29c003f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8001a30 tx=0x7fd2a801c620 comp rx=0 tx=0).stop 2024-03-30T13:08:37.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3116592182 0 0) 0x7f5374003980 con 0x7f537c006280 2024-03-30T13:08:37.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c04f3e0 msgr2=0x7f537c04f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c04f3e0 0x7f537c04f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 >> v1:172.21.15.83:6789/0 conn(0x7f537c100e30 legacy=0x7f537c054230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c03a550 con 0x7f537c006280 2024-03-30T13:08:37.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f5384069760 con 0x7f537c006280 2024-03-30T13:08:37.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 >> v1:172.21.15.153:6789/0 conn(0x7f537c006280 legacy=0x7f537c006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5374004c60 0x7f5374005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53740055a0 0x7f5374003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5374004140 0x7f53740045c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f537400c090 con 0x7f53740055a0 2024-03-30T13:08:37.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f537400c240 con 0x7f5374004140 2024-03-30T13:08:37.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f537400c440 con 0x7f5374004c60 2024-03-30T13:08:37.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7fd2b91e5640 1 -- 172.21.15.83:0/2337843528 shutdown_connections 2024-03-30T13:08:37.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7fd2b91e5640 1 --2- 172.21.15.83:0/2337843528 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd29c003b50 0x7fd29c003f90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7fd2b91e5640 1 -- 172.21.15.83:0/2337843528 >> 172.21.15.83:0/2337843528 conn(0x7fd2b4072ec0 msgr2=0x7fd2b406b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f5382ffd640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c04f3e0 0x7f537c04f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:37.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f7d6ad60640 1 --2- 172.21.15.83:0/471259508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d6415f410 0x7f7d641682e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7d640d1170 tx=0x7f7d6001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3ba56c9ae4f512 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f7d6955d640 1 -- 172.21.15.83:0/471259508 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d600b0070 con 0x7f7d6415f410 2024-03-30T13:08:37.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f7d6955d640 1 -- 172.21.15.83:0/471259508 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d600ab600 con 0x7f7d6415f410 2024-03-30T13:08:37.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f7d6955d640 1 -- 172.21.15.83:0/471259508 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d600ab9d0 con 0x7f7d6415f410 2024-03-30T13:08:37.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f5f0effd640 1 -- 172.21.15.83:0/3050573550 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5f140aab50 con 0x7f5f180b5430 2024-03-30T13:08:37.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f5f0effd640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5efc068010 0x7f5efc06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f5f0effd640 1 -- 172.21.15.83:0/3050573550 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5f141203c0 con 0x7f5f180b5430 2024-03-30T13:08:37.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/471259508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d6415f410 msgr2=0x7f7d641682e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f7d6c7c3640 1 --2- 172.21.15.83:0/471259508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d6415f410 0x7f7d641682e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7d640d1170 tx=0x7f7d6001c520 comp rx=0 tx=0).stop 2024-03-30T13:08:37.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f942b485640 1 Processor -- start 2024-03-30T13:08:37.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f942b485640 1 -- start start 2024-03-30T13:08:37.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c8759e640 1 Processor -- start 2024-03-30T13:08:37.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c8759e640 1 -- start start 2024-03-30T13:08:37.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c8759e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c880ce7e0 0x7f9c881468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c8759e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 0x7f9c8806db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c8759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c8815d510 0x7f9c8815e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c8759e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88071bf0 con 0x7f9c8815d510 2024-03-30T13:08:37.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c8759e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88071a70 con 0x7f9c880ce7e0 2024-03-30T13:08:37.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c8759e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9c88071d70 con 0x7f9c880d1670 2024-03-30T13:08:37.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f5f20770640 1 -- 172.21.15.83:0/3050573550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f000052a0 con 0x7f5f180b5430 2024-03-30T13:08:37.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/471259508 shutdown_connections 2024-03-30T13:08:37.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f7d6c7c3640 1 --2- 172.21.15.83:0/471259508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d6415f410 0x7f7d641682e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f7d6c7c3640 1 --2- 172.21.15.83:0/471259508 >> v2:172.21.15.153:3300/0 conn(0x7f7d64071f20 0x7f7d640d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/471259508 >> 172.21.15.83:0/471259508 conn(0x7f7d6406b830 msgr2=0x7f7d6406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7fd2b91e5640 1 -- 172.21.15.83:0/2337843528 shutdown_connections 2024-03-30T13:08:37.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7fd2b91e5640 1 -- 172.21.15.83:0/2337843528 wait complete. 2024-03-30T13:08:37.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7fd2b91e5640 1 Processor -- start 2024-03-30T13:08:37.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c85d9b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 0x7f9c8806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c85d9b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 0x7f9c8806db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:41026/0 (socket says 172.21.15.83:41026) 2024-03-30T13:08:37.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c85d9b640 1 -- 172.21.15.83:0/1911798041 learned_addr learned my addr 172.21.15.83:0/1911798041 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:37.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f9c8659c640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c880ce7e0 0x7f9c881468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/471259508 shutdown_connections 2024-03-30T13:08:37.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53837fe640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5374004c60 0x7f5374005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9c85d9b640 1 -- 172.21.15.83:0/1911798041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c880ce7e0 msgr2=0x7f9c881468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9c85d9b640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c880ce7e0 0x7f9c881468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9c85d9b640 1 -- 172.21.15.83:0/1911798041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c8815d510 msgr2=0x7f9c8815e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9c85d9b640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c8815d510 0x7f9c8815e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9c85d9b640 1 -- 172.21.15.83:0/1911798041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8814fbf0 con 0x7f9c880d1670 2024-03-30T13:08:37.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f5382ffd640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53740055a0 0x7f5374003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f5383fff640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5374004140 0x7f53740045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f5f1e50c640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5efc068010 0x7f5efc06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53837fe640 1 -- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5374004140 msgr2=0x7f53740045c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53837fe640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5374004140 0x7f53740045c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53837fe640 1 -- 172.21.15.83:0/4241780703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53740055a0 msgr2=0x7f5374003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53837fe640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53740055a0 0x7f5374003c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9c85d9b640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 0x7f9c8806db30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800c3c0 tx=0x7f9c7800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7f53837fe640 1 -- 172.21.15.83:0/4241780703 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c03a550 con 0x7f5374004c60 2024-03-30T13:08:37.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9c76ffd640 1 -- 172.21.15.83:0/1911798041 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c78017070 con 0x7f9c880d1670 2024-03-30T13:08:37.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f53837fe640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5374004c60 0x7f5374005060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53700018c0 tx=0x7f537001c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc51955cef07365d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53700af070 con 0x7f5374004c60 2024-03-30T13:08:37.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53700052d0 con 0x7f5374004c60 2024-03-30T13:08:37.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f53827fc640 1 -- 172.21.15.83:0/4241780703 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370001510 con 0x7f5374004c60 2024-03-30T13:08:37.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9c8759e640 1 -- 172.21.15.83:0/1911798041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8806d050 con 0x7f9c880d1670 2024-03-30T13:08:37.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9c8759e640 1 -- 172.21.15.83:0/1911798041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c8806e070 con 0x7f9c880d1670 2024-03-30T13:08:37.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9c8759e640 1 -- 172.21.15.83:0/1911798041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c8804f900 con 0x7f9c880d1670 2024-03-30T13:08:37.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f5f1e50c640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5efc068010 0x7f5efc06a4d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f180ad890 tx=0x7f5f08009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9c76ffd640 1 -- 172.21.15.83:0/1911798041 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c78005cf0 con 0x7f9c880d1670 2024-03-30T13:08:37.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9c76ffd640 1 -- 172.21.15.83:0/1911798041 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c780072d0 con 0x7f9c880d1670 2024-03-30T13:08:37.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f5388bf2640 1 -- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5374004c60 msgr2=0x7f5374005060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f5388bf2640 1 --2- 172.21.15.83:0/4241780703 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5374004c60 0x7f5374005060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53700018c0 tx=0x7f537001c580 comp rx=0 tx=0).stop 2024-03-30T13:08:37.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f5383fff640 1 -- 172.21.15.83:0/4241780703 reap_dead start 2024-03-30T13:08:37.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f5388bf2640 1 -- 172.21.15.83:0/4241780703 shutdown_connections 2024-03-30T13:08:37.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f5388bf2640 1 -- 172.21.15.83:0/4241780703 >> 172.21.15.83:0/4241780703 conn(0x7f537c009fc0 msgr2=0x7f537c00a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f5388bf2640 1 -- 172.21.15.83:0/4241780703 shutdown_connections 2024-03-30T13:08:37.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f5388bf2640 1 -- 172.21.15.83:0/4241780703 wait complete. 2024-03-30T13:08:37.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/471259508 wait complete. 2024-03-30T13:08:37.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f7d6c7c3640 1 Processor -- start 2024-03-30T13:08:37.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f942b485640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94241627f0 0x7f9424071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f942b485640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f942406f910 con 0x7f9424072d80 2024-03-30T13:08:37.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f942b485640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9424071ce0 con 0x7f942406d510 2024-03-30T13:08:37.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f942b485640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f94240731e0 con 0x7f94241627f0 2024-03-30T13:08:37.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9429c82640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f9424072d80 0x7f9424162bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56422/0 (socket says 172.21.15.83:56422) 2024-03-30T13:08:37.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f9429c82640 1 -- 172.21.15.83:0/360131984 learned_addr learned my addr 172.21.15.83:0/360131984 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:37.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f942a483640 1 --2- 172.21.15.83:0/360131984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94241627f0 0x7f9424071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f942a483640 1 -- 172.21.15.83:0/360131984 >> v1:172.21.15.153:6789/0 conn(0x7f942406d510 legacy=0x7f94240b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f942a483640 1 -- 172.21.15.83:0/360131984 >> v1:172.21.15.83:6789/0 conn(0x7f9424072d80 legacy=0x7f9424162bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f942a483640 1 -- 172.21.15.83:0/360131984 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9424071fc0 con 0x7f94241627f0 2024-03-30T13:08:37.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.185+0000 7fd2b91e5640 1 -- start start 2024-03-30T13:08:37.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b91e5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd29c003b50 0x7fd2b41585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b91e5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2b40c9920 0x7fd2b40cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b91e5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b42008d0 0x7fd2b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b91e5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b40d01d0 con 0x7fd2b42008d0 2024-03-30T13:08:37.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b91e5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b40cf500 con 0x7fd29c003b50 2024-03-30T13:08:37.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b91e5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b40d0350 con 0x7fd2b40c9920 2024-03-30T13:08:37.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b259c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2b40c9920 0x7fd2b40cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b259c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2b40c9920 0x7fd2b40cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:41048/0 (socket says 172.21.15.83:41048) 2024-03-30T13:08:37.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b259c640 1 -- 172.21.15.83:0/4041421108 learned_addr learned my addr 172.21.15.83:0/4041421108 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:37.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b259c640 1 -- 172.21.15.83:0/4041421108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd29c003b50 msgr2=0x7fd2b41585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b259c640 1 --2- 172.21.15.83:0/4041421108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd29c003b50 0x7fd2b41585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b259c640 1 -- 172.21.15.83:0/4041421108 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b42008d0 msgr2=0x7fd2b406e2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T13:08:37.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b259c640 1 --2- 172.21.15.83:0/4041421108 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b42008d0 0x7fd2b406e2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b259c640 1 -- 172.21.15.83:0/4041421108 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b40cb2b0 con 0x7fd2b40c9920 2024-03-30T13:08:37.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7fd2b259c640 1 --2- 172.21.15.83:0/4041421108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2b40c9920 0x7fd2b40cc2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4011c00 tx=0x7fd2a400f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5388bf2640 1 Processor -- start 2024-03-30T13:08:37.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5388bf2640 1 -- start start 2024-03-30T13:08:37.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.189+0000 7f7d6c7c3640 1 -- start start 2024-03-30T13:08:37.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6c7c3640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d64071f20 0x7f7d6414d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6c7c3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d640d0880 0x7f7d64160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6c7c3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d6415f410 0x7f7d6414ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6c7c3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6416b040 con 0x7f7d640d0880 2024-03-30T13:08:37.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6c7c3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6415f830 con 0x7f7d6415f410 2024-03-30T13:08:37.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6c7c3640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d6416b1c0 con 0x7f7d64071f20 2024-03-30T13:08:37.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d69d5e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d640d0880 0x7f7d64160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6a55f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d64071f20 0x7f7d6414d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6ad60640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d6415f410 0x7f7d6414ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d69d5e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d640d0880 0x7f7d64160b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59418/0 (socket says 172.21.15.83:59418) 2024-03-30T13:08:37.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d69d5e640 1 -- 172.21.15.83:0/2977427933 learned_addr learned my addr 172.21.15.83:0/2977427933 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:37.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f942a483640 1 --2- 172.21.15.83:0/360131984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94241627f0 0x7f9424071670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f941c009dc0 tx=0x7f941c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77241a31e9d8eae8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6ad60640 1 -- 172.21.15.83:0/2977427933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d64071f20 msgr2=0x7f7d6414d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6ad60640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d64071f20 0x7f7d6414d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6ad60640 1 -- 172.21.15.83:0/2977427933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d640d0880 msgr2=0x7f7d64160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6ad60640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d640d0880 0x7f7d64160b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6ad60640 1 -- 172.21.15.83:0/2977427933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d64157b00 con 0x7f7d6415f410 2024-03-30T13:08:37.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d69d5e640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d640d0880 0x7f7d64160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:37.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5388bf2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5374004c60 0x7f537c0ecf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5388bf2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c0fdc70 0x7f537c0ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5388bf2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c102f80 0x7f537c103430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f9c76ffd640 1 -- 172.21.15.83:0/1911798041 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9c7801a070 con 0x7f9c880d1670 2024-03-30T13:08:37.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f7d6ad60640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d6415f410 0x7f7d6414ff90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7d600ab000 tx=0x7f7d600192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f53837fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5374004c60 0x7f537c0ecf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f53837fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5374004c60 0x7f537c0ecf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:59912/0 (socket says 172.21.15.83:59912) 2024-03-30T13:08:37.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5382ffd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c0fdc70 0x7f537c0ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5382ffd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c0fdc70 0x7f537c0ed440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:41066/0 (socket says 172.21.15.83:41066) 2024-03-30T13:08:37.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f9c76ffd640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9c68067fc0 0x7f9c6806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f9c76ffd640 1 -- 172.21.15.83:0/1911798041 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9c78085ca0 con 0x7f9c880d1670 2024-03-30T13:08:37.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f9c8659c640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9c68067fc0 0x7f9c6806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5388bf2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f537c0533d0 con 0x7f537c102f80 2024-03-30T13:08:37.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5388bf2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f537c053550 con 0x7f5374004c60 2024-03-30T13:08:37.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5388bf2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f537c04f870 con 0x7f537c0fdc70 2024-03-30T13:08:37.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f53837fe640 1 -- 172.21.15.83:0/2396996328 learned_addr learned my addr 172.21.15.83:0/2396996328 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:37.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5383fff640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c102f80 0x7f537c103430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f53837fe640 1 -- 172.21.15.83:0/2396996328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c0fdc70 msgr2=0x7f537c0ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f53837fe640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c0fdc70 0x7f537c0ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f53837fe640 1 -- 172.21.15.83:0/2396996328 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c102f80 msgr2=0x7f537c103430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f9c8659c640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9c68067fc0 0x7f9c6806a480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c880b1a30 tx=0x7f9c7c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f53837fe640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c102f80 0x7f537c103430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f53837fe640 1 -- 172.21.15.83:0/2396996328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c03a1b0 con 0x7f5374004c60 2024-03-30T13:08:37.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5382ffd640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c0fdc70 0x7f537c0ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:37.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f53837fe640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5374004c60 0x7f537c0ecf00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f537001c3b0 tx=0x7f5374005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f536ffff640 1 -- 172.21.15.83:0/2396996328 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53700ba070 con 0x7f5374004c60 2024-03-30T13:08:37.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f536ffff640 1 -- 172.21.15.83:0/2396996328 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5370003810 con 0x7f5374004c60 2024-03-30T13:08:37.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f536ffff640 1 -- 172.21.15.83:0/2396996328 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53700af040 con 0x7f5374004c60 2024-03-30T13:08:37.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5f0effd640 1 -- 172.21.15.83:0/3050573550 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5f14015fb0 con 0x7f5f180b5430 2024-03-30T13:08:37.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5e77e90640 1 Processor -- start 2024-03-30T13:08:37.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.193+0000 7f5e77e90640 1 -- start start 2024-03-30T13:08:37.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7fd29b7fe640 1 -- 172.21.15.83:0/4041421108 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4011cf0 con 0x7fd2b40c9920 2024-03-30T13:08:37.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7fd2b91e5640 1 -- 172.21.15.83:0/4041421108 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b40cc830 con 0x7fd2b40c9920 2024-03-30T13:08:37.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7fd2b91e5640 1 -- 172.21.15.83:0/4041421108 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b40cb830 con 0x7fd2b40c9920 2024-03-30T13:08:37.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5388bf2640 1 -- 172.21.15.83:0/2396996328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537c0e7a90 con 0x7f5374004c60 2024-03-30T13:08:37.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5388bf2640 1 -- 172.21.15.83:0/2396996328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f537c0e8050 con 0x7f5374004c60 2024-03-30T13:08:37.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7fd2b91e5640 1 -- 172.21.15.83:0/4041421108 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b4073790 con 0x7fd2b40c9920 2024-03-30T13:08:37.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e77e90640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7015b050 0x7f5e70073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e77e90640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5e7006f860 0x7f5e7015b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5388bf2640 1 -- 172.21.15.83:0/2396996328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f537c0089e0 con 0x7f5374004c60 2024-03-30T13:08:37.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e77e90640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e700b31e0 con 0x7f5e700b3ca0 2024-03-30T13:08:37.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e77e90640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f5e70073ab0 con 0x7f5e7006f860 2024-03-30T13:08:37.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e77e90640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5e700ad4f0 con 0x7f5e7015b050 2024-03-30T13:08:37.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e75c2c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7015b050 0x7f5e70073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e7542b640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5e700b3ca0 0x7f5e7006f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:56984/0 (socket says 172.21.15.83:56984) 2024-03-30T13:08:37.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e7542b640 1 -- 172.21.15.83:0/327274560 learned_addr learned my addr 172.21.15.83:0/327274560 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:37.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e7642d640 1 --2- 172.21.15.83:0/327274560 >> v2:172.21.15.83:3300/0 conn(0x7f5e7006f860 0x7f5e7015b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f536ffff640 1 -- 172.21.15.83:0/2396996328 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f53700bd070 con 0x7f5374004c60 2024-03-30T13:08:37.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f536ffff640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5368067ff0 0x7f536806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5382ffd640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5368067ff0 0x7f536806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f536ffff640 1 -- 172.21.15.83:0/2396996328 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5370120bc0 con 0x7f5374004c60 2024-03-30T13:08:37.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5382ffd640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5368067ff0 0x7f536806a4b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f537c0eaab0 tx=0x7f5378008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7fd29b7fe640 1 -- 172.21.15.83:0/4041421108 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a4011e90 con 0x7fd2b40c9920 2024-03-30T13:08:37.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7fd29b7fe640 1 -- 172.21.15.83:0/4041421108 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4022060 con 0x7fd2b40c9920 2024-03-30T13:08:37.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f9429481640 1 -- 172.21.15.83:0/360131984 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c0b2070 con 0x7f94241627f0 2024-03-30T13:08:37.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e75c2c640 1 -- 172.21.15.83:0/327274560 >> v2:172.21.15.83:3300/0 conn(0x7f5e7006f860 msgr2=0x7f5e7015b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e75c2c640 1 --2- 172.21.15.83:0/327274560 >> v2:172.21.15.83:3300/0 conn(0x7f5e7006f860 0x7f5e7015b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e75c2c640 1 -- 172.21.15.83:0/327274560 >> v1:172.21.15.153:6789/0 conn(0x7f5e700b3ca0 legacy=0x7f5e7006f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.197+0000 7f5e75c2c640 1 -- 172.21.15.83:0/327274560 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e700ad7d0 con 0x7f5e7015b050 2024-03-30T13:08:37.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7f9429481640 1 -- 172.21.15.83:0/360131984 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941c0a5970 con 0x7f94241627f0 2024-03-30T13:08:37.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7f9429481640 1 -- 172.21.15.83:0/360131984 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c0a5d80 con 0x7f94241627f0 2024-03-30T13:08:37.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7f9c76ffd640 1 -- 172.21.15.83:0/1911798041 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9c78055de0 con 0x7f9c880d1670 2024-03-30T13:08:37.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7f5e75c2c640 1 --2- 172.21.15.83:0/327274560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7015b050 0x7f5e70073570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0097c0 tx=0x7f5e6c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a7ce11daf4ce080 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7f942b485640 1 -- 172.21.15.83:0/360131984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94241627f0 msgr2=0x7f9424071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7f942b485640 1 --2- 172.21.15.83:0/360131984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94241627f0 0x7f9424071670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f941c009dc0 tx=0x7f941c01c8b0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7fd29b7fe640 1 -- 172.21.15.83:0/4041421108 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fd2a4012040 con 0x7fd2b40c9920 2024-03-30T13:08:37.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7fd29b7fe640 1 --2- 172.21.15.83:0/4041421108 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd2a0067fc0 0x7fd2a006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7fd2b2d9d640 1 --2- 172.21.15.83:0/4041421108 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd2a0067fc0 0x7fd2a006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7fd29b7fe640 1 -- 172.21.15.83:0/4041421108 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd2a4086e80 con 0x7fd2b40c9920 2024-03-30T13:08:37.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7fd2b2d9d640 1 --2- 172.21.15.83:0/4041421108 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd2a0067fc0 0x7fd2a006a480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80aa000 tx=0x7fd2a80012e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7f942b485640 1 -- 172.21.15.83:0/360131984 shutdown_connections 2024-03-30T13:08:37.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7f942b485640 1 --2- 172.21.15.83:0/360131984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94241627f0 0x7f9424071670 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.201+0000 7f942b485640 1 -- 172.21.15.83:0/360131984 >> 172.21.15.83:0/360131984 conn(0x7f94240b1b80 msgr2=0x7f94240b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f7d5affd640 1 -- 172.21.15.83:0/2977427933 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d600b0070 con 0x7f7d6415f410 2024-03-30T13:08:37.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/2977427933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d64157de0 con 0x7f7d6415f410 2024-03-30T13:08:37.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/2977427933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d641583a0 con 0x7f7d6415f410 2024-03-30T13:08:37.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f536ffff640 1 -- 172.21.15.83:0/2396996328 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5370016290 con 0x7f5374004c60 2024-03-30T13:08:37.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f942b485640 1 -- 172.21.15.83:0/360131984 shutdown_connections 2024-03-30T13:08:37.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f942b485640 1 -- 172.21.15.83:0/360131984 wait complete. 2024-03-30T13:08:37.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f7d5affd640 1 -- 172.21.15.83:0/2977427933 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d600b1040 con 0x7f7d6415f410 2024-03-30T13:08:37.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f7d5affd640 1 -- 172.21.15.83:0/2977427933 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d600aa810 con 0x7f7d6415f410 2024-03-30T13:08:37.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/2977427933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4c0052a0 con 0x7f7d6415f410 2024-03-30T13:08:37.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f942b485640 1 Processor -- start 2024-03-30T13:08:37.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f942b485640 1 -- start start 2024-03-30T13:08:37.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f7d5affd640 1 -- 172.21.15.83:0/2977427933 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f7d600aa9b0 con 0x7f7d6415f410 2024-03-30T13:08:37.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f7d5affd640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d48068010 0x7f7d4806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f7d5affd640 1 -- 172.21.15.83:0/2977427933 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7d6011fef0 con 0x7f7d6415f410 2024-03-30T13:08:37.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f942b485640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f942406d510 0x7f94240b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f942b485640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9424072d80 0x7f942409d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f942b485640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94241627f0 0x7f9424151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f942b485640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f94240b3df0 con 0x7f94241627f0 2024-03-30T13:08:37.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f942b485640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f942406ddb0 con 0x7f942406d510 2024-03-30T13:08:37.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f942b485640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f94240b3f70 con 0x7f9424072d80 2024-03-30T13:08:37.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f942ac84640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94241627f0 0x7f9424151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f942ac84640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94241627f0 0x7f9424151130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59438/0 (socket says 172.21.15.83:59438) 2024-03-30T13:08:37.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f942ac84640 1 -- 172.21.15.83:0/1103418546 learned_addr learned my addr 172.21.15.83:0/1103418546 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:37.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f9429c82640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9424072d80 0x7f942409d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f7d6a55f640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d48068010 0x7f7d4806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7fd29b7fe640 1 -- 172.21.15.83:0/4041421108 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fd2a4019070 con 0x7fd2b40c9920 2024-03-30T13:08:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f942a483640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f942406d510 0x7f94240b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f942ac84640 1 -- 172.21.15.83:0/1103418546 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9424072d80 msgr2=0x7f942409d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f942ac84640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9424072d80 0x7f942409d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f942ac84640 1 -- 172.21.15.83:0/1103418546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f942406d510 msgr2=0x7f94240b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f942ac84640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f942406d510 0x7f94240b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f942ac84640 1 -- 172.21.15.83:0/1103418546 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942409b840 con 0x7f94241627f0 2024-03-30T13:08:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f942a483640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f942406d510 0x7f94240b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f942ac84640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94241627f0 0x7f9424151130 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f942000c3c0 tx=0x7f942000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f7d6a55f640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d48068010 0x7f7d4806a4d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c003ab0 tx=0x7f7d5c009830 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f941affd640 1 -- 172.21.15.83:0/1103418546 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420011790 con 0x7f94241627f0 2024-03-30T13:08:37.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f941affd640 1 -- 172.21.15.83:0/1103418546 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9420017070 con 0x7f94241627f0 2024-03-30T13:08:37.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f941affd640 1 -- 172.21.15.83:0/1103418546 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420011b70 con 0x7f94241627f0 2024-03-30T13:08:37.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f5e74c2a640 1 -- 172.21.15.83:0/327274560 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0aa5f0 con 0x7f5e7015b050 2024-03-30T13:08:37.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.205+0000 7f5e74c2a640 1 -- 172.21.15.83:0/327274560 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e6c0af070 con 0x7f5e7015b050 2024-03-30T13:08:37.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.209+0000 7f5e74c2a640 1 -- 172.21.15.83:0/327274560 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0aa9f0 con 0x7f5e7015b050 2024-03-30T13:08:37.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f942b485640 1 -- 172.21.15.83:0/1103418546 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942409bb20 con 0x7f94241627f0 2024-03-30T13:08:37.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f942b485640 1 -- 172.21.15.83:0/1103418546 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9424164380 con 0x7f94241627f0 2024-03-30T13:08:37.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f5e77e90640 1 -- 172.21.15.83:0/327274560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7015b050 msgr2=0x7f5e70073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f5e77e90640 1 --2- 172.21.15.83:0/327274560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7015b050 0x7f5e70073570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0097c0 tx=0x7f5e6c01c490 comp rx=0 tx=0).stop 2024-03-30T13:08:37.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f5e77e90640 1 -- 172.21.15.83:0/327274560 shutdown_connections 2024-03-30T13:08:37.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f5e77e90640 1 --2- 172.21.15.83:0/327274560 >> v2:172.21.15.83:3300/0 conn(0x7f5e7006f860 0x7f5e7015b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f5e77e90640 1 --2- 172.21.15.83:0/327274560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7015b050 0x7f5e70073570 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0097c0 tx=0x7f5e6c01c490 comp rx=0 tx=0).stop 2024-03-30T13:08:37.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f5e77e90640 1 -- 172.21.15.83:0/327274560 >> 172.21.15.83:0/327274560 conn(0x7f5e7006b660 msgr2=0x7f5e7006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f942b485640 1 -- 172.21.15.83:0/1103418546 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f942404f900 con 0x7f94241627f0 2024-03-30T13:08:37.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f941affd640 1 -- 172.21.15.83:0/1103418546 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9420011d10 con 0x7f94241627f0 2024-03-30T13:08:37.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f5e77e90640 1 -- 172.21.15.83:0/327274560 shutdown_connections 2024-03-30T13:08:37.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f7d5affd640 1 -- 172.21.15.83:0/2977427933 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f7d60016110 con 0x7f7d6415f410 2024-03-30T13:08:37.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f5e77e90640 1 -- 172.21.15.83:0/327274560 wait complete. 2024-03-30T13:08:37.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f941affd640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f94080680c0 0x7f940806a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f941affd640 1 -- 172.21.15.83:0/1103418546 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9420086d40 con 0x7f94241627f0 2024-03-30T13:08:37.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.213+0000 7f942a483640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f94080680c0 0x7f940806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f942a483640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f94080680c0 0x7f940806a580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f941c0af000 tx=0x7f941c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e77e90640 1 Processor -- start 2024-03-30T13:08:37.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e77e90640 1 -- start start 2024-03-30T13:08:37.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e77e90640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7006f860 0x7f5e701519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e77e90640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e700b3ca0 0x7f5e7014c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e77e90640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e7014cd80 0x7f5e70099590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e77e90640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5e700b4d90 con 0x7f5e700b3ca0 2024-03-30T13:08:37.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e75c2c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7006f860 0x7f5e701519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e75c2c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7006f860 0x7f5e701519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:41086/0 (socket says 172.21.15.83:41086) 2024-03-30T13:08:37.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e75c2c640 1 -- 172.21.15.83:0/1763955538 learned_addr learned my addr 172.21.15.83:0/1763955538 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:37.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e7542b640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e700b3ca0 0x7f5e7014c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e7642d640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e7014cd80 0x7f5e70099590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e77e90640 1 -- 172.21.15.83:0/1763955538 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5e700b4c10 con 0x7f5e7014cd80 2024-03-30T13:08:37.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e77e90640 1 -- 172.21.15.83:0/1763955538 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5e700b4080 con 0x7f5e7006f860 2024-03-30T13:08:37.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e75c2c640 1 -- 172.21.15.83:0/1763955538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e7014cd80 msgr2=0x7f5e70099590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e75c2c640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e7014cd80 0x7f5e70099590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e75c2c640 1 -- 172.21.15.83:0/1763955538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e700b3ca0 msgr2=0x7f5e7014c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e75c2c640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e700b3ca0 0x7f5e7014c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.217+0000 7f5e75c2c640 1 -- 172.21.15.83:0/1763955538 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e700b0b70 con 0x7f5e7006f860 2024-03-30T13:08:37.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.221+0000 7f5e75c2c640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7006f860 0x7f5e701519b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0190a0 tx=0x7f5e6c01acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.221+0000 7f941affd640 1 -- 172.21.15.83:0/1103418546 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9420057560 con 0x7f94241627f0 2024-03-30T13:08:37.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.221+0000 7f5e667fc640 1 -- 172.21.15.83:0/1763955538 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c006e20 con 0x7f5e7006f860 2024-03-30T13:08:37.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.225+0000 7f5e667fc640 1 -- 172.21.15.83:0/1763955538 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e6c0be610 con 0x7f5e7006f860 2024-03-30T13:08:37.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.237+0000 7f5e667fc640 1 -- 172.21.15.83:0/1763955538 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0bea00 con 0x7f5e7006f860 2024-03-30T13:08:37.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.237+0000 7f5e77e90640 1 -- 172.21.15.83:0/1763955538 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e700afdf0 con 0x7f5e7006f860 2024-03-30T13:08:37.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.237+0000 7f5e77e90640 1 -- 172.21.15.83:0/1763955538 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e700b0370 con 0x7f5e7006f860 2024-03-30T13:08:37.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.237+0000 7f5e667fc640 1 -- 172.21.15.83:0/1763955538 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5e6c0bc020 con 0x7f5e7006f860 2024-03-30T13:08:37.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.237+0000 7f5e667fc640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5e5c068150 0x7f5e5c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.237+0000 7f5e667fc640 1 -- 172.21.15.83:0/1763955538 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5e6c120700 con 0x7f5e7006f860 2024-03-30T13:08:37.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.237+0000 7f5e7542b640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5e5c068150 0x7f5e5c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.241+0000 7f5e7542b640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5e5c068150 0x7f5e5c06a610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e7015a080 tx=0x7f5e60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.249+0000 7f5e53fff640 1 -- 172.21.15.83:0/1763955538 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e7009e540 con 0x7f5e7006f860 2024-03-30T13:08:37.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.261+0000 7f5e667fc640 1 -- 172.21.15.83:0/1763955538 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5e6c11ee20 con 0x7f5e7006f860 2024-03-30T13:08:37.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.477+0000 7f4c26ef3640 1 -- 172.21.15.83:0/2861914071 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4c00005860 con 0x7f4c200b3170 2024-03-30T13:08:37.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.477+0000 7f4c1d7fa640 1 -- 172.21.15.83:0/2861914071 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4c1805a9d0 con 0x7f4c200b3170 2024-03-30T13:08:37.485 INFO:teuthology.orchestra.run.smithi083.stdout:64424509447 2024-03-30T13:08:37.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.477+0000 7f4c06ffd640 1 -- 172.21.15.83:0/2861914071 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4c0c067fc0 msgr2=0x7f4c0c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.477+0000 7f4c06ffd640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4c0c067fc0 0x7f4c0c06a480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c140af000 tx=0x7f4c140a7000 comp rx=0 tx=0).stop 2024-03-30T13:08:37.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.477+0000 7f4c06ffd640 1 -- 172.21.15.83:0/2861914071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c200b3170 msgr2=0x7f4c2015d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.481+0000 7f4c06ffd640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c200b3170 0x7f4c2015d500 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800cad0 tx=0x7f4c1800cf90 comp rx=0 tx=0).stop 2024-03-30T13:08:37.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.481+0000 7f4c06ffd640 1 -- 172.21.15.83:0/2861914071 shutdown_connections 2024-03-30T13:08:37.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.481+0000 7f4c06ffd640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4c0c067fc0 0x7f4c0c06a480 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.481+0000 7f4c06ffd640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c2015a370 0x7f4c200cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.481+0000 7f4c06ffd640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c200b3170 0x7f4c2015d500 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.481+0000 7f4c06ffd640 1 --2- 172.21.15.83:0/2861914071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c20073240 0x7f4c2016bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.481+0000 7f4c06ffd640 1 -- 172.21.15.83:0/2861914071 >> 172.21.15.83:0/2861914071 conn(0x7f4c200b5690 msgr2=0x7f4c200b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.481+0000 7f4c06ffd640 1 -- 172.21.15.83:0/2861914071 shutdown_connections 2024-03-30T13:08:37.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.481+0000 7f4c06ffd640 1 -- 172.21.15.83:0/2861914071 wait complete. 2024-03-30T13:08:37.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.497+0000 7fd2b91e5640 1 -- 172.21.15.83:0/4041421108 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd2b404f9e0 con 0x7fd2b40c9920 2024-03-30T13:08:37.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.497+0000 7fd29b7fe640 1 -- 172.21.15.83:0/4041421108 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd2a40575f0 con 0x7fd2b40c9920 2024-03-30T13:08:37.505 INFO:teuthology.orchestra.run.smithi083.stdout:55834574855 2024-03-30T13:08:37.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-03-30T13:08:37.507 DEBUG:teuthology.parallel:result is None 2024-03-30T13:08:37.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.501+0000 7fd2b91e5640 1 -- 172.21.15.83:0/4041421108 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd2a0067fc0 msgr2=0x7fd2a006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.501+0000 7fd2b91e5640 1 --2- 172.21.15.83:0/4041421108 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd2a0067fc0 0x7fd2a006a480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80aa000 tx=0x7fd2a80012e0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.501+0000 7fd2b91e5640 1 -- 172.21.15.83:0/4041421108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2b40c9920 msgr2=0x7fd2b40cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.501+0000 7fd2b91e5640 1 --2- 172.21.15.83:0/4041421108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2b40c9920 0x7fd2b40cc2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4011c00 tx=0x7fd2a400f610 comp rx=0 tx=0).stop 2024-03-30T13:08:37.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.501+0000 7fd2b91e5640 1 -- 172.21.15.83:0/4041421108 shutdown_connections 2024-03-30T13:08:37.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.501+0000 7fd2b91e5640 1 --2- 172.21.15.83:0/4041421108 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd2a0067fc0 0x7fd2a006a480 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.501+0000 7fd2b91e5640 1 --2- 172.21.15.83:0/4041421108 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b42008d0 0x7fd2b406e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.501+0000 7fd2b91e5640 1 --2- 172.21.15.83:0/4041421108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2b40c9920 0x7fd2b40cc2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.501+0000 7fd2b91e5640 1 --2- 172.21.15.83:0/4041421108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd29c003b50 0x7fd2b41585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.501+0000 7fd2b91e5640 1 -- 172.21.15.83:0/4041421108 >> 172.21.15.83:0/4041421108 conn(0x7fd2b4072ec0 msgr2=0x7fd2b415f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.501+0000 7fd2b91e5640 1 -- 172.21.15.83:0/4041421108 shutdown_connections 2024-03-30T13:08:37.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.501+0000 7fd2b91e5640 1 -- 172.21.15.83:0/4041421108 wait complete. 2024-03-30T13:08:37.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 -- 172.21.15.83:0/2396996328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f537c0053a0 con 0x7f5374004c60 2024-03-30T13:08:37.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f536ffff640 1 -- 172.21.15.83:0/2396996328 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f53700f0d90 con 0x7f5374004c60 2024-03-30T13:08:37.514 INFO:teuthology.orchestra.run.smithi083.stdout:64424509448 2024-03-30T13:08:37.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 -- 172.21.15.83:0/2396996328 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5368067ff0 msgr2=0x7f536806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5368067ff0 0x7f536806a4b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f537c0eaab0 tx=0x7f5378008040 comp rx=0 tx=0).stop 2024-03-30T13:08:37.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 -- 172.21.15.83:0/2396996328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5374004c60 msgr2=0x7f537c0ecf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5374004c60 0x7f537c0ecf00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f537001c3b0 tx=0x7f5374005c90 comp rx=0 tx=0).stop 2024-03-30T13:08:37.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 -- 172.21.15.83:0/2396996328 shutdown_connections 2024-03-30T13:08:37.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5368067ff0 0x7f536806a4b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c102f80 0x7f537c103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c0fdc70 0x7f537c0ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 --2- 172.21.15.83:0/2396996328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5374004c60 0x7f537c0ecf00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 -- 172.21.15.83:0/2396996328 >> 172.21.15.83:0/2396996328 conn(0x7f537c009fc0 msgr2=0x7f537c04d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 -- 172.21.15.83:0/2396996328 shutdown_connections 2024-03-30T13:08:37.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.509+0000 7f5388bf2640 1 -- 172.21.15.83:0/2396996328 wait complete. 2024-03-30T13:08:37.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.525+0000 7f9c8759e640 1 -- 172.21.15.83:0/1911798041 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9c881541b0 con 0x7f9c880d1670 2024-03-30T13:08:37.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.525+0000 7f9c76ffd640 1 -- 172.21.15.83:0/1911798041 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9c7805a0e0 con 0x7f9c880d1670 2024-03-30T13:08:37.531 INFO:teuthology.orchestra.run.smithi083.stdout:64424509449 2024-03-30T13:08:37.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-03-30T13:08:37.534 DEBUG:teuthology.parallel:result is None 2024-03-30T13:08:37.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.529+0000 7f9c8759e640 1 -- 172.21.15.83:0/1911798041 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9c68067fc0 msgr2=0x7f9c6806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.529+0000 7f9c8759e640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9c68067fc0 0x7f9c6806a480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c880b1a30 tx=0x7f9c7c009190 comp rx=0 tx=0).stop 2024-03-30T13:08:37.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.529+0000 7f9c8759e640 1 -- 172.21.15.83:0/1911798041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 msgr2=0x7f9c8806db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.529+0000 7f9c8759e640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 0x7f9c8806db30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800c3c0 tx=0x7f9c7800c880 comp rx=0 tx=0).stop 2024-03-30T13:08:37.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.529+0000 7f9c8759e640 1 -- 172.21.15.83:0/1911798041 shutdown_connections 2024-03-30T13:08:37.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.529+0000 7f9c8759e640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9c68067fc0 0x7f9c6806a480 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.529+0000 7f9c8759e640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c8815d510 0x7f9c8815e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.529+0000 7f9c8759e640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c880d1670 0x7f9c8806db30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.529+0000 7f9c8759e640 1 --2- 172.21.15.83:0/1911798041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c880ce7e0 0x7f9c881468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.529+0000 7f9c8759e640 1 -- 172.21.15.83:0/1911798041 >> 172.21.15.83:0/1911798041 conn(0x7f9c88067540 msgr2=0x7f9c880d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.529+0000 7f9c8759e640 1 -- 172.21.15.83:0/1911798041 shutdown_connections 2024-03-30T13:08:37.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.529+0000 7f9c8759e640 1 -- 172.21.15.83:0/1911798041 wait complete. 2024-03-30T13:08:37.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-03-30T13:08:37.536 DEBUG:teuthology.parallel:result is None 2024-03-30T13:08:37.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/2977427933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7d4c005860 con 0x7f7d6415f410 2024-03-30T13:08:37.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f7d5affd640 1 -- 172.21.15.83:0/2977427933 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7d600f01c0 con 0x7f7d6415f410 2024-03-30T13:08:37.542 INFO:teuthology.orchestra.run.smithi083.stdout:55834574855 2024-03-30T13:08:37.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f5f20770640 1 -- 172.21.15.83:0/3050573550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5f00005860 con 0x7f5f180b5430 2024-03-30T13:08:37.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f5f0effd640 1 -- 172.21.15.83:0/3050573550 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f140f0690 con 0x7f5f180b5430 2024-03-30T13:08:37.544 INFO:teuthology.orchestra.run.smithi083.stdout:64424509446 2024-03-30T13:08:37.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f942b485640 1 -- 172.21.15.83:0/1103418546 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f94240af290 con 0x7f94241627f0 2024-03-30T13:08:37.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/2977427933 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d48068010 msgr2=0x7f7d4806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f7d6c7c3640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d48068010 0x7f7d4806a4d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c003ab0 tx=0x7f7d5c009830 comp rx=0 tx=0).stop 2024-03-30T13:08:37.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/2977427933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d6415f410 msgr2=0x7f7d6414ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f7d6c7c3640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d6415f410 0x7f7d6414ff90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7d600ab000 tx=0x7f7d600192c0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/2977427933 shutdown_connections 2024-03-30T13:08:37.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f7d6c7c3640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d48068010 0x7f7d4806a4d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f7d6c7c3640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d6415f410 0x7f7d6414ff90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f7d6c7c3640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d640d0880 0x7f7d64160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.537+0000 7f7d6c7c3640 1 --2- 172.21.15.83:0/2977427933 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d64071f20 0x7f7d6414d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/2977427933 >> 172.21.15.83:0/2977427933 conn(0x7f7d6406b830 msgr2=0x7f7d6406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/2977427933 shutdown_connections 2024-03-30T13:08:37.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f941affd640 1 -- 172.21.15.83:0/1103418546 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9420056e60 con 0x7f94241627f0 2024-03-30T13:08:37.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f7d6c7c3640 1 -- 172.21.15.83:0/2977427933 wait complete. 2024-03-30T13:08:37.547 INFO:teuthology.orchestra.run.smithi083.stdout:64424509447 2024-03-30T13:08:37.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f5f20770640 1 -- 172.21.15.83:0/3050573550 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5efc068010 msgr2=0x7f5efc06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f5f20770640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5efc068010 0x7f5efc06a4d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f180ad890 tx=0x7f5f08009190 comp rx=0 tx=0).stop 2024-03-30T13:08:37.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f5f20770640 1 -- 172.21.15.83:0/3050573550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f180b5430 msgr2=0x7f5f181e85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f5f20770640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f180b5430 0x7f5f181e85c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5f140ae040 tx=0x7f5f140190d0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f5f20770640 1 -- 172.21.15.83:0/3050573550 shutdown_connections 2024-03-30T13:08:37.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f5f20770640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5efc068010 0x7f5efc06a4d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f5f20770640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f1815e5d0 0x7f5f181e8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f5f20770640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f180b5430 0x7f5f181e85c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f5f20770640 1 --2- 172.21.15.83:0/3050573550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f180b4fd0 0x7f5f18160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f5f20770640 1 -- 172.21.15.83:0/3050573550 >> 172.21.15.83:0/3050573550 conn(0x7f5f18072ec0 msgr2=0x7f5f180b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f5f20770640 1 -- 172.21.15.83:0/3050573550 shutdown_connections 2024-03-30T13:08:37.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f5f20770640 1 -- 172.21.15.83:0/3050573550 wait complete. 2024-03-30T13:08:37.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f942b485640 1 -- 172.21.15.83:0/1103418546 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f94080680c0 msgr2=0x7f940806a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f942b485640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f94080680c0 0x7f940806a580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f941c0af000 tx=0x7f941c0a7070 comp rx=0 tx=0).stop 2024-03-30T13:08:37.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f942b485640 1 -- 172.21.15.83:0/1103418546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94241627f0 msgr2=0x7f9424151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f942b485640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94241627f0 0x7f9424151130 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f942000c3c0 tx=0x7f942000c880 comp rx=0 tx=0).stop 2024-03-30T13:08:37.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f942b485640 1 -- 172.21.15.83:0/1103418546 shutdown_connections 2024-03-30T13:08:37.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f942b485640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f94080680c0 0x7f940806a580 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f942b485640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94241627f0 0x7f9424151130 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f942b485640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9424072d80 0x7f942409d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f942b485640 1 --2- 172.21.15.83:0/1103418546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f942406d510 0x7f94240b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f942b485640 1 -- 172.21.15.83:0/1103418546 >> 172.21.15.83:0/1103418546 conn(0x7f94240b1b80 msgr2=0x7f94240b4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f942b485640 1 -- 172.21.15.83:0/1103418546 shutdown_connections 2024-03-30T13:08:37.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.541+0000 7f942b485640 1 -- 172.21.15.83:0/1103418546 wait complete. 2024-03-30T13:08:37.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-03-30T13:08:37.558 DEBUG:teuthology.parallel:result is None 2024-03-30T13:08:37.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-03-30T13:08:37.568 DEBUG:teuthology.parallel:result is None 2024-03-30T13:08:37.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-03-30T13:08:37.570 DEBUG:teuthology.parallel:result is None 2024-03-30T13:08:37.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-03-30T13:08:37.574 DEBUG:teuthology.parallel:result is None 2024-03-30T13:08:37.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.573+0000 7f5e53fff640 1 -- 172.21.15.83:0/1763955538 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5e7015e4c0 con 0x7f5e7006f860 2024-03-30T13:08:37.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.573+0000 7f5e667fc640 1 -- 172.21.15.83:0/1763955538 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5e6c0160b0 con 0x7f5e7006f860 2024-03-30T13:08:37.580 INFO:teuthology.orchestra.run.smithi083.stdout:64424509448 2024-03-30T13:08:37.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.577+0000 7f5e53fff640 1 -- 172.21.15.83:0/1763955538 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5e5c068150 msgr2=0x7f5e5c06a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.577+0000 7f5e53fff640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5e5c068150 0x7f5e5c06a610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e7015a080 tx=0x7f5e60009040 comp rx=0 tx=0).stop 2024-03-30T13:08:37.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.577+0000 7f5e53fff640 1 -- 172.21.15.83:0/1763955538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7006f860 msgr2=0x7f5e701519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.577+0000 7f5e53fff640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7006f860 0x7f5e701519b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0190a0 tx=0x7f5e6c01acd0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.577+0000 7f5e53fff640 1 -- 172.21.15.83:0/1763955538 shutdown_connections 2024-03-30T13:08:37.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.577+0000 7f5e53fff640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5e5c068150 0x7f5e5c06a610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.577+0000 7f5e53fff640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e7014cd80 0x7f5e70099590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.577+0000 7f5e53fff640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e700b3ca0 0x7f5e7014c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.577+0000 7f5e53fff640 1 --2- 172.21.15.83:0/1763955538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5e7006f860 0x7f5e701519b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.577+0000 7f5e53fff640 1 -- 172.21.15.83:0/1763955538 >> 172.21.15.83:0/1763955538 conn(0x7f5e7006b660 msgr2=0x7f5e701551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.577+0000 7f5e53fff640 1 -- 172.21.15.83:0/1763955538 shutdown_connections 2024-03-30T13:08:37.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.577+0000 7f5e53fff640 1 -- 172.21.15.83:0/1763955538 wait complete. 2024-03-30T13:08:37.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-03-30T13:08:37.597 DEBUG:teuthology.parallel:result is None 2024-03-30T13:08:37.597 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-30T13:08:37.597 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:08:37.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.737+0000 7f814d778640 1 Processor -- start 2024-03-30T13:08:37.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.737+0000 7f814d778640 1 -- start start 2024-03-30T13:08:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f81480aed20 0x7f81480af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f814806dfe0 0x7f814806e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81480cfcb0 con 0x7f81480b4830 2024-03-30T13:08:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f8148156e00 con 0x7f81480aed20 2024-03-30T13:08:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f81480ad040 con 0x7f814806dfe0 2024-03-30T13:08:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f81467fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f81480aed20 0x7f81480af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f81467fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f81480aed20 0x7f81480af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59464/0 (socket says 172.21.15.83:59464) 2024-03-30T13:08:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f81467fc640 1 -- 172.21.15.83:0/165343876 learned_addr learned my addr 172.21.15.83:0/165343876 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f81477fe640 1 --2- 172.21.15.83:0/165343876 >> v2:172.21.15.153:3300/0 conn(0x7f814806dfe0 0x7f814806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f81467fc640 1 -- 172.21.15.83:0/165343876 >> v2:172.21.15.153:3300/0 conn(0x7f814806dfe0 msgr2=0x7f814806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:37.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f81467fc640 1 --2- 172.21.15.83:0/165343876 >> v2:172.21.15.153:3300/0 conn(0x7f814806dfe0 0x7f814806e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f81467fc640 1 -- 172.21.15.83:0/165343876 >> v1:172.21.15.153:6789/0 conn(0x7f81480b4830 legacy=0x7f814815d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f81467fc640 1 -- 172.21.15.83:0/165343876 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81480ad290 con 0x7f81480aed20 2024-03-30T13:08:37.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f81467fc640 1 --2- 172.21.15.83:0/165343876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81480aed20 0x7f81480af1d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8148073d60 tx=0x7f813c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28381e34d7ae453a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f8145ffb640 1 -- 172.21.15.83:0/165343876 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c0b1070 con 0x7f81480aed20 2024-03-30T13:08:37.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f8145ffb640 1 -- 172.21.15.83:0/165343876 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813c0ac630 con 0x7f81480aed20 2024-03-30T13:08:37.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f8145ffb640 1 -- 172.21.15.83:0/165343876 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c0a8050 con 0x7f81480aed20 2024-03-30T13:08:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 -- 172.21.15.83:0/165343876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81480aed20 msgr2=0x7f81480af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 --2- 172.21.15.83:0/165343876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81480aed20 0x7f81480af1d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8148073d60 tx=0x7f813c01c3d0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 -- 172.21.15.83:0/165343876 shutdown_connections 2024-03-30T13:08:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 --2- 172.21.15.83:0/165343876 >> v2:172.21.15.153:3300/0 conn(0x7f814806dfe0 0x7f814806e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 --2- 172.21.15.83:0/165343876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81480aed20 0x7f81480af1d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 -- 172.21.15.83:0/165343876 >> 172.21.15.83:0/165343876 conn(0x7f81480b1d60 msgr2=0x7f81480b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 -- 172.21.15.83:0/165343876 shutdown_connections 2024-03-30T13:08:37.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.741+0000 7f814d778640 1 -- 172.21.15.83:0/165343876 wait complete. 2024-03-30T13:08:37.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f814d778640 1 Processor -- start 2024-03-30T13:08:37.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f814d778640 1 -- start start 2024-03-30T13:08:37.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f814d778640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f814806dfe0 0x7f81481520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f814d778640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81480aed20 0x7f81481561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f814d778640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81480b4830 0x7f81481566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f814d778640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f81480cf860 con 0x7f81480aed20 2024-03-30T13:08:37.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f814d778640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f814806fa90 con 0x7f814806dfe0 2024-03-30T13:08:37.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f814d778640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f81480cf9e0 con 0x7f81480b4830 2024-03-30T13:08:37.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f81467fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81480aed20 0x7f81481561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f81467fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81480aed20 0x7f81481561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59474/0 (socket says 172.21.15.83:59474) 2024-03-30T13:08:37.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f81467fc640 1 -- 172.21.15.83:0/4123016166 learned_addr learned my addr 172.21.15.83:0/4123016166 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f81477fe640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81480b4830 0x7f81481566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f8146ffd640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f814806dfe0 0x7f81481520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f81467fc640 1 -- 172.21.15.83:0/4123016166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81480b4830 msgr2=0x7f81481566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f81467fc640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81480b4830 0x7f81481566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f81467fc640 1 -- 172.21.15.83:0/4123016166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f814806dfe0 msgr2=0x7f81481520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f81467fc640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f814806dfe0 0x7f81481520b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f81467fc640 1 -- 172.21.15.83:0/4123016166 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81481fad80 con 0x7f81480aed20 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f81477fe640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81480b4830 0x7f81481566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f81467fc640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81480aed20 0x7f81481561b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f813c018fe0 tx=0x7f813c019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f812f7fe640 1 -- 172.21.15.83:0/4123016166 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c0b1040 con 0x7f81480aed20 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f812f7fe640 1 -- 172.21.15.83:0/4123016166 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813c0ba070 con 0x7f81480aed20 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f814d778640 1 -- 172.21.15.83:0/4123016166 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81481fb060 con 0x7f81480aed20 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f812f7fe640 1 -- 172.21.15.83:0/4123016166 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c0b5680 con 0x7f81480aed20 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f814d778640 1 -- 172.21.15.83:0/4123016166 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81481fb620 con 0x7f81480aed20 2024-03-30T13:08:37.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f814d778640 1 -- 172.21.15.83:0/4123016166 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81480686c0 con 0x7f81480aed20 2024-03-30T13:08:37.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.745+0000 7f812f7fe640 1 -- 172.21.15.83:0/4123016166 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f813c0b5820 con 0x7f81480aed20 2024-03-30T13:08:37.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.749+0000 7f812f7fe640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8134067fc0 0x7f813406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:37.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.749+0000 7f812f7fe640 1 -- 172.21.15.83:0/4123016166 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f813c11fff0 con 0x7f81480aed20 2024-03-30T13:08:37.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.749+0000 7f8146ffd640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8134067fc0 0x7f813406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:37.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.749+0000 7f8146ffd640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8134067fc0 0x7f813406a480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8138007fd0 tx=0x7f8138009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:37.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.753+0000 7f812f7fe640 1 -- 172.21.15.83:0/4123016166 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f813c016110 con 0x7f81480aed20 2024-03-30T13:08:37.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.893+0000 7f814d778640 1 -- 172.21.15.83:0/4123016166 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f814809e1d0 con 0x7f8134067fc0 2024-03-30T13:08:37.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f812f7fe640 1 -- 172.21.15.83:0/4123016166 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f813800d4a0 con 0x7f8134067fc0 2024-03-30T13:08:37.919 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:37.921 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:08:37.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f814d778640 1 -- 172.21.15.83:0/4123016166 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8134067fc0 msgr2=0x7f813406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f814d778640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8134067fc0 0x7f813406a480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8138007fd0 tx=0x7f8138009040 comp rx=0 tx=0).stop 2024-03-30T13:08:37.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f814d778640 1 -- 172.21.15.83:0/4123016166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81480aed20 msgr2=0x7f81481561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:37.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f814d778640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81480aed20 0x7f81481561b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f813c018fe0 tx=0x7f813c019170 comp rx=0 tx=0).stop 2024-03-30T13:08:37.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f814d778640 1 -- 172.21.15.83:0/4123016166 shutdown_connections 2024-03-30T13:08:37.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f814d778640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8134067fc0 0x7f813406a480 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f814d778640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81480b4830 0x7f81481566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f814d778640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81480aed20 0x7f81481561b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f814d778640 1 --2- 172.21.15.83:0/4123016166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f814806dfe0 0x7f81481520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:37.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f814d778640 1 -- 172.21.15.83:0/4123016166 >> 172.21.15.83:0/4123016166 conn(0x7f81480b1d60 msgr2=0x7f814815d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:37.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f814d778640 1 -- 172.21.15.83:0/4123016166 shutdown_connections 2024-03-30T13:08:37.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:37.913+0000 7f814d778640 1 -- 172.21.15.83:0/4123016166 wait complete. 2024-03-30T13:08:37.936 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-03-30T13:08:36.144176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2924544,"data_stored":1770620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.913451"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847699+0000","last_change":"2024-03-30T13:08:26.268523+0000","last_active":"2024-03-30T13:08:27.847699+0000","last_peered":"2024-03-30T13:08:27.847699+0000","last_clean":"2024-03-30T13:08:27.847699+0000","last_became_active":"2024-03-30T13:08:26.267614+0000","last_became_peered":"2024-03-30T13:08:26.267614+0000","last_unstale":"2024-03-30T13:08:27.847699+0000","last_undegraded":"2024-03-30T13:08:27.847699+0000","last_fullsized":"2024-03-30T13:08:27.847699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:07.743621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246696+0000","last_change":"2024-03-30T13:08:26.263035+0000","last_active":"2024-03-30T13:08:27.246696+0000","last_peered":"2024-03-30T13:08:27.246696+0000","last_clean":"2024-03-30T13:08:27.246696+0000","last_became_active":"2024-03-30T13:08:26.262669+0000","last_became_peered":"2024-03-30T13:08:26.262669+0000","last_unstale":"2024-03-30T13:08:27.246696+0000","last_undegraded":"2024-03-30T13:08:27.246696+0000","last_fullsized":"2024-03-30T13:08:27.246696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433514+0000","last_change":"2024-03-30T13:08:26.247241+0000","last_active":"2024-03-30T13:08:27.433514+0000","last_peered":"2024-03-30T13:08:27.433514+0000","last_clean":"2024-03-30T13:08:27.433514+0000","last_became_active":"2024-03-30T13:08:26.246633+0000","last_became_peered":"2024-03-30T13:08:26.246633+0000","last_unstale":"2024-03-30T13:08:27.433514+0000","last_undegraded":"2024-03-30T13:08:27.433514+0000","last_fullsized":"2024-03-30T13:08:27.433514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247342+0000","last_change":"2024-03-30T13:08:26.267093+0000","last_active":"2024-03-30T13:08:27.247342+0000","last_peered":"2024-03-30T13:08:27.247342+0000","last_clean":"2024-03-30T13:08:27.247342+0000","last_became_active":"2024-03-30T13:08:26.266648+0000","last_became_peered":"2024-03-30T13:08:26.266648+0000","last_unstale":"2024-03-30T13:08:27.247342+0000","last_undegraded":"2024-03-30T13:08:27.247342+0000","last_fullsized":"2024-03-30T13:08:27.247342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847414+0000","last_change":"2024-03-30T13:08:26.268233+0000","last_active":"2024-03-30T13:08:27.847414+0000","last_peered":"2024-03-30T13:08:27.847414+0000","last_clean":"2024-03-30T13:08:27.847414+0000","last_became_active":"2024-03-30T13:08:26.267934+0000","last_became_peered":"2024-03-30T13:08:26.267934+0000","last_unstale":"2024-03-30T13:08:27.847414+0000","last_undegraded":"2024-03-30T13:08:27.847414+0000","last_fullsized":"2024-03-30T13:08:27.847414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:33.096715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247522+0000","last_change":"2024-03-30T13:08:26.262334+0000","last_active":"2024-03-30T13:08:27.247522+0000","last_peered":"2024-03-30T13:08:27.247522+0000","last_clean":"2024-03-30T13:08:27.247522+0000","last_became_active":"2024-03-30T13:08:26.262065+0000","last_became_peered":"2024-03-30T13:08:26.262065+0000","last_unstale":"2024-03-30T13:08:27.247522+0000","last_undegraded":"2024-03-30T13:08:27.247522+0000","last_fullsized":"2024-03-30T13:08:27.247522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:38.839595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847119+0000","last_change":"2024-03-30T13:08:26.266561+0000","last_active":"2024-03-30T13:08:27.847119+0000","last_peered":"2024-03-30T13:08:27.847119+0000","last_clean":"2024-03-30T13:08:27.847119+0000","last_became_active":"2024-03-30T13:08:26.266102+0000","last_became_peered":"2024-03-30T13:08:26.266102+0000","last_unstale":"2024-03-30T13:08:27.847119+0000","last_undegraded":"2024-03-30T13:08:27.847119+0000","last_fullsized":"2024-03-30T13:08:27.847119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846133+0000","last_change":"2024-03-30T13:08:26.260829+0000","last_active":"2024-03-30T13:08:27.846133+0000","last_peered":"2024-03-30T13:08:27.846133+0000","last_clean":"2024-03-30T13:08:27.846133+0000","last_became_active":"2024-03-30T13:08:26.254325+0000","last_became_peered":"2024-03-30T13:08:26.254325+0000","last_unstale":"2024-03-30T13:08:27.846133+0000","last_undegraded":"2024-03-30T13:08:27.846133+0000","last_fullsized":"2024-03-30T13:08:27.846133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:06:18.572457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847837+0000","last_change":"2024-03-30T13:08:26.270155+0000","last_active":"2024-03-30T13:08:27.847837+0000","last_peered":"2024-03-30T13:08:27.847837+0000","last_clean":"2024-03-30T13:08:27.847837+0000","last_became_active":"2024-03-30T13:08:26.268095+0000","last_became_peered":"2024-03-30T13:08:26.268095+0000","last_unstale":"2024-03-30T13:08:27.847837+0000","last_undegraded":"2024-03-30T13:08:27.847837+0000","last_fullsized":"2024-03-30T13:08:27.847837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:11:06.559848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845477+0000","last_change":"2024-03-30T13:08:26.254361+0000","last_active":"2024-03-30T13:08:27.845477+0000","last_peered":"2024-03-30T13:08:27.845477+0000","last_clean":"2024-03-30T13:08:27.845477+0000","last_became_active":"2024-03-30T13:08:26.253497+0000","last_became_peered":"2024-03-30T13:08:26.253497+0000","last_unstale":"2024-03-30T13:08:27.845477+0000","last_undegraded":"2024-03-30T13:08:27.845477+0000","last_fullsized":"2024-03-30T13:08:27.845477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845664+0000","last_change":"2024-03-30T13:08:26.252884+0000","last_active":"2024-03-30T13:08:27.845664+0000","last_peered":"2024-03-30T13:08:27.845664+0000","last_clean":"2024-03-30T13:08:27.845664+0000","last_became_active":"2024-03-30T13:08:26.252506+0000","last_became_peered":"2024-03-30T13:08:26.252506+0000","last_unstale":"2024-03-30T13:08:27.845664+0000","last_undegraded":"2024-03-30T13:08:27.845664+0000","last_fullsized":"2024-03-30T13:08:27.845664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250505+0000","last_change":"2024-03-30T13:08:26.260415+0000","last_active":"2024-03-30T13:08:27.250505+0000","last_peered":"2024-03-30T13:08:27.250505+0000","last_clean":"2024-03-30T13:08:27.250505+0000","last_became_active":"2024-03-30T13:08:26.259953+0000","last_became_peered":"2024-03-30T13:08:26.259953+0000","last_unstale":"2024-03-30T13:08:27.250505+0000","last_undegraded":"2024-03-30T13:08:27.250505+0000","last_fullsized":"2024-03-30T13:08:27.250505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:15:20.022778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847088+0000","last_change":"2024-03-30T13:08:26.266434+0000","last_active":"2024-03-30T13:08:27.847088+0000","last_peered":"2024-03-30T13:08:27.847088+0000","last_clean":"2024-03-30T13:08:27.847088+0000","last_became_active":"2024-03-30T13:08:26.266165+0000","last_became_peered":"2024-03-30T13:08:26.266165+0000","last_unstale":"2024-03-30T13:08:27.847088+0000","last_undegraded":"2024-03-30T13:08:27.847088+0000","last_fullsized":"2024-03-30T13:08:27.847088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433251+0000","last_change":"2024-03-30T13:08:26.260199+0000","last_active":"2024-03-30T13:08:27.433251+0000","last_peered":"2024-03-30T13:08:27.433251+0000","last_clean":"2024-03-30T13:08:27.433251+0000","last_became_active":"2024-03-30T13:08:26.259816+0000","last_became_peered":"2024-03-30T13:08:26.259816+0000","last_unstale":"2024-03-30T13:08:27.433251+0000","last_undegraded":"2024-03-30T13:08:27.433251+0000","last_fullsized":"2024-03-30T13:08:27.433251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:25:49.517498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246122+0000","last_change":"2024-03-30T13:08:26.253691+0000","last_active":"2024-03-30T13:08:27.246122+0000","last_peered":"2024-03-30T13:08:27.246122+0000","last_clean":"2024-03-30T13:08:27.246122+0000","last_became_active":"2024-03-30T13:08:26.253423+0000","last_became_peered":"2024-03-30T13:08:26.253423+0000","last_unstale":"2024-03-30T13:08:27.246122+0000","last_undegraded":"2024-03-30T13:08:27.246122+0000","last_fullsized":"2024-03-30T13:08:27.246122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246924+0000","last_change":"2024-03-30T13:08:26.256141+0000","last_active":"2024-03-30T13:08:27.246924+0000","last_peered":"2024-03-30T13:08:27.246924+0000","last_clean":"2024-03-30T13:08:27.246924+0000","last_became_active":"2024-03-30T13:08:26.255881+0000","last_became_peered":"2024-03-30T13:08:26.255881+0000","last_unstale":"2024-03-30T13:08:27.246924+0000","last_undegraded":"2024-03-30T13:08:27.246924+0000","last_fullsized":"2024-03-30T13:08:27.246924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250662+0000","last_change":"2024-03-30T13:08:26.258857+0000","last_active":"2024-03-30T13:08:27.250662+0000","last_peered":"2024-03-30T13:08:27.250662+0000","last_clean":"2024-03-30T13:08:27.250662+0000","last_became_active":"2024-03-30T13:08:26.258537+0000","last_became_peered":"2024-03-30T13:08:26.258537+0000","last_unstale":"2024-03-30T13:08:27.250662+0000","last_undegraded":"2024-03-30T13:08:27.250662+0000","last_fullsized":"2024-03-30T13:08:27.250662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:52:03.940597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846186+0000","last_change":"2024-03-30T13:08:26.256951+0000","last_active":"2024-03-30T13:08:27.846186+0000","last_peered":"2024-03-30T13:08:27.846186+0000","last_clean":"2024-03-30T13:08:27.846186+0000","last_became_active":"2024-03-30T13:08:26.256610+0000","last_became_peered":"2024-03-30T13:08:26.256610+0000","last_unstale":"2024-03-30T13:08:27.846186+0000","last_undegraded":"2024-03-30T13:08:27.846186+0000","last_fullsized":"2024-03-30T13:08:27.846186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:32.954292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847955+0000","last_change":"2024-03-30T13:08:26.263617+0000","last_active":"2024-03-30T13:08:27.847955+0000","last_peered":"2024-03-30T13:08:27.847955+0000","last_clean":"2024-03-30T13:08:27.847955+0000","last_became_active":"2024-03-30T13:08:26.262858+0000","last_became_peered":"2024-03-30T13:08:26.262858+0000","last_unstale":"2024-03-30T13:08:27.847955+0000","last_undegraded":"2024-03-30T13:08:27.847955+0000","last_fullsized":"2024-03-30T13:08:27.847955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:17.381480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845439+0000","last_change":"2024-03-30T13:08:26.267101+0000","last_active":"2024-03-30T13:08:27.845439+0000","last_peered":"2024-03-30T13:08:27.845439+0000","last_clean":"2024-03-30T13:08:27.845439+0000","last_became_active":"2024-03-30T13:08:26.266836+0000","last_became_peered":"2024-03-30T13:08:26.266836+0000","last_unstale":"2024-03-30T13:08:27.845439+0000","last_undegraded":"2024-03-30T13:08:27.845439+0000","last_fullsized":"2024-03-30T13:08:27.845439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433468+0000","last_change":"2024-03-30T13:08:26.263715+0000","last_active":"2024-03-30T13:08:27.433468+0000","last_peered":"2024-03-30T13:08:27.433468+0000","last_clean":"2024-03-30T13:08:27.433468+0000","last_became_active":"2024-03-30T13:08:26.263309+0000","last_became_peered":"2024-03-30T13:08:26.263309+0000","last_unstale":"2024-03-30T13:08:27.433468+0000","last_undegraded":"2024-03-30T13:08:27.433468+0000","last_fullsized":"2024-03-30T13:08:27.433468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247889+0000","last_change":"2024-03-30T13:08:26.255497+0000","last_active":"2024-03-30T13:08:27.247889+0000","last_peered":"2024-03-30T13:08:27.247889+0000","last_clean":"2024-03-30T13:08:27.247889+0000","last_became_active":"2024-03-30T13:08:26.255198+0000","last_became_peered":"2024-03-30T13:08:26.255198+0000","last_unstale":"2024-03-30T13:08:27.247889+0000","last_undegraded":"2024-03-30T13:08:27.247889+0000","last_fullsized":"2024-03-30T13:08:27.247889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:33.096715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846623+0000","last_change":"2024-03-30T13:08:26.267231+0000","last_active":"2024-03-30T13:08:27.846623+0000","last_peered":"2024-03-30T13:08:27.846623+0000","last_clean":"2024-03-30T13:08:27.846623+0000","last_became_active":"2024-03-30T13:08:26.266897+0000","last_became_peered":"2024-03-30T13:08:26.266897+0000","last_unstale":"2024-03-30T13:08:27.846623+0000","last_undegraded":"2024-03-30T13:08:27.846623+0000","last_fullsized":"2024-03-30T13:08:27.846623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246893+0000","last_change":"2024-03-30T13:08:26.254581+0000","last_active":"2024-03-30T13:08:27.246893+0000","last_peered":"2024-03-30T13:08:27.246893+0000","last_clean":"2024-03-30T13:08:27.246893+0000","last_became_active":"2024-03-30T13:08:26.254315+0000","last_became_peered":"2024-03-30T13:08:26.254315+0000","last_unstale":"2024-03-30T13:08:27.246893+0000","last_undegraded":"2024-03-30T13:08:27.246893+0000","last_fullsized":"2024-03-30T13:08:27.246893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846776+0000","last_change":"2024-03-30T13:08:26.261482+0000","last_active":"2024-03-30T13:08:27.846776+0000","last_peered":"2024-03-30T13:08:27.846776+0000","last_clean":"2024-03-30T13:08:27.846776+0000","last_became_active":"2024-03-30T13:08:26.260033+0000","last_became_peered":"2024-03-30T13:08:26.260033+0000","last_unstale":"2024-03-30T13:08:27.846776+0000","last_undegraded":"2024-03-30T13:08:27.846776+0000","last_fullsized":"2024-03-30T13:08:27.846776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845559+0000","last_change":"2024-03-30T13:08:26.256864+0000","last_active":"2024-03-30T13:08:27.845559+0000","last_peered":"2024-03-30T13:08:27.845559+0000","last_clean":"2024-03-30T13:08:27.845559+0000","last_became_active":"2024-03-30T13:08:26.256473+0000","last_became_peered":"2024-03-30T13:08:26.256473+0000","last_unstale":"2024-03-30T13:08:27.845559+0000","last_undegraded":"2024-03-30T13:08:27.845559+0000","last_fullsized":"2024-03-30T13:08:27.845559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246353+0000","last_change":"2024-03-30T13:08:26.258095+0000","last_active":"2024-03-30T13:08:27.246353+0000","last_peered":"2024-03-30T13:08:27.246353+0000","last_clean":"2024-03-30T13:08:27.246353+0000","last_became_active":"2024-03-30T13:08:26.257730+0000","last_became_peered":"2024-03-30T13:08:26.257730+0000","last_unstale":"2024-03-30T13:08:27.246353+0000","last_undegraded":"2024-03-30T13:08:27.246353+0000","last_fullsized":"2024-03-30T13:08:27.246353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847781+0000","last_change":"2024-03-30T13:08:26.273733+0000","last_active":"2024-03-30T13:08:27.847781+0000","last_peered":"2024-03-30T13:08:27.847781+0000","last_clean":"2024-03-30T13:08:27.847781+0000","last_became_active":"2024-03-30T13:08:26.273292+0000","last_became_peered":"2024-03-30T13:08:26.273292+0000","last_unstale":"2024-03-30T13:08:27.847781+0000","last_undegraded":"2024-03-30T13:08:27.847781+0000","last_fullsized":"2024-03-30T13:08:27.847781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:09:50.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433604+0000","last_change":"2024-03-30T13:08:26.268609+0000","last_active":"2024-03-30T13:08:27.433604+0000","last_peered":"2024-03-30T13:08:27.433604+0000","last_clean":"2024-03-30T13:08:27.433604+0000","last_became_active":"2024-03-30T13:08:26.267927+0000","last_became_peered":"2024-03-30T13:08:26.267927+0000","last_unstale":"2024-03-30T13:08:27.433604+0000","last_undegraded":"2024-03-30T13:08:27.433604+0000","last_fullsized":"2024-03-30T13:08:27.433604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248242+0000","last_change":"2024-03-30T13:08:26.266866+0000","last_active":"2024-03-30T13:08:27.248242+0000","last_peered":"2024-03-30T13:08:27.248242+0000","last_clean":"2024-03-30T13:08:27.248242+0000","last_became_active":"2024-03-30T13:08:26.266575+0000","last_became_peered":"2024-03-30T13:08:26.266575+0000","last_unstale":"2024-03-30T13:08:27.248242+0000","last_undegraded":"2024-03-30T13:08:27.248242+0000","last_fullsized":"2024-03-30T13:08:27.248242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:09:50.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845802+0000","last_change":"2024-03-30T13:08:26.254723+0000","last_active":"2024-03-30T13:08:27.845802+0000","last_peered":"2024-03-30T13:08:27.845802+0000","last_clean":"2024-03-30T13:08:27.845802+0000","last_became_active":"2024-03-30T13:08:26.254265+0000","last_became_peered":"2024-03-30T13:08:26.254265+0000","last_unstale":"2024-03-30T13:08:27.845802+0000","last_undegraded":"2024-03-30T13:08:27.845802+0000","last_fullsized":"2024-03-30T13:08:27.845802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:15:20.022778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845227+0000","last_change":"2024-03-30T13:08:26.262550+0000","last_active":"2024-03-30T13:08:27.845227+0000","last_peered":"2024-03-30T13:08:27.845227+0000","last_clean":"2024-03-30T13:08:27.845227+0000","last_became_active":"2024-03-30T13:08:26.262229+0000","last_became_peered":"2024-03-30T13:08:26.262229+0000","last_unstale":"2024-03-30T13:08:27.845227+0000","last_undegraded":"2024-03-30T13:08:27.845227+0000","last_fullsized":"2024-03-30T13:08:27.845227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:00:23.772051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247533+0000","last_change":"2024-03-30T13:08:26.243305+0000","last_active":"2024-03-30T13:08:27.247533+0000","last_peered":"2024-03-30T13:08:27.247533+0000","last_clean":"2024-03-30T13:08:27.247533+0000","last_became_active":"2024-03-30T13:08:26.242498+0000","last_became_peered":"2024-03-30T13:08:26.242498+0000","last_unstale":"2024-03-30T13:08:27.247533+0000","last_undegraded":"2024-03-30T13:08:27.247533+0000","last_fullsized":"2024-03-30T13:08:27.247533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:33.361760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847372+0000","last_change":"2024-03-30T13:08:25.270817+0000","last_active":"2024-03-30T13:08:27.847372+0000","last_peered":"2024-03-30T13:08:27.847372+0000","last_clean":"2024-03-30T13:08:27.847372+0000","last_became_active":"2024-03-30T13:08:25.270460+0000","last_became_peered":"2024-03-30T13:08:25.270460+0000","last_unstale":"2024-03-30T13:08:27.847372+0000","last_undegraded":"2024-03-30T13:08:27.847372+0000","last_fullsized":"2024-03-30T13:08:27.847372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:07:26.410219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433632+0000","last_change":"2024-03-30T13:08:26.267853+0000","last_active":"2024-03-30T13:08:27.433632+0000","last_peered":"2024-03-30T13:08:27.433632+0000","last_clean":"2024-03-30T13:08:27.433632+0000","last_became_active":"2024-03-30T13:08:26.267527+0000","last_became_peered":"2024-03-30T13:08:26.267527+0000","last_unstale":"2024-03-30T13:08:27.433632+0000","last_undegraded":"2024-03-30T13:08:27.433632+0000","last_fullsized":"2024-03-30T13:08:27.433632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845594+0000","last_change":"2024-03-30T13:08:25.253579+0000","last_active":"2024-03-30T13:08:27.845594+0000","last_peered":"2024-03-30T13:08:27.845594+0000","last_clean":"2024-03-30T13:08:27.845594+0000","last_became_active":"2024-03-30T13:08:25.252838+0000","last_became_peered":"2024-03-30T13:08:25.252838+0000","last_unstale":"2024-03-30T13:08:27.845594+0000","last_undegraded":"2024-03-30T13:08:27.845594+0000","last_fullsized":"2024-03-30T13:08:27.845594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:35:44.891908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847051+0000","last_change":"2024-03-30T13:08:25.255081+0000","last_active":"2024-03-30T13:08:27.847051+0000","last_peered":"2024-03-30T13:08:27.847051+0000","last_clean":"2024-03-30T13:08:27.847051+0000","last_became_active":"2024-03-30T13:08:25.254790+0000","last_became_peered":"2024-03-30T13:08:25.254790+0000","last_unstale":"2024-03-30T13:08:27.847051+0000","last_undegraded":"2024-03-30T13:08:27.847051+0000","last_fullsized":"2024-03-30T13:08:27.847051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846524+0000","last_change":"2024-03-30T13:08:26.269902+0000","last_active":"2024-03-30T13:08:27.846524+0000","last_peered":"2024-03-30T13:08:27.846524+0000","last_clean":"2024-03-30T13:08:27.846524+0000","last_became_active":"2024-03-30T13:08:26.269503+0000","last_became_peered":"2024-03-30T13:08:26.269503+0000","last_unstale":"2024-03-30T13:08:27.846524+0000","last_undegraded":"2024-03-30T13:08:27.846524+0000","last_fullsized":"2024-03-30T13:08:27.846524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247045+0000","last_change":"2024-03-30T13:08:25.273212+0000","last_active":"2024-03-30T13:08:27.247045+0000","last_peered":"2024-03-30T13:08:27.247045+0000","last_clean":"2024-03-30T13:08:27.247045+0000","last_became_active":"2024-03-30T13:08:25.269863+0000","last_became_peered":"2024-03-30T13:08:25.269863+0000","last_unstale":"2024-03-30T13:08:27.247045+0000","last_undegraded":"2024-03-30T13:08:27.247045+0000","last_fullsized":"2024-03-30T13:08:27.247045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:39.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246339+0000","last_change":"2024-03-30T13:08:26.270878+0000","last_active":"2024-03-30T13:08:27.246339+0000","last_peered":"2024-03-30T13:08:27.246339+0000","last_clean":"2024-03-30T13:08:27.246339+0000","last_became_active":"2024-03-30T13:08:26.270607+0000","last_became_peered":"2024-03-30T13:08:26.270607+0000","last_unstale":"2024-03-30T13:08:27.246339+0000","last_undegraded":"2024-03-30T13:08:27.246339+0000","last_fullsized":"2024-03-30T13:08:27.246339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845448+0000","last_change":"2024-03-30T13:08:25.271725+0000","last_active":"2024-03-30T13:08:27.845448+0000","last_peered":"2024-03-30T13:08:27.845448+0000","last_clean":"2024-03-30T13:08:27.845448+0000","last_became_active":"2024-03-30T13:08:25.271059+0000","last_became_peered":"2024-03-30T13:08:25.271059+0000","last_unstale":"2024-03-30T13:08:27.845448+0000","last_undegraded":"2024-03-30T13:08:27.845448+0000","last_fullsized":"2024-03-30T13:08:27.845448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249536+0000","last_change":"2024-03-30T13:08:26.256649+0000","last_active":"2024-03-30T13:08:27.249536+0000","last_peered":"2024-03-30T13:08:27.249536+0000","last_clean":"2024-03-30T13:08:27.249536+0000","last_became_active":"2024-03-30T13:08:26.256365+0000","last_became_peered":"2024-03-30T13:08:26.256365+0000","last_unstale":"2024-03-30T13:08:27.249536+0000","last_undegraded":"2024-03-30T13:08:27.249536+0000","last_fullsized":"2024-03-30T13:08:27.249536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:34:59.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249749+0000","last_change":"2024-03-30T13:08:25.258848+0000","last_active":"2024-03-30T13:08:27.249749+0000","last_peered":"2024-03-30T13:08:27.249749+0000","last_clean":"2024-03-30T13:08:27.249749+0000","last_became_active":"2024-03-30T13:08:25.258153+0000","last_became_peered":"2024-03-30T13:08:25.258153+0000","last_unstale":"2024-03-30T13:08:27.249749+0000","last_undegraded":"2024-03-30T13:08:27.249749+0000","last_fullsized":"2024-03-30T13:08:27.249749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:24:11.686334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433812+0000","last_change":"2024-03-30T13:08:26.248994+0000","last_active":"2024-03-30T13:08:27.433812+0000","last_peered":"2024-03-30T13:08:27.433812+0000","last_clean":"2024-03-30T13:08:27.433812+0000","last_became_active":"2024-03-30T13:08:26.248649+0000","last_became_peered":"2024-03-30T13:08:26.248649+0000","last_unstale":"2024-03-30T13:08:27.433812+0000","last_undegraded":"2024-03-30T13:08:27.433812+0000","last_fullsized":"2024-03-30T13:08:27.433812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246424+0000","last_change":"2024-03-30T13:08:25.271938+0000","last_active":"2024-03-30T13:08:27.246424+0000","last_peered":"2024-03-30T13:08:27.246424+0000","last_clean":"2024-03-30T13:08:27.246424+0000","last_became_active":"2024-03-30T13:08:25.271537+0000","last_became_peered":"2024-03-30T13:08:25.271537+0000","last_unstale":"2024-03-30T13:08:27.246424+0000","last_undegraded":"2024-03-30T13:08:27.246424+0000","last_fullsized":"2024-03-30T13:08:27.246424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:25:11.691446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250784+0000","last_change":"2024-03-30T13:08:26.258598+0000","last_active":"2024-03-30T13:08:27.250784+0000","last_peered":"2024-03-30T13:08:27.250784+0000","last_clean":"2024-03-30T13:08:27.250784+0000","last_became_active":"2024-03-30T13:08:26.258283+0000","last_became_peered":"2024-03-30T13:08:26.258283+0000","last_unstale":"2024-03-30T13:08:27.250784+0000","last_undegraded":"2024-03-30T13:08:27.250784+0000","last_fullsized":"2024-03-30T13:08:27.250784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:32.954292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845682+0000","last_change":"2024-03-30T13:08:25.257898+0000","last_active":"2024-03-30T13:08:27.845682+0000","last_peered":"2024-03-30T13:08:27.845682+0000","last_clean":"2024-03-30T13:08:27.845682+0000","last_became_active":"2024-03-30T13:08:25.257311+0000","last_became_peered":"2024-03-30T13:08:25.257311+0000","last_unstale":"2024-03-30T13:08:27.845682+0000","last_undegraded":"2024-03-30T13:08:27.845682+0000","last_fullsized":"2024-03-30T13:08:27.845682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847509+0000","last_change":"2024-03-30T13:08:26.263276+0000","last_active":"2024-03-30T13:08:27.847509+0000","last_peered":"2024-03-30T13:08:27.847509+0000","last_clean":"2024-03-30T13:08:27.847509+0000","last_became_active":"2024-03-30T13:08:26.262279+0000","last_became_peered":"2024-03-30T13:08:26.262279+0000","last_unstale":"2024-03-30T13:08:27.847509+0000","last_undegraded":"2024-03-30T13:08:27.847509+0000","last_fullsized":"2024-03-30T13:08:27.847509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:09:50.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433714+0000","last_change":"2024-03-30T13:08:25.247025+0000","last_active":"2024-03-30T13:08:27.433714+0000","last_peered":"2024-03-30T13:08:27.433714+0000","last_clean":"2024-03-30T13:08:27.433714+0000","last_became_active":"2024-03-30T13:08:25.246656+0000","last_became_peered":"2024-03-30T13:08:25.246656+0000","last_unstale":"2024-03-30T13:08:27.433714+0000","last_undegraded":"2024-03-30T13:08:27.433714+0000","last_fullsized":"2024-03-30T13:08:27.433714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433293+0000","last_change":"2024-03-30T13:08:26.260804+0000","last_active":"2024-03-30T13:08:27.433293+0000","last_peered":"2024-03-30T13:08:27.433293+0000","last_clean":"2024-03-30T13:08:27.433293+0000","last_became_active":"2024-03-30T13:08:26.260342+0000","last_became_peered":"2024-03-30T13:08:26.260342+0000","last_unstale":"2024-03-30T13:08:27.433293+0000","last_undegraded":"2024-03-30T13:08:27.433293+0000","last_fullsized":"2024-03-30T13:08:27.433293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:00:23.772051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248471+0000","last_change":"2024-03-30T13:08:25.266076+0000","last_active":"2024-03-30T13:08:27.248471+0000","last_peered":"2024-03-30T13:08:27.248471+0000","last_clean":"2024-03-30T13:08:27.248471+0000","last_became_active":"2024-03-30T13:08:25.264628+0000","last_became_peered":"2024-03-30T13:08:25.264628+0000","last_unstale":"2024-03-30T13:08:27.248471+0000","last_undegraded":"2024-03-30T13:08:27.248471+0000","last_fullsized":"2024-03-30T13:08:27.248471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847623+0000","last_change":"2024-03-30T13:08:26.272989+0000","last_active":"2024-03-30T13:08:27.847623+0000","last_peered":"2024-03-30T13:08:27.847623+0000","last_clean":"2024-03-30T13:08:27.847623+0000","last_became_active":"2024-03-30T13:08:26.272715+0000","last_became_peered":"2024-03-30T13:08:26.272715+0000","last_unstale":"2024-03-30T13:08:27.847623+0000","last_undegraded":"2024-03-30T13:08:27.847623+0000","last_fullsized":"2024-03-30T13:08:27.847623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:51:01.414724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845237+0000","last_change":"2024-03-30T13:08:25.255530+0000","last_active":"2024-03-30T13:08:27.845237+0000","last_peered":"2024-03-30T13:08:27.845237+0000","last_clean":"2024-03-30T13:08:27.845237+0000","last_became_active":"2024-03-30T13:08:25.254828+0000","last_became_peered":"2024-03-30T13:08:25.254828+0000","last_unstale":"2024-03-30T13:08:27.845237+0000","last_undegraded":"2024-03-30T13:08:27.845237+0000","last_fullsized":"2024-03-30T13:08:27.845237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:07:26.410219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845374+0000","last_change":"2024-03-30T13:08:26.262416+0000","last_active":"2024-03-30T13:08:27.845374+0000","last_peered":"2024-03-30T13:08:27.845374+0000","last_clean":"2024-03-30T13:08:27.845374+0000","last_became_active":"2024-03-30T13:08:26.262147+0000","last_became_peered":"2024-03-30T13:08:26.262147+0000","last_unstale":"2024-03-30T13:08:27.845374+0000","last_undegraded":"2024-03-30T13:08:27.845374+0000","last_fullsized":"2024-03-30T13:08:27.845374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:06:18.572457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845499+0000","last_change":"2024-03-30T13:08:25.244929+0000","last_active":"2024-03-30T13:08:27.845499+0000","last_peered":"2024-03-30T13:08:27.845499+0000","last_clean":"2024-03-30T13:08:27.845499+0000","last_became_active":"2024-03-30T13:08:25.244565+0000","last_became_peered":"2024-03-30T13:08:25.244565+0000","last_unstale":"2024-03-30T13:08:27.845499+0000","last_undegraded":"2024-03-30T13:08:27.845499+0000","last_fullsized":"2024-03-30T13:08:27.845499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:24.519549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847184+0000","last_change":"2024-03-30T13:08:26.270298+0000","last_active":"2024-03-30T13:08:27.847184+0000","last_peered":"2024-03-30T13:08:27.847184+0000","last_clean":"2024-03-30T13:08:27.847184+0000","last_became_active":"2024-03-30T13:08:26.270008+0000","last_became_peered":"2024-03-30T13:08:26.270008+0000","last_unstale":"2024-03-30T13:08:27.847184+0000","last_undegraded":"2024-03-30T13:08:27.847184+0000","last_fullsized":"2024-03-30T13:08:27.847184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:38.839595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250765+0000","last_change":"2024-03-30T13:08:25.247533+0000","last_active":"2024-03-30T13:08:27.250765+0000","last_peered":"2024-03-30T13:08:27.250765+0000","last_clean":"2024-03-30T13:08:27.250765+0000","last_became_active":"2024-03-30T13:08:25.246529+0000","last_became_peered":"2024-03-30T13:08:25.246529+0000","last_unstale":"2024-03-30T13:08:27.250765+0000","last_undegraded":"2024-03-30T13:08:27.250765+0000","last_fullsized":"2024-03-30T13:08:27.250765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:47.553831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.848594+0000","last_change":"2024-03-30T13:08:26.273076+0000","last_active":"2024-03-30T13:08:27.848594+0000","last_peered":"2024-03-30T13:08:27.848594+0000","last_clean":"2024-03-30T13:08:27.848594+0000","last_became_active":"2024-03-30T13:08:26.272648+0000","last_became_peered":"2024-03-30T13:08:26.272648+0000","last_unstale":"2024-03-30T13:08:27.848594+0000","last_undegraded":"2024-03-30T13:08:27.848594+0000","last_fullsized":"2024-03-30T13:08:27.848594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:38:27.246797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846430+0000","last_change":"2024-03-30T13:08:25.246374+0000","last_active":"2024-03-30T13:08:27.846430+0000","last_peered":"2024-03-30T13:08:27.846430+0000","last_clean":"2024-03-30T13:08:27.846430+0000","last_became_active":"2024-03-30T13:08:25.246054+0000","last_became_peered":"2024-03-30T13:08:25.246054+0000","last_unstale":"2024-03-30T13:08:27.846430+0000","last_undegraded":"2024-03-30T13:08:27.846430+0000","last_fullsized":"2024-03-30T13:08:27.846430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:35:16.864101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.848301+0000","last_change":"2024-03-30T13:08:26.272977+0000","last_active":"2024-03-30T13:08:27.848301+0000","last_peered":"2024-03-30T13:08:27.848301+0000","last_clean":"2024-03-30T13:08:27.848301+0000","last_became_active":"2024-03-30T13:08:26.272484+0000","last_became_peered":"2024-03-30T13:08:26.272484+0000","last_unstale":"2024-03-30T13:08:27.848301+0000","last_undegraded":"2024-03-30T13:08:27.848301+0000","last_fullsized":"2024-03-30T13:08:27.848301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:52:03.940597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246440+0000","last_change":"2024-03-30T13:08:25.247470+0000","last_active":"2024-03-30T13:08:27.246440+0000","last_peered":"2024-03-30T13:08:27.246440+0000","last_clean":"2024-03-30T13:08:27.246440+0000","last_became_active":"2024-03-30T13:08:25.247147+0000","last_became_peered":"2024-03-30T13:08:25.247147+0000","last_unstale":"2024-03-30T13:08:27.246440+0000","last_undegraded":"2024-03-30T13:08:27.246440+0000","last_fullsized":"2024-03-30T13:08:27.246440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:07.835197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249178+0000","last_change":"2024-03-30T13:08:26.261671+0000","last_active":"2024-03-30T13:08:27.249178+0000","last_peered":"2024-03-30T13:08:27.249178+0000","last_clean":"2024-03-30T13:08:27.249178+0000","last_became_active":"2024-03-30T13:08:26.261411+0000","last_became_peered":"2024-03-30T13:08:26.261411+0000","last_unstale":"2024-03-30T13:08:27.249178+0000","last_undegraded":"2024-03-30T13:08:27.249178+0000","last_fullsized":"2024-03-30T13:08:27.249178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:07.743621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845955+0000","last_change":"2024-03-30T13:08:25.273872+0000","last_active":"2024-03-30T13:08:27.845955+0000","last_peered":"2024-03-30T13:08:27.845955+0000","last_clean":"2024-03-30T13:08:27.845955+0000","last_became_active":"2024-03-30T13:08:25.273570+0000","last_became_peered":"2024-03-30T13:08:25.273570+0000","last_unstale":"2024-03-30T13:08:27.845955+0000","last_undegraded":"2024-03-30T13:08:27.845955+0000","last_fullsized":"2024-03-30T13:08:27.845955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:32.352462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847718+0000","last_change":"2024-03-30T13:08:26.257523+0000","last_active":"2024-03-30T13:08:27.847718+0000","last_peered":"2024-03-30T13:08:27.847718+0000","last_clean":"2024-03-30T13:08:27.847718+0000","last_became_active":"2024-03-30T13:08:26.257150+0000","last_became_peered":"2024-03-30T13:08:26.257150+0000","last_unstale":"2024-03-30T13:08:27.847718+0000","last_undegraded":"2024-03-30T13:08:27.847718+0000","last_fullsized":"2024-03-30T13:08:27.847718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:34:59.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847028+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:08:27.847028+0000","last_peered":"2024-03-30T13:08:27.847028+0000","last_clean":"2024-03-30T13:08:27.847028+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:08:27.847028+0000","last_undegraded":"2024-03-30T13:08:27.847028+0000","last_fullsized":"2024-03-30T13:08:27.847028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247294+0000","last_change":"2024-03-30T13:08:25.258621+0000","last_active":"2024-03-30T13:08:27.247294+0000","last_peered":"2024-03-30T13:08:27.247294+0000","last_clean":"2024-03-30T13:08:27.247294+0000","last_became_active":"2024-03-30T13:08:25.257931+0000","last_became_peered":"2024-03-30T13:08:25.257931+0000","last_unstale":"2024-03-30T13:08:27.247294+0000","last_undegraded":"2024-03-30T13:08:27.247294+0000","last_fullsized":"2024-03-30T13:08:27.247294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847645+0000","last_change":"2024-03-30T13:08:26.260707+0000","last_active":"2024-03-30T13:08:27.847645+0000","last_peered":"2024-03-30T13:08:27.847645+0000","last_clean":"2024-03-30T13:08:27.847645+0000","last_became_active":"2024-03-30T13:08:26.254479+0000","last_became_peered":"2024-03-30T13:08:26.254479+0000","last_unstale":"2024-03-30T13:08:27.847645+0000","last_undegraded":"2024-03-30T13:08:27.847645+0000","last_fullsized":"2024-03-30T13:08:27.847645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:33.096715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846876+0000","last_change":"2024-03-30T13:08:25.266025+0000","last_active":"2024-03-30T13:08:27.846876+0000","last_peered":"2024-03-30T13:08:27.846876+0000","last_clean":"2024-03-30T13:08:27.846876+0000","last_became_active":"2024-03-30T13:08:25.265377+0000","last_became_peered":"2024-03-30T13:08:25.265377+0000","last_unstale":"2024-03-30T13:08:27.846876+0000","last_undegraded":"2024-03-30T13:08:27.846876+0000","last_fullsized":"2024-03-30T13:08:27.846876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:39.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433360+0000","last_change":"2024-03-30T13:08:26.267267+0000","last_active":"2024-03-30T13:08:27.433360+0000","last_peered":"2024-03-30T13:08:27.433360+0000","last_clean":"2024-03-30T13:08:27.433360+0000","last_became_active":"2024-03-30T13:08:26.266946+0000","last_became_peered":"2024-03-30T13:08:26.266946+0000","last_unstale":"2024-03-30T13:08:27.433360+0000","last_undegraded":"2024-03-30T13:08:27.433360+0000","last_fullsized":"2024-03-30T13:08:27.433360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:06:18.572457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845756+0000","last_change":"2024-03-30T13:08:25.240103+0000","last_active":"2024-03-30T13:08:27.845756+0000","last_peered":"2024-03-30T13:08:27.845756+0000","last_clean":"2024-03-30T13:08:27.845756+0000","last_became_active":"2024-03-30T13:08:25.239719+0000","last_became_peered":"2024-03-30T13:08:25.239719+0000","last_unstale":"2024-03-30T13:08:27.845756+0000","last_undegraded":"2024-03-30T13:08:27.845756+0000","last_fullsized":"2024-03-30T13:08:27.845756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:33:02.419995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246239+0000","last_change":"2024-03-30T13:08:26.253339+0000","last_active":"2024-03-30T13:08:27.246239+0000","last_peered":"2024-03-30T13:08:27.246239+0000","last_clean":"2024-03-30T13:08:27.246239+0000","last_became_active":"2024-03-30T13:08:26.243687+0000","last_became_peered":"2024-03-30T13:08:26.243687+0000","last_unstale":"2024-03-30T13:08:27.246239+0000","last_undegraded":"2024-03-30T13:08:27.246239+0000","last_fullsized":"2024-03-30T13:08:27.246239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248693+0000","last_change":"2024-03-30T13:08:25.265220+0000","last_active":"2024-03-30T13:08:27.248693+0000","last_peered":"2024-03-30T13:08:27.248693+0000","last_clean":"2024-03-30T13:08:27.248693+0000","last_became_active":"2024-03-30T13:08:25.263916+0000","last_became_peered":"2024-03-30T13:08:25.263916+0000","last_unstale":"2024-03-30T13:08:27.248693+0000","last_undegraded":"2024-03-30T13:08:27.248693+0000","last_fullsized":"2024-03-30T13:08:27.248693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:25:11.691446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249508+0000","last_change":"2024-03-30T13:08:26.266484+0000","last_active":"2024-03-30T13:08:27.249508+0000","last_peered":"2024-03-30T13:08:27.249508+0000","last_clean":"2024-03-30T13:08:27.249508+0000","last_became_active":"2024-03-30T13:08:26.266155+0000","last_became_peered":"2024-03-30T13:08:26.266155+0000","last_unstale":"2024-03-30T13:08:27.249508+0000","last_undegraded":"2024-03-30T13:08:27.249508+0000","last_fullsized":"2024-03-30T13:08:27.249508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:31:26.132649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246596+0000","last_change":"2024-03-30T13:08:25.248845+0000","last_active":"2024-03-30T13:08:27.246596+0000","last_peered":"2024-03-30T13:08:27.246596+0000","last_clean":"2024-03-30T13:08:27.246596+0000","last_became_active":"2024-03-30T13:08:25.248455+0000","last_became_peered":"2024-03-30T13:08:25.248455+0000","last_unstale":"2024-03-30T13:08:27.246596+0000","last_undegraded":"2024-03-30T13:08:27.246596+0000","last_fullsized":"2024-03-30T13:08:27.246596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:39.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249863+0000","last_change":"2024-03-30T13:08:26.254255+0000","last_active":"2024-03-30T13:08:27.249863+0000","last_peered":"2024-03-30T13:08:27.249863+0000","last_clean":"2024-03-30T13:08:27.249863+0000","last_became_active":"2024-03-30T13:08:26.253990+0000","last_became_peered":"2024-03-30T13:08:26.253990+0000","last_unstale":"2024-03-30T13:08:27.249863+0000","last_undegraded":"2024-03-30T13:08:27.249863+0000","last_fullsized":"2024-03-30T13:08:27.249863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:17.381480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.848028+0000","last_change":"2024-03-30T13:08:25.275050+0000","last_active":"2024-03-30T13:08:27.848028+0000","last_peered":"2024-03-30T13:08:27.848028+0000","last_clean":"2024-03-30T13:08:27.848028+0000","last_became_active":"2024-03-30T13:08:25.270650+0000","last_became_peered":"2024-03-30T13:08:25.270650+0000","last_unstale":"2024-03-30T13:08:27.848028+0000","last_undegraded":"2024-03-30T13:08:27.848028+0000","last_fullsized":"2024-03-30T13:08:27.848028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:11.754124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246448+0000","last_change":"2024-03-30T13:08:26.252864+0000","last_active":"2024-03-30T13:08:27.246448+0000","last_peered":"2024-03-30T13:08:27.246448+0000","last_clean":"2024-03-30T13:08:27.246448+0000","last_became_active":"2024-03-30T13:08:26.252487+0000","last_became_peered":"2024-03-30T13:08:26.252487+0000","last_unstale":"2024-03-30T13:08:27.246448+0000","last_undegraded":"2024-03-30T13:08:27.246448+0000","last_fullsized":"2024-03-30T13:08:27.246448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:28.163978+0000","last_change":"2024-03-30T13:08:25.256761+0000","last_active":"2024-03-30T13:08:28.163978+0000","last_peered":"2024-03-30T13:08:28.163978+0000","last_clean":"2024-03-30T13:08:28.163978+0000","last_became_active":"2024-03-30T13:08:25.256423+0000","last_became_peered":"2024-03-30T13:08:25.256423+0000","last_unstale":"2024-03-30T13:08:28.163978+0000","last_undegraded":"2024-03-30T13:08:28.163978+0000","last_fullsized":"2024-03-30T13:08:28.163978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:11.754124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847010+0000","last_change":"2024-03-30T13:08:26.266237+0000","last_active":"2024-03-30T13:08:27.847010+0000","last_peered":"2024-03-30T13:08:27.847010+0000","last_clean":"2024-03-30T13:08:27.847010+0000","last_became_active":"2024-03-30T13:08:26.265651+0000","last_became_peered":"2024-03-30T13:08:26.265651+0000","last_unstale":"2024-03-30T13:08:27.847010+0000","last_undegraded":"2024-03-30T13:08:27.847010+0000","last_fullsized":"2024-03-30T13:08:27.847010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845790+0000","last_change":"2024-03-30T13:08:25.277163+0000","last_active":"2024-03-30T13:08:27.845790+0000","last_peered":"2024-03-30T13:08:27.845790+0000","last_clean":"2024-03-30T13:08:27.845790+0000","last_became_active":"2024-03-30T13:08:25.276378+0000","last_became_peered":"2024-03-30T13:08:25.276378+0000","last_unstale":"2024-03-30T13:08:27.845790+0000","last_undegraded":"2024-03-30T13:08:27.845790+0000","last_fullsized":"2024-03-30T13:08:27.845790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:24:11.686334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433709+0000","last_change":"2024-03-30T13:08:26.260918+0000","last_active":"2024-03-30T13:08:27.433709+0000","last_peered":"2024-03-30T13:08:27.433709+0000","last_clean":"2024-03-30T13:08:27.433709+0000","last_became_active":"2024-03-30T13:08:26.260191+0000","last_became_peered":"2024-03-30T13:08:26.260191+0000","last_unstale":"2024-03-30T13:08:27.433709+0000","last_undegraded":"2024-03-30T13:08:27.433709+0000","last_fullsized":"2024-03-30T13:08:27.433709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846849+0000","last_change":"2024-03-30T13:08:25.261497+0000","last_active":"2024-03-30T13:08:27.846849+0000","last_peered":"2024-03-30T13:08:27.846849+0000","last_clean":"2024-03-30T13:08:27.846849+0000","last_became_active":"2024-03-30T13:08:25.260478+0000","last_became_peered":"2024-03-30T13:08:25.260478+0000","last_unstale":"2024-03-30T13:08:27.846849+0000","last_undegraded":"2024-03-30T13:08:27.846849+0000","last_fullsized":"2024-03-30T13:08:27.846849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248615+0000","last_change":"2024-03-30T13:08:26.248004+0000","last_active":"2024-03-30T13:08:27.248615+0000","last_peered":"2024-03-30T13:08:27.248615+0000","last_clean":"2024-03-30T13:08:27.248615+0000","last_became_active":"2024-03-30T13:08:26.247256+0000","last_became_peered":"2024-03-30T13:08:26.247256+0000","last_unstale":"2024-03-30T13:08:27.248615+0000","last_undegraded":"2024-03-30T13:08:27.248615+0000","last_fullsized":"2024-03-30T13:08:27.248615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:00:34.966299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246220+0000","last_change":"2024-03-30T13:08:25.271738+0000","last_active":"2024-03-30T13:08:27.246220+0000","last_peered":"2024-03-30T13:08:27.246220+0000","last_clean":"2024-03-30T13:08:27.246220+0000","last_became_active":"2024-03-30T13:08:25.271345+0000","last_became_peered":"2024-03-30T13:08:25.271345+0000","last_unstale":"2024-03-30T13:08:27.246220+0000","last_undegraded":"2024-03-30T13:08:27.246220+0000","last_fullsized":"2024-03-30T13:08:27.246220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846920+0000","last_change":"2024-03-30T13:08:26.269105+0000","last_active":"2024-03-30T13:08:27.846920+0000","last_peered":"2024-03-30T13:08:27.846920+0000","last_clean":"2024-03-30T13:08:27.846920+0000","last_became_active":"2024-03-30T13:08:26.260812+0000","last_became_peered":"2024-03-30T13:08:26.260812+0000","last_unstale":"2024-03-30T13:08:27.846920+0000","last_undegraded":"2024-03-30T13:08:27.846920+0000","last_fullsized":"2024-03-30T13:08:27.846920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246299+0000","last_change":"2024-03-30T13:08:25.248839+0000","last_active":"2024-03-30T13:08:27.246299+0000","last_peered":"2024-03-30T13:08:27.246299+0000","last_clean":"2024-03-30T13:08:27.246299+0000","last_became_active":"2024-03-30T13:08:25.248429+0000","last_became_peered":"2024-03-30T13:08:25.248429+0000","last_unstale":"2024-03-30T13:08:27.246299+0000","last_undegraded":"2024-03-30T13:08:27.246299+0000","last_fullsized":"2024-03-30T13:08:27.246299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:24:11.686334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847416+0000","last_change":"2024-03-30T13:08:26.269026+0000","last_active":"2024-03-30T13:08:27.847416+0000","last_peered":"2024-03-30T13:08:27.847416+0000","last_clean":"2024-03-30T13:08:27.847416+0000","last_became_active":"2024-03-30T13:08:26.268626+0000","last_became_peered":"2024-03-30T13:08:26.268626+0000","last_unstale":"2024-03-30T13:08:27.847416+0000","last_undegraded":"2024-03-30T13:08:27.847416+0000","last_fullsized":"2024-03-30T13:08:27.847416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:38.839595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847773+0000","last_change":"2024-03-30T13:08:25.277478+0000","last_active":"2024-03-30T13:08:27.847773+0000","last_peered":"2024-03-30T13:08:27.847773+0000","last_clean":"2024-03-30T13:08:27.847773+0000","last_became_active":"2024-03-30T13:08:25.276694+0000","last_became_peered":"2024-03-30T13:08:25.276694+0000","last_unstale":"2024-03-30T13:08:27.847773+0000","last_undegraded":"2024-03-30T13:08:27.847773+0000","last_fullsized":"2024-03-30T13:08:27.847773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:13:51.325672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845058+0000","last_change":"2024-03-30T13:08:26.268719+0000","last_active":"2024-03-30T13:08:27.845058+0000","last_peered":"2024-03-30T13:08:27.845058+0000","last_clean":"2024-03-30T13:08:27.845058+0000","last_became_active":"2024-03-30T13:08:26.268461+0000","last_became_peered":"2024-03-30T13:08:26.268461+0000","last_unstale":"2024-03-30T13:08:27.845058+0000","last_undegraded":"2024-03-30T13:08:27.845058+0000","last_fullsized":"2024-03-30T13:08:27.845058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:25:49.517498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249613+0000","last_change":"2024-03-30T13:08:26.249193+0000","last_active":"2024-03-30T13:08:27.249613+0000","last_peered":"2024-03-30T13:08:27.249613+0000","last_clean":"2024-03-30T13:08:27.249613+0000","last_became_active":"2024-03-30T13:08:26.248772+0000","last_became_peered":"2024-03-30T13:08:26.248772+0000","last_unstale":"2024-03-30T13:08:27.249613+0000","last_undegraded":"2024-03-30T13:08:27.249613+0000","last_fullsized":"2024-03-30T13:08:27.249613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:11:06.559848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847285+0000","last_change":"2024-03-30T13:08:25.281959+0000","last_active":"2024-03-30T13:08:27.847285+0000","last_peered":"2024-03-30T13:08:27.847285+0000","last_clean":"2024-03-30T13:08:27.847285+0000","last_became_active":"2024-03-30T13:08:25.281274+0000","last_became_peered":"2024-03-30T13:08:25.281274+0000","last_unstale":"2024-03-30T13:08:27.847285+0000","last_undegraded":"2024-03-30T13:08:27.847285+0000","last_fullsized":"2024-03-30T13:08:27.847285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:25:11.691446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249036+0000","last_change":"2024-03-30T13:08:26.249258+0000","last_active":"2024-03-30T13:08:27.249036+0000","last_peered":"2024-03-30T13:08:27.249036+0000","last_clean":"2024-03-30T13:08:27.249036+0000","last_became_active":"2024-03-30T13:08:26.248751+0000","last_became_peered":"2024-03-30T13:08:26.248751+0000","last_unstale":"2024-03-30T13:08:27.249036+0000","last_undegraded":"2024-03-30T13:08:27.249036+0000","last_fullsized":"2024-03-30T13:08:27.249036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:51:01.414724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847841+0000","last_change":"2024-03-30T13:08:25.277430+0000","last_active":"2024-03-30T13:08:27.847841+0000","last_peered":"2024-03-30T13:08:27.847841+0000","last_clean":"2024-03-30T13:08:27.847841+0000","last_became_active":"2024-03-30T13:08:25.276574+0000","last_became_peered":"2024-03-30T13:08:25.276574+0000","last_unstale":"2024-03-30T13:08:27.847841+0000","last_undegraded":"2024-03-30T13:08:27.847841+0000","last_fullsized":"2024-03-30T13:08:27.847841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:07.835197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433517+0000","last_change":"2024-03-30T13:08:26.249242+0000","last_active":"2024-03-30T13:08:27.433517+0000","last_peered":"2024-03-30T13:08:27.433517+0000","last_clean":"2024-03-30T13:08:27.433517+0000","last_became_active":"2024-03-30T13:08:26.248878+0000","last_became_peered":"2024-03-30T13:08:26.248878+0000","last_unstale":"2024-03-30T13:08:27.433517+0000","last_undegraded":"2024-03-30T13:08:27.433517+0000","last_fullsized":"2024-03-30T13:08:27.433517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847382+0000","last_change":"2024-03-30T13:08:25.244866+0000","last_active":"2024-03-30T13:08:27.847382+0000","last_peered":"2024-03-30T13:08:27.847382+0000","last_clean":"2024-03-30T13:08:27.847382+0000","last_became_active":"2024-03-30T13:08:25.244502+0000","last_became_peered":"2024-03-30T13:08:25.244502+0000","last_unstale":"2024-03-30T13:08:27.847382+0000","last_undegraded":"2024-03-30T13:08:27.847382+0000","last_fullsized":"2024-03-30T13:08:27.847382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:35:44.891908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847055+0000","last_change":"2024-03-30T13:08:26.265904+0000","last_active":"2024-03-30T13:08:27.847055+0000","last_peered":"2024-03-30T13:08:27.847055+0000","last_clean":"2024-03-30T13:08:27.847055+0000","last_became_active":"2024-03-30T13:08:26.265600+0000","last_became_peered":"2024-03-30T13:08:26.265600+0000","last_unstale":"2024-03-30T13:08:27.847055+0000","last_undegraded":"2024-03-30T13:08:27.847055+0000","last_fullsized":"2024-03-30T13:08:27.847055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433661+0000","last_change":"2024-03-30T13:08:25.271879+0000","last_active":"2024-03-30T13:08:27.433661+0000","last_peered":"2024-03-30T13:08:27.433661+0000","last_clean":"2024-03-30T13:08:27.433661+0000","last_became_active":"2024-03-30T13:08:25.270729+0000","last_became_peered":"2024-03-30T13:08:25.270729+0000","last_unstale":"2024-03-30T13:08:27.433661+0000","last_undegraded":"2024-03-30T13:08:27.433661+0000","last_fullsized":"2024-03-30T13:08:27.433661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:45:33.842798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":664083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":73223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":664139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":73133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:08:37.940 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:08:38.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.077+0000 7fe4a1398640 1 Processor -- start 2024-03-30T13:08:38.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.077+0000 7fe4a1398640 1 -- start start 2024-03-30T13:08:38.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe49c0b4830 0x7fe49c15d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe49c0aed20 0x7fe49c0af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe49c15d880 con 0x7fe49c15fee0 2024-03-30T13:08:38.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fe49c156e00 con 0x7fe49c0b4830 2024-03-30T13:08:38.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe49c0ad040 con 0x7fe49c0aed20 2024-03-30T13:08:38.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe49affd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe49c0b4830 0x7fe49c15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe49b7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fe49c15fee0 0x7fe49c160310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56430/0 (socket says 172.21.15.83:56430) 2024-03-30T13:08:38.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe49b7fe640 1 -- 172.21.15.83:0/1900856893 learned_addr learned my addr 172.21.15.83:0/1900856893 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:38.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe49a7fc640 1 --2- 172.21.15.83:0/1900856893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe49c0aed20 0x7fe49c0af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe49affd640 1 -- 172.21.15.83:0/1900856893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe49c0aed20 msgr2=0x7fe49c0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:38.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe49affd640 1 --2- 172.21.15.83:0/1900856893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe49c0aed20 0x7fe49c0af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe49affd640 1 -- 172.21.15.83:0/1900856893 >> v1:172.21.15.83:6789/0 conn(0x7fe49c15fee0 legacy=0x7fe49c160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe49affd640 1 -- 172.21.15.83:0/1900856893 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49c0cfcb0 con 0x7fe49c0b4830 2024-03-30T13:08:38.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe49affd640 1 --2- 172.21.15.83:0/1900856893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe49c0b4830 0x7fe49c15d340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0097c0 tx=0x7fe48c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ff19b84de89e37 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:38.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe499ffb640 1 -- 172.21.15.83:0/1900856893 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0b0070 con 0x7fe49c0b4830 2024-03-30T13:08:38.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe499ffb640 1 -- 172.21.15.83:0/1900856893 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe48c004230 con 0x7fe49c0b4830 2024-03-30T13:08:38.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe499ffb640 1 -- 172.21.15.83:0/1900856893 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c003620 con 0x7fe49c0b4830 2024-03-30T13:08:38.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 -- 172.21.15.83:0/1900856893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe49c0b4830 msgr2=0x7fe49c15d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 --2- 172.21.15.83:0/1900856893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe49c0b4830 0x7fe49c15d340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0097c0 tx=0x7fe48c01c350 comp rx=0 tx=0).stop 2024-03-30T13:08:38.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 -- 172.21.15.83:0/1900856893 shutdown_connections 2024-03-30T13:08:38.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 --2- 172.21.15.83:0/1900856893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe49c0aed20 0x7fe49c0af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 --2- 172.21.15.83:0/1900856893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe49c0b4830 0x7fe49c15d340 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 -- 172.21.15.83:0/1900856893 >> 172.21.15.83:0/1900856893 conn(0x7fe49c0b1d60 msgr2=0x7fe49c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:38.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 -- 172.21.15.83:0/1900856893 shutdown_connections 2024-03-30T13:08:38.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.081+0000 7fe4a1398640 1 -- 172.21.15.83:0/1900856893 wait complete. 2024-03-30T13:08:38.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4a1398640 1 Processor -- start 2024-03-30T13:08:38.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4a1398640 1 -- start start 2024-03-30T13:08:38.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4a1398640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe49c0aed20 0x7fe49c14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4a1398640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe49c0b4830 0x7fe49c149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4a1398640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe49c15fee0 0x7fe49c14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4a1398640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c0af6e0 con 0x7fe49c15fee0 2024-03-30T13:08:38.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4a1398640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c06fa90 con 0x7fe49c0b4830 2024-03-30T13:08:38.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4a1398640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe49c0cf860 con 0x7fe49c0aed20 2024-03-30T13:08:38.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe49c15fee0 0x7fe49c14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe49c15fee0 0x7fe49c14d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59504/0 (socket says 172.21.15.83:59504) 2024-03-30T13:08:38.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe49b7fe640 1 -- 172.21.15.83:0/1177428501 learned_addr learned my addr 172.21.15.83:0/1177428501 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:38.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe49affd640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe49c0aed20 0x7fe49c14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe49a7fc640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe49c0b4830 0x7fe49c149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe49b7fe640 1 -- 172.21.15.83:0/1177428501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe49c0aed20 msgr2=0x7fe49c14b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe49b7fe640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe49c0aed20 0x7fe49c14b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe49b7fe640 1 -- 172.21.15.83:0/1177428501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe49c0b4830 msgr2=0x7fe49c149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe49b7fe640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe49c0b4830 0x7fe49c149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe49b7fe640 1 -- 172.21.15.83:0/1177428501 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49c14bf20 con 0x7fe49c15fee0 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe49affd640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe49c0aed20 0x7fe49c14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe49b7fe640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe49c15fee0 0x7fe49c14d9f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe49400caa0 tx=0x7fe49400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4837fe640 1 -- 172.21.15.83:0/1177428501 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494017070 con 0x7fe49c15fee0 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4837fe640 1 -- 172.21.15.83:0/1177428501 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe49400ab40 con 0x7fe49c15fee0 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4a1398640 1 -- 172.21.15.83:0/1177428501 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe49c14a910 con 0x7fe49c15fee0 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4837fe640 1 -- 172.21.15.83:0/1177428501 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494012400 con 0x7fe49c15fee0 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4a1398640 1 -- 172.21.15.83:0/1177428501 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe49c14f070 con 0x7fe49c15fee0 2024-03-30T13:08:38.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4a1398640 1 -- 172.21.15.83:0/1177428501 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe49c0686c0 con 0x7fe49c15fee0 2024-03-30T13:08:38.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.085+0000 7fe4837fe640 1 -- 172.21.15.83:0/1177428501 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fe49401a070 con 0x7fe49c15fee0 2024-03-30T13:08:38.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.089+0000 7fe4837fe640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe488067fc0 0x7fe48806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.089+0000 7fe4837fe640 1 -- 172.21.15.83:0/1177428501 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe494086050 con 0x7fe49c15fee0 2024-03-30T13:08:38.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.089+0000 7fe49affd640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe488067fc0 0x7fe48806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.089+0000 7fe49affd640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe488067fc0 0x7fe48806a480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0ad000 tx=0x7fe48c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:38.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.093+0000 7fe4837fe640 1 -- 172.21.15.83:0/1177428501 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fe4940561b0 con 0x7fe49c15fee0 2024-03-30T13:08:38.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.241+0000 7fe4a1398640 1 -- 172.21.15.83:0/1177428501 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe49c0d09e0 con 0x7fe488067fc0 2024-03-30T13:08:38.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.257+0000 7fe4837fe640 1 -- 172.21.15.83:0/1177428501 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7fe49c0d09e0 con 0x7fe488067fc0 2024-03-30T13:08:38.265 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:38.266 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:08:38.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.261+0000 7fe4a1398640 1 -- 172.21.15.83:0/1177428501 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe488067fc0 msgr2=0x7fe48806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.261+0000 7fe4a1398640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe488067fc0 0x7fe48806a480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0ad000 tx=0x7fe48c008040 comp rx=0 tx=0).stop 2024-03-30T13:08:38.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.261+0000 7fe4a1398640 1 -- 172.21.15.83:0/1177428501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe49c15fee0 msgr2=0x7fe49c14d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.261+0000 7fe4a1398640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe49c15fee0 0x7fe49c14d9f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe49400caa0 tx=0x7fe49400cf60 comp rx=0 tx=0).stop 2024-03-30T13:08:38.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.261+0000 7fe4a1398640 1 -- 172.21.15.83:0/1177428501 shutdown_connections 2024-03-30T13:08:38.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.261+0000 7fe4a1398640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe488067fc0 0x7fe48806a480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.261+0000 7fe4a1398640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe49c15fee0 0x7fe49c14d9f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.261+0000 7fe4a1398640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe49c0b4830 0x7fe49c149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.261+0000 7fe4a1398640 1 --2- 172.21.15.83:0/1177428501 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe49c0aed20 0x7fe49c14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.261+0000 7fe4a1398640 1 -- 172.21.15.83:0/1177428501 >> 172.21.15.83:0/1177428501 conn(0x7fe49c0b1d60 msgr2=0x7fe49c15ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:38.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.261+0000 7fe4a1398640 1 -- 172.21.15.83:0/1177428501 shutdown_connections 2024-03-30T13:08:38.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.261+0000 7fe4a1398640 1 -- 172.21.15.83:0/1177428501 wait complete. 2024-03-30T13:08:38.281 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-03-30T13:08:38.145038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2924544,"data_stored":1770620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.900512"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847699+0000","last_change":"2024-03-30T13:08:26.268523+0000","last_active":"2024-03-30T13:08:27.847699+0000","last_peered":"2024-03-30T13:08:27.847699+0000","last_clean":"2024-03-30T13:08:27.847699+0000","last_became_active":"2024-03-30T13:08:26.267614+0000","last_became_peered":"2024-03-30T13:08:26.267614+0000","last_unstale":"2024-03-30T13:08:27.847699+0000","last_undegraded":"2024-03-30T13:08:27.847699+0000","last_fullsized":"2024-03-30T13:08:27.847699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:07.743621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246696+0000","last_change":"2024-03-30T13:08:26.263035+0000","last_active":"2024-03-30T13:08:27.246696+0000","last_peered":"2024-03-30T13:08:27.246696+0000","last_clean":"2024-03-30T13:08:27.246696+0000","last_became_active":"2024-03-30T13:08:26.262669+0000","last_became_peered":"2024-03-30T13:08:26.262669+0000","last_unstale":"2024-03-30T13:08:27.246696+0000","last_undegraded":"2024-03-30T13:08:27.246696+0000","last_fullsized":"2024-03-30T13:08:27.246696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433514+0000","last_change":"2024-03-30T13:08:26.247241+0000","last_active":"2024-03-30T13:08:27.433514+0000","last_peered":"2024-03-30T13:08:27.433514+0000","last_clean":"2024-03-30T13:08:27.433514+0000","last_became_active":"2024-03-30T13:08:26.246633+0000","last_became_peered":"2024-03-30T13:08:26.246633+0000","last_unstale":"2024-03-30T13:08:27.433514+0000","last_undegraded":"2024-03-30T13:08:27.433514+0000","last_fullsized":"2024-03-30T13:08:27.433514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247342+0000","last_change":"2024-03-30T13:08:26.267093+0000","last_active":"2024-03-30T13:08:27.247342+0000","last_peered":"2024-03-30T13:08:27.247342+0000","last_clean":"2024-03-30T13:08:27.247342+0000","last_became_active":"2024-03-30T13:08:26.266648+0000","last_became_peered":"2024-03-30T13:08:26.266648+0000","last_unstale":"2024-03-30T13:08:27.247342+0000","last_undegraded":"2024-03-30T13:08:27.247342+0000","last_fullsized":"2024-03-30T13:08:27.247342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847414+0000","last_change":"2024-03-30T13:08:26.268233+0000","last_active":"2024-03-30T13:08:27.847414+0000","last_peered":"2024-03-30T13:08:27.847414+0000","last_clean":"2024-03-30T13:08:27.847414+0000","last_became_active":"2024-03-30T13:08:26.267934+0000","last_became_peered":"2024-03-30T13:08:26.267934+0000","last_unstale":"2024-03-30T13:08:27.847414+0000","last_undegraded":"2024-03-30T13:08:27.847414+0000","last_fullsized":"2024-03-30T13:08:27.847414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:33.096715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247522+0000","last_change":"2024-03-30T13:08:26.262334+0000","last_active":"2024-03-30T13:08:27.247522+0000","last_peered":"2024-03-30T13:08:27.247522+0000","last_clean":"2024-03-30T13:08:27.247522+0000","last_became_active":"2024-03-30T13:08:26.262065+0000","last_became_peered":"2024-03-30T13:08:26.262065+0000","last_unstale":"2024-03-30T13:08:27.247522+0000","last_undegraded":"2024-03-30T13:08:27.247522+0000","last_fullsized":"2024-03-30T13:08:27.247522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:38.839595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847119+0000","last_change":"2024-03-30T13:08:26.266561+0000","last_active":"2024-03-30T13:08:27.847119+0000","last_peered":"2024-03-30T13:08:27.847119+0000","last_clean":"2024-03-30T13:08:27.847119+0000","last_became_active":"2024-03-30T13:08:26.266102+0000","last_became_peered":"2024-03-30T13:08:26.266102+0000","last_unstale":"2024-03-30T13:08:27.847119+0000","last_undegraded":"2024-03-30T13:08:27.847119+0000","last_fullsized":"2024-03-30T13:08:27.847119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846133+0000","last_change":"2024-03-30T13:08:26.260829+0000","last_active":"2024-03-30T13:08:27.846133+0000","last_peered":"2024-03-30T13:08:27.846133+0000","last_clean":"2024-03-30T13:08:27.846133+0000","last_became_active":"2024-03-30T13:08:26.254325+0000","last_became_peered":"2024-03-30T13:08:26.254325+0000","last_unstale":"2024-03-30T13:08:27.846133+0000","last_undegraded":"2024-03-30T13:08:27.846133+0000","last_fullsized":"2024-03-30T13:08:27.846133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:06:18.572457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847837+0000","last_change":"2024-03-30T13:08:26.270155+0000","last_active":"2024-03-30T13:08:27.847837+0000","last_peered":"2024-03-30T13:08:27.847837+0000","last_clean":"2024-03-30T13:08:27.847837+0000","last_became_active":"2024-03-30T13:08:26.268095+0000","last_became_peered":"2024-03-30T13:08:26.268095+0000","last_unstale":"2024-03-30T13:08:27.847837+0000","last_undegraded":"2024-03-30T13:08:27.847837+0000","last_fullsized":"2024-03-30T13:08:27.847837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:11:06.559848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845477+0000","last_change":"2024-03-30T13:08:26.254361+0000","last_active":"2024-03-30T13:08:27.845477+0000","last_peered":"2024-03-30T13:08:27.845477+0000","last_clean":"2024-03-30T13:08:27.845477+0000","last_became_active":"2024-03-30T13:08:26.253497+0000","last_became_peered":"2024-03-30T13:08:26.253497+0000","last_unstale":"2024-03-30T13:08:27.845477+0000","last_undegraded":"2024-03-30T13:08:27.845477+0000","last_fullsized":"2024-03-30T13:08:27.845477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845664+0000","last_change":"2024-03-30T13:08:26.252884+0000","last_active":"2024-03-30T13:08:27.845664+0000","last_peered":"2024-03-30T13:08:27.845664+0000","last_clean":"2024-03-30T13:08:27.845664+0000","last_became_active":"2024-03-30T13:08:26.252506+0000","last_became_peered":"2024-03-30T13:08:26.252506+0000","last_unstale":"2024-03-30T13:08:27.845664+0000","last_undegraded":"2024-03-30T13:08:27.845664+0000","last_fullsized":"2024-03-30T13:08:27.845664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250505+0000","last_change":"2024-03-30T13:08:26.260415+0000","last_active":"2024-03-30T13:08:27.250505+0000","last_peered":"2024-03-30T13:08:27.250505+0000","last_clean":"2024-03-30T13:08:27.250505+0000","last_became_active":"2024-03-30T13:08:26.259953+0000","last_became_peered":"2024-03-30T13:08:26.259953+0000","last_unstale":"2024-03-30T13:08:27.250505+0000","last_undegraded":"2024-03-30T13:08:27.250505+0000","last_fullsized":"2024-03-30T13:08:27.250505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:15:20.022778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847088+0000","last_change":"2024-03-30T13:08:26.266434+0000","last_active":"2024-03-30T13:08:27.847088+0000","last_peered":"2024-03-30T13:08:27.847088+0000","last_clean":"2024-03-30T13:08:27.847088+0000","last_became_active":"2024-03-30T13:08:26.266165+0000","last_became_peered":"2024-03-30T13:08:26.266165+0000","last_unstale":"2024-03-30T13:08:27.847088+0000","last_undegraded":"2024-03-30T13:08:27.847088+0000","last_fullsized":"2024-03-30T13:08:27.847088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433251+0000","last_change":"2024-03-30T13:08:26.260199+0000","last_active":"2024-03-30T13:08:27.433251+0000","last_peered":"2024-03-30T13:08:27.433251+0000","last_clean":"2024-03-30T13:08:27.433251+0000","last_became_active":"2024-03-30T13:08:26.259816+0000","last_became_peered":"2024-03-30T13:08:26.259816+0000","last_unstale":"2024-03-30T13:08:27.433251+0000","last_undegraded":"2024-03-30T13:08:27.433251+0000","last_fullsized":"2024-03-30T13:08:27.433251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:25:49.517498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246122+0000","last_change":"2024-03-30T13:08:26.253691+0000","last_active":"2024-03-30T13:08:27.246122+0000","last_peered":"2024-03-30T13:08:27.246122+0000","last_clean":"2024-03-30T13:08:27.246122+0000","last_became_active":"2024-03-30T13:08:26.253423+0000","last_became_peered":"2024-03-30T13:08:26.253423+0000","last_unstale":"2024-03-30T13:08:27.246122+0000","last_undegraded":"2024-03-30T13:08:27.246122+0000","last_fullsized":"2024-03-30T13:08:27.246122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246924+0000","last_change":"2024-03-30T13:08:26.256141+0000","last_active":"2024-03-30T13:08:27.246924+0000","last_peered":"2024-03-30T13:08:27.246924+0000","last_clean":"2024-03-30T13:08:27.246924+0000","last_became_active":"2024-03-30T13:08:26.255881+0000","last_became_peered":"2024-03-30T13:08:26.255881+0000","last_unstale":"2024-03-30T13:08:27.246924+0000","last_undegraded":"2024-03-30T13:08:27.246924+0000","last_fullsized":"2024-03-30T13:08:27.246924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250662+0000","last_change":"2024-03-30T13:08:26.258857+0000","last_active":"2024-03-30T13:08:27.250662+0000","last_peered":"2024-03-30T13:08:27.250662+0000","last_clean":"2024-03-30T13:08:27.250662+0000","last_became_active":"2024-03-30T13:08:26.258537+0000","last_became_peered":"2024-03-30T13:08:26.258537+0000","last_unstale":"2024-03-30T13:08:27.250662+0000","last_undegraded":"2024-03-30T13:08:27.250662+0000","last_fullsized":"2024-03-30T13:08:27.250662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:52:03.940597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846186+0000","last_change":"2024-03-30T13:08:26.256951+0000","last_active":"2024-03-30T13:08:27.846186+0000","last_peered":"2024-03-30T13:08:27.846186+0000","last_clean":"2024-03-30T13:08:27.846186+0000","last_became_active":"2024-03-30T13:08:26.256610+0000","last_became_peered":"2024-03-30T13:08:26.256610+0000","last_unstale":"2024-03-30T13:08:27.846186+0000","last_undegraded":"2024-03-30T13:08:27.846186+0000","last_fullsized":"2024-03-30T13:08:27.846186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:32.954292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847955+0000","last_change":"2024-03-30T13:08:26.263617+0000","last_active":"2024-03-30T13:08:27.847955+0000","last_peered":"2024-03-30T13:08:27.847955+0000","last_clean":"2024-03-30T13:08:27.847955+0000","last_became_active":"2024-03-30T13:08:26.262858+0000","last_became_peered":"2024-03-30T13:08:26.262858+0000","last_unstale":"2024-03-30T13:08:27.847955+0000","last_undegraded":"2024-03-30T13:08:27.847955+0000","last_fullsized":"2024-03-30T13:08:27.847955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:17.381480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845439+0000","last_change":"2024-03-30T13:08:26.267101+0000","last_active":"2024-03-30T13:08:27.845439+0000","last_peered":"2024-03-30T13:08:27.845439+0000","last_clean":"2024-03-30T13:08:27.845439+0000","last_became_active":"2024-03-30T13:08:26.266836+0000","last_became_peered":"2024-03-30T13:08:26.266836+0000","last_unstale":"2024-03-30T13:08:27.845439+0000","last_undegraded":"2024-03-30T13:08:27.845439+0000","last_fullsized":"2024-03-30T13:08:27.845439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433468+0000","last_change":"2024-03-30T13:08:26.263715+0000","last_active":"2024-03-30T13:08:27.433468+0000","last_peered":"2024-03-30T13:08:27.433468+0000","last_clean":"2024-03-30T13:08:27.433468+0000","last_became_active":"2024-03-30T13:08:26.263309+0000","last_became_peered":"2024-03-30T13:08:26.263309+0000","last_unstale":"2024-03-30T13:08:27.433468+0000","last_undegraded":"2024-03-30T13:08:27.433468+0000","last_fullsized":"2024-03-30T13:08:27.433468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247889+0000","last_change":"2024-03-30T13:08:26.255497+0000","last_active":"2024-03-30T13:08:27.247889+0000","last_peered":"2024-03-30T13:08:27.247889+0000","last_clean":"2024-03-30T13:08:27.247889+0000","last_became_active":"2024-03-30T13:08:26.255198+0000","last_became_peered":"2024-03-30T13:08:26.255198+0000","last_unstale":"2024-03-30T13:08:27.247889+0000","last_undegraded":"2024-03-30T13:08:27.247889+0000","last_fullsized":"2024-03-30T13:08:27.247889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:33.096715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846623+0000","last_change":"2024-03-30T13:08:26.267231+0000","last_active":"2024-03-30T13:08:27.846623+0000","last_peered":"2024-03-30T13:08:27.846623+0000","last_clean":"2024-03-30T13:08:27.846623+0000","last_became_active":"2024-03-30T13:08:26.266897+0000","last_became_peered":"2024-03-30T13:08:26.266897+0000","last_unstale":"2024-03-30T13:08:27.846623+0000","last_undegraded":"2024-03-30T13:08:27.846623+0000","last_fullsized":"2024-03-30T13:08:27.846623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246893+0000","last_change":"2024-03-30T13:08:26.254581+0000","last_active":"2024-03-30T13:08:27.246893+0000","last_peered":"2024-03-30T13:08:27.246893+0000","last_clean":"2024-03-30T13:08:27.246893+0000","last_became_active":"2024-03-30T13:08:26.254315+0000","last_became_peered":"2024-03-30T13:08:26.254315+0000","last_unstale":"2024-03-30T13:08:27.246893+0000","last_undegraded":"2024-03-30T13:08:27.246893+0000","last_fullsized":"2024-03-30T13:08:27.246893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846776+0000","last_change":"2024-03-30T13:08:26.261482+0000","last_active":"2024-03-30T13:08:27.846776+0000","last_peered":"2024-03-30T13:08:27.846776+0000","last_clean":"2024-03-30T13:08:27.846776+0000","last_became_active":"2024-03-30T13:08:26.260033+0000","last_became_peered":"2024-03-30T13:08:26.260033+0000","last_unstale":"2024-03-30T13:08:27.846776+0000","last_undegraded":"2024-03-30T13:08:27.846776+0000","last_fullsized":"2024-03-30T13:08:27.846776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845559+0000","last_change":"2024-03-30T13:08:26.256864+0000","last_active":"2024-03-30T13:08:27.845559+0000","last_peered":"2024-03-30T13:08:27.845559+0000","last_clean":"2024-03-30T13:08:27.845559+0000","last_became_active":"2024-03-30T13:08:26.256473+0000","last_became_peered":"2024-03-30T13:08:26.256473+0000","last_unstale":"2024-03-30T13:08:27.845559+0000","last_undegraded":"2024-03-30T13:08:27.845559+0000","last_fullsized":"2024-03-30T13:08:27.845559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246353+0000","last_change":"2024-03-30T13:08:26.258095+0000","last_active":"2024-03-30T13:08:27.246353+0000","last_peered":"2024-03-30T13:08:27.246353+0000","last_clean":"2024-03-30T13:08:27.246353+0000","last_became_active":"2024-03-30T13:08:26.257730+0000","last_became_peered":"2024-03-30T13:08:26.257730+0000","last_unstale":"2024-03-30T13:08:27.246353+0000","last_undegraded":"2024-03-30T13:08:27.246353+0000","last_fullsized":"2024-03-30T13:08:27.246353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847781+0000","last_change":"2024-03-30T13:08:26.273733+0000","last_active":"2024-03-30T13:08:27.847781+0000","last_peered":"2024-03-30T13:08:27.847781+0000","last_clean":"2024-03-30T13:08:27.847781+0000","last_became_active":"2024-03-30T13:08:26.273292+0000","last_became_peered":"2024-03-30T13:08:26.273292+0000","last_unstale":"2024-03-30T13:08:27.847781+0000","last_undegraded":"2024-03-30T13:08:27.847781+0000","last_fullsized":"2024-03-30T13:08:27.847781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:09:50.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433604+0000","last_change":"2024-03-30T13:08:26.268609+0000","last_active":"2024-03-30T13:08:27.433604+0000","last_peered":"2024-03-30T13:08:27.433604+0000","last_clean":"2024-03-30T13:08:27.433604+0000","last_became_active":"2024-03-30T13:08:26.267927+0000","last_became_peered":"2024-03-30T13:08:26.267927+0000","last_unstale":"2024-03-30T13:08:27.433604+0000","last_undegraded":"2024-03-30T13:08:27.433604+0000","last_fullsized":"2024-03-30T13:08:27.433604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248242+0000","last_change":"2024-03-30T13:08:26.266866+0000","last_active":"2024-03-30T13:08:27.248242+0000","last_peered":"2024-03-30T13:08:27.248242+0000","last_clean":"2024-03-30T13:08:27.248242+0000","last_became_active":"2024-03-30T13:08:26.266575+0000","last_became_peered":"2024-03-30T13:08:26.266575+0000","last_unstale":"2024-03-30T13:08:27.248242+0000","last_undegraded":"2024-03-30T13:08:27.248242+0000","last_fullsized":"2024-03-30T13:08:27.248242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:09:50.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845802+0000","last_change":"2024-03-30T13:08:26.254723+0000","last_active":"2024-03-30T13:08:27.845802+0000","last_peered":"2024-03-30T13:08:27.845802+0000","last_clean":"2024-03-30T13:08:27.845802+0000","last_became_active":"2024-03-30T13:08:26.254265+0000","last_became_peered":"2024-03-30T13:08:26.254265+0000","last_unstale":"2024-03-30T13:08:27.845802+0000","last_undegraded":"2024-03-30T13:08:27.845802+0000","last_fullsized":"2024-03-30T13:08:27.845802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:15:20.022778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845227+0000","last_change":"2024-03-30T13:08:26.262550+0000","last_active":"2024-03-30T13:08:27.845227+0000","last_peered":"2024-03-30T13:08:27.845227+0000","last_clean":"2024-03-30T13:08:27.845227+0000","last_became_active":"2024-03-30T13:08:26.262229+0000","last_became_peered":"2024-03-30T13:08:26.262229+0000","last_unstale":"2024-03-30T13:08:27.845227+0000","last_undegraded":"2024-03-30T13:08:27.845227+0000","last_fullsized":"2024-03-30T13:08:27.845227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:00:23.772051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247533+0000","last_change":"2024-03-30T13:08:26.243305+0000","last_active":"2024-03-30T13:08:27.247533+0000","last_peered":"2024-03-30T13:08:27.247533+0000","last_clean":"2024-03-30T13:08:27.247533+0000","last_became_active":"2024-03-30T13:08:26.242498+0000","last_became_peered":"2024-03-30T13:08:26.242498+0000","last_unstale":"2024-03-30T13:08:27.247533+0000","last_undegraded":"2024-03-30T13:08:27.247533+0000","last_fullsized":"2024-03-30T13:08:27.247533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:33.361760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847372+0000","last_change":"2024-03-30T13:08:25.270817+0000","last_active":"2024-03-30T13:08:27.847372+0000","last_peered":"2024-03-30T13:08:27.847372+0000","last_clean":"2024-03-30T13:08:27.847372+0000","last_became_active":"2024-03-30T13:08:25.270460+0000","last_became_peered":"2024-03-30T13:08:25.270460+0000","last_unstale":"2024-03-30T13:08:27.847372+0000","last_undegraded":"2024-03-30T13:08:27.847372+0000","last_fullsized":"2024-03-30T13:08:27.847372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:07:26.410219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433632+0000","last_change":"2024-03-30T13:08:26.267853+0000","last_active":"2024-03-30T13:08:27.433632+0000","last_peered":"2024-03-30T13:08:27.433632+0000","last_clean":"2024-03-30T13:08:27.433632+0000","last_became_active":"2024-03-30T13:08:26.267527+0000","last_became_peered":"2024-03-30T13:08:26.267527+0000","last_unstale":"2024-03-30T13:08:27.433632+0000","last_undegraded":"2024-03-30T13:08:27.433632+0000","last_fullsized":"2024-03-30T13:08:27.433632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845594+0000","last_change":"2024-03-30T13:08:25.253579+0000","last_active":"2024-03-30T13:08:27.845594+0000","last_peered":"2024-03-30T13:08:27.845594+0000","last_clean":"2024-03-30T13:08:27.845594+0000","last_became_active":"2024-03-30T13:08:25.252838+0000","last_became_peered":"2024-03-30T13:08:25.252838+0000","last_unstale":"2024-03-30T13:08:27.845594+0000","last_undegraded":"2024-03-30T13:08:27.845594+0000","last_fullsized":"2024-03-30T13:08:27.845594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:35:44.891908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847051+0000","last_change":"2024-03-30T13:08:25.255081+0000","last_active":"2024-03-30T13:08:27.847051+0000","last_peered":"2024-03-30T13:08:27.847051+0000","last_clean":"2024-03-30T13:08:27.847051+0000","last_became_active":"2024-03-30T13:08:25.254790+0000","last_became_peered":"2024-03-30T13:08:25.254790+0000","last_unstale":"2024-03-30T13:08:27.847051+0000","last_undegraded":"2024-03-30T13:08:27.847051+0000","last_fullsized":"2024-03-30T13:08:27.847051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846524+0000","last_change":"2024-03-30T13:08:26.269902+0000","last_active":"2024-03-30T13:08:27.846524+0000","last_peered":"2024-03-30T13:08:27.846524+0000","last_clean":"2024-03-30T13:08:27.846524+0000","last_became_active":"2024-03-30T13:08:26.269503+0000","last_became_peered":"2024-03-30T13:08:26.269503+0000","last_unstale":"2024-03-30T13:08:27.846524+0000","last_undegraded":"2024-03-30T13:08:27.846524+0000","last_fullsized":"2024-03-30T13:08:27.846524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:09.810819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247045+0000","last_change":"2024-03-30T13:08:25.273212+0000","last_active":"2024-03-30T13:08:27.247045+0000","last_peered":"2024-03-30T13:08:27.247045+0000","last_clean":"2024-03-30T13:08:27.247045+0000","last_became_active":"2024-03-30T13:08:25.269863+0000","last_became_peered":"2024-03-30T13:08:25.269863+0000","last_unstale":"2024-03-30T13:08:27.247045+0000","last_undegraded":"2024-03-30T13:08:27.247045+0000","last_fullsized":"2024-03-30T13:08:27.247045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:39.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246339+0000","last_change":"2024-03-30T13:08:26.270878+0000","last_active":"2024-03-30T13:08:27.246339+0000","last_peered":"2024-03-30T13:08:27.246339+0000","last_clean":"2024-03-30T13:08:27.246339+0000","last_became_active":"2024-03-30T13:08:26.270607+0000","last_became_peered":"2024-03-30T13:08:26.270607+0000","last_unstale":"2024-03-30T13:08:27.246339+0000","last_undegraded":"2024-03-30T13:08:27.246339+0000","last_fullsized":"2024-03-30T13:08:27.246339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845448+0000","last_change":"2024-03-30T13:08:25.271725+0000","last_active":"2024-03-30T13:08:27.845448+0000","last_peered":"2024-03-30T13:08:27.845448+0000","last_clean":"2024-03-30T13:08:27.845448+0000","last_became_active":"2024-03-30T13:08:25.271059+0000","last_became_peered":"2024-03-30T13:08:25.271059+0000","last_unstale":"2024-03-30T13:08:27.845448+0000","last_undegraded":"2024-03-30T13:08:27.845448+0000","last_fullsized":"2024-03-30T13:08:27.845448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249536+0000","last_change":"2024-03-30T13:08:26.256649+0000","last_active":"2024-03-30T13:08:27.249536+0000","last_peered":"2024-03-30T13:08:27.249536+0000","last_clean":"2024-03-30T13:08:27.249536+0000","last_became_active":"2024-03-30T13:08:26.256365+0000","last_became_peered":"2024-03-30T13:08:26.256365+0000","last_unstale":"2024-03-30T13:08:27.249536+0000","last_undegraded":"2024-03-30T13:08:27.249536+0000","last_fullsized":"2024-03-30T13:08:27.249536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:34:59.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249749+0000","last_change":"2024-03-30T13:08:25.258848+0000","last_active":"2024-03-30T13:08:27.249749+0000","last_peered":"2024-03-30T13:08:27.249749+0000","last_clean":"2024-03-30T13:08:27.249749+0000","last_became_active":"2024-03-30T13:08:25.258153+0000","last_became_peered":"2024-03-30T13:08:25.258153+0000","last_unstale":"2024-03-30T13:08:27.249749+0000","last_undegraded":"2024-03-30T13:08:27.249749+0000","last_fullsized":"2024-03-30T13:08:27.249749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:24:11.686334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433812+0000","last_change":"2024-03-30T13:08:26.248994+0000","last_active":"2024-03-30T13:08:27.433812+0000","last_peered":"2024-03-30T13:08:27.433812+0000","last_clean":"2024-03-30T13:08:27.433812+0000","last_became_active":"2024-03-30T13:08:26.248649+0000","last_became_peered":"2024-03-30T13:08:26.248649+0000","last_unstale":"2024-03-30T13:08:27.433812+0000","last_undegraded":"2024-03-30T13:08:27.433812+0000","last_fullsized":"2024-03-30T13:08:27.433812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:16.136564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246424+0000","last_change":"2024-03-30T13:08:25.271938+0000","last_active":"2024-03-30T13:08:27.246424+0000","last_peered":"2024-03-30T13:08:27.246424+0000","last_clean":"2024-03-30T13:08:27.246424+0000","last_became_active":"2024-03-30T13:08:25.271537+0000","last_became_peered":"2024-03-30T13:08:25.271537+0000","last_unstale":"2024-03-30T13:08:27.246424+0000","last_undegraded":"2024-03-30T13:08:27.246424+0000","last_fullsized":"2024-03-30T13:08:27.246424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:25:11.691446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250784+0000","last_change":"2024-03-30T13:08:26.258598+0000","last_active":"2024-03-30T13:08:27.250784+0000","last_peered":"2024-03-30T13:08:27.250784+0000","last_clean":"2024-03-30T13:08:27.250784+0000","last_became_active":"2024-03-30T13:08:26.258283+0000","last_became_peered":"2024-03-30T13:08:26.258283+0000","last_unstale":"2024-03-30T13:08:27.250784+0000","last_undegraded":"2024-03-30T13:08:27.250784+0000","last_fullsized":"2024-03-30T13:08:27.250784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:32.954292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845682+0000","last_change":"2024-03-30T13:08:25.257898+0000","last_active":"2024-03-30T13:08:27.845682+0000","last_peered":"2024-03-30T13:08:27.845682+0000","last_clean":"2024-03-30T13:08:27.845682+0000","last_became_active":"2024-03-30T13:08:25.257311+0000","last_became_peered":"2024-03-30T13:08:25.257311+0000","last_unstale":"2024-03-30T13:08:27.845682+0000","last_undegraded":"2024-03-30T13:08:27.845682+0000","last_fullsized":"2024-03-30T13:08:27.845682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847509+0000","last_change":"2024-03-30T13:08:26.263276+0000","last_active":"2024-03-30T13:08:27.847509+0000","last_peered":"2024-03-30T13:08:27.847509+0000","last_clean":"2024-03-30T13:08:27.847509+0000","last_became_active":"2024-03-30T13:08:26.262279+0000","last_became_peered":"2024-03-30T13:08:26.262279+0000","last_unstale":"2024-03-30T13:08:27.847509+0000","last_undegraded":"2024-03-30T13:08:27.847509+0000","last_fullsized":"2024-03-30T13:08:27.847509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:09:50.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433714+0000","last_change":"2024-03-30T13:08:25.247025+0000","last_active":"2024-03-30T13:08:27.433714+0000","last_peered":"2024-03-30T13:08:27.433714+0000","last_clean":"2024-03-30T13:08:27.433714+0000","last_became_active":"2024-03-30T13:08:25.246656+0000","last_became_peered":"2024-03-30T13:08:25.246656+0000","last_unstale":"2024-03-30T13:08:27.433714+0000","last_undegraded":"2024-03-30T13:08:27.433714+0000","last_fullsized":"2024-03-30T13:08:27.433714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433293+0000","last_change":"2024-03-30T13:08:26.260804+0000","last_active":"2024-03-30T13:08:27.433293+0000","last_peered":"2024-03-30T13:08:27.433293+0000","last_clean":"2024-03-30T13:08:27.433293+0000","last_became_active":"2024-03-30T13:08:26.260342+0000","last_became_peered":"2024-03-30T13:08:26.260342+0000","last_unstale":"2024-03-30T13:08:27.433293+0000","last_undegraded":"2024-03-30T13:08:27.433293+0000","last_fullsized":"2024-03-30T13:08:27.433293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:00:23.772051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248471+0000","last_change":"2024-03-30T13:08:25.266076+0000","last_active":"2024-03-30T13:08:27.248471+0000","last_peered":"2024-03-30T13:08:27.248471+0000","last_clean":"2024-03-30T13:08:27.248471+0000","last_became_active":"2024-03-30T13:08:25.264628+0000","last_became_peered":"2024-03-30T13:08:25.264628+0000","last_unstale":"2024-03-30T13:08:27.248471+0000","last_undegraded":"2024-03-30T13:08:27.248471+0000","last_fullsized":"2024-03-30T13:08:27.248471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847623+0000","last_change":"2024-03-30T13:08:26.272989+0000","last_active":"2024-03-30T13:08:27.847623+0000","last_peered":"2024-03-30T13:08:27.847623+0000","last_clean":"2024-03-30T13:08:27.847623+0000","last_became_active":"2024-03-30T13:08:26.272715+0000","last_became_peered":"2024-03-30T13:08:26.272715+0000","last_unstale":"2024-03-30T13:08:27.847623+0000","last_undegraded":"2024-03-30T13:08:27.847623+0000","last_fullsized":"2024-03-30T13:08:27.847623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:51:01.414724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845237+0000","last_change":"2024-03-30T13:08:25.255530+0000","last_active":"2024-03-30T13:08:27.845237+0000","last_peered":"2024-03-30T13:08:27.845237+0000","last_clean":"2024-03-30T13:08:27.845237+0000","last_became_active":"2024-03-30T13:08:25.254828+0000","last_became_peered":"2024-03-30T13:08:25.254828+0000","last_unstale":"2024-03-30T13:08:27.845237+0000","last_undegraded":"2024-03-30T13:08:27.845237+0000","last_fullsized":"2024-03-30T13:08:27.845237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:07:26.410219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845374+0000","last_change":"2024-03-30T13:08:26.262416+0000","last_active":"2024-03-30T13:08:27.845374+0000","last_peered":"2024-03-30T13:08:27.845374+0000","last_clean":"2024-03-30T13:08:27.845374+0000","last_became_active":"2024-03-30T13:08:26.262147+0000","last_became_peered":"2024-03-30T13:08:26.262147+0000","last_unstale":"2024-03-30T13:08:27.845374+0000","last_undegraded":"2024-03-30T13:08:27.845374+0000","last_fullsized":"2024-03-30T13:08:27.845374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:06:18.572457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845499+0000","last_change":"2024-03-30T13:08:25.244929+0000","last_active":"2024-03-30T13:08:27.845499+0000","last_peered":"2024-03-30T13:08:27.845499+0000","last_clean":"2024-03-30T13:08:27.845499+0000","last_became_active":"2024-03-30T13:08:25.244565+0000","last_became_peered":"2024-03-30T13:08:25.244565+0000","last_unstale":"2024-03-30T13:08:27.845499+0000","last_undegraded":"2024-03-30T13:08:27.845499+0000","last_fullsized":"2024-03-30T13:08:27.845499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:24.519549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847184+0000","last_change":"2024-03-30T13:08:26.270298+0000","last_active":"2024-03-30T13:08:27.847184+0000","last_peered":"2024-03-30T13:08:27.847184+0000","last_clean":"2024-03-30T13:08:27.847184+0000","last_became_active":"2024-03-30T13:08:26.270008+0000","last_became_peered":"2024-03-30T13:08:26.270008+0000","last_unstale":"2024-03-30T13:08:27.847184+0000","last_undegraded":"2024-03-30T13:08:27.847184+0000","last_fullsized":"2024-03-30T13:08:27.847184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:38.839595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.250765+0000","last_change":"2024-03-30T13:08:25.247533+0000","last_active":"2024-03-30T13:08:27.250765+0000","last_peered":"2024-03-30T13:08:27.250765+0000","last_clean":"2024-03-30T13:08:27.250765+0000","last_became_active":"2024-03-30T13:08:25.246529+0000","last_became_peered":"2024-03-30T13:08:25.246529+0000","last_unstale":"2024-03-30T13:08:27.250765+0000","last_undegraded":"2024-03-30T13:08:27.250765+0000","last_fullsized":"2024-03-30T13:08:27.250765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:47.553831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.848594+0000","last_change":"2024-03-30T13:08:26.273076+0000","last_active":"2024-03-30T13:08:27.848594+0000","last_peered":"2024-03-30T13:08:27.848594+0000","last_clean":"2024-03-30T13:08:27.848594+0000","last_became_active":"2024-03-30T13:08:26.272648+0000","last_became_peered":"2024-03-30T13:08:26.272648+0000","last_unstale":"2024-03-30T13:08:27.848594+0000","last_undegraded":"2024-03-30T13:08:27.848594+0000","last_fullsized":"2024-03-30T13:08:27.848594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:38:27.246797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846430+0000","last_change":"2024-03-30T13:08:25.246374+0000","last_active":"2024-03-30T13:08:27.846430+0000","last_peered":"2024-03-30T13:08:27.846430+0000","last_clean":"2024-03-30T13:08:27.846430+0000","last_became_active":"2024-03-30T13:08:25.246054+0000","last_became_peered":"2024-03-30T13:08:25.246054+0000","last_unstale":"2024-03-30T13:08:27.846430+0000","last_undegraded":"2024-03-30T13:08:27.846430+0000","last_fullsized":"2024-03-30T13:08:27.846430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:35:16.864101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.848301+0000","last_change":"2024-03-30T13:08:26.272977+0000","last_active":"2024-03-30T13:08:27.848301+0000","last_peered":"2024-03-30T13:08:27.848301+0000","last_clean":"2024-03-30T13:08:27.848301+0000","last_became_active":"2024-03-30T13:08:26.272484+0000","last_became_peered":"2024-03-30T13:08:26.272484+0000","last_unstale":"2024-03-30T13:08:27.848301+0000","last_undegraded":"2024-03-30T13:08:27.848301+0000","last_fullsized":"2024-03-30T13:08:27.848301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:52:03.940597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246440+0000","last_change":"2024-03-30T13:08:25.247470+0000","last_active":"2024-03-30T13:08:27.246440+0000","last_peered":"2024-03-30T13:08:27.246440+0000","last_clean":"2024-03-30T13:08:27.246440+0000","last_became_active":"2024-03-30T13:08:25.247147+0000","last_became_peered":"2024-03-30T13:08:25.247147+0000","last_unstale":"2024-03-30T13:08:27.246440+0000","last_undegraded":"2024-03-30T13:08:27.246440+0000","last_fullsized":"2024-03-30T13:08:27.246440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:07.835197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249178+0000","last_change":"2024-03-30T13:08:26.261671+0000","last_active":"2024-03-30T13:08:27.249178+0000","last_peered":"2024-03-30T13:08:27.249178+0000","last_clean":"2024-03-30T13:08:27.249178+0000","last_became_active":"2024-03-30T13:08:26.261411+0000","last_became_peered":"2024-03-30T13:08:26.261411+0000","last_unstale":"2024-03-30T13:08:27.249178+0000","last_undegraded":"2024-03-30T13:08:27.249178+0000","last_fullsized":"2024-03-30T13:08:27.249178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:45:07.743621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845955+0000","last_change":"2024-03-30T13:08:25.273872+0000","last_active":"2024-03-30T13:08:27.845955+0000","last_peered":"2024-03-30T13:08:27.845955+0000","last_clean":"2024-03-30T13:08:27.845955+0000","last_became_active":"2024-03-30T13:08:25.273570+0000","last_became_peered":"2024-03-30T13:08:25.273570+0000","last_unstale":"2024-03-30T13:08:27.845955+0000","last_undegraded":"2024-03-30T13:08:27.845955+0000","last_fullsized":"2024-03-30T13:08:27.845955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:32.352462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847718+0000","last_change":"2024-03-30T13:08:26.257523+0000","last_active":"2024-03-30T13:08:27.847718+0000","last_peered":"2024-03-30T13:08:27.847718+0000","last_clean":"2024-03-30T13:08:27.847718+0000","last_became_active":"2024-03-30T13:08:26.257150+0000","last_became_peered":"2024-03-30T13:08:26.257150+0000","last_unstale":"2024-03-30T13:08:27.847718+0000","last_undegraded":"2024-03-30T13:08:27.847718+0000","last_fullsized":"2024-03-30T13:08:27.847718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:34:59.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847028+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:08:27.847028+0000","last_peered":"2024-03-30T13:08:27.847028+0000","last_clean":"2024-03-30T13:08:27.847028+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:08:27.847028+0000","last_undegraded":"2024-03-30T13:08:27.847028+0000","last_fullsized":"2024-03-30T13:08:27.847028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.247294+0000","last_change":"2024-03-30T13:08:25.258621+0000","last_active":"2024-03-30T13:08:27.247294+0000","last_peered":"2024-03-30T13:08:27.247294+0000","last_clean":"2024-03-30T13:08:27.247294+0000","last_became_active":"2024-03-30T13:08:25.257931+0000","last_became_peered":"2024-03-30T13:08:25.257931+0000","last_unstale":"2024-03-30T13:08:27.247294+0000","last_undegraded":"2024-03-30T13:08:27.247294+0000","last_fullsized":"2024-03-30T13:08:27.247294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:25:49.567430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847645+0000","last_change":"2024-03-30T13:08:26.260707+0000","last_active":"2024-03-30T13:08:27.847645+0000","last_peered":"2024-03-30T13:08:27.847645+0000","last_clean":"2024-03-30T13:08:27.847645+0000","last_became_active":"2024-03-30T13:08:26.254479+0000","last_became_peered":"2024-03-30T13:08:26.254479+0000","last_unstale":"2024-03-30T13:08:27.847645+0000","last_undegraded":"2024-03-30T13:08:27.847645+0000","last_fullsized":"2024-03-30T13:08:27.847645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:33.096715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846876+0000","last_change":"2024-03-30T13:08:25.266025+0000","last_active":"2024-03-30T13:08:27.846876+0000","last_peered":"2024-03-30T13:08:27.846876+0000","last_clean":"2024-03-30T13:08:27.846876+0000","last_became_active":"2024-03-30T13:08:25.265377+0000","last_became_peered":"2024-03-30T13:08:25.265377+0000","last_unstale":"2024-03-30T13:08:27.846876+0000","last_undegraded":"2024-03-30T13:08:27.846876+0000","last_fullsized":"2024-03-30T13:08:27.846876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:39.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433360+0000","last_change":"2024-03-30T13:08:26.267267+0000","last_active":"2024-03-30T13:08:27.433360+0000","last_peered":"2024-03-30T13:08:27.433360+0000","last_clean":"2024-03-30T13:08:27.433360+0000","last_became_active":"2024-03-30T13:08:26.266946+0000","last_became_peered":"2024-03-30T13:08:26.266946+0000","last_unstale":"2024-03-30T13:08:27.433360+0000","last_undegraded":"2024-03-30T13:08:27.433360+0000","last_fullsized":"2024-03-30T13:08:27.433360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:06:18.572457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845756+0000","last_change":"2024-03-30T13:08:25.240103+0000","last_active":"2024-03-30T13:08:27.845756+0000","last_peered":"2024-03-30T13:08:27.845756+0000","last_clean":"2024-03-30T13:08:27.845756+0000","last_became_active":"2024-03-30T13:08:25.239719+0000","last_became_peered":"2024-03-30T13:08:25.239719+0000","last_unstale":"2024-03-30T13:08:27.845756+0000","last_undegraded":"2024-03-30T13:08:27.845756+0000","last_fullsized":"2024-03-30T13:08:27.845756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:33:02.419995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246239+0000","last_change":"2024-03-30T13:08:26.253339+0000","last_active":"2024-03-30T13:08:27.246239+0000","last_peered":"2024-03-30T13:08:27.246239+0000","last_clean":"2024-03-30T13:08:27.246239+0000","last_became_active":"2024-03-30T13:08:26.243687+0000","last_became_peered":"2024-03-30T13:08:26.243687+0000","last_unstale":"2024-03-30T13:08:27.246239+0000","last_undegraded":"2024-03-30T13:08:27.246239+0000","last_fullsized":"2024-03-30T13:08:27.246239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:34.234904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248693+0000","last_change":"2024-03-30T13:08:25.265220+0000","last_active":"2024-03-30T13:08:27.248693+0000","last_peered":"2024-03-30T13:08:27.248693+0000","last_clean":"2024-03-30T13:08:27.248693+0000","last_became_active":"2024-03-30T13:08:25.263916+0000","last_became_peered":"2024-03-30T13:08:25.263916+0000","last_unstale":"2024-03-30T13:08:27.248693+0000","last_undegraded":"2024-03-30T13:08:27.248693+0000","last_fullsized":"2024-03-30T13:08:27.248693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:25:11.691446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249508+0000","last_change":"2024-03-30T13:08:26.266484+0000","last_active":"2024-03-30T13:08:27.249508+0000","last_peered":"2024-03-30T13:08:27.249508+0000","last_clean":"2024-03-30T13:08:27.249508+0000","last_became_active":"2024-03-30T13:08:26.266155+0000","last_became_peered":"2024-03-30T13:08:26.266155+0000","last_unstale":"2024-03-30T13:08:27.249508+0000","last_undegraded":"2024-03-30T13:08:27.249508+0000","last_fullsized":"2024-03-30T13:08:27.249508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:31:26.132649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246596+0000","last_change":"2024-03-30T13:08:25.248845+0000","last_active":"2024-03-30T13:08:27.246596+0000","last_peered":"2024-03-30T13:08:27.246596+0000","last_clean":"2024-03-30T13:08:27.246596+0000","last_became_active":"2024-03-30T13:08:25.248455+0000","last_became_peered":"2024-03-30T13:08:25.248455+0000","last_unstale":"2024-03-30T13:08:27.246596+0000","last_undegraded":"2024-03-30T13:08:27.246596+0000","last_fullsized":"2024-03-30T13:08:27.246596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:39.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249863+0000","last_change":"2024-03-30T13:08:26.254255+0000","last_active":"2024-03-30T13:08:27.249863+0000","last_peered":"2024-03-30T13:08:27.249863+0000","last_clean":"2024-03-30T13:08:27.249863+0000","last_became_active":"2024-03-30T13:08:26.253990+0000","last_became_peered":"2024-03-30T13:08:26.253990+0000","last_unstale":"2024-03-30T13:08:27.249863+0000","last_undegraded":"2024-03-30T13:08:27.249863+0000","last_fullsized":"2024-03-30T13:08:27.249863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:17.381480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.848028+0000","last_change":"2024-03-30T13:08:25.275050+0000","last_active":"2024-03-30T13:08:27.848028+0000","last_peered":"2024-03-30T13:08:27.848028+0000","last_clean":"2024-03-30T13:08:27.848028+0000","last_became_active":"2024-03-30T13:08:25.270650+0000","last_became_peered":"2024-03-30T13:08:25.270650+0000","last_unstale":"2024-03-30T13:08:27.848028+0000","last_undegraded":"2024-03-30T13:08:27.848028+0000","last_fullsized":"2024-03-30T13:08:27.848028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:11.754124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246448+0000","last_change":"2024-03-30T13:08:26.252864+0000","last_active":"2024-03-30T13:08:27.246448+0000","last_peered":"2024-03-30T13:08:27.246448+0000","last_clean":"2024-03-30T13:08:27.246448+0000","last_became_active":"2024-03-30T13:08:26.252487+0000","last_became_peered":"2024-03-30T13:08:26.252487+0000","last_unstale":"2024-03-30T13:08:27.246448+0000","last_undegraded":"2024-03-30T13:08:27.246448+0000","last_fullsized":"2024-03-30T13:08:27.246448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:28.163978+0000","last_change":"2024-03-30T13:08:25.256761+0000","last_active":"2024-03-30T13:08:28.163978+0000","last_peered":"2024-03-30T13:08:28.163978+0000","last_clean":"2024-03-30T13:08:28.163978+0000","last_became_active":"2024-03-30T13:08:25.256423+0000","last_became_peered":"2024-03-30T13:08:25.256423+0000","last_unstale":"2024-03-30T13:08:28.163978+0000","last_undegraded":"2024-03-30T13:08:28.163978+0000","last_fullsized":"2024-03-30T13:08:28.163978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:11.754124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847010+0000","last_change":"2024-03-30T13:08:26.266237+0000","last_active":"2024-03-30T13:08:27.847010+0000","last_peered":"2024-03-30T13:08:27.847010+0000","last_clean":"2024-03-30T13:08:27.847010+0000","last_became_active":"2024-03-30T13:08:26.265651+0000","last_became_peered":"2024-03-30T13:08:26.265651+0000","last_unstale":"2024-03-30T13:08:27.847010+0000","last_undegraded":"2024-03-30T13:08:27.847010+0000","last_fullsized":"2024-03-30T13:08:27.847010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:55.912703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845790+0000","last_change":"2024-03-30T13:08:25.277163+0000","last_active":"2024-03-30T13:08:27.845790+0000","last_peered":"2024-03-30T13:08:27.845790+0000","last_clean":"2024-03-30T13:08:27.845790+0000","last_became_active":"2024-03-30T13:08:25.276378+0000","last_became_peered":"2024-03-30T13:08:25.276378+0000","last_unstale":"2024-03-30T13:08:27.845790+0000","last_undegraded":"2024-03-30T13:08:27.845790+0000","last_fullsized":"2024-03-30T13:08:27.845790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:24:11.686334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433709+0000","last_change":"2024-03-30T13:08:26.260918+0000","last_active":"2024-03-30T13:08:27.433709+0000","last_peered":"2024-03-30T13:08:27.433709+0000","last_clean":"2024-03-30T13:08:27.433709+0000","last_became_active":"2024-03-30T13:08:26.260191+0000","last_became_peered":"2024-03-30T13:08:26.260191+0000","last_unstale":"2024-03-30T13:08:27.433709+0000","last_undegraded":"2024-03-30T13:08:27.433709+0000","last_fullsized":"2024-03-30T13:08:27.433709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846849+0000","last_change":"2024-03-30T13:08:25.261497+0000","last_active":"2024-03-30T13:08:27.846849+0000","last_peered":"2024-03-30T13:08:27.846849+0000","last_clean":"2024-03-30T13:08:27.846849+0000","last_became_active":"2024-03-30T13:08:25.260478+0000","last_became_peered":"2024-03-30T13:08:25.260478+0000","last_unstale":"2024-03-30T13:08:27.846849+0000","last_undegraded":"2024-03-30T13:08:27.846849+0000","last_fullsized":"2024-03-30T13:08:27.846849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.248615+0000","last_change":"2024-03-30T13:08:26.248004+0000","last_active":"2024-03-30T13:08:27.248615+0000","last_peered":"2024-03-30T13:08:27.248615+0000","last_clean":"2024-03-30T13:08:27.248615+0000","last_became_active":"2024-03-30T13:08:26.247256+0000","last_became_peered":"2024-03-30T13:08:26.247256+0000","last_unstale":"2024-03-30T13:08:27.248615+0000","last_undegraded":"2024-03-30T13:08:27.248615+0000","last_fullsized":"2024-03-30T13:08:27.248615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:00:34.966299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246220+0000","last_change":"2024-03-30T13:08:25.271738+0000","last_active":"2024-03-30T13:08:27.246220+0000","last_peered":"2024-03-30T13:08:27.246220+0000","last_clean":"2024-03-30T13:08:27.246220+0000","last_became_active":"2024-03-30T13:08:25.271345+0000","last_became_peered":"2024-03-30T13:08:25.271345+0000","last_unstale":"2024-03-30T13:08:27.246220+0000","last_undegraded":"2024-03-30T13:08:27.246220+0000","last_fullsized":"2024-03-30T13:08:27.246220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:20:25.901625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.846920+0000","last_change":"2024-03-30T13:08:26.269105+0000","last_active":"2024-03-30T13:08:27.846920+0000","last_peered":"2024-03-30T13:08:27.846920+0000","last_clean":"2024-03-30T13:08:27.846920+0000","last_became_active":"2024-03-30T13:08:26.260812+0000","last_became_peered":"2024-03-30T13:08:26.260812+0000","last_unstale":"2024-03-30T13:08:27.846920+0000","last_undegraded":"2024-03-30T13:08:27.846920+0000","last_fullsized":"2024-03-30T13:08:27.846920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:30:16.007550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.246299+0000","last_change":"2024-03-30T13:08:25.248839+0000","last_active":"2024-03-30T13:08:27.246299+0000","last_peered":"2024-03-30T13:08:27.246299+0000","last_clean":"2024-03-30T13:08:27.246299+0000","last_became_active":"2024-03-30T13:08:25.248429+0000","last_became_peered":"2024-03-30T13:08:25.248429+0000","last_unstale":"2024-03-30T13:08:27.246299+0000","last_undegraded":"2024-03-30T13:08:27.246299+0000","last_fullsized":"2024-03-30T13:08:27.246299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:24:11.686334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847416+0000","last_change":"2024-03-30T13:08:26.269026+0000","last_active":"2024-03-30T13:08:27.847416+0000","last_peered":"2024-03-30T13:08:27.847416+0000","last_clean":"2024-03-30T13:08:27.847416+0000","last_became_active":"2024-03-30T13:08:26.268626+0000","last_became_peered":"2024-03-30T13:08:26.268626+0000","last_unstale":"2024-03-30T13:08:27.847416+0000","last_undegraded":"2024-03-30T13:08:27.847416+0000","last_fullsized":"2024-03-30T13:08:27.847416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:38.839595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847773+0000","last_change":"2024-03-30T13:08:25.277478+0000","last_active":"2024-03-30T13:08:27.847773+0000","last_peered":"2024-03-30T13:08:27.847773+0000","last_clean":"2024-03-30T13:08:27.847773+0000","last_became_active":"2024-03-30T13:08:25.276694+0000","last_became_peered":"2024-03-30T13:08:25.276694+0000","last_unstale":"2024-03-30T13:08:27.847773+0000","last_undegraded":"2024-03-30T13:08:27.847773+0000","last_fullsized":"2024-03-30T13:08:27.847773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:13:51.325672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.845058+0000","last_change":"2024-03-30T13:08:26.268719+0000","last_active":"2024-03-30T13:08:27.845058+0000","last_peered":"2024-03-30T13:08:27.845058+0000","last_clean":"2024-03-30T13:08:27.845058+0000","last_became_active":"2024-03-30T13:08:26.268461+0000","last_became_peered":"2024-03-30T13:08:26.268461+0000","last_unstale":"2024-03-30T13:08:27.845058+0000","last_undegraded":"2024-03-30T13:08:27.845058+0000","last_fullsized":"2024-03-30T13:08:27.845058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:25:49.517498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249613+0000","last_change":"2024-03-30T13:08:26.249193+0000","last_active":"2024-03-30T13:08:27.249613+0000","last_peered":"2024-03-30T13:08:27.249613+0000","last_clean":"2024-03-30T13:08:27.249613+0000","last_became_active":"2024-03-30T13:08:26.248772+0000","last_became_peered":"2024-03-30T13:08:26.248772+0000","last_unstale":"2024-03-30T13:08:27.249613+0000","last_undegraded":"2024-03-30T13:08:27.249613+0000","last_fullsized":"2024-03-30T13:08:27.249613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:11:06.559848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847285+0000","last_change":"2024-03-30T13:08:25.281959+0000","last_active":"2024-03-30T13:08:27.847285+0000","last_peered":"2024-03-30T13:08:27.847285+0000","last_clean":"2024-03-30T13:08:27.847285+0000","last_became_active":"2024-03-30T13:08:25.281274+0000","last_became_peered":"2024-03-30T13:08:25.281274+0000","last_unstale":"2024-03-30T13:08:27.847285+0000","last_undegraded":"2024-03-30T13:08:27.847285+0000","last_fullsized":"2024-03-30T13:08:27.847285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:25:11.691446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.249036+0000","last_change":"2024-03-30T13:08:26.249258+0000","last_active":"2024-03-30T13:08:27.249036+0000","last_peered":"2024-03-30T13:08:27.249036+0000","last_clean":"2024-03-30T13:08:27.249036+0000","last_became_active":"2024-03-30T13:08:26.248751+0000","last_became_peered":"2024-03-30T13:08:26.248751+0000","last_unstale":"2024-03-30T13:08:27.249036+0000","last_undegraded":"2024-03-30T13:08:27.249036+0000","last_fullsized":"2024-03-30T13:08:27.249036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:51:01.414724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847841+0000","last_change":"2024-03-30T13:08:25.277430+0000","last_active":"2024-03-30T13:08:27.847841+0000","last_peered":"2024-03-30T13:08:27.847841+0000","last_clean":"2024-03-30T13:08:27.847841+0000","last_became_active":"2024-03-30T13:08:25.276574+0000","last_became_peered":"2024-03-30T13:08:25.276574+0000","last_unstale":"2024-03-30T13:08:27.847841+0000","last_undegraded":"2024-03-30T13:08:27.847841+0000","last_fullsized":"2024-03-30T13:08:27.847841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:07.835197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433517+0000","last_change":"2024-03-30T13:08:26.249242+0000","last_active":"2024-03-30T13:08:27.433517+0000","last_peered":"2024-03-30T13:08:27.433517+0000","last_clean":"2024-03-30T13:08:27.433517+0000","last_became_active":"2024-03-30T13:08:26.248878+0000","last_became_peered":"2024-03-30T13:08:26.248878+0000","last_unstale":"2024-03-30T13:08:27.433517+0000","last_undegraded":"2024-03-30T13:08:27.433517+0000","last_fullsized":"2024-03-30T13:08:27.433517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:04.934375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847382+0000","last_change":"2024-03-30T13:08:25.244866+0000","last_active":"2024-03-30T13:08:27.847382+0000","last_peered":"2024-03-30T13:08:27.847382+0000","last_clean":"2024-03-30T13:08:27.847382+0000","last_became_active":"2024-03-30T13:08:25.244502+0000","last_became_peered":"2024-03-30T13:08:25.244502+0000","last_unstale":"2024-03-30T13:08:27.847382+0000","last_undegraded":"2024-03-30T13:08:27.847382+0000","last_fullsized":"2024-03-30T13:08:27.847382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:35:44.891908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.847055+0000","last_change":"2024-03-30T13:08:26.265904+0000","last_active":"2024-03-30T13:08:27.847055+0000","last_peered":"2024-03-30T13:08:27.847055+0000","last_clean":"2024-03-30T13:08:27.847055+0000","last_became_active":"2024-03-30T13:08:26.265600+0000","last_became_peered":"2024-03-30T13:08:26.265600+0000","last_unstale":"2024-03-30T13:08:27.847055+0000","last_undegraded":"2024-03-30T13:08:27.847055+0000","last_fullsized":"2024-03-30T13:08:27.847055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:25.214237+0000","last_clean_scrub_stamp":"2024-03-30T13:08:25.214237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:31:17.593555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:08:27.433661+0000","last_change":"2024-03-30T13:08:25.271879+0000","last_active":"2024-03-30T13:08:27.433661+0000","last_peered":"2024-03-30T13:08:27.433661+0000","last_clean":"2024-03-30T13:08:27.433661+0000","last_became_active":"2024-03-30T13:08:25.270729+0000","last_became_peered":"2024-03-30T13:08:25.270729+0000","last_unstale":"2024-03-30T13:08:27.433661+0000","last_undegraded":"2024-03-30T13:08:27.433661+0000","last_fullsized":"2024-03-30T13:08:27.433661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:24.204939+0000","last_clean_scrub_stamp":"2024-03-30T13:08:24.204939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:45:33.842798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":664083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":73223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":664139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":73133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:08:38.285 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-30T13:08:38.285 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-30T13:08:38.285 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-30T13:08:38.285 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-30T13:08:38.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb3a69640 1 Processor -- start 2024-03-30T13:08:38.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb3a69640 1 -- start start 2024-03-30T13:08:38.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb3a69640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fceac06f140 0x7fceac06f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb3a69640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceac0734c0 con 0x7fceac0b4bb0 2024-03-30T13:08:38.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb3a69640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceac15c2a0 con 0x7fceac0730e0 2024-03-30T13:08:38.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb3a69640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fceac15c060 con 0x7fceac06f140 2024-03-30T13:08:38.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb1004640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fceac0b4bb0 0x7fceac15f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56444/0 (socket says 172.21.15.83:56444) 2024-03-30T13:08:38.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb1004640 1 -- 172.21.15.83:0/2685683902 learned_addr learned my addr 172.21.15.83:0/2685683902 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:38.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb2006640 1 --2- 172.21.15.83:0/2685683902 >> v2:172.21.15.153:3300/0 conn(0x7fceac06f140 0x7fceac06f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3753977645 0 0) 0x7fceac0734c0 con 0x7fceac0b4bb0 2024-03-30T13:08:38.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce98003530 con 0x7fceac0b4bb0 2024-03-30T13:08:38.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1075349962 0 0) 0x7fce98003530 con 0x7fceac0b4bb0 2024-03-30T13:08:38.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 >> v2:172.21.15.153:3300/0 conn(0x7fceac06f140 msgr2=0x7fceac06f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:38.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 --2- 172.21.15.83:0/2685683902 >> v2:172.21.15.153:3300/0 conn(0x7fceac06f140 0x7fceac06f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 >> v1:172.21.15.153:6789/0 conn(0x7fceac0730e0 legacy=0x7fceac15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceac15c580 con 0x7fceac0b4bb0 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fcea8001680 con 0x7fceac0b4bb0 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 >> v1:172.21.15.83:6789/0 conn(0x7fceac0b4bb0 legacy=0x7fceac15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 --2- 172.21.15.83:0/2685683902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 0x7fce98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 --2- 172.21.15.83:0/2685683902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce98004810 0x7fce98004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 --2- 172.21.15.83:0/2685683902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce980051d0 0x7fce9800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fceac15c060 con 0x7fce980039c0 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce9800c070 con 0x7fce980051d0 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fce9800c270 con 0x7fce98004810 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb1805640 1 --2- 172.21.15.83:0/2685683902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 0x7fce98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb2006640 1 --2- 172.21.15.83:0/2685683902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce980051d0 0x7fce9800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.429+0000 7fceb1004640 1 --2- 172.21.15.83:0/2685683902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce98004810 0x7fce98004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb1805640 1 -- 172.21.15.83:0/2685683902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce98004810 msgr2=0x7fce98004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:38.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb1805640 1 --2- 172.21.15.83:0/2685683902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce98004810 0x7fce98004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb1805640 1 -- 172.21.15.83:0/2685683902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce980051d0 msgr2=0x7fce9800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:38.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb1805640 1 --2- 172.21.15.83:0/2685683902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce980051d0 0x7fce9800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb2006640 1 -- 172.21.15.83:0/2685683902 reap_dead start 2024-03-30T13:08:38.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb1805640 1 -- 172.21.15.83:0/2685683902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce98003530 con 0x7fce980039c0 2024-03-30T13:08:38.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb1805640 1 --2- 172.21.15.83:0/2685683902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 0x7fce98003de0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fce9c001780 tx=0x7fce9c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516574d2721cd670 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:38.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0013a0 con 0x7fce980039c0 2024-03-30T13:08:38.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9c0052f0 con 0x7fce980039c0 2024-03-30T13:08:38.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb0803640 1 -- 172.21.15.83:0/2685683902 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0a4e60 con 0x7fce980039c0 2024-03-30T13:08:38.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb3a69640 1 -- 172.21.15.83:0/2685683902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 msgr2=0x7fce98003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb3a69640 1 --2- 172.21.15.83:0/2685683902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 0x7fce98003de0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fce9c001780 tx=0x7fce9c01c3d0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb3a69640 1 -- 172.21.15.83:0/2685683902 shutdown_connections 2024-03-30T13:08:38.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb3a69640 1 --2- 172.21.15.83:0/2685683902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 0x7fce98003de0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb3a69640 1 -- 172.21.15.83:0/2685683902 >> 172.21.15.83:0/2685683902 conn(0x7fceac0b1d60 msgr2=0x7fceac0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:38.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb3a69640 1 -- 172.21.15.83:0/2685683902 shutdown_connections 2024-03-30T13:08:38.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb3a69640 1 -- 172.21.15.83:0/2685683902 wait complete. 2024-03-30T13:08:38.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.433+0000 7fceb3a69640 1 Processor -- start 2024-03-30T13:08:38.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb3a69640 1 -- start start 2024-03-30T13:08:38.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb3a69640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 0x7fceac14c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb3a69640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceac14e5d0 0x7fceac14ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb3a69640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceac14cef0 0x7fceac14d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb3a69640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fceac15bee0 con 0x7fce980039c0 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb3a69640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fceac15bd60 con 0x7fceac14cef0 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb3a69640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fceac06f930 con 0x7fceac14e5d0 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb1805640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 0x7fceac14c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb1805640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 0x7fceac14c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59522/0 (socket says 172.21.15.83:59522) 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb1805640 1 -- 172.21.15.83:0/1756444232 learned_addr learned my addr 172.21.15.83:0/1756444232 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb1805640 1 -- 172.21.15.83:0/1756444232 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceac14e5d0 msgr2=0x7fceac14ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb1805640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceac14e5d0 0x7fceac14ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb1805640 1 -- 172.21.15.83:0/1756444232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceac14cef0 msgr2=0x7fceac14d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb2006640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceac14cef0 0x7fceac14d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb1805640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceac14cef0 0x7fceac14d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb1805640 1 -- 172.21.15.83:0/1756444232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceac14dbb0 con 0x7fce980039c0 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb1805640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 0x7fceac14c370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fce9c01c200 tx=0x7fce98005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:38.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fcea27fc640 1 -- 172.21.15.83:0/1756444232 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c007a40 con 0x7fce980039c0 2024-03-30T13:08:38.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fcea27fc640 1 -- 172.21.15.83:0/1756444232 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9c0ba070 con 0x7fce980039c0 2024-03-30T13:08:38.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fcea27fc640 1 -- 172.21.15.83:0/1756444232 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0054a0 con 0x7fce980039c0 2024-03-30T13:08:38.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb3a69640 1 -- 172.21.15.83:0/1756444232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceac14de90 con 0x7fce980039c0 2024-03-30T13:08:38.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb3a69640 1 -- 172.21.15.83:0/1756444232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceac14d8b0 con 0x7fce980039c0 2024-03-30T13:08:38.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb3a69640 1 -- 172.21.15.83:0/1756444232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceac0686c0 con 0x7fce980039c0 2024-03-30T13:08:38.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fcea27fc640 1 -- 172.21.15.83:0/1756444232 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fce9c007030 con 0x7fce980039c0 2024-03-30T13:08:38.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fcea27fc640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fce90067ff0 0x7fce9006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fcea27fc640 1 -- 172.21.15.83:0/1756444232 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fce9c1202a0 con 0x7fce980039c0 2024-03-30T13:08:38.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.437+0000 7fceb1004640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fce90067ff0 0x7fce9006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.441+0000 7fceb1004640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fce90067ff0 0x7fce9006a4b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fceac0b4060 tx=0x7fcea8000f00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:38.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.441+0000 7fcea27fc640 1 -- 172.21.15.83:0/1756444232 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fce9c016110 con 0x7fce980039c0 2024-03-30T13:08:38.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.621+0000 7fceb3a69640 1 -- 172.21.15.83:0/1756444232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fceac0b29b0 con 0x7fce980039c0 2024-03-30T13:08:38.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.621+0000 7fcea27fc640 1 -- 172.21.15.83:0/1756444232 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fce9c0f0a50 con 0x7fce980039c0 2024-03-30T13:08:38.629 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:38.629 INFO:teuthology.orchestra.run.smithi083.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-30T13:08:38.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.625+0000 7fceb3a69640 1 -- 172.21.15.83:0/1756444232 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fce90067ff0 msgr2=0x7fce9006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.625+0000 7fceb3a69640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fce90067ff0 0x7fce9006a4b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fceac0b4060 tx=0x7fcea8000f00 comp rx=0 tx=0).stop 2024-03-30T13:08:38.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.625+0000 7fceb3a69640 1 -- 172.21.15.83:0/1756444232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 msgr2=0x7fceac14c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.625+0000 7fceb3a69640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 0x7fceac14c370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fce9c01c200 tx=0x7fce98005840 comp rx=0 tx=0).stop 2024-03-30T13:08:38.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.625+0000 7fceb3a69640 1 -- 172.21.15.83:0/1756444232 shutdown_connections 2024-03-30T13:08:38.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.625+0000 7fceb3a69640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fce90067ff0 0x7fce9006a4b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.625+0000 7fceb3a69640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceac14cef0 0x7fceac14d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.625+0000 7fceb3a69640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceac14e5d0 0x7fceac14ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.625+0000 7fceb3a69640 1 --2- 172.21.15.83:0/1756444232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce980039c0 0x7fceac14c370 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.625+0000 7fceb3a69640 1 -- 172.21.15.83:0/1756444232 >> 172.21.15.83:0/1756444232 conn(0x7fceac0b1d60 msgr2=0x7fceac0b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:38.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.625+0000 7fceb3a69640 1 -- 172.21.15.83:0/1756444232 shutdown_connections 2024-03-30T13:08:38.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.625+0000 7fceb3a69640 1 -- 172.21.15.83:0/1756444232 wait complete. 2024-03-30T13:08:38.647 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-30T13:08:38.647 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:38.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.745+0000 7f69df08f640 1 Processor -- start 2024-03-30T13:08:38.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.745+0000 7f69df08f640 1 -- start start 2024-03-30T13:08:38.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69df08f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80b6ed0 0x7f69d80b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69df08f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f69d80cda80 0x7f69d80b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69df08f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69d80b0610 con 0x7f69d806b660 2024-03-30T13:08:38.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69df08f640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f69d80b03c0 con 0x7f69d80cda80 2024-03-30T13:08:38.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69df08f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f69d80b08f0 con 0x7f69d80b6ed0 2024-03-30T13:08:38.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69dce2b640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f69d806b660 0x7f69d806ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56446/0 (socket says 172.21.15.83:56446) 2024-03-30T13:08:38.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69dce2b640 1 -- 172.21.15.83:0/711199972 learned_addr learned my addr 172.21.15.83:0/711199972 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69dd62c640 1 --2- 172.21.15.83:0/711199972 >> v2:172.21.15.153:3300/0 conn(0x7f69d80cda80 0x7f69d80b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d7fff640 1 --2- 172.21.15.83:0/711199972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80b6ed0 0x7f69d80b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414902955 0 0) 0x7f69d80b0610 con 0x7f69d806b660 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69c0003530 con 0x7f69d806b660 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 495824606 0 0) 0x7f69c0003530 con 0x7f69d806b660 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80b6ed0 msgr2=0x7f69d80b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 --2- 172.21.15.83:0/711199972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80b6ed0 0x7f69d80b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 >> v2:172.21.15.153:3300/0 conn(0x7f69d80cda80 msgr2=0x7f69d80b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 --2- 172.21.15.83:0/711199972 >> v2:172.21.15.153:3300/0 conn(0x7f69d80cda80 0x7f69d80b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d80b0bd0 con 0x7f69d806b660 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f69c8001680 con 0x7f69d806b660 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 >> v1:172.21.15.83:6789/0 conn(0x7f69d806b660 legacy=0x7f69d806ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 --2- 172.21.15.83:0/711199972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69c00039c0 0x7f69c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 --2- 172.21.15.83:0/711199972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80b6ed0 0x7f69c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 --2- 172.21.15.83:0/711199972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69c0004d50 0x7f69c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f69d80b03c0 con 0x7f69c0004d50 2024-03-30T13:08:38.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69d80b08f0 con 0x7f69c00039c0 2024-03-30T13:08:38.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f69c000b9d0 con 0x7f69d80b6ed0 2024-03-30T13:08:38.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69dd62c640 1 --2- 172.21.15.83:0/711199972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69c0004d50 0x7f69c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69dce2b640 1 --2- 172.21.15.83:0/711199972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69c00039c0 0x7f69c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69d7fff640 1 --2- 172.21.15.83:0/711199972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80b6ed0 0x7f69c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69dd62c640 1 -- 172.21.15.83:0/711199972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80b6ed0 msgr2=0x7f69c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:38.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69dd62c640 1 --2- 172.21.15.83:0/711199972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80b6ed0 0x7f69c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69dd62c640 1 -- 172.21.15.83:0/711199972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69c00039c0 msgr2=0x7f69c0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:38.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69dd62c640 1 --2- 172.21.15.83:0/711199972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69c00039c0 0x7f69c0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.749+0000 7f69dd62c640 1 -- 172.21.15.83:0/711199972 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c0003530 con 0x7f69c0004d50 2024-03-30T13:08:38.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69dd62c640 1 --2- 172.21.15.83:0/711199972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69c0004d50 0x7f69c00051d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f69d0009fc0 tx=0x7f69d001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ff64c74a6647ff server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:38.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d00b2070 con 0x7f69c0004d50 2024-03-30T13:08:38.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d00a5bc0 con 0x7f69c0004d50 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d77fe640 1 -- 172.21.15.83:0/711199972 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0009c10 con 0x7f69c0004d50 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 -- 172.21.15.83:0/711199972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69c0004d50 msgr2=0x7f69c00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 --2- 172.21.15.83:0/711199972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69c0004d50 0x7f69c00051d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f69d0009fc0 tx=0x7f69d001ccc0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69dd62c640 1 -- 172.21.15.83:0/711199972 reap_dead start 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 -- 172.21.15.83:0/711199972 shutdown_connections 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 -- 172.21.15.83:0/711199972 >> 172.21.15.83:0/711199972 conn(0x7f69d809aa50 msgr2=0x7f69d80b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 -- 172.21.15.83:0/711199972 shutdown_connections 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 -- 172.21.15.83:0/711199972 wait complete. 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 Processor -- start 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 -- start start 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69c0004d50 0x7f69d815ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69d8140270 0x7f69d815f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80ce3b0 0x7f69d80ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f69d80b23f0 con 0x7f69d8140270 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69d8146030 con 0x7f69c0004d50 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f69d80b2570 con 0x7f69d80ce3b0 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69d8140270 0x7f69d815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69d8140270 0x7f69d815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59544/0 (socket says 172.21.15.83:59544) 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d7fff640 1 -- 172.21.15.83:0/2550589337 learned_addr learned my addr 172.21.15.83:0/2550589337 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69dce2b640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69c0004d50 0x7f69d815ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69dd62c640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80ce3b0 0x7f69d80ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d7fff640 1 -- 172.21.15.83:0/2550589337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80ce3b0 msgr2=0x7f69d80ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d7fff640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80ce3b0 0x7f69d80ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d7fff640 1 -- 172.21.15.83:0/2550589337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69c0004d50 msgr2=0x7f69d815ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d7fff640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69c0004d50 0x7f69d815ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d7fff640 1 -- 172.21.15.83:0/2550589337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d815bf50 con 0x7f69d8140270 2024-03-30T13:08:38.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69dd62c640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80ce3b0 0x7f69d80ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:38.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d7fff640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69d8140270 0x7f69d815f500 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f69cc011590 tx=0x7f69cc011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:38.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d57fa640 1 -- 172.21.15.83:0/2550589337 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc004220 con 0x7f69d8140270 2024-03-30T13:08:38.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d57fa640 1 -- 172.21.15.83:0/2550589337 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69cc0043c0 con 0x7f69d8140270 2024-03-30T13:08:38.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 -- 172.21.15.83:0/2550589337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d815e460 con 0x7f69d8140270 2024-03-30T13:08:38.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69d57fa640 1 -- 172.21.15.83:0/2550589337 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc015870 con 0x7f69d8140270 2024-03-30T13:08:38.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.753+0000 7f69df08f640 1 -- 172.21.15.83:0/2550589337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d815ea20 con 0x7f69d8140270 2024-03-30T13:08:38.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.757+0000 7f69df08f640 1 -- 172.21.15.83:0/2550589337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d8068dd0 con 0x7f69d8140270 2024-03-30T13:08:38.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.757+0000 7f69d57fa640 1 -- 172.21.15.83:0/2550589337 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f69cc015a10 con 0x7f69d8140270 2024-03-30T13:08:38.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.757+0000 7f69d57fa640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f69c4067ff0 0x7f69c406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:38.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.757+0000 7f69d57fa640 1 -- 172.21.15.83:0/2550589337 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f69cc086af0 con 0x7f69d8140270 2024-03-30T13:08:38.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.757+0000 7f69dce2b640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f69c4067ff0 0x7f69c406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:38.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.757+0000 7f69dce2b640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f69c4067ff0 0x7f69c406a4b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f69d81f5640 tx=0x7f69c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:38.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.761+0000 7f69d57fa640 1 -- 172.21.15.83:0/2550589337 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f69d815bf50 con 0x7f69d8140270 2024-03-30T13:08:38.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.909+0000 7f69df08f640 1 -- 172.21.15.83:0/2550589337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69d806bd20 con 0x7f69d8140270 2024-03-30T13:08:38.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69d57fa640 1 -- 172.21.15.83:0/2550589337 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f69cc019030 con 0x7f69d8140270 2024-03-30T13:08:38.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:38.919 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69df08f640 1 -- 172.21.15.83:0/2550589337 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f69c4067ff0 msgr2=0x7f69c406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69df08f640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f69c4067ff0 0x7f69c406a4b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f69d81f5640 tx=0x7f69c8009040 comp rx=0 tx=0).stop 2024-03-30T13:08:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69df08f640 1 -- 172.21.15.83:0/2550589337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69d8140270 msgr2=0x7f69d815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69df08f640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69d8140270 0x7f69d815f500 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f69cc011590 tx=0x7f69cc011a50 comp rx=0 tx=0).stop 2024-03-30T13:08:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69df08f640 1 -- 172.21.15.83:0/2550589337 shutdown_connections 2024-03-30T13:08:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69df08f640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f69c4067ff0 0x7f69c406a4b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69df08f640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69d80ce3b0 0x7f69d80ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69df08f640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69d8140270 0x7f69d815f500 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69df08f640 1 --2- 172.21.15.83:0/2550589337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69c0004d50 0x7f69d815ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69df08f640 1 -- 172.21.15.83:0/2550589337 >> 172.21.15.83:0/2550589337 conn(0x7f69d809aa50 msgr2=0x7f69d80d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69df08f640 1 -- 172.21.15.83:0/2550589337 shutdown_connections 2024-03-30T13:08:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:38.913+0000 7f69df08f640 1 -- 172.21.15.83:0/2550589337 wait complete. 2024-03-30T13:08:38.935 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:08:38.936 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:08:39.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.049+0000 7fe1c1865640 1 Processor -- start 2024-03-30T13:08:39.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.049+0000 7fe1c1865640 1 -- start start 2024-03-30T13:08:39.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1c1865640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc06e180 0x7fe1bc0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1c1865640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1bc0ce990 con 0x7fe1bc0b6510 2024-03-30T13:08:39.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1c1865640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1bc06f7a0 con 0x7fe1bc13f520 2024-03-30T13:08:39.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1c1865640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe1bc06e740 con 0x7fe1bc06e180 2024-03-30T13:08:39.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1b27fc640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fe1bc0b6510 0x7fe1bc06fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56448/0 (socket says 172.21.15.83:56448) 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1b27fc640 1 -- 172.21.15.83:0/333299033 learned_addr learned my addr 172.21.15.83:0/333299033 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1bb7fe640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc06e180 0x7fe1bc0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2450734853 0 0) 0x7fe1a4001120 con 0x7fe1bc0b6510 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1a8003530 con 0x7fe1bc0b6510 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1293380944 0 0) 0x7fe1a8003530 con 0x7fe1bc0b6510 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc06e180 msgr2=0x7fe1bc0ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc06e180 0x7fe1bc0ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 >> v1:172.21.15.153:6789/0 conn(0x7fe1bc13f520 legacy=0x7fe1bc0b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc06ea20 con 0x7fe1bc0b6510 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fe1a4001870 con 0x7fe1bc0b6510 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 >> v1:172.21.15.83:6789/0 conn(0x7fe1bc0b6510 legacy=0x7fe1bc06fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a80039f0 0x7fe1a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc06e180 0x7fe1a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a8004d50 0x7fe1a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc06e740 con 0x7fe1a8004d50 2024-03-30T13:08:39.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a800ba80 con 0x7fe1a80039f0 2024-03-30T13:08:39.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a800bc80 con 0x7fe1bc06e180 2024-03-30T13:08:39.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1bb7fe640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a8004d50 0x7fe1a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1baffd640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a80039f0 0x7fe1a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1b27fc640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc06e180 0x7fe1a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1bb7fe640 1 -- 172.21.15.83:0/333299033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc06e180 msgr2=0x7fe1a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:39.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1bb7fe640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc06e180 0x7fe1a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1bb7fe640 1 -- 172.21.15.83:0/333299033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a80039f0 msgr2=0x7fe1a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:39.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1bb7fe640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a80039f0 0x7fe1a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1bb7fe640 1 -- 172.21.15.83:0/333299033 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a8003530 con 0x7fe1a8004d50 2024-03-30T13:08:39.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.053+0000 7fe1baffd640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a80039f0 0x7fe1a8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:39.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1bb7fe640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a8004d50 0x7fe1a80051d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009fc0 tx=0x7fe1b401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed38bafb9a1884aa server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:39.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b40b2070 con 0x7fe1a8004d50 2024-03-30T13:08:39.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b40a5a70 con 0x7fe1a8004d50 2024-03-30T13:08:39.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1ba7fc640 1 -- 172.21.15.83:0/333299033 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4009c10 con 0x7fe1a8004d50 2024-03-30T13:08:39.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 -- 172.21.15.83:0/333299033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a8004d50 msgr2=0x7fe1a80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 --2- 172.21.15.83:0/333299033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a8004d50 0x7fe1a80051d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009fc0 tx=0x7fe1b401cc80 comp rx=0 tx=0).stop 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1bb7fe640 1 -- 172.21.15.83:0/333299033 reap_dead start 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 -- 172.21.15.83:0/333299033 shutdown_connections 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 -- 172.21.15.83:0/333299033 >> 172.21.15.83:0/333299033 conn(0x7fe1bc072f00 msgr2=0x7fe1bc06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 -- 172.21.15.83:0/333299033 shutdown_connections 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 -- 172.21.15.83:0/333299033 wait complete. 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 Processor -- start 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 -- start start 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a8004d50 0x7fe1bc14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1bc13d880 0x7fe1bc13dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc151f80 0x7fe1bc152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc070530 con 0x7fe1a8004d50 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc0703b0 con 0x7fe1bc13d880 2024-03-30T13:08:39.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1c1865640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe1bc0706b0 con 0x7fe1bc151f80 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1baffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a8004d50 0x7fe1bc14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1baffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a8004d50 0x7fe1bc14ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59556/0 (socket says 172.21.15.83:59556) 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1baffd640 1 -- 172.21.15.83:0/4044094356 learned_addr learned my addr 172.21.15.83:0/4044094356 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1b27fc640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1bc13d880 0x7fe1bc13dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1bb7fe640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc151f80 0x7fe1bc152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1baffd640 1 -- 172.21.15.83:0/4044094356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc151f80 msgr2=0x7fe1bc152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1baffd640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc151f80 0x7fe1bc152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1baffd640 1 -- 172.21.15.83:0/4044094356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1bc13d880 msgr2=0x7fe1bc13dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1baffd640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1bc13d880 0x7fe1bc13dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.057+0000 7fe1baffd640 1 -- 172.21.15.83:0/4044094356 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc13e390 con 0x7fe1a8004d50 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.061+0000 7fe1baffd640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a8004d50 0x7fe1bc14ef90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00e5d0 tx=0x7fe1ac00ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.061+0000 7fe1b8ff9640 1 -- 172.21.15.83:0/4044094356 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac0052e0 con 0x7fe1a8004d50 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.061+0000 7fe1b8ff9640 1 -- 172.21.15.83:0/4044094356 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ac018070 con 0x7fe1a8004d50 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.061+0000 7fe1c1865640 1 -- 172.21.15.83:0/4044094356 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1bc13e670 con 0x7fe1a8004d50 2024-03-30T13:08:39.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.061+0000 7fe1b8ff9640 1 -- 172.21.15.83:0/4044094356 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac003800 con 0x7fe1a8004d50 2024-03-30T13:08:39.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.061+0000 7fe1c1865640 1 -- 172.21.15.83:0/4044094356 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1bc14f4d0 con 0x7fe1a8004d50 2024-03-30T13:08:39.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.061+0000 7fe1c1865640 1 -- 172.21.15.83:0/4044094356 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1bc0737d0 con 0x7fe1a8004d50 2024-03-30T13:08:39.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.061+0000 7fe1b8ff9640 1 -- 172.21.15.83:0/4044094356 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fe1ac0039a0 con 0x7fe1a8004d50 2024-03-30T13:08:39.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.061+0000 7fe1b8ff9640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe19c067fc0 0x7fe19c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.061+0000 7fe1b8ff9640 1 -- 172.21.15.83:0/4044094356 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe1ac086320 con 0x7fe1a8004d50 2024-03-30T13:08:39.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.061+0000 7fe1b27fc640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe19c067fc0 0x7fe19c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.061+0000 7fe1b27fc640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe19c067fc0 0x7fe19c06a480 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0b06b0 tx=0x7fe1a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:39.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.065+0000 7fe1b8ff9640 1 -- 172.21.15.83:0/4044094356 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fe1ac01a310 con 0x7fe1a8004d50 2024-03-30T13:08:39.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 -- 172.21.15.83:0/4044094356 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe1bc04f9e0 con 0x7fe1a8004d50 2024-03-30T13:08:39.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1b8ff9640 1 -- 172.21.15.83:0/4044094356 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fe1ac056ad0 con 0x7fe1a8004d50 2024-03-30T13:08:39.231 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:08:39.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 -- 172.21.15.83:0/4044094356 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe19c067fc0 msgr2=0x7fe19c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe19c067fc0 0x7fe19c06a480 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0b06b0 tx=0x7fe1a4009040 comp rx=0 tx=0).stop 2024-03-30T13:08:39.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 -- 172.21.15.83:0/4044094356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a8004d50 msgr2=0x7fe1bc14ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a8004d50 0x7fe1bc14ef90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00e5d0 tx=0x7fe1ac00ea90 comp rx=0 tx=0).stop 2024-03-30T13:08:39.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 -- 172.21.15.83:0/4044094356 shutdown_connections 2024-03-30T13:08:39.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe19c067fc0 0x7fe19c06a480 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1bc151f80 0x7fe1bc152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1bc13d880 0x7fe1bc13dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 --2- 172.21.15.83:0/4044094356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a8004d50 0x7fe1bc14ef90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 -- 172.21.15.83:0/4044094356 >> 172.21.15.83:0/4044094356 conn(0x7fe1bc072f00 msgr2=0x7fe1bc15ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:39.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 -- 172.21.15.83:0/4044094356 shutdown_connections 2024-03-30T13:08:39.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.225+0000 7fe1c1865640 1 -- 172.21.15.83:0/4044094356 wait complete. 2024-03-30T13:08:39.248 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:08:39.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.357+0000 7f883862e640 1 Processor -- start 2024-03-30T13:08:39.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.357+0000 7f883862e640 1 -- start start 2024-03-30T13:08:39.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f883862e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f883015c8e0 0x7f88300ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f883862e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88300adac0 0x7f883015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f883862e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f883015d200 0x7f88300b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f883862e640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f88300b31e0 con 0x7f883015c8e0 2024-03-30T13:08:39.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f883862e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f88300ae040 con 0x7f883015d200 2024-03-30T13:08:39.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f883862e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f88300ae320 con 0x7f88300adac0 2024-03-30T13:08:39.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f88363ca640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f883015c8e0 0x7f88300ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f88363ca640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f883015c8e0 0x7f88300ad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59568/0 (socket says 172.21.15.83:59568) 2024-03-30T13:08:39.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f88363ca640 1 -- 172.21.15.83:0/338797239 learned_addr learned my addr 172.21.15.83:0/338797239 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:39.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f8835bc9640 1 --2- 172.21.15.83:0/338797239 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88300adac0 0x7f883015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f8836bcb640 1 --2- 172.21.15.83:0/338797239 >> v2:172.21.15.153:3300/0 conn(0x7f883015d200 0x7f88300b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f88363ca640 1 -- 172.21.15.83:0/338797239 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88300adac0 msgr2=0x7f883015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f88363ca640 1 --2- 172.21.15.83:0/338797239 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88300adac0 0x7f883015ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f88363ca640 1 -- 172.21.15.83:0/338797239 >> v2:172.21.15.153:3300/0 conn(0x7f883015d200 msgr2=0x7f88300b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f88363ca640 1 --2- 172.21.15.83:0/338797239 >> v2:172.21.15.153:3300/0 conn(0x7f883015d200 0x7f88300b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f88363ca640 1 -- 172.21.15.83:0/338797239 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88300ae600 con 0x7f883015c8e0 2024-03-30T13:08:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f8836bcb640 1 --2- 172.21.15.83:0/338797239 >> v2:172.21.15.153:3300/0 conn(0x7f883015d200 0x7f88300b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f88363ca640 1 --2- 172.21.15.83:0/338797239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f883015c8e0 0x7f88300ad580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f883015fda0 tx=0x7f882c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca08a588d33f828 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f88353c8640 1 -- 172.21.15.83:0/338797239 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c0ab5f0 con 0x7f883015c8e0 2024-03-30T13:08:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f88353c8640 1 -- 172.21.15.83:0/338797239 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882c0b0070 con 0x7f883015c8e0 2024-03-30T13:08:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.361+0000 7f88353c8640 1 -- 172.21.15.83:0/338797239 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c0ab9b0 con 0x7f883015c8e0 2024-03-30T13:08:39.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 -- 172.21.15.83:0/338797239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f883015c8e0 msgr2=0x7f88300ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 --2- 172.21.15.83:0/338797239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f883015c8e0 0x7f88300ad580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f883015fda0 tx=0x7f882c01c520 comp rx=0 tx=0).stop 2024-03-30T13:08:39.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 -- 172.21.15.83:0/338797239 shutdown_connections 2024-03-30T13:08:39.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 --2- 172.21.15.83:0/338797239 >> v2:172.21.15.153:3300/0 conn(0x7f883015d200 0x7f88300b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 --2- 172.21.15.83:0/338797239 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88300adac0 0x7f883015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 --2- 172.21.15.83:0/338797239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f883015c8e0 0x7f88300ad580 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 -- 172.21.15.83:0/338797239 >> 172.21.15.83:0/338797239 conn(0x7f883006b660 msgr2=0x7f883006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:39.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 -- 172.21.15.83:0/338797239 shutdown_connections 2024-03-30T13:08:39.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 -- 172.21.15.83:0/338797239 wait complete. 2024-03-30T13:08:39.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 Processor -- start 2024-03-30T13:08:39.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 -- start start 2024-03-30T13:08:39.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88300adac0 0x7f8830146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f883015c8e0 0x7f8830156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f883015d200 0x7f8830072f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f88300b4540 con 0x7f883015d200 2024-03-30T13:08:39.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f88300b43c0 con 0x7f88300adac0 2024-03-30T13:08:39.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f88300b46c0 con 0x7f883015c8e0 2024-03-30T13:08:39.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8836bcb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f883015d200 0x7f8830072f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8836bcb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f883015d200 0x7f8830072f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59576/0 (socket says 172.21.15.83:59576) 2024-03-30T13:08:39.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8836bcb640 1 -- 172.21.15.83:0/2529257619 learned_addr learned my addr 172.21.15.83:0/2529257619 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:39.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f88363ca640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88300adac0 0x7f8830146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8835bc9640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f883015c8e0 0x7f8830156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8836bcb640 1 -- 172.21.15.83:0/2529257619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f883015c8e0 msgr2=0x7f8830156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8836bcb640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f883015c8e0 0x7f8830156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8836bcb640 1 -- 172.21.15.83:0/2529257619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88300adac0 msgr2=0x7f8830146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8836bcb640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88300adac0 0x7f8830146c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8836bcb640 1 -- 172.21.15.83:0/2529257619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883015b900 con 0x7f883015d200 2024-03-30T13:08:39.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8836bcb640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f883015d200 0x7f8830072f60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f882800cef0 tx=0x7f882800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:39.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8826ffd640 1 -- 172.21.15.83:0/2529257619 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882801a070 con 0x7f883015d200 2024-03-30T13:08:39.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8826ffd640 1 -- 172.21.15.83:0/2529257619 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882800d860 con 0x7f883015d200 2024-03-30T13:08:39.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f8826ffd640 1 -- 172.21.15.83:0/2529257619 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882800dc50 con 0x7f883015d200 2024-03-30T13:08:39.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.365+0000 7f883862e640 1 -- 172.21.15.83:0/2529257619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883015bbe0 con 0x7f883015d200 2024-03-30T13:08:39.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.369+0000 7f883862e640 1 -- 172.21.15.83:0/2529257619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f883015c1a0 con 0x7f883015d200 2024-03-30T13:08:39.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.369+0000 7f883862e640 1 -- 172.21.15.83:0/2529257619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f883009e540 con 0x7f883015d200 2024-03-30T13:08:39.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.369+0000 7f8826ffd640 1 -- 172.21.15.83:0/2529257619 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f882801d070 con 0x7f883015d200 2024-03-30T13:08:39.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.369+0000 7f8826ffd640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8814067fc0 0x7f881406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.369+0000 7f8826ffd640 1 -- 172.21.15.83:0/2529257619 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8828086c70 con 0x7f883015d200 2024-03-30T13:08:39.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.369+0000 7f88363ca640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8814067fc0 0x7f881406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.369+0000 7f88363ca640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8814067fc0 0x7f881406a480 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f882c0af000 tx=0x7f882c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:39.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.373+0000 7f8826ffd640 1 -- 172.21.15.83:0/2529257619 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f8828057570 con 0x7f883015d200 2024-03-30T13:08:39.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.521+0000 7f883862e640 1 -- 172.21.15.83:0/2529257619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f883004f9e0 con 0x7f883015d200 2024-03-30T13:08:39.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.521+0000 7f8826ffd640 1 -- 172.21.15.83:0/2529257619 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f8828056e70 con 0x7f883015d200 2024-03-30T13:08:39.529 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:08:39.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.525+0000 7f883862e640 1 -- 172.21.15.83:0/2529257619 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8814067fc0 msgr2=0x7f881406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.525+0000 7f883862e640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8814067fc0 0x7f881406a480 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f882c0af000 tx=0x7f882c0a7000 comp rx=0 tx=0).stop 2024-03-30T13:08:39.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.525+0000 7f883862e640 1 -- 172.21.15.83:0/2529257619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f883015d200 msgr2=0x7f8830072f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.525+0000 7f883862e640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f883015d200 0x7f8830072f60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f882800cef0 tx=0x7f882800a710 comp rx=0 tx=0).stop 2024-03-30T13:08:39.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.525+0000 7f883862e640 1 -- 172.21.15.83:0/2529257619 shutdown_connections 2024-03-30T13:08:39.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.525+0000 7f883862e640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8814067fc0 0x7f881406a480 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.525+0000 7f883862e640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f883015d200 0x7f8830072f60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.525+0000 7f883862e640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f883015c8e0 0x7f8830156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.525+0000 7f883862e640 1 --2- 172.21.15.83:0/2529257619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88300adac0 0x7f8830146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.525+0000 7f883862e640 1 -- 172.21.15.83:0/2529257619 >> 172.21.15.83:0/2529257619 conn(0x7f883006b660 msgr2=0x7f8830154cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:39.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.525+0000 7f883862e640 1 -- 172.21.15.83:0/2529257619 shutdown_connections 2024-03-30T13:08:39.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.525+0000 7f883862e640 1 -- 172.21.15.83:0/2529257619 wait complete. 2024-03-30T13:08:39.545 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:08:39.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.649+0000 7f9062a41640 1 Processor -- start 2024-03-30T13:08:39.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.649+0000 7f9062a41640 1 -- start start 2024-03-30T13:08:39.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.649+0000 7f9062a41640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f905c15c8e0 0x7f905c0ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.649+0000 7f9062a41640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f905c0b4680 0x7f905c165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.649+0000 7f9062a41640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905c0ae040 con 0x7f905c0adac0 2024-03-30T13:08:39.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.649+0000 7f9062a41640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f905c0b31e0 con 0x7f905c15c8e0 2024-03-30T13:08:39.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.649+0000 7f9062a41640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f905c0ae320 con 0x7f905c0b4680 2024-03-30T13:08:39.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.649+0000 7f905bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f905c15c8e0 0x7f905c0ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.649+0000 7f905bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f905c15c8e0 0x7f905c0ad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59586/0 (socket says 172.21.15.83:59586) 2024-03-30T13:08:39.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.649+0000 7f905bfff640 1 -- 172.21.15.83:0/1854992028 learned_addr learned my addr 172.21.15.83:0/1854992028 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:39.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.649+0000 7f9060fde640 1 --2- 172.21.15.83:0/1854992028 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f905c0b4680 0x7f905c165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f905bfff640 1 -- 172.21.15.83:0/1854992028 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f905c0b4680 msgr2=0x7f905c165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:39.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f905bfff640 1 --2- 172.21.15.83:0/1854992028 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f905c0b4680 0x7f905c165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f905bfff640 1 -- 172.21.15.83:0/1854992028 >> v1:172.21.15.83:6789/0 conn(0x7f905c0adac0 legacy=0x7f905c15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f905bfff640 1 -- 172.21.15.83:0/1854992028 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c0ae600 con 0x7f905c15c8e0 2024-03-30T13:08:39.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f905affd640 1 -- 172.21.15.83:0/1854992028 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3242242294 0 0) 0x7f905c0ae040 con 0x7f905c0adac0 2024-03-30T13:08:39.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f905bfff640 1 --2- 172.21.15.83:0/1854992028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f905c15c8e0 0x7f905c0ad580 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f904c009870 tx=0x7f904c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3c5cc78cf05a90 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:39.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f905affd640 1 -- 172.21.15.83:0/1854992028 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c0b2070 con 0x7f905c15c8e0 2024-03-30T13:08:39.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f905affd640 1 -- 172.21.15.83:0/1854992028 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904c0a9070 con 0x7f905c15c8e0 2024-03-30T13:08:39.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f905affd640 1 -- 172.21.15.83:0/1854992028 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c0ad880 con 0x7f905c15c8e0 2024-03-30T13:08:39.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f9062a41640 1 -- 172.21.15.83:0/1854992028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f905c15c8e0 msgr2=0x7f905c0ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f9062a41640 1 --2- 172.21.15.83:0/1854992028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f905c15c8e0 0x7f905c0ad580 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f904c009870 tx=0x7f904c01c560 comp rx=0 tx=0).stop 2024-03-30T13:08:39.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f9062a41640 1 -- 172.21.15.83:0/1854992028 shutdown_connections 2024-03-30T13:08:39.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f9062a41640 1 --2- 172.21.15.83:0/1854992028 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f905c0b4680 0x7f905c165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f9062a41640 1 --2- 172.21.15.83:0/1854992028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f905c15c8e0 0x7f905c0ad580 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f9062a41640 1 -- 172.21.15.83:0/1854992028 >> 172.21.15.83:0/1854992028 conn(0x7f905c06b660 msgr2=0x7f905c06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:39.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f9062a41640 1 -- 172.21.15.83:0/1854992028 shutdown_connections 2024-03-30T13:08:39.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f9062a41640 1 -- 172.21.15.83:0/1854992028 wait complete. 2024-03-30T13:08:39.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.653+0000 7f9062a41640 1 Processor -- start 2024-03-30T13:08:39.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9062a41640 1 -- start start 2024-03-30T13:08:39.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9062a41640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f905c0adac0 0x7f905c14d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9062a41640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f905c0b4680 0x7f905c1538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9062a41640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f905c15c8e0 0x7f905c1f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9062a41640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f905c168f80 con 0x7f905c0b4680 2024-03-30T13:08:39.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9062a41640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f905c168e00 con 0x7f905c0adac0 2024-03-30T13:08:39.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9062a41640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f905c169100 con 0x7f905c15c8e0 2024-03-30T13:08:39.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f905b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f905c0b4680 0x7f905c1538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f905b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f905c0b4680 0x7f905c1538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59590/0 (socket says 172.21.15.83:59590) 2024-03-30T13:08:39.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f905b7fe640 1 -- 172.21.15.83:0/3119276191 learned_addr learned my addr 172.21.15.83:0/3119276191 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:39.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9060fde640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f905c15c8e0 0x7f905c1f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f905bfff640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f905c0adac0 0x7f905c14d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f905b7fe640 1 -- 172.21.15.83:0/3119276191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f905c15c8e0 msgr2=0x7f905c1f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f905b7fe640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f905c15c8e0 0x7f905c1f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f905b7fe640 1 -- 172.21.15.83:0/3119276191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f905c0adac0 msgr2=0x7f905c14d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f905b7fe640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f905c0adac0 0x7f905c14d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f905b7fe640 1 -- 172.21.15.83:0/3119276191 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c159410 con 0x7f905c0b4680 2024-03-30T13:08:39.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f905b7fe640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f905c0b4680 0x7f905c1538b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9050001ec0 tx=0x7f905000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:39.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9058ff9640 1 -- 172.21.15.83:0/3119276191 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050017070 con 0x7f905c0b4680 2024-03-30T13:08:39.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9058ff9640 1 -- 172.21.15.83:0/3119276191 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9050003600 con 0x7f905c0b4680 2024-03-30T13:08:39.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9058ff9640 1 -- 172.21.15.83:0/3119276191 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500039f0 con 0x7f905c0b4680 2024-03-30T13:08:39.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9062a41640 1 -- 172.21.15.83:0/3119276191 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905c1596f0 con 0x7f905c0b4680 2024-03-30T13:08:39.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9062a41640 1 -- 172.21.15.83:0/3119276191 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f905c159cb0 con 0x7f905c0b4680 2024-03-30T13:08:39.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9062a41640 1 -- 172.21.15.83:0/3119276191 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f905c04f9e0 con 0x7f905c0b4680 2024-03-30T13:08:39.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9058ff9640 1 -- 172.21.15.83:0/3119276191 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f905001a070 con 0x7f905c0b4680 2024-03-30T13:08:39.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9058ff9640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9048067ff0 0x7f904806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f9058ff9640 1 -- 172.21.15.83:0/3119276191 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9050085920 con 0x7f905c0b4680 2024-03-30T13:08:39.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.657+0000 7f905bfff640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9048067ff0 0x7f904806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.661+0000 7f905bfff640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9048067ff0 0x7f904806a4b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f904c0af000 tx=0x7f904c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:39.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.661+0000 7f9058ff9640 1 -- 172.21.15.83:0/3119276191 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9050056050 con 0x7f905c0b4680 2024-03-30T13:08:39.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.809+0000 7f9062a41640 1 -- 172.21.15.83:0/3119276191 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f905c06bc50 con 0x7f905c0b4680 2024-03-30T13:08:39.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9058ff9640 1 -- 172.21.15.83:0/3119276191 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f9050055950 con 0x7f905c0b4680 2024-03-30T13:08:39.817 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:08:39.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9062a41640 1 -- 172.21.15.83:0/3119276191 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9048067ff0 msgr2=0x7f904806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9062a41640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9048067ff0 0x7f904806a4b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f904c0af000 tx=0x7f904c0a7000 comp rx=0 tx=0).stop 2024-03-30T13:08:39.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9062a41640 1 -- 172.21.15.83:0/3119276191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f905c0b4680 msgr2=0x7f905c1538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9062a41640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f905c0b4680 0x7f905c1538b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9050001ec0 tx=0x7f905000c8e0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9062a41640 1 -- 172.21.15.83:0/3119276191 shutdown_connections 2024-03-30T13:08:39.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9062a41640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9048067ff0 0x7f904806a4b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9062a41640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f905c15c8e0 0x7f905c1f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9062a41640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f905c0b4680 0x7f905c1538b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9062a41640 1 --2- 172.21.15.83:0/3119276191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f905c0adac0 0x7f905c14d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9062a41640 1 -- 172.21.15.83:0/3119276191 >> 172.21.15.83:0/3119276191 conn(0x7f905c06b660 msgr2=0x7f905c06de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:39.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9062a41640 1 -- 172.21.15.83:0/3119276191 shutdown_connections 2024-03-30T13:08:39.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.813+0000 7f9062a41640 1 -- 172.21.15.83:0/3119276191 wait complete. 2024-03-30T13:08:39.836 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:08:39.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feebc1ad640 1 Processor -- start 2024-03-30T13:08:39.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feebc1ad640 1 -- start start 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feebc1ad640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feeb40b4830 0x7feeb415d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feebc1ad640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb415d880 con 0x7feeb406dfe0 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feebc1ad640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb40cfcb0 con 0x7feeb40aed20 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feebc1ad640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7feeb4156e00 con 0x7feeb40b4830 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeba74a640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7feeb406dfe0 0x7feeb406e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56462/0 (socket says 172.21.15.83:56462) 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeba74a640 1 -- 172.21.15.83:0/2714773413 learned_addr learned my addr 172.21.15.83:0/2714773413 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb9f49640 1 --2- 172.21.15.83:0/2714773413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feeb40b4830 0x7feeb415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 599650204 0 0) 0x7feeb415d880 con 0x7feeb406dfe0 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feea0003530 con 0x7feeb406dfe0 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241771335 0 0) 0x7feeb40cfcb0 con 0x7feeb40aed20 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feeb415d880 con 0x7feeb40aed20 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1667444954 0 0) 0x7feea0003530 con 0x7feeb406dfe0 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feeb40b4830 msgr2=0x7feeb415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:39.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 --2- 172.21.15.83:0/2714773413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feeb40b4830 0x7feeb415d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 >> v1:172.21.15.153:6789/0 conn(0x7feeb40aed20 legacy=0x7feeb40af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb40ad290 con 0x7feeb406dfe0 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7feeac001a00 con 0x7feeb406dfe0 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 >> v1:172.21.15.83:6789/0 conn(0x7feeb406dfe0 legacy=0x7feeb406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 --2- 172.21.15.83:0/2714773413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feea0003b80 0x7feea0003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 --2- 172.21.15.83:0/2714773413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feeb40b4830 0x7feea0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 --2- 172.21.15.83:0/2714773413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feea0004d50 0x7feea00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feeb4156e00 con 0x7feea0003b80 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feea000bb60 con 0x7feea0004d50 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7feea000bd60 con 0x7feeb40b4830 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb9f49640 1 --2- 172.21.15.83:0/2714773413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feea0003b80 0x7feea0003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb9748640 1 --2- 172.21.15.83:0/2714773413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feeb40b4830 0x7feea0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeba74a640 1 --2- 172.21.15.83:0/2714773413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feea0004d50 0x7feea00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb9f49640 1 -- 172.21.15.83:0/2714773413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feeb40b4830 msgr2=0x7feea0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:39.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb9f49640 1 --2- 172.21.15.83:0/2714773413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feeb40b4830 0x7feea0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb9f49640 1 -- 172.21.15.83:0/2714773413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feea0004d50 msgr2=0x7feea00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:39.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb9f49640 1 --2- 172.21.15.83:0/2714773413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feea0004d50 0x7feea00051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.937+0000 7feeb9f49640 1 -- 172.21.15.83:0/2714773413 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea0003530 con 0x7feea0003b80 2024-03-30T13:08:39.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feeb9f49640 1 --2- 172.21.15.83:0/2714773413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feea0003b80 0x7feea0003f60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feea4009ae0 tx=0x7feea401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bd2821123729a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:39.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea40096b0 con 0x7feea0003b80 2024-03-30T13:08:39.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea40a6450 con 0x7feea0003b80 2024-03-30T13:08:39.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feeb8f47640 1 -- 172.21.15.83:0/2714773413 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea40a6840 con 0x7feea0003b80 2024-03-30T13:08:39.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feebc1ad640 1 -- 172.21.15.83:0/2714773413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feea0003b80 msgr2=0x7feea0003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feebc1ad640 1 --2- 172.21.15.83:0/2714773413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feea0003b80 0x7feea0003f60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feea4009ae0 tx=0x7feea401ca70 comp rx=0 tx=0).stop 2024-03-30T13:08:39.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feeba74a640 1 -- 172.21.15.83:0/2714773413 reap_dead start 2024-03-30T13:08:39.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feebc1ad640 1 -- 172.21.15.83:0/2714773413 shutdown_connections 2024-03-30T13:08:39.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feebc1ad640 1 -- 172.21.15.83:0/2714773413 >> 172.21.15.83:0/2714773413 conn(0x7feeb40b1d60 msgr2=0x7feeb40b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:39.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feebc1ad640 1 -- 172.21.15.83:0/2714773413 shutdown_connections 2024-03-30T13:08:39.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feebc1ad640 1 -- 172.21.15.83:0/2714773413 wait complete. 2024-03-30T13:08:39.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feebc1ad640 1 Processor -- start 2024-03-30T13:08:39.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.941+0000 7feebc1ad640 1 -- start start 2024-03-30T13:08:39.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feebc1ad640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feea0003b80 0x7feeb41475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feebc1ad640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feeb4163250 0x7feeb4163eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feebc1ad640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeb41555e0 0x7feeb41643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feebc1ad640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feeb40cf9e0 con 0x7feeb41555e0 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feebc1ad640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feeb40cf860 con 0x7feeb4163250 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feebc1ad640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7feeb4168280 con 0x7feea0003b80 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeba74a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeb41555e0 0x7feeb41643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeba74a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeb41555e0 0x7feeb41643f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59610/0 (socket says 172.21.15.83:59610) 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeba74a640 1 -- 172.21.15.83:0/4043159968 learned_addr learned my addr 172.21.15.83:0/4043159968 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeb9f49640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feea0003b80 0x7feeb41475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeb9748640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feeb4163250 0x7feeb4163eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeba74a640 1 -- 172.21.15.83:0/4043159968 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feea0003b80 msgr2=0x7feeb41475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeba74a640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feea0003b80 0x7feeb41475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeba74a640 1 -- 172.21.15.83:0/4043159968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feeb4163250 msgr2=0x7feeb4163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeba74a640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feeb4163250 0x7feeb4163eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeba74a640 1 -- 172.21.15.83:0/4043159968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb409d7d0 con 0x7feeb41555e0 2024-03-30T13:08:39.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeba74a640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeb41555e0 0x7feeb41643f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feeb4073aa0 tx=0x7feeac00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:39.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeaa7fc640 1 -- 172.21.15.83:0/4043159968 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac008850 con 0x7feeb41555e0 2024-03-30T13:08:39.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeaa7fc640 1 -- 172.21.15.83:0/4043159968 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac0089f0 con 0x7feeb41555e0 2024-03-30T13:08:39.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feebc1ad640 1 -- 172.21.15.83:0/4043159968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb409dab0 con 0x7feeb41555e0 2024-03-30T13:08:39.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeaa7fc640 1 -- 172.21.15.83:0/4043159968 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac015670 con 0x7feeb41555e0 2024-03-30T13:08:39.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feebc1ad640 1 -- 172.21.15.83:0/4043159968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb409c880 con 0x7feeb41555e0 2024-03-30T13:08:39.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feebc1ad640 1 -- 172.21.15.83:0/4043159968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb40686c0 con 0x7feeb41555e0 2024-03-30T13:08:39.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeaa7fc640 1 -- 172.21.15.83:0/4043159968 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7feeac01c020 con 0x7feeb41555e0 2024-03-30T13:08:39.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeaa7fc640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fee98067fc0 0x7fee9806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:39.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeb9f49640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fee98067fc0 0x7fee9806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:39.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeaa7fc640 1 -- 172.21.15.83:0/4043159968 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feeac0868f0 con 0x7feeb41555e0 2024-03-30T13:08:39.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.945+0000 7feeb9f49640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fee98067fc0 0x7fee9806a480 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feea40ad000 tx=0x7feea40b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:39.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:39.949+0000 7feeaa7fc640 1 -- 172.21.15.83:0/4043159968 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7feeac057130 con 0x7feeb41555e0 2024-03-30T13:08:40.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.129+0000 7feebc1ad640 1 -- 172.21.15.83:0/4043159968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feeb409a250 con 0x7feeb41555e0 2024-03-30T13:08:40.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feeaa7fc640 1 -- 172.21.15.83:0/4043159968 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7feeac056a30 con 0x7feeb41555e0 2024-03-30T13:08:40.138 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:40.138 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2431286615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2431286615},{"type":"v1","addr":"172.21.15.153:6835","nonce":2431286615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1036905849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1036905849},{"type":"v1","addr":"172.21.15.83:6835","nonce":1036905849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2692566836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2692566836},{"type":"v1","addr":"172.21.15.83:6837","nonce":2692566836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:08:25.599943+0000","modified":"2024-03-30T13:08:27.589265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/53727078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":53727078},{"type":"v1","addr":"172.21.15.153:6833","nonce":53727078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-30T13:08:40.138 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 6 2024-03-30T13:08:40.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feebc1ad640 1 -- 172.21.15.83:0/4043159968 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fee98067fc0 msgr2=0x7fee9806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feebc1ad640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fee98067fc0 0x7fee9806a480 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feea40ad000 tx=0x7feea40b2040 comp rx=0 tx=0).stop 2024-03-30T13:08:40.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feebc1ad640 1 -- 172.21.15.83:0/4043159968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeb41555e0 msgr2=0x7feeb41643f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feebc1ad640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeb41555e0 0x7feeb41643f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feeb4073aa0 tx=0x7feeac00eef0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feebc1ad640 1 -- 172.21.15.83:0/4043159968 shutdown_connections 2024-03-30T13:08:40.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feebc1ad640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fee98067fc0 0x7fee9806a480 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feebc1ad640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeb41555e0 0x7feeb41643f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feebc1ad640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feeb4163250 0x7feeb4163eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feebc1ad640 1 --2- 172.21.15.83:0/4043159968 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feea0003b80 0x7feeb41475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feebc1ad640 1 -- 172.21.15.83:0/4043159968 >> 172.21.15.83:0/4043159968 conn(0x7feeb40b1d60 msgr2=0x7feeb415ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:40.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feebc1ad640 1 -- 172.21.15.83:0/4043159968 shutdown_connections 2024-03-30T13:08:40.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.133+0000 7feebc1ad640 1 -- 172.21.15.83:0/4043159968 wait complete. 2024-03-30T13:08:40.156 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:40.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f67684b7640 1 Processor -- start 2024-03-30T13:08:40.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f67684b7640 1 -- start start 2024-03-30T13:08:40.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f67684b7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67600d4950 0x7f676015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f67684b7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f67600cee20 0x7f67600cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f67684b7640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f676006c6a0 con 0x7f676015e500 2024-03-30T13:08:40.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f67684b7640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f67600d2340 con 0x7f67600cee20 2024-03-30T13:08:40.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f67684b7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f67600cfb30 con 0x7f67600d4950 2024-03-30T13:08:40.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6766a54640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f67600cee20 0x7f67600cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6766a54640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f67600cee20 0x7f67600cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59616/0 (socket says 172.21.15.83:59616) 2024-03-30T13:08:40.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6766a54640 1 -- 172.21.15.83:0/3701454969 learned_addr learned my addr 172.21.15.83:0/3701454969 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:40.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6765a52640 1 --2- 172.21.15.83:0/3701454969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67600d4950 0x7f676015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6766a54640 1 -- 172.21.15.83:0/3701454969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67600d4950 msgr2=0x7f676015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:40.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6766a54640 1 --2- 172.21.15.83:0/3701454969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67600d4950 0x7f676015e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6766a54640 1 -- 172.21.15.83:0/3701454969 >> v1:172.21.15.153:6789/0 conn(0x7f676015e500 legacy=0x7f67600d4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6766a54640 1 -- 172.21.15.83:0/3701454969 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67600cfe10 con 0x7f67600cee20 2024-03-30T13:08:40.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6765a52640 1 --2- 172.21.15.83:0/3701454969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67600d4950 0x7f676015e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:40.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6766a54640 1 --2- 172.21.15.83:0/3701454969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67600cee20 0x7f67600cf2b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6758009e50 tx=0x7f675801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd50c2fb0d2847d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:40.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6765251640 1 -- 172.21.15.83:0/3701454969 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67580a58d0 con 0x7f67600cee20 2024-03-30T13:08:40.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6765251640 1 -- 172.21.15.83:0/3701454969 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67580a5a70 con 0x7f67600cee20 2024-03-30T13:08:40.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.265+0000 7f6765251640 1 -- 172.21.15.83:0/3701454969 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67580a5e40 con 0x7f67600cee20 2024-03-30T13:08:40.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 -- 172.21.15.83:0/3701454969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67600cee20 msgr2=0x7f67600cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 --2- 172.21.15.83:0/3701454969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67600cee20 0x7f67600cf2b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6758009e50 tx=0x7f675801ca00 comp rx=0 tx=0).stop 2024-03-30T13:08:40.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 -- 172.21.15.83:0/3701454969 shutdown_connections 2024-03-30T13:08:40.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 --2- 172.21.15.83:0/3701454969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67600d4950 0x7f676015e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 --2- 172.21.15.83:0/3701454969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67600cee20 0x7f67600cf2b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 -- 172.21.15.83:0/3701454969 >> 172.21.15.83:0/3701454969 conn(0x7f676008bfe0 msgr2=0x7f676009d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:40.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 -- 172.21.15.83:0/3701454969 shutdown_connections 2024-03-30T13:08:40.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 -- 172.21.15.83:0/3701454969 wait complete. 2024-03-30T13:08:40.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 Processor -- start 2024-03-30T13:08:40.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 -- start start 2024-03-30T13:08:40.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67600cee20 0x7f6760147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67600d4950 0x7f67600c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f676015e500 0x7f6760158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f676006d810 con 0x7f67600d4950 2024-03-30T13:08:40.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f676006d690 con 0x7f67600cee20 2024-03-30T13:08:40.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f67684b7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f676006d990 con 0x7f676015e500 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f6765a52640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67600d4950 0x7f67600c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f6765a52640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67600d4950 0x7f67600c7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59624/0 (socket says 172.21.15.83:59624) 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f6765a52640 1 -- 172.21.15.83:0/1377341793 learned_addr learned my addr 172.21.15.83:0/1377341793 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f6766253640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67600cee20 0x7f6760147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f6766a54640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f676015e500 0x7f6760158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f6765a52640 1 -- 172.21.15.83:0/1377341793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f676015e500 msgr2=0x7f6760158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f6765a52640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f676015e500 0x7f6760158550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f6765a52640 1 -- 172.21.15.83:0/1377341793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67600cee20 msgr2=0x7f6760147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f6765a52640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67600cee20 0x7f6760147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f6765a52640 1 -- 172.21.15.83:0/1377341793 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6760158e80 con 0x7f67600d4950 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f6765a52640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67600d4950 0x7f67600c7910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f675400c820 tx=0x7f675400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.269+0000 7f6752ffd640 1 -- 172.21.15.83:0/1377341793 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6754005ba0 con 0x7f67600d4950 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.273+0000 7f6752ffd640 1 -- 172.21.15.83:0/1377341793 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6754005d40 con 0x7f67600d4950 2024-03-30T13:08:40.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.273+0000 7f67684b7640 1 -- 172.21.15.83:0/1377341793 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6760159160 con 0x7f67600d4950 2024-03-30T13:08:40.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.273+0000 7f6752ffd640 1 -- 172.21.15.83:0/1377341793 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6754007a50 con 0x7f67600d4950 2024-03-30T13:08:40.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.273+0000 7f67684b7640 1 -- 172.21.15.83:0/1377341793 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6760159720 con 0x7f67600d4950 2024-03-30T13:08:40.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.273+0000 7f67684b7640 1 -- 172.21.15.83:0/1377341793 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67600686c0 con 0x7f67600d4950 2024-03-30T13:08:40.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.273+0000 7f6752ffd640 1 -- 172.21.15.83:0/1377341793 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6754007bf0 con 0x7f67600d4950 2024-03-30T13:08:40.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.273+0000 7f6752ffd640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6744067ff0 0x7f674406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.273+0000 7f6752ffd640 1 -- 172.21.15.83:0/1377341793 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6754086940 con 0x7f67600d4950 2024-03-30T13:08:40.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.273+0000 7f6766253640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6744067ff0 0x7f674406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.273+0000 7f6766253640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6744067ff0 0x7f674406a4b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f675c0015b0 tx=0x7f675c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:40.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.277+0000 7f6752ffd640 1 -- 172.21.15.83:0/1377341793 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6754015020 con 0x7f67600d4950 2024-03-30T13:08:40.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.429+0000 7f67684b7640 1 -- 172.21.15.83:0/1377341793 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f676015d430 con 0x7f67600d4950 2024-03-30T13:08:40.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.429+0000 7f6752ffd640 1 -- 172.21.15.83:0/1377341793 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f67540571d0 con 0x7f67600d4950 2024-03-30T13:08:40.437 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:40.437 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:40.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.433+0000 7f67684b7640 1 -- 172.21.15.83:0/1377341793 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6744067ff0 msgr2=0x7f674406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.433+0000 7f67684b7640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6744067ff0 0x7f674406a4b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f675c0015b0 tx=0x7f675c009040 comp rx=0 tx=0).stop 2024-03-30T13:08:40.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.433+0000 7f67684b7640 1 -- 172.21.15.83:0/1377341793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67600d4950 msgr2=0x7f67600c7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.433+0000 7f67684b7640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67600d4950 0x7f67600c7910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f675400c820 tx=0x7f675400cc20 comp rx=0 tx=0).stop 2024-03-30T13:08:40.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.433+0000 7f67684b7640 1 -- 172.21.15.83:0/1377341793 shutdown_connections 2024-03-30T13:08:40.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.433+0000 7f67684b7640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6744067ff0 0x7f674406a4b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.433+0000 7f67684b7640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f676015e500 0x7f6760158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.433+0000 7f67684b7640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67600d4950 0x7f67600c7910 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.433+0000 7f67684b7640 1 --2- 172.21.15.83:0/1377341793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67600cee20 0x7f6760147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.433+0000 7f67684b7640 1 -- 172.21.15.83:0/1377341793 >> 172.21.15.83:0/1377341793 conn(0x7f676008bfe0 msgr2=0x7f67600b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:40.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.433+0000 7f67684b7640 1 -- 172.21.15.83:0/1377341793 shutdown_connections 2024-03-30T13:08:40.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.433+0000 7f67684b7640 1 -- 172.21.15.83:0/1377341793 wait complete. 2024-03-30T13:08:40.454 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:08:40.455 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:08:40.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ef3ef640 1 Processor -- start 2024-03-30T13:08:40.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ef3ef640 1 -- start start 2024-03-30T13:08:40.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ef3ef640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff9e815c8e0 0x7ff9e80ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ef3ef640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff9e80adac0 0x7ff9e815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ef3ef640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e80ae040 con 0x7ff9e815d200 2024-03-30T13:08:40.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ef3ef640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e80b31e0 con 0x7ff9e815c8e0 2024-03-30T13:08:40.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ef3ef640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e80ae320 con 0x7ff9e80adac0 2024-03-30T13:08:40.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ed18b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff9e815c8e0 0x7ff9e80ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ed98c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff9e815d200 0x7ff9e80b3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56474/0 (socket says 172.21.15.83:56474) 2024-03-30T13:08:40.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ed18b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff9e815c8e0 0x7ff9e80ad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59632/0 (socket says 172.21.15.83:59632) 2024-03-30T13:08:40.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ed98c640 1 -- 172.21.15.83:0/1552427264 learned_addr learned my addr 172.21.15.83:0/1552427264 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:40.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ec98a640 1 --2- 172.21.15.83:0/1552427264 >> v2:172.21.15.153:3300/0 conn(0x7ff9e80adac0 0x7ff9e815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ed18b640 1 -- 172.21.15.83:0/1552427264 >> v2:172.21.15.153:3300/0 conn(0x7ff9e80adac0 msgr2=0x7ff9e815ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:40.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ed18b640 1 --2- 172.21.15.83:0/1552427264 >> v2:172.21.15.153:3300/0 conn(0x7ff9e80adac0 0x7ff9e815ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ed18b640 1 -- 172.21.15.83:0/1552427264 >> v1:172.21.15.83:6789/0 conn(0x7ff9e815d200 legacy=0x7ff9e80b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9ed18b640 1 -- 172.21.15.83:0/1552427264 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e80ae600 con 0x7ff9e815c8e0 2024-03-30T13:08:40.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.569+0000 7ff9dffff640 1 -- 172.21.15.83:0/1552427264 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1257136505 0 0) 0x7ff9e80ae040 con 0x7ff9e815d200 2024-03-30T13:08:40.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ed18b640 1 --2- 172.21.15.83:0/1552427264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9e815c8e0 0x7ff9e80ad580 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80afd20 tx=0x7ff9d801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0035c9b395f6b40 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:40.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9dffff640 1 -- 172.21.15.83:0/1552427264 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80b2070 con 0x7ff9e815c8e0 2024-03-30T13:08:40.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9dffff640 1 -- 172.21.15.83:0/1552427264 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d80ad640 con 0x7ff9e815c8e0 2024-03-30T13:08:40.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9dffff640 1 -- 172.21.15.83:0/1552427264 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80ada10 con 0x7ff9e815c8e0 2024-03-30T13:08:40.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/1552427264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9e815c8e0 msgr2=0x7ff9e80ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 --2- 172.21.15.83:0/1552427264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9e815c8e0 0x7ff9e80ad580 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80afd20 tx=0x7ff9d801c480 comp rx=0 tx=0).stop 2024-03-30T13:08:40.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/1552427264 shutdown_connections 2024-03-30T13:08:40.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 --2- 172.21.15.83:0/1552427264 >> v2:172.21.15.153:3300/0 conn(0x7ff9e80adac0 0x7ff9e815ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 --2- 172.21.15.83:0/1552427264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9e815c8e0 0x7ff9e80ad580 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/1552427264 >> 172.21.15.83:0/1552427264 conn(0x7ff9e806b660 msgr2=0x7ff9e806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:40.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/1552427264 shutdown_connections 2024-03-30T13:08:40.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/1552427264 wait complete. 2024-03-30T13:08:40.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 Processor -- start 2024-03-30T13:08:40.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 -- start start 2024-03-30T13:08:40.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9e80adac0 0x7ff9e8144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9e815c8e0 0x7ff9e814e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e815d200 0x7ff9e81f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e80b4710 con 0x7ff9e815c8e0 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e80b4590 con 0x7ff9e815d200 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e80b4890 con 0x7ff9e80adac0 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ec98a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9e815c8e0 0x7ff9e814e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ec98a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9e815c8e0 0x7ff9e814e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59634/0 (socket says 172.21.15.83:59634) 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ec98a640 1 -- 172.21.15.83:0/2622179111 learned_addr learned my addr 172.21.15.83:0/2622179111 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ed18b640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9e80adac0 0x7ff9e8144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ed98c640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e815d200 0x7ff9e81f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ec98a640 1 -- 172.21.15.83:0/2622179111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9e80adac0 msgr2=0x7ff9e8144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ec98a640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9e80adac0 0x7ff9e8144b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ec98a640 1 -- 172.21.15.83:0/2622179111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e815d200 msgr2=0x7ff9e81f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ec98a640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e815d200 0x7ff9e81f4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ec98a640 1 -- 172.21.15.83:0/2622179111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e814f040 con 0x7ff9e815c8e0 2024-03-30T13:08:40.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ec98a640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9e815c8e0 0x7ff9e814e960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400d620 tx=0x7ff9e400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:40.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ddffb640 1 -- 172.21.15.83:0/2622179111 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400b620 con 0x7ff9e815c8e0 2024-03-30T13:08:40.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ddffb640 1 -- 172.21.15.83:0/2622179111 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e4019070 con 0x7ff9e815c8e0 2024-03-30T13:08:40.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/2622179111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e8145ae0 con 0x7ff9e815c8e0 2024-03-30T13:08:40.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ddffb640 1 -- 172.21.15.83:0/2622179111 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400b9e0 con 0x7ff9e815c8e0 2024-03-30T13:08:40.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.573+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/2622179111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e81460a0 con 0x7ff9e815c8e0 2024-03-30T13:08:40.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.577+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/2622179111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e804f9e0 con 0x7ff9e815c8e0 2024-03-30T13:08:40.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.577+0000 7ff9ddffb640 1 -- 172.21.15.83:0/2622179111 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff9e400bb80 con 0x7ff9e815c8e0 2024-03-30T13:08:40.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.577+0000 7ff9ddffb640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff9cc067fc0 0x7ff9cc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.577+0000 7ff9ddffb640 1 -- 172.21.15.83:0/2622179111 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff9e4086930 con 0x7ff9e815c8e0 2024-03-30T13:08:40.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.577+0000 7ff9ed18b640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff9cc067fc0 0x7ff9cc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.577+0000 7ff9ed18b640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff9cc067fc0 0x7ff9cc06a480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80af000 tx=0x7ff9d80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:40.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.581+0000 7ff9ddffb640 1 -- 172.21.15.83:0/2622179111 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff9e40570e0 con 0x7ff9e815c8e0 2024-03-30T13:08:40.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.737+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/2622179111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff9e806eba0 con 0x7ff9e815c8e0 2024-03-30T13:08:40.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.737+0000 7ff9ddffb640 1 -- 172.21.15.83:0/2622179111 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7ff9e40569e0 con 0x7ff9e815c8e0 2024-03-30T13:08:40.744 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:08:40.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.741+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/2622179111 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff9cc067fc0 msgr2=0x7ff9cc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.741+0000 7ff9ef3ef640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff9cc067fc0 0x7ff9cc06a480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80af000 tx=0x7ff9d80a7070 comp rx=0 tx=0).stop 2024-03-30T13:08:40.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.741+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/2622179111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9e815c8e0 msgr2=0x7ff9e814e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.741+0000 7ff9ef3ef640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9e815c8e0 0x7ff9e814e960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400d620 tx=0x7ff9e400dae0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.741+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/2622179111 shutdown_connections 2024-03-30T13:08:40.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.741+0000 7ff9ef3ef640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff9cc067fc0 0x7ff9cc06a480 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.741+0000 7ff9ef3ef640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e815d200 0x7ff9e81f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.741+0000 7ff9ef3ef640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9e815c8e0 0x7ff9e814e960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.741+0000 7ff9ef3ef640 1 --2- 172.21.15.83:0/2622179111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9e80adac0 0x7ff9e8144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.741+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/2622179111 >> 172.21.15.83:0/2622179111 conn(0x7ff9e806b660 msgr2=0x7ff9e806de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:40.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.741+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/2622179111 shutdown_connections 2024-03-30T13:08:40.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.741+0000 7ff9ef3ef640 1 -- 172.21.15.83:0/2622179111 wait complete. 2024-03-30T13:08:40.762 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:08:40.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe065cc640 1 Processor -- start 2024-03-30T13:08:40.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe065cc640 1 -- start start 2024-03-30T13:08:40.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe065cc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe000b4680 0x7efe0015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe065cc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efe0015d200 0x7efe00165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe065cc640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe000ae040 con 0x7efe0015c8e0 2024-03-30T13:08:40.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe065cc640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7efe000b31e0 con 0x7efe0015d200 2024-03-30T13:08:40.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe065cc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe000ae320 con 0x7efe000b4680 2024-03-30T13:08:40.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe04b69640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efe0015d200 0x7efe00165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe04b69640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efe0015d200 0x7efe00165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59642/0 (socket says 172.21.15.83:59642) 2024-03-30T13:08:40.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe04b69640 1 -- 172.21.15.83:0/1550882171 learned_addr learned my addr 172.21.15.83:0/1550882171 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:40.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efdfffff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7efe0015c8e0 0x7efe000ad580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56478/0 (socket says 172.21.15.83:56478) 2024-03-30T13:08:40.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efdff7fe640 1 --2- 172.21.15.83:0/1550882171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe000b4680 0x7efe0015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe04b69640 1 -- 172.21.15.83:0/1550882171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe000b4680 msgr2=0x7efe0015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:40.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe04b69640 1 --2- 172.21.15.83:0/1550882171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe000b4680 0x7efe0015ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe04b69640 1 -- 172.21.15.83:0/1550882171 >> v1:172.21.15.83:6789/0 conn(0x7efe0015c8e0 legacy=0x7efe000ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe04b69640 1 -- 172.21.15.83:0/1550882171 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe000ae600 con 0x7efe0015d200 2024-03-30T13:08:40.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efdfeffd640 1 -- 172.21.15.83:0/1550882171 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1919202136 0 0) 0x7efe000ae040 con 0x7efe0015c8e0 2024-03-30T13:08:40.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efe04b69640 1 --2- 172.21.15.83:0/1550882171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe0015d200 0x7efe00165e90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009e50 tx=0x7efdf801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4018e4e044521118 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:40.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efdfeffd640 1 -- 172.21.15.83:0/1550882171 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf80a5810 con 0x7efe0015d200 2024-03-30T13:08:40.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efdfeffd640 1 -- 172.21.15.83:0/1550882171 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf80a59b0 con 0x7efe0015d200 2024-03-30T13:08:40.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.881+0000 7efdfeffd640 1 -- 172.21.15.83:0/1550882171 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf80a5d80 con 0x7efe0015d200 2024-03-30T13:08:40.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 -- 172.21.15.83:0/1550882171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe0015d200 msgr2=0x7efe00165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 --2- 172.21.15.83:0/1550882171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe0015d200 0x7efe00165e90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009e50 tx=0x7efdf801ca30 comp rx=0 tx=0).stop 2024-03-30T13:08:40.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 -- 172.21.15.83:0/1550882171 shutdown_connections 2024-03-30T13:08:40.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 --2- 172.21.15.83:0/1550882171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe0015d200 0x7efe00165e90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 --2- 172.21.15.83:0/1550882171 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe000b4680 0x7efe0015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 -- 172.21.15.83:0/1550882171 >> 172.21.15.83:0/1550882171 conn(0x7efe0006b660 msgr2=0x7efe0006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:40.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 -- 172.21.15.83:0/1550882171 shutdown_connections 2024-03-30T13:08:40.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 -- 172.21.15.83:0/1550882171 wait complete. 2024-03-30T13:08:40.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 Processor -- start 2024-03-30T13:08:40.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 -- start start 2024-03-30T13:08:40.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe000b4680 0x7efe00143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe0015c8e0 0x7efe0015e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0015d200 0x7efe00099860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efe000adc90 con 0x7efe000b4680 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe00168bf0 con 0x7efe0015c8e0 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe00144660 con 0x7efe0015d200 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdfffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe000b4680 0x7efe00143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdfffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe000b4680 0x7efe00143fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59658/0 (socket says 172.21.15.83:59658) 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdfffff640 1 -- 172.21.15.83:0/1989671747 learned_addr learned my addr 172.21.15.83:0/1989671747 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe04b69640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0015d200 0x7efe00099860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdff7fe640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe0015c8e0 0x7efe0015e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdfffff640 1 -- 172.21.15.83:0/1989671747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0015d200 msgr2=0x7efe00099860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdfffff640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0015d200 0x7efe00099860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdfffff640 1 -- 172.21.15.83:0/1989671747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe0015c8e0 msgr2=0x7efe0015e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:40.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdfffff640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe0015c8e0 0x7efe0015e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:40.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdfffff640 1 -- 172.21.15.83:0/1989671747 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe001520b0 con 0x7efe000b4680 2024-03-30T13:08:40.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe04b69640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0015d200 0x7efe00099860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:40.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdff7fe640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe0015c8e0 0x7efe0015e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:40.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdfffff640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe000b4680 0x7efe00143fc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efdf000c4b0 tx=0x7efdf000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:40.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdfcff9640 1 -- 172.21.15.83:0/1989671747 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf0018070 con 0x7efe000b4680 2024-03-30T13:08:40.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdfcff9640 1 -- 172.21.15.83:0/1989671747 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf0007500 con 0x7efe000b4680 2024-03-30T13:08:40.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 -- 172.21.15.83:0/1989671747 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe00152390 con 0x7efe000b4680 2024-03-30T13:08:40.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efdfcff9640 1 -- 172.21.15.83:0/1989671747 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf0004a30 con 0x7efe000b4680 2024-03-30T13:08:40.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.885+0000 7efe065cc640 1 -- 172.21.15.83:0/1989671747 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe00099da0 con 0x7efe000b4680 2024-03-30T13:08:40.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.889+0000 7efe065cc640 1 -- 172.21.15.83:0/1989671747 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe00166160 con 0x7efe000b4680 2024-03-30T13:08:40.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.889+0000 7efdfcff9640 1 -- 172.21.15.83:0/1989671747 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7efdf001b070 con 0x7efe000b4680 2024-03-30T13:08:40.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.889+0000 7efdfcff9640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efdec067fc0 0x7efdec06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:40.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.889+0000 7efdfcff9640 1 -- 172.21.15.83:0/1989671747 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efdf00857a0 con 0x7efe000b4680 2024-03-30T13:08:40.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.889+0000 7efdff7fe640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efdec067fc0 0x7efdec06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:40.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.889+0000 7efdff7fe640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efdec067fc0 0x7efdec06a480 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe0015be20 tx=0x7efdf4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:40.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:40.893+0000 7efdfcff9640 1 -- 172.21.15.83:0/1989671747 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7efdf0055f50 con 0x7efe000b4680 2024-03-30T13:08:41.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 -- 172.21.15.83:0/1989671747 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efe0004f9e0 con 0x7efe000b4680 2024-03-30T13:08:41.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efdfcff9640 1 -- 172.21.15.83:0/1989671747 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7efdf0055850 con 0x7efe000b4680 2024-03-30T13:08:41.058 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:08:41.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 -- 172.21.15.83:0/1989671747 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efdec067fc0 msgr2=0x7efdec06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efdec067fc0 0x7efdec06a480 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe0015be20 tx=0x7efdf4008040 comp rx=0 tx=0).stop 2024-03-30T13:08:41.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 -- 172.21.15.83:0/1989671747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe000b4680 msgr2=0x7efe00143fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe000b4680 0x7efe00143fc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efdf000c4b0 tx=0x7efdf000c970 comp rx=0 tx=0).stop 2024-03-30T13:08:41.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 -- 172.21.15.83:0/1989671747 shutdown_connections 2024-03-30T13:08:41.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efdec067fc0 0x7efdec06a480 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0015d200 0x7efe00099860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe0015c8e0 0x7efe0015e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 --2- 172.21.15.83:0/1989671747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe000b4680 0x7efe00143fc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 -- 172.21.15.83:0/1989671747 >> 172.21.15.83:0/1989671747 conn(0x7efe0006b660 msgr2=0x7efe0015ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:41.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 -- 172.21.15.83:0/1989671747 shutdown_connections 2024-03-30T13:08:41.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.053+0000 7efe065cc640 1 -- 172.21.15.83:0/1989671747 wait complete. 2024-03-30T13:08:41.077 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:08:41.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8eb4d9640 1 Processor -- start 2024-03-30T13:08:41.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8eb4d9640 1 -- start start 2024-03-30T13:08:41.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8eb4d9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e406f860 0x7fe8e4165dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8eb4d9640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e40b31e0 con 0x7fe8e415b050 2024-03-30T13:08:41.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8eb4d9640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e40ad4f0 con 0x7fe8e4073570 2024-03-30T13:08:41.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8eb4d9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e40ad7d0 con 0x7fe8e406f860 2024-03-30T13:08:41.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e9275640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fe8e415b050 0x7fe8e40b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56482/0 (socket says 172.21.15.83:56482) 2024-03-30T13:08:41.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e9275640 1 -- 172.21.15.83:0/2722859290 learned_addr learned my addr 172.21.15.83:0/2722859290 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:41.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e9a76640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e406f860 0x7fe8e4165dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1666782999 0 0) 0x7fe8e40b31e0 con 0x7fe8e415b050 2024-03-30T13:08:41.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8d0003530 con 0x7fe8e415b050 2024-03-30T13:08:41.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2116617162 0 0) 0x7fe8d0003530 con 0x7fe8e415b050 2024-03-30T13:08:41.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e406f860 msgr2=0x7fe8e4165dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:41.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e406f860 0x7fe8e4165dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 >> v1:172.21.15.153:6789/0 conn(0x7fe8e4073570 legacy=0x7fe8e406f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e40b34a0 con 0x7fe8e415b050 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fe8e0001680 con 0x7fe8e415b050 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 >> v1:172.21.15.83:6789/0 conn(0x7fe8e415b050 legacy=0x7fe8e40b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8d00039f0 0x7fe8d0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e406f860 0x7fe8d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d0004d50 0x7fe8d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e40ad7d0 con 0x7fe8d00039f0 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d000bab0 con 0x7fe8d0004d50 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d000bcb0 con 0x7fe8e406f860 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e9275640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8d00039f0 0x7fe8d0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e8a74640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e406f860 0x7fe8d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e9275640 1 -- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e406f860 msgr2=0x7fe8d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e9a76640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d0004d50 0x7fe8d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e9275640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e406f860 0x7fe8d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e9275640 1 -- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d0004d50 msgr2=0x7fe8d00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:41.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e9275640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d0004d50 0x7fe8d00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e9275640 1 -- 172.21.15.83:0/2722859290 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d0003530 con 0x7fe8d00039f0 2024-03-30T13:08:41.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e9a76640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d0004d50 0x7fe8d00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:41.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.185+0000 7fe8e8a74640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e406f860 0x7fe8d0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:41.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8e9275640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8d00039f0 0x7fe8d0003e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000c190 tx=0x7fe8e001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc75aea4d2664ce9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:41.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0007d00 con 0x7fe8d00039f0 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e00a9020 con 0x7fe8d00039f0 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8dbfff640 1 -- 172.21.15.83:0/2722859290 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0005ae0 con 0x7fe8d00039f0 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/2722859290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8d00039f0 msgr2=0x7fe8d0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 --2- 172.21.15.83:0/2722859290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8d00039f0 0x7fe8d0003e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000c190 tx=0x7fe8e001cc40 comp rx=0 tx=0).stop 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8e9a76640 1 -- 172.21.15.83:0/2722859290 reap_dead start 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/2722859290 shutdown_connections 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/2722859290 >> 172.21.15.83:0/2722859290 conn(0x7fe8e406b660 msgr2=0x7fe8e406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/2722859290 shutdown_connections 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/2722859290 wait complete. 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 Processor -- start 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 -- start start 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d00039f0 0x7fe8e41479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e4148180 0x7fe8e4148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8e414af40 0x7fe8e414b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e40b4d90 con 0x7fe8e414af40 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e40b4c10 con 0x7fe8d00039f0 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8eb4d9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e41665d0 con 0x7fe8e4148180 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8e9a76640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8e414af40 0x7fe8e414b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8e9a76640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8e414af40 0x7fe8e414b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59670/0 (socket says 172.21.15.83:59670) 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8e9a76640 1 -- 172.21.15.83:0/423180584 learned_addr learned my addr 172.21.15.83:0/423180584 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8e9275640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d00039f0 0x7fe8e41479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8e8a74640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e4148180 0x7fe8e4148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8e9a76640 1 -- 172.21.15.83:0/423180584 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e4148180 msgr2=0x7fe8e4148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8e9a76640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e4148180 0x7fe8e4148d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8e9a76640 1 -- 172.21.15.83:0/423180584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d00039f0 msgr2=0x7fe8e41479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8e9a76640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d00039f0 0x7fe8e41479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.189+0000 7fe8e9a76640 1 -- 172.21.15.83:0/423180584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e4147ef0 con 0x7fe8e414af40 2024-03-30T13:08:41.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.193+0000 7fe8e9a76640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8e414af40 0x7fe8e414b3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40afd20 tx=0x7fe8dc00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:41.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.193+0000 7fe8d9ffb640 1 -- 172.21.15.83:0/423180584 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc01c070 con 0x7fe8e414af40 2024-03-30T13:08:41.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.193+0000 7fe8d9ffb640 1 -- 172.21.15.83:0/423180584 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8dc017400 con 0x7fe8e414af40 2024-03-30T13:08:41.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.193+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/423180584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e4149650 con 0x7fe8e414af40 2024-03-30T13:08:41.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.193+0000 7fe8d9ffb640 1 -- 172.21.15.83:0/423180584 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0177d0 con 0x7fe8e414af40 2024-03-30T13:08:41.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.193+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/423180584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e41583a0 con 0x7fe8e414af40 2024-03-30T13:08:41.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.193+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/423180584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e409e540 con 0x7fe8e414af40 2024-03-30T13:08:41.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.193+0000 7fe8d9ffb640 1 -- 172.21.15.83:0/423180584 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fe8dc01f070 con 0x7fe8e414af40 2024-03-30T13:08:41.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.193+0000 7fe8d9ffb640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe8c8067ff0 0x7fe8c806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.193+0000 7fe8d9ffb640 1 -- 172.21.15.83:0/423180584 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe8dc086500 con 0x7fe8e414af40 2024-03-30T13:08:41.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.193+0000 7fe8e9275640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe8c8067ff0 0x7fe8c806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.193+0000 7fe8e9275640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe8c8067ff0 0x7fe8c806a4b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00aa000 tx=0x7fe8e40ad6c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:41.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.197+0000 7fe8d9ffb640 1 -- 172.21.15.83:0/423180584 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fe8dc012070 con 0x7fe8e414af40 2024-03-30T13:08:41.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/423180584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe8e4154de0 con 0x7fe8e414af40 2024-03-30T13:08:41.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8d9ffb640 1 -- 172.21.15.83:0/423180584 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fe8dc056cb0 con 0x7fe8e414af40 2024-03-30T13:08:41.355 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:08:41.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/423180584 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe8c8067ff0 msgr2=0x7fe8c806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe8c8067ff0 0x7fe8c806a4b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00aa000 tx=0x7fe8e40ad6c0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/423180584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8e414af40 msgr2=0x7fe8e414b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8e414af40 0x7fe8e414b3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40afd20 tx=0x7fe8dc00f4a0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/423180584 shutdown_connections 2024-03-30T13:08:41.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe8c8067ff0 0x7fe8c806a4b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8e414af40 0x7fe8e414b3c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e4148180 0x7fe8e4148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 --2- 172.21.15.83:0/423180584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d00039f0 0x7fe8e41479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/423180584 >> 172.21.15.83:0/423180584 conn(0x7fe8e406b660 msgr2=0x7fe8e406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:41.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/423180584 shutdown_connections 2024-03-30T13:08:41.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.349+0000 7fe8eb4d9640 1 -- 172.21.15.83:0/423180584 wait complete. 2024-03-30T13:08:41.372 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:08:41.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4f6e87640 1 Processor -- start 2024-03-30T13:08:41.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4f6e87640 1 -- start start 2024-03-30T13:08:41.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4f6e87640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb4f015e500 0x7fb4f015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4f6e87640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f006c6a0 con 0x7fb4f00d4240 2024-03-30T13:08:41.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4f6e87640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f00cfb30 con 0x7fb4f00cee20 2024-03-30T13:08:41.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4f6e87640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb4f00d2340 con 0x7fb4f015e500 2024-03-30T13:08:41.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4f4c23640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb4f015e500 0x7fb4f015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4effff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fb4f00d4240 0x7fb4f00d4660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56496/0 (socket says 172.21.15.83:56496) 2024-03-30T13:08:41.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4f4c23640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb4f015e500 0x7fb4f015e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59686/0 (socket says 172.21.15.83:59686) 2024-03-30T13:08:41.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4effff640 1 -- 172.21.15.83:0/1383201406 learned_addr learned my addr 172.21.15.83:0/1383201406 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:41.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4f4c23640 1 -- 172.21.15.83:0/1383201406 >> v1:172.21.15.153:6789/0 conn(0x7fb4f00cee20 legacy=0x7fb4f00cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4f4c23640 1 -- 172.21.15.83:0/1383201406 >> v1:172.21.15.83:6789/0 conn(0x7fb4f00d4240 legacy=0x7fb4f00d4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.473+0000 7fb4f4c23640 1 -- 172.21.15.83:0/1383201406 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f00cfe10 con 0x7fb4f015e500 2024-03-30T13:08:41.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f4c23640 1 --2- 172.21.15.83:0/1383201406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f015e500 0x7fb4f015e8e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40097c0 tx=0x7fb4e401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc921d6347652b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:41.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4ef7fe640 1 -- 172.21.15.83:0/1383201406 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40b1070 con 0x7fb4f015e500 2024-03-30T13:08:41.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4ef7fe640 1 -- 172.21.15.83:0/1383201406 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e40ac5f0 con 0x7fb4f015e500 2024-03-30T13:08:41.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4ef7fe640 1 -- 172.21.15.83:0/1383201406 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40ac9c0 con 0x7fb4f015e500 2024-03-30T13:08:41.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 -- 172.21.15.83:0/1383201406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f015e500 msgr2=0x7fb4f015e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 --2- 172.21.15.83:0/1383201406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f015e500 0x7fb4f015e8e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40097c0 tx=0x7fb4e401c4a0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 -- 172.21.15.83:0/1383201406 shutdown_connections 2024-03-30T13:08:41.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 --2- 172.21.15.83:0/1383201406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f015e500 0x7fb4f015e8e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 -- 172.21.15.83:0/1383201406 >> 172.21.15.83:0/1383201406 conn(0x7fb4f008bfe0 msgr2=0x7fb4f009d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:41.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 -- 172.21.15.83:0/1383201406 shutdown_connections 2024-03-30T13:08:41.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 -- 172.21.15.83:0/1383201406 wait complete. 2024-03-30T13:08:41.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 Processor -- start 2024-03-30T13:08:41.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 -- start start 2024-03-30T13:08:41.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f00cee20 0x7fb4f00b8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4f00d4240 0x7fb4f00c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4f015e500 0x7fb4f014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f016bf10 con 0x7fb4f00cee20 2024-03-30T13:08:41.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f016bd90 con 0x7fb4f00d4240 2024-03-30T13:08:41.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f6e87640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f016c090 con 0x7fb4f015e500 2024-03-30T13:08:41.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f4c23640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f00cee20 0x7fb4f00b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f4c23640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f00cee20 0x7fb4f00b8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59694/0 (socket says 172.21.15.83:59694) 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4f4c23640 1 -- 172.21.15.83:0/3714275747 learned_addr learned my addr 172.21.15.83:0/3714275747 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.477+0000 7fb4effff640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4f00d4240 0x7fb4f00c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4f4c23640 1 -- 172.21.15.83:0/3714275747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4f015e500 msgr2=0x7fb4f014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4f4c23640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4f015e500 0x7fb4f014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4f4c23640 1 -- 172.21.15.83:0/3714275747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4f00d4240 msgr2=0x7fb4f00c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4f4c23640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4f00d4240 0x7fb4f00c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4f4c23640 1 -- 172.21.15.83:0/3714275747 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f00b7330 con 0x7fb4f00cee20 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4effff640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4f00d4240 0x7fb4f00c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4f4c23640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f00cee20 0x7fb4f00b8600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb4e401a0d0 tx=0x7fb4e401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4ed7fa640 1 -- 172.21.15.83:0/3714275747 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40b1050 con 0x7fb4f00cee20 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4ed7fa640 1 -- 172.21.15.83:0/3714275747 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e40bd070 con 0x7fb4f00cee20 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4f6e87640 1 -- 172.21.15.83:0/3714275747 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f00c9b00 con 0x7fb4f00cee20 2024-03-30T13:08:41.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4ed7fa640 1 -- 172.21.15.83:0/3714275747 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40b6a30 con 0x7fb4f00cee20 2024-03-30T13:08:41.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4f6e87640 1 -- 172.21.15.83:0/3714275747 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f00ca0c0 con 0x7fb4f00cee20 2024-03-30T13:08:41.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4f6e87640 1 -- 172.21.15.83:0/3714275747 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f00686c0 con 0x7fb4f00cee20 2024-03-30T13:08:41.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4ed7fa640 1 -- 172.21.15.83:0/3714275747 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb4e40ac4b0 con 0x7fb4f00cee20 2024-03-30T13:08:41.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4ed7fa640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb4d4067fc0 0x7fb4d406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4ed7fa640 1 -- 172.21.15.83:0/3714275747 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb4e4120d10 con 0x7fb4f00cee20 2024-03-30T13:08:41.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4effff640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb4d4067fc0 0x7fb4d406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.481+0000 7fb4effff640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb4d4067fc0 0x7fb4d406a480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4f015c070 tx=0x7fb4dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:41.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.485+0000 7fb4ed7fa640 1 -- 172.21.15.83:0/3714275747 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb4e40a9070 con 0x7fb4f00cee20 2024-03-30T13:08:41.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.665+0000 7fb4f6e87640 1 -- 172.21.15.83:0/3714275747 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4f00b52e0 con 0x7fb4f00cee20 2024-03-30T13:08:41.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.665+0000 7fb4ed7fa640 1 -- 172.21.15.83:0/3714275747 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7fb4e4016090 con 0x7fb4f00cee20 2024-03-30T13:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2431286615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2431286615},{"type":"v1","addr":"172.21.15.153:6835","nonce":2431286615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1036905849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1036905849},{"type":"v1","addr":"172.21.15.83:6835","nonce":1036905849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2692566836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2692566836},{"type":"v1","addr":"172.21.15.83:6837","nonce":2692566836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:08:25.599943+0000","modified":"2024-03-30T13:08:27.589265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/53727078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":53727078},{"type":"v1","addr":"172.21.15.153:6833","nonce":53727078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-30T13:08:41.671 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 6 2024-03-30T13:08:41.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.669+0000 7fb4f6e87640 1 -- 172.21.15.83:0/3714275747 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb4d4067fc0 msgr2=0x7fb4d406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.669+0000 7fb4f6e87640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb4d4067fc0 0x7fb4d406a480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4f015c070 tx=0x7fb4dc009040 comp rx=0 tx=0).stop 2024-03-30T13:08:41.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.669+0000 7fb4f6e87640 1 -- 172.21.15.83:0/3714275747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f00cee20 msgr2=0x7fb4f00b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.669+0000 7fb4f6e87640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f00cee20 0x7fb4f00b8600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb4e401a0d0 tx=0x7fb4e401ace0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.669+0000 7fb4f6e87640 1 -- 172.21.15.83:0/3714275747 shutdown_connections 2024-03-30T13:08:41.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.669+0000 7fb4f6e87640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb4d4067fc0 0x7fb4d406a480 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.669+0000 7fb4f6e87640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4f015e500 0x7fb4f014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.669+0000 7fb4f6e87640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4f00d4240 0x7fb4f00c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.669+0000 7fb4f6e87640 1 --2- 172.21.15.83:0/3714275747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f00cee20 0x7fb4f00b8600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.669+0000 7fb4f6e87640 1 -- 172.21.15.83:0/3714275747 >> 172.21.15.83:0/3714275747 conn(0x7fb4f008bfe0 msgr2=0x7fb4f00b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:41.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.669+0000 7fb4f6e87640 1 -- 172.21.15.83:0/3714275747 shutdown_connections 2024-03-30T13:08:41.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.669+0000 7fb4f6e87640 1 -- 172.21.15.83:0/3714275747 wait complete. 2024-03-30T13:08:41.689 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:41.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.789+0000 7ff5be3aa640 1 Processor -- start 2024-03-30T13:08:41.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.789+0000 7ff5be3aa640 1 -- start start 2024-03-30T13:08:41.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5be3aa640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff5b809bb60 0x7ff5b80d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5be3aa640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5b8070ad0 0x7ff5b815f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5be3aa640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b80d0b30 con 0x7ff5b80706f0 2024-03-30T13:08:41.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5be3aa640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff5b806fdb0 con 0x7ff5b809bb60 2024-03-30T13:08:41.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5be3aa640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff5b815fc90 con 0x7ff5b8070ad0 2024-03-30T13:08:41.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5b77fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff5b809bb60 0x7ff5b80d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5b77fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff5b809bb60 0x7ff5b80d0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59704/0 (socket says 172.21.15.83:59704) 2024-03-30T13:08:41.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5b77fe640 1 -- 172.21.15.83:0/2918796303 learned_addr learned my addr 172.21.15.83:0/2918796303 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:41.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5bc947640 1 --2- 172.21.15.83:0/2918796303 >> v2:172.21.15.153:3300/0 conn(0x7ff5b8070ad0 0x7ff5b815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5b77fe640 1 -- 172.21.15.83:0/2918796303 >> v2:172.21.15.153:3300/0 conn(0x7ff5b8070ad0 msgr2=0x7ff5b815f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:41.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5b77fe640 1 --2- 172.21.15.83:0/2918796303 >> v2:172.21.15.153:3300/0 conn(0x7ff5b8070ad0 0x7ff5b815f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5b77fe640 1 -- 172.21.15.83:0/2918796303 >> v1:172.21.15.83:6789/0 conn(0x7ff5b80706f0 legacy=0x7ff5b8162240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5b77fe640 1 -- 172.21.15.83:0/2918796303 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b80d0e10 con 0x7ff5b809bb60 2024-03-30T13:08:41.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5b77fe640 1 --2- 172.21.15.83:0/2918796303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5b809bb60 0x7ff5b80d0530 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80730c0 tx=0x7ff5ac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154601a6f91546bf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:41.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5b6ffd640 1 -- 172.21.15.83:0/2918796303 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0b0070 con 0x7ff5b809bb60 2024-03-30T13:08:41.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5b6ffd640 1 -- 172.21.15.83:0/2918796303 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ac0ab600 con 0x7ff5b809bb60 2024-03-30T13:08:41.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.793+0000 7ff5b6ffd640 1 -- 172.21.15.83:0/2918796303 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0ab9d0 con 0x7ff5b809bb60 2024-03-30T13:08:41.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 -- 172.21.15.83:0/2918796303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5b809bb60 msgr2=0x7ff5b80d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 --2- 172.21.15.83:0/2918796303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5b809bb60 0x7ff5b80d0530 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80730c0 tx=0x7ff5ac01c520 comp rx=0 tx=0).stop 2024-03-30T13:08:41.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 -- 172.21.15.83:0/2918796303 shutdown_connections 2024-03-30T13:08:41.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 --2- 172.21.15.83:0/2918796303 >> v2:172.21.15.153:3300/0 conn(0x7ff5b8070ad0 0x7ff5b815f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 --2- 172.21.15.83:0/2918796303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5b809bb60 0x7ff5b80d0530 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 -- 172.21.15.83:0/2918796303 >> 172.21.15.83:0/2918796303 conn(0x7ff5b80d2260 msgr2=0x7ff5b80d2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:41.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 -- 172.21.15.83:0/2918796303 shutdown_connections 2024-03-30T13:08:41.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 -- 172.21.15.83:0/2918796303 wait complete. 2024-03-30T13:08:41.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 Processor -- start 2024-03-30T13:08:41.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 -- start start 2024-03-30T13:08:41.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5b80706f0 0x7ff5b8159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5b8070ad0 0x7ff5b80b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5b80b35f0 0x7ff5b81603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b816b700 con 0x7ff5b80b35f0 2024-03-30T13:08:41.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b816b580 con 0x7ff5b80706f0 2024-03-30T13:08:41.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5be3aa640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b816b880 con 0x7ff5b8070ad0 2024-03-30T13:08:41.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5bc947640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5b80b35f0 0x7ff5b81603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5bc947640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5b80b35f0 0x7ff5b81603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59720/0 (socket says 172.21.15.83:59720) 2024-03-30T13:08:41.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5bc947640 1 -- 172.21.15.83:0/845965985 learned_addr learned my addr 172.21.15.83:0/845965985 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:41.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5b7fff640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5b80706f0 0x7ff5b8159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5b77fe640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5b8070ad0 0x7ff5b80b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5bc947640 1 -- 172.21.15.83:0/845965985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5b8070ad0 msgr2=0x7ff5b80b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5bc947640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5b8070ad0 0x7ff5b80b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5bc947640 1 -- 172.21.15.83:0/845965985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5b80706f0 msgr2=0x7ff5b8159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5bc947640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5b80706f0 0x7ff5b8159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5bc947640 1 -- 172.21.15.83:0/845965985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b80cc690 con 0x7ff5b80b35f0 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5b77fe640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5b8070ad0 0x7ff5b80b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.797+0000 7ff5bc947640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5b80b35f0 0x7ff5b81603f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0007e70 tx=0x7ff5b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.801+0000 7ff5b4ff9640 1 -- 172.21.15.83:0/845965985 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0014620 con 0x7ff5b80b35f0 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.801+0000 7ff5b4ff9640 1 -- 172.21.15.83:0/845965985 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b0019070 con 0x7ff5b80b35f0 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.801+0000 7ff5be3aa640 1 -- 172.21.15.83:0/845965985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b80cc970 con 0x7ff5b80b35f0 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.801+0000 7ff5b4ff9640 1 -- 172.21.15.83:0/845965985 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0014a20 con 0x7ff5b80b35f0 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.801+0000 7ff5be3aa640 1 -- 172.21.15.83:0/845965985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b80ccf30 con 0x7ff5b80b35f0 2024-03-30T13:08:41.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.801+0000 7ff5be3aa640 1 -- 172.21.15.83:0/845965985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b80b6670 con 0x7ff5b80b35f0 2024-03-30T13:08:41.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.801+0000 7ff5b4ff9640 1 -- 172.21.15.83:0/845965985 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff5b0014bc0 con 0x7ff5b80b35f0 2024-03-30T13:08:41.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.801+0000 7ff5b4ff9640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff5a4067fc0 0x7ff5a406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:41.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.801+0000 7ff5b4ff9640 1 -- 172.21.15.83:0/845965985 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff5b0087bf0 con 0x7ff5b80b35f0 2024-03-30T13:08:41.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.801+0000 7ff5b7fff640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff5a4067fc0 0x7ff5a406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:41.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.801+0000 7ff5b7fff640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff5a4067fc0 0x7ff5a406a480 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8160f70 tx=0x7ff5a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:41.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.805+0000 7ff5b4ff9640 1 -- 172.21.15.83:0/845965985 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff5b80b6670 con 0x7ff5b80b35f0 2024-03-30T13:08:41.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.952+0000 7ff5be3aa640 1 -- 172.21.15.83:0/845965985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5b80686c0 con 0x7ff5b80b35f0 2024-03-30T13:08:41.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.952+0000 7ff5b4ff9640 1 -- 172.21.15.83:0/845965985 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7ff5b0058510 con 0x7ff5b80b35f0 2024-03-30T13:08:41.960 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:41.961 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:41.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.956+0000 7ff5be3aa640 1 -- 172.21.15.83:0/845965985 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff5a4067fc0 msgr2=0x7ff5a406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.956+0000 7ff5be3aa640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff5a4067fc0 0x7ff5a406a480 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8160f70 tx=0x7ff5a8009040 comp rx=0 tx=0).stop 2024-03-30T13:08:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.956+0000 7ff5be3aa640 1 -- 172.21.15.83:0/845965985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5b80b35f0 msgr2=0x7ff5b81603f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.956+0000 7ff5be3aa640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5b80b35f0 0x7ff5b81603f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0007e70 tx=0x7ff5b000e4b0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.956+0000 7ff5be3aa640 1 -- 172.21.15.83:0/845965985 shutdown_connections 2024-03-30T13:08:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.956+0000 7ff5be3aa640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff5a4067fc0 0x7ff5a406a480 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.956+0000 7ff5be3aa640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5b80b35f0 0x7ff5b81603f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.956+0000 7ff5be3aa640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5b8070ad0 0x7ff5b80b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.956+0000 7ff5be3aa640 1 --2- 172.21.15.83:0/845965985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5b80706f0 0x7ff5b8159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.956+0000 7ff5be3aa640 1 -- 172.21.15.83:0/845965985 >> 172.21.15.83:0/845965985 conn(0x7ff5b80d2260 msgr2=0x7ff5b80b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.956+0000 7ff5be3aa640 1 -- 172.21.15.83:0/845965985 shutdown_connections 2024-03-30T13:08:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:41.956+0000 7ff5be3aa640 1 -- 172.21.15.83:0/845965985 wait complete. 2024-03-30T13:08:41.978 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:08:42.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.080+0000 7f9f1a9b3640 1 Processor -- start 2024-03-30T13:08:42.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.080+0000 7f9f1a9b3640 1 -- start start 2024-03-30T13:08:42.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f1a9b3640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9f140730e0 0x7f9f1415b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f1a9b3640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9f140b4bb0 0x7f9f1415f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f1a9b3640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f140734c0 con 0x7f9f1406f140 2024-03-30T13:08:42.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f1a9b3640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f9f1415c2a0 con 0x7f9f140b4bb0 2024-03-30T13:08:42.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f1a9b3640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9f1415c580 con 0x7f9f140730e0 2024-03-30T13:08:42.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f137fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9f140b4bb0 0x7f9f1415f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f137fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9f140b4bb0 0x7f9f1415f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59724/0 (socket says 172.21.15.83:59724) 2024-03-30T13:08:42.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f137fe640 1 -- 172.21.15.83:0/1198713638 learned_addr learned my addr 172.21.15.83:0/1198713638 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:42.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f13fff640 1 --2- 172.21.15.83:0/1198713638 >> v2:172.21.15.153:3300/0 conn(0x7f9f140730e0 0x7f9f1415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f137fe640 1 -- 172.21.15.83:0/1198713638 >> v2:172.21.15.153:3300/0 conn(0x7f9f140730e0 msgr2=0x7f9f1415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:42.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f137fe640 1 --2- 172.21.15.83:0/1198713638 >> v2:172.21.15.153:3300/0 conn(0x7f9f140730e0 0x7f9f1415b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f137fe640 1 -- 172.21.15.83:0/1198713638 >> v1:172.21.15.153:6789/0 conn(0x7f9f1406f140 legacy=0x7f9f140b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:42.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f137fe640 1 -- 172.21.15.83:0/1198713638 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1415c860 con 0x7f9f140b4bb0 2024-03-30T13:08:42.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f137fe640 1 --2- 172.21.15.83:0/1198713638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f140b4bb0 0x7f9f1415f7c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9f14070f30 tx=0x7f9f0801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a833084abfe70d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:42.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f12ffd640 1 -- 172.21.15.83:0/1198713638 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f080b1070 con 0x7f9f140b4bb0 2024-03-30T13:08:42.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f12ffd640 1 -- 172.21.15.83:0/1198713638 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f080ac620 con 0x7f9f140b4bb0 2024-03-30T13:08:42.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.084+0000 7f9f12ffd640 1 -- 172.21.15.83:0/1198713638 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f080ac9f0 con 0x7f9f140b4bb0 2024-03-30T13:08:42.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/1198713638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f140b4bb0 msgr2=0x7f9f1415f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 --2- 172.21.15.83:0/1198713638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f140b4bb0 0x7f9f1415f7c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9f14070f30 tx=0x7f9f0801c4b0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/1198713638 shutdown_connections 2024-03-30T13:08:42.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 --2- 172.21.15.83:0/1198713638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f140b4bb0 0x7f9f1415f7c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 --2- 172.21.15.83:0/1198713638 >> v2:172.21.15.153:3300/0 conn(0x7f9f140730e0 0x7f9f1415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/1198713638 >> 172.21.15.83:0/1198713638 conn(0x7f9f140b1d60 msgr2=0x7f9f140b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:42.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/1198713638 shutdown_connections 2024-03-30T13:08:42.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/1198713638 wait complete. 2024-03-30T13:08:42.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 Processor -- start 2024-03-30T13:08:42.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 -- start start 2024-03-30T13:08:42.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f1406f140 0x7f9f1414ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f140730e0 0x7f9f140b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140b4bb0 0x7f9f140cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1415c010 con 0x7f9f140730e0 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1415be90 con 0x7f9f1406f140 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9f1415fd00 con 0x7f9f140b4bb0 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f137fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f140730e0 0x7f9f140b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f137fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f140730e0 0x7f9f140b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59740/0 (socket says 172.21.15.83:59740) 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f137fe640 1 -- 172.21.15.83:0/320747696 learned_addr learned my addr 172.21.15.83:0/320747696 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f13fff640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f1406f140 0x7f9f1414ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f137fe640 1 -- 172.21.15.83:0/320747696 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140b4bb0 msgr2=0x7f9f140cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f137fe640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140b4bb0 0x7f9f140cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f137fe640 1 -- 172.21.15.83:0/320747696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f1406f140 msgr2=0x7f9f1414ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f137fe640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f1406f140 0x7f9f1414ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f137fe640 1 -- 172.21.15.83:0/320747696 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f140b1b10 con 0x7f9f140730e0 2024-03-30T13:08:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f137fe640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f140730e0 0x7f9f140b15d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f0801a0e0 tx=0x7f9f08019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f10ff9640 1 -- 172.21.15.83:0/320747696 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f080ba070 con 0x7f9f140730e0 2024-03-30T13:08:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f10ff9640 1 -- 172.21.15.83:0/320747696 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f080b5620 con 0x7f9f140730e0 2024-03-30T13:08:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/320747696 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f1414f6b0 con 0x7f9f140730e0 2024-03-30T13:08:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f10ff9640 1 -- 172.21.15.83:0/320747696 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f080b1040 con 0x7f9f140730e0 2024-03-30T13:08:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/320747696 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f140b0300 con 0x7f9f140730e0 2024-03-30T13:08:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.088+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/320747696 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f140686c0 con 0x7f9f140730e0 2024-03-30T13:08:42.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.092+0000 7f9f10ff9640 1 -- 172.21.15.83:0/320747696 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9f080bd070 con 0x7f9f140730e0 2024-03-30T13:08:42.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.092+0000 7f9f10ff9640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f00067fc0 0x7f9f0006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.092+0000 7f9f10ff9640 1 -- 172.21.15.83:0/320747696 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f0811f610 con 0x7f9f140730e0 2024-03-30T13:08:42.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.092+0000 7f9f13fff640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f00067fc0 0x7f9f0006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.092+0000 7f9f13fff640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f00067fc0 0x7f9f0006a480 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400b7c0 tx=0x7f9f04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:42.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.096+0000 7f9f10ff9640 1 -- 172.21.15.83:0/320747696 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9f140b1b10 con 0x7f9f140730e0 2024-03-30T13:08:42.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/320747696 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f1406da70 con 0x7f9f140730e0 2024-03-30T13:08:42.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f10ff9640 1 -- 172.21.15.83:0/320747696 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7f9f080160d0 con 0x7f9f140730e0 2024-03-30T13:08:42.291 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:42.291 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2431286615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2431286615},{"type":"v1","addr":"172.21.15.153:6835","nonce":2431286615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1036905849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1036905849},{"type":"v1","addr":"172.21.15.83:6835","nonce":1036905849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2692566836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2692566836},{"type":"v1","addr":"172.21.15.83:6837","nonce":2692566836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:08:25.599943+0000","modified":"2024-03-30T13:08:27.589265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/53727078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":53727078},{"type":"v1","addr":"172.21.15.153:6833","nonce":53727078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-30T13:08:42.291 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 6 2024-03-30T13:08:42.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/320747696 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f00067fc0 msgr2=0x7f9f0006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f00067fc0 0x7f9f0006a480 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400b7c0 tx=0x7f9f04008040 comp rx=0 tx=0).stop 2024-03-30T13:08:42.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/320747696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f140730e0 msgr2=0x7f9f140b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f140730e0 0x7f9f140b15d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f0801a0e0 tx=0x7f9f08019250 comp rx=0 tx=0).stop 2024-03-30T13:08:42.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/320747696 shutdown_connections 2024-03-30T13:08:42.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f00067fc0 0x7f9f0006a480 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140b4bb0 0x7f9f140cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f140730e0 0x7f9f140b15d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 --2- 172.21.15.83:0/320747696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f1406f140 0x7f9f1414ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/320747696 >> 172.21.15.83:0/320747696 conn(0x7f9f140b1d60 msgr2=0x7f9f14152030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:42.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/320747696 shutdown_connections 2024-03-30T13:08:42.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.284+0000 7f9f1a9b3640 1 -- 172.21.15.83:0/320747696 wait complete. 2024-03-30T13:08:42.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T13:08:25.599943+0000', 'modified': '2024-03-30T13:08:27.589265+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6833/53727078', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 53727078}, {'type': 'v1', 'addr': '172.21.15.153:6833', 'nonce': 53727078}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4279, 'qdb_cluster': [4279]} 2024-03-30T13:08:42.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-30T13:08:42.710 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-30T13:08:42.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b8a7b2640 1 Processor -- start 2024-03-30T13:08:42.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b8a7b2640 1 -- start start 2024-03-30T13:08:42.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b8a7b2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b8415e840 0x7f2b840d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b8a7b2640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2b840d1540 0x7f2b840d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b8a7b2640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b840d51f0 con 0x7f2b840cfc10 2024-03-30T13:08:42.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b8a7b2640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f2b8415ec20 con 0x7f2b840d1540 2024-03-30T13:08:42.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b8a7b2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2b840d2d50 con 0x7f2b8415e840 2024-03-30T13:08:42.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b88d4f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2b840d1540 0x7f2b840d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b88d4f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2b840d1540 0x7f2b840d0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59746/0 (socket says 172.21.15.83:59746) 2024-03-30T13:08:42.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b88d4f640 1 -- 172.21.15.83:0/3453387229 learned_addr learned my addr 172.21.15.83:0/3453387229 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:42.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b83fff640 1 --2- 172.21.15.83:0/3453387229 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b8415e840 0x7f2b840d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b88d4f640 1 -- 172.21.15.83:0/3453387229 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b8415e840 msgr2=0x7f2b840d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:42.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b88d4f640 1 --2- 172.21.15.83:0/3453387229 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b8415e840 0x7f2b840d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b88d4f640 1 -- 172.21.15.83:0/3453387229 >> v1:172.21.15.153:6789/0 conn(0x7f2b840cfc10 legacy=0x7f2b840d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.840+0000 7f2b88d4f640 1 -- 172.21.15.83:0/3453387229 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b840d2140 con 0x7f2b840d1540 2024-03-30T13:08:42.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b88d4f640 1 --2- 172.21.15.83:0/3453387229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b840d1540 0x7f2b840d0070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009e50 tx=0x7f2b7c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d55d8f148f8c22 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:42.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b82ffd640 1 -- 172.21.15.83:0/3453387229 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c0a5860 con 0x7f2b840d1540 2024-03-30T13:08:42.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b82ffd640 1 -- 172.21.15.83:0/3453387229 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7c0a5a00 con 0x7f2b840d1540 2024-03-30T13:08:42.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b82ffd640 1 -- 172.21.15.83:0/3453387229 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c0a5dd0 con 0x7f2b840d1540 2024-03-30T13:08:42.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3453387229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b840d1540 msgr2=0x7f2b840d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 --2- 172.21.15.83:0/3453387229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b840d1540 0x7f2b840d0070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009e50 tx=0x7f2b7c01c9a0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3453387229 shutdown_connections 2024-03-30T13:08:42.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 --2- 172.21.15.83:0/3453387229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b840d1540 0x7f2b840d0070 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 --2- 172.21.15.83:0/3453387229 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b8415e840 0x7f2b840d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3453387229 >> 172.21.15.83:0/3453387229 conn(0x7f2b8409d7f0 msgr2=0x7f2b840d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:42.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3453387229 shutdown_connections 2024-03-30T13:08:42.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3453387229 wait complete. 2024-03-30T13:08:42.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 Processor -- start 2024-03-30T13:08:42.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 -- start start 2024-03-30T13:08:42.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b840cfc10 0x7f2b841566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b840d1540 0x7f2b840b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b8415e840 0x7f2b840b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8406d0b0 con 0x7f2b840d1540 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8406cf30 con 0x7f2b8415e840 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.844+0000 7f2b8a7b2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2b8406d230 con 0x7f2b840cfc10 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b837fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b840d1540 0x7f2b840b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b837fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b840d1540 0x7f2b840b6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59752/0 (socket says 172.21.15.83:59752) 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b837fe640 1 -- 172.21.15.83:0/3247409263 learned_addr learned my addr 172.21.15.83:0/3247409263 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b88d4f640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b8415e840 0x7f2b840b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b837fe640 1 -- 172.21.15.83:0/3247409263 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b840cfc10 msgr2=0x7f2b841566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b83fff640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b840cfc10 0x7f2b841566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b837fe640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b840cfc10 0x7f2b841566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b837fe640 1 -- 172.21.15.83:0/3247409263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b8415e840 msgr2=0x7f2b840b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b837fe640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b8415e840 0x7f2b840b74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b837fe640 1 -- 172.21.15.83:0/3247409263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b841f7800 con 0x7f2b840d1540 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b88d4f640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b8415e840 0x7f2b840b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b83fff640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b840cfc10 0x7f2b841566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:42.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b837fe640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b840d1540 0x7f2b840b6fa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c420 tx=0x7f2b7400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:42.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b80ff9640 1 -- 172.21.15.83:0/3247409263 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b740052d0 con 0x7f2b840d1540 2024-03-30T13:08:42.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b80ff9640 1 -- 172.21.15.83:0/3247409263 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b74005470 con 0x7f2b840d1540 2024-03-30T13:08:42.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3247409263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b841f7ae0 con 0x7f2b840d1540 2024-03-30T13:08:42.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b80ff9640 1 -- 172.21.15.83:0/3247409263 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74007260 con 0x7f2b840d1540 2024-03-30T13:08:42.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3247409263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b841f80a0 con 0x7f2b840d1540 2024-03-30T13:08:42.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b80ff9640 1 -- 172.21.15.83:0/3247409263 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2b74007400 con 0x7f2b840d1540 2024-03-30T13:08:42.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b80ff9640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2b70067fc0 0x7f2b7006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b80ff9640 1 -- 172.21.15.83:0/3247409263 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2b740859a0 con 0x7f2b840d1540 2024-03-30T13:08:42.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b83fff640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2b70067fc0 0x7f2b7006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b83fff640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2b70067fc0 0x7f2b7006a480 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2b780097a0 tx=0x7f2b78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b8d934000 1 Processor -- start 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.848+0000 7f2b8d934000 1 -- start start 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 0x56103cfe9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe9dc0 0x56103cf9cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cf9d0b0 0x56103cf9d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56103cdef950 con 0x56103cfe94a0 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56103cd8c990 con 0x56103cf9d0b0 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56103cdeb900 con 0x56103cfe9dc0 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 0x56103cfe9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 0x56103cfe9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59762/0 (socket says 172.21.15.83:59762) 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 -- 172.21.15.83:0/3049409619 learned_addr learned my addr 172.21.15.83:0/3049409619 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 -- 172.21.15.83:0/3049409619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe9dc0 msgr2=0x56103cf9cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 --2- 172.21.15.83:0/3049409619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe9dc0 0x56103cf9cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b88d4f640 1 --2- 172.21.15.83:0/3049409619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cf9d0b0 0x56103cf9d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 -- 172.21.15.83:0/3049409619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cf9d0b0 msgr2=0x56103cf9d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 --2- 172.21.15.83:0/3049409619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cf9d0b0 0x56103cf9d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 -- 172.21.15.83:0/3049409619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56103ce34100 con 0x56103cfe94a0 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 --2- 172.21.15.83:0/3049409619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 0x56103cfe9880 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b78004350 tx=0x7f2b78011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594bb1a30bc9244f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b69ffb640 1 -- 172.21.15.83:0/3049409619 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7800f040 con 0x56103cfe94a0 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b69ffb640 1 -- 172.21.15.83:0/3049409619 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b78004380 con 0x56103cfe94a0 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b69ffb640 1 -- 172.21.15.83:0/3049409619 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7800ee80 con 0x56103cfe94a0 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- 172.21.15.83:0/3049409619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 msgr2=0x56103cfe9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 --2- 172.21.15.83:0/3049409619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 0x56103cfe9880 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b78004350 tx=0x7f2b78011000 comp rx=0 tx=0).stop 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- 172.21.15.83:0/3049409619 shutdown_connections 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 --2- 172.21.15.83:0/3049409619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cf9d0b0 0x56103cf9d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 --2- 172.21.15.83:0/3049409619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe9dc0 0x56103cf9cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 --2- 172.21.15.83:0/3049409619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 0x56103cfe9880 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- 172.21.15.83:0/3049409619 >> 172.21.15.83:0/3049409619 conn(0x56103ce87b80 msgr2=0x56103cfcc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:42.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- 172.21.15.83:0/3049409619 shutdown_connections 2024-03-30T13:08:42.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- 172.21.15.83:0/3049409619 wait complete. 2024-03-30T13:08:42.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- start start 2024-03-30T13:08:42.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 Processor -- start 2024-03-30T13:08:42.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cf9d0b0 0x56103cfa4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cfe94a0 0x56103cfcd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe9dc0 0x56103cfcdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56103cd877b0 con 0x56103cf9d0b0 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56103cdad3e0 con 0x56103cfe94a0 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56103cdf3f80 con 0x56103cfe9dc0 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 10 client.0 _ll_register_callbacks cb 0x56103ce500f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cf9d0b0 0x56103cfa4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cf9d0b0 0x56103cfa4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59778/0 (socket says 172.21.15.83:59778) 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 -- 172.21.15.83:0/194678009 learned_addr learned my addr 172.21.15.83:0/194678009 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b88d4f640 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe9dc0 0x56103cfcdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b837fe640 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cfe94a0 0x56103cfcd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 -- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe9dc0 msgr2=0x56103cfcdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe9dc0 0x56103cfcdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 -- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cfe94a0 msgr2=0x56103cfcd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cfe94a0 0x56103cfcd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 -- 172.21.15.83:0/194678009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56103cdb98c0 con 0x56103cf9d0b0 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b88d4f640 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe9dc0 0x56103cfcdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b83fff640 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cf9d0b0 0x56103cfa4cc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b78008010 tx=0x7f2b78004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d590b26ec725cca4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b62ffd640 1 -- 172.21.15.83:0/194678009 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7802f060 con 0x56103cf9d0b0 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b62ffd640 1 -- 172.21.15.83:0/194678009 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2b78013a70 con 0x56103cf9d0b0 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.852+0000 7f2b8d934000 1 -- 172.21.15.83:0/194678009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b78004380 con 0x56103cf9d0b0 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b62ffd640 1 -- 172.21.15.83:0/194678009 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f2b78035050 con 0x56103cf9d0b0 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 10 client.4650 fetch_fsmap learned FSMap version 6 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 -- 172.21.15.83:0/194678009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56103cd77e80 con 0x56103cf9d0b0 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b62ffd640 1 -- 172.21.15.83:0/194678009 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b78004380 con 0x56103cf9d0b0 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b62ffd640 1 -- 172.21.15.83:0/194678009 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f2b78038020 con 0x56103cf9d0b0 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 10 client.4650 fetch_fsmap finished waiting for FSMap version 6 2024-03-30T13:08:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 10 client.4650 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 20 client.4650 populate_metadata read hostname 'smithi083' 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:6832/53727078,v1:172.21.15.153:6833/53727078] conn(0x56103cff9540 0x56103cffb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 4 client.4650 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 -- 172.21.15.83:0/194678009 --> [v2:172.21.15.153:6832/53727078,v1:172.21.15.153:6833/53727078] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56103cd8abc0 con 0x56103cff9540 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b837fe640 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:6832/53727078,v1:172.21.15.153:6833/53727078] conn(0x56103cff9540 0x56103cffb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b837fe640 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:6832/53727078,v1:172.21.15.153:6833/53727078] conn(0x56103cff9540 0x56103cffb930 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c70628202e5355e3 server_cookie=aec65ebb07d3d385 in_seq=0 out_seq=0 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b62ffd640 10 client.4650 ms_handle_connect on v2:172.21.15.153:6832/53727078 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b62ffd640 1 -- 172.21.15.83:0/194678009 <== mds.0 v2:172.21.15.153:6832/53727078 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x56103cd8abc0 con 0x56103cff9540 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b62ffd640 10 client.4650 handle_command_reply: tid=0 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 client.4650 shutdown 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 -- 172.21.15.83:0/194678009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cf9d0b0 msgr2=0x56103cfa4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cf9d0b0 0x56103cfa4cc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b78008010 tx=0x7f2b78004740 comp rx=0 tx=0).stop 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 -- 172.21.15.83:0/194678009 shutdown_connections 2024-03-30T13:08:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:6832/53727078,v1:172.21.15.153:6833/53727078] conn(0x56103cff9540 0x56103cffb930 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe9dc0 0x56103cfcdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b62ffd640 0 client.4650 ms_handle_reset on v2:172.21.15.153:6832/53727078 2024-03-30T13:08:42.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cfe94a0 0x56103cfcd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 --2- 172.21.15.83:0/194678009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cf9d0b0 0x56103cfa4cc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 -- 172.21.15.83:0/194678009 >> 172.21.15.83:0/194678009 conn(0x56103ce87b80 msgr2=0x56103cf9c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:42.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 -- 172.21.15.83:0/194678009 shutdown_connections 2024-03-30T13:08:42.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 1 -- 172.21.15.83:0/194678009 wait complete. 2024-03-30T13:08:42.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.856+0000 7f2b8d934000 20 client.4650 trim_cache size 0 max 16384 2024-03-30T13:08:42.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 Processor -- start 2024-03-30T13:08:42.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 -- start start 2024-03-30T13:08:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cf9d0b0 0x56103cffed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 0x56103cffb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cfe9dc0 0x56103cffbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2b84203a10 con 0x56103cfe94a0 2024-03-30T13:08:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b84202a70 con 0x56103cfe9dc0 2024-03-30T13:08:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2b84201ef0 con 0x56103cf9d0b0 2024-03-30T13:08:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b837fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 0x56103cffb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b837fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 0x56103cffb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59792/0 (socket says 172.21.15.83:59792) 2024-03-30T13:08:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b837fe640 1 -- 172.21.15.83:0/4062745699 learned_addr learned my addr 172.21.15.83:0/4062745699 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b837fe640 1 -- 172.21.15.83:0/4062745699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cf9d0b0 msgr2=0x56103cffed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b837fe640 1 --2- 172.21.15.83:0/4062745699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cf9d0b0 0x56103cffed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b837fe640 1 -- 172.21.15.83:0/4062745699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cfe9dc0 msgr2=0x56103cffbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b837fe640 1 --2- 172.21.15.83:0/4062745699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cfe9dc0 0x56103cffbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b837fe640 1 -- 172.21.15.83:0/4062745699 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56103cdaa490 con 0x56103cfe94a0 2024-03-30T13:08:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b837fe640 1 --2- 172.21.15.83:0/4062745699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 0x56103cffb930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b74051f40 tx=0x7f2b7400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba653c59af88b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b697fa640 1 -- 172.21.15.83:0/4062745699 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74053b80 con 0x56103cfe94a0 2024-03-30T13:08:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b697fa640 1 -- 172.21.15.83:0/4062745699 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b74053de0 con 0x56103cfe94a0 2024-03-30T13:08:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b697fa640 1 -- 172.21.15.83:0/4062745699 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74052150 con 0x56103cfe94a0 2024-03-30T13:08:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 -- 172.21.15.83:0/4062745699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 msgr2=0x56103cffb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 --2- 172.21.15.83:0/4062745699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 0x56103cffb930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b74051f40 tx=0x7f2b7400cf90 comp rx=0 tx=0).stop 2024-03-30T13:08:42.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 -- 172.21.15.83:0/4062745699 shutdown_connections 2024-03-30T13:08:42.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 --2- 172.21.15.83:0/4062745699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cfe9dc0 0x56103cffbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 --2- 172.21.15.83:0/4062745699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe94a0 0x56103cffb930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 --2- 172.21.15.83:0/4062745699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cf9d0b0 0x56103cffed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 -- 172.21.15.83:0/4062745699 >> 172.21.15.83:0/4062745699 conn(0x56103ce87b80 msgr2=0x56103cff6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:42.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 -- 172.21.15.83:0/4062745699 shutdown_connections 2024-03-30T13:08:42.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 -- 172.21.15.83:0/4062745699 wait complete. 2024-03-30T13:08:42.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.876+0000 7f2b8d934000 1 -- start start 2024-03-30T13:08:42.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 Processor -- start 2024-03-30T13:08:42.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cf9d0b0 0x56103d05bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe94a0 0x56103d05c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe9dc0 0x56103cffcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56103cdee830 con 0x56103cfe9dc0 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b84202420 con 0x56103cf9d0b0 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56103cd738d0 con 0x56103cfe94a0 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 10 client.0 _ll_register_callbacks cb 0x7f2b78004250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b88d4f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe9dc0 0x56103cffcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b88d4f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe9dc0 0x56103cffcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59800/0 (socket says 172.21.15.83:59800) 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b88d4f640 1 -- 172.21.15.83:0/1288797776 learned_addr learned my addr 172.21.15.83:0/1288797776 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b837fe640 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe94a0 0x56103d05c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b83fff640 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cf9d0b0 0x56103d05bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b88d4f640 1 -- 172.21.15.83:0/1288797776 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe94a0 msgr2=0x56103d05c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b88d4f640 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe94a0 0x56103d05c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b88d4f640 1 -- 172.21.15.83:0/1288797776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cf9d0b0 msgr2=0x56103d05bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b88d4f640 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cf9d0b0 0x56103d05bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b88d4f640 1 -- 172.21.15.83:0/1288797776 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56103cda8e80 con 0x56103cfe9dc0 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b88d4f640 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe9dc0 0x56103cffcde0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c01a5d0 tx=0x7f2b7c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce4a4f53a82634a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b62ffd640 1 -- 172.21.15.83:0/1288797776 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c0a5ba0 con 0x56103cfe9dc0 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 -- 172.21.15.83:0/1288797776 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b74053de0 con 0x56103cfe9dc0 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b62ffd640 1 -- 172.21.15.83:0/1288797776 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2b7c0a5d40 con 0x56103cfe9dc0 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b62ffd640 1 -- 172.21.15.83:0/1288797776 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f2b7c0b63f0 con 0x56103cfe9dc0 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 10 client.4656 fetch_fsmap learned FSMap version 6 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 -- 172.21.15.83:0/1288797776 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56103cd96270 con 0x56103cfe9dc0 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b62ffd640 1 -- 172.21.15.83:0/1288797776 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b74053de0 con 0x56103cfe9dc0 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b62ffd640 1 -- 172.21.15.83:0/1288797776 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f2b7c0c8050 con 0x56103cfe9dc0 2024-03-30T13:08:42.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 10 client.4656 fetch_fsmap finished waiting for FSMap version 6 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 10 client.4656 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 20 client.4656 populate_metadata read hostname 'smithi083' 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.153:6832/53727078,v1:172.21.15.153:6833/53727078] conn(0x56103cffd320 0x56103cffd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 4 client.4656 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 -- 172.21.15.83:0/1288797776 --> [v2:172.21.15.153:6832/53727078,v1:172.21.15.153:6833/53727078] -- command(tid 0: {"prefix": "status"}) -- 0x56103cdfce90 con 0x56103cffd320 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b83fff640 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.153:6832/53727078,v1:172.21.15.153:6833/53727078] conn(0x56103cffd320 0x56103cffd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b62ffd640 10 client.4656 ms_handle_connect on v2:172.21.15.153:6832/53727078 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b83fff640 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.153:6832/53727078,v1:172.21.15.153:6833/53727078] conn(0x56103cffd320 0x56103cffd700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1d82f6a88c3f7e6 server_cookie=a22ead54c432c9e in_seq=0 out_seq=0 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b62ffd640 1 -- 172.21.15.83:0/1288797776 <== mds.0 v2:172.21.15.153:6832/53727078 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x56103cdfce90 con 0x56103cffd320 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b62ffd640 10 client.4656 handle_command_reply: tid=0 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 client.4656 shutdown 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 -- 172.21.15.83:0/1288797776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe9dc0 msgr2=0x56103cffcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe9dc0 0x56103cffcde0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c01a5d0 tx=0x7f2b7c019740 comp rx=0 tx=0).stop 2024-03-30T13:08:42.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 -- 172.21.15.83:0/1288797776 shutdown_connections 2024-03-30T13:08:42.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.153:6832/53727078,v1:172.21.15.153:6833/53727078] conn(0x56103cffd320 0x56103cffd700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56103cfe9dc0 0x56103cffcde0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56103cfe94a0 0x56103d05c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b62ffd640 0 client.4656 ms_handle_reset on v2:172.21.15.153:6832/53727078 2024-03-30T13:08:42.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 --2- 172.21.15.83:0/1288797776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56103cf9d0b0 0x56103d05bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 -- 172.21.15.83:0/1288797776 >> 172.21.15.83:0/1288797776 conn(0x56103ce87b80 msgr2=0x56103cff6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:42.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 -- 172.21.15.83:0/1288797776 shutdown_connections 2024-03-30T13:08:42.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 1 -- 172.21.15.83:0/1288797776 wait complete. 2024-03-30T13:08:42.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.880+0000 7f2b8d934000 20 client.4656 trim_cache size 0 max 16384 2024-03-30T13:08:42.894 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:08:42.895 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "7979f39b-f62b-4bbb-8ee9-a3dd267196bf", 2024-03-30T13:08:42.895 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-03-30T13:08:42.895 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4279, 2024-03-30T13:08:42.895 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-03-30T13:08:42.895 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-03-30T13:08:42.895 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-03-30T13:08:42.895 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 16.65837385, 2024-03-30T13:08:42.895 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 6, 2024-03-30T13:08:42.895 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 21, 2024-03-30T13:08:42.895 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 21, 2024-03-30T13:08:42.895 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 23.509617092999999 2024-03-30T13:08:42.895 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:08:42.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.884+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3247409263 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2b70067fc0 msgr2=0x7f2b7006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.884+0000 7f2b8a7b2640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2b70067fc0 0x7f2b7006a480 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2b780097a0 tx=0x7f2b78008040 comp rx=0 tx=0).stop 2024-03-30T13:08:42.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.884+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3247409263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b840d1540 msgr2=0x7f2b840b6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:42.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.884+0000 7f2b8a7b2640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b840d1540 0x7f2b840b6fa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c420 tx=0x7f2b7400c8e0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.884+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3247409263 shutdown_connections 2024-03-30T13:08:42.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.884+0000 7f2b8a7b2640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2b70067fc0 0x7f2b7006a480 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.884+0000 7f2b8a7b2640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b8415e840 0x7f2b840b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.884+0000 7f2b8a7b2640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b840d1540 0x7f2b840b6fa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.884+0000 7f2b8a7b2640 1 --2- 172.21.15.83:0/3247409263 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b840cfc10 0x7f2b841566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:42.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.884+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3247409263 >> 172.21.15.83:0/3247409263 conn(0x7f2b8409d7f0 msgr2=0x7f2b840d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:42.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.884+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3247409263 shutdown_connections 2024-03-30T13:08:42.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:42.884+0000 7f2b8a7b2640 1 -- 172.21.15.83:0/3247409263 wait complete. 2024-03-30T13:08:42.905 INFO:teuthology.run_tasks:Running task sequential... 2024-03-30T13:08:42.916 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-03-30T13:08:42.916 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-30T13:08:42.917 INFO:teuthology.task.print:Enabling mgr modules 2024-03-30T13:08:42.917 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-30T13:08:42.952 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-30T13:08:42.953 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-30T13:08:42.953 INFO:tasks.ceph_fuse:client.0 config is {} 2024-03-30T13:08:42.953 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:08:42.953 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-30T13:08:42.953 INFO:tasks.ceph_fuse:client.2 config is {} 2024-03-30T13:08:42.953 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:08:42.953 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-30T13:08:42.953 INFO:tasks.ceph_fuse:client.1 config is {} 2024-03-30T13:08:42.953 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:08:42.953 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-30T13:08:42.953 INFO:tasks.ceph_fuse:client.3 config is {} 2024-03-30T13:08:42.954 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:08:42.954 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-30T13:08:42.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:42.954 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-03-30T13:08:42.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:42.959 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-03-30T13:08:43.015 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2024-03-30T13:08:43.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:08:43.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:43.016 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-03-30T13:08:43.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:43.023 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-03-30T13:08:43.083 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-03-30T13:08:43.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:08:43.084 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-30T13:08:43.085 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:08:43.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0923aaa640 1 Processor -- start 2024-03-30T13:08:43.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0923aaa640 1 -- start start 2024-03-30T13:08:43.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0923aaa640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f091c15eee0 0x7f091c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:43.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0923aaa640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f091c0b4d10 con 0x7f091c0aeac0 2024-03-30T13:08:43.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0923aaa640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f091c0b4ff0 con 0x7f091c15f2c0 2024-03-30T13:08:43.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0923aaa640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f091c0b52d0 con 0x7f091c15eee0 2024-03-30T13:08:43.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0922047640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f091c0aeac0 0x7f091c0aeef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56510/0 (socket says 172.21.15.83:56510) 2024-03-30T13:08:43.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0922047640 1 -- 172.21.15.83:0/3436709386 learned_addr learned my addr 172.21.15.83:0/3436709386 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:43.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0921846640 1 --2- 172.21.15.83:0/3436709386 >> v2:172.21.15.153:3300/0 conn(0x7f091c15eee0 0x7f091c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:43.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544683129 0 0) 0x7f091c0b4d10 con 0x7f091c0aeac0 2024-03-30T13:08:43.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0908003530 con 0x7f091c0aeac0 2024-03-30T13:08:43.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 666124845 0 0) 0x7f0908003530 con 0x7f091c0aeac0 2024-03-30T13:08:43.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 >> v2:172.21.15.153:3300/0 conn(0x7f091c15eee0 msgr2=0x7f091c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:43.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 --2- 172.21.15.83:0/3436709386 >> v2:172.21.15.153:3300/0 conn(0x7f091c15eee0 0x7f091c09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:43.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 >> v1:172.21.15.153:6789/0 conn(0x7f091c15f2c0 legacy=0x7f091c15f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f091c0b55b0 con 0x7f091c0aeac0 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f0914001680 con 0x7f091c0aeac0 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 >> v1:172.21.15.83:6789/0 conn(0x7f091c0aeac0 legacy=0x7f091c0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 --2- 172.21.15.83:0/3436709386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09080039c0 0x7f0908003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 --2- 172.21.15.83:0/3436709386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0908004810 0x7f0908004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 --2- 172.21.15.83:0/3436709386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09080051d0 0x7f090800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f091c0b52d0 con 0x7f0908004810 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f090800c170 con 0x7f09080039c0 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f090800e580 con 0x7f09080051d0 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0921045640 1 --2- 172.21.15.83:0/3436709386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0908004810 0x7f0908004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0921846640 1 --2- 172.21.15.83:0/3436709386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09080039c0 0x7f0908003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0922047640 1 --2- 172.21.15.83:0/3436709386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09080051d0 0x7f090800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0921045640 1 -- 172.21.15.83:0/3436709386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09080051d0 msgr2=0x7f090800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0921045640 1 --2- 172.21.15.83:0/3436709386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09080051d0 0x7f090800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0921045640 1 -- 172.21.15.83:0/3436709386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09080039c0 msgr2=0x7f0908003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:43.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0921045640 1 --2- 172.21.15.83:0/3436709386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09080039c0 0x7f0908003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:43.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0922047640 1 -- 172.21.15.83:0/3436709386 reap_dead start 2024-03-30T13:08:43.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0921045640 1 -- 172.21.15.83:0/3436709386 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0908003530 con 0x7f0908004810 2024-03-30T13:08:43.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.200+0000 7f0921846640 1 --2- 172.21.15.83:0/3436709386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09080039c0 0x7f0908003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:43.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0921045640 1 --2- 172.21.15.83:0/3436709386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0908004810 0x7f0908004c90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f090c001780 tx=0x7f090c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a16e13a9ff87e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:43.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090c0013a0 con 0x7f0908004810 2024-03-30T13:08:43.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f090c0052f0 con 0x7f0908004810 2024-03-30T13:08:43.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0920844640 1 -- 172.21.15.83:0/3436709386 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090c003840 con 0x7f0908004810 2024-03-30T13:08:43.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 -- 172.21.15.83:0/3436709386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0908004810 msgr2=0x7f0908004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:43.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 --2- 172.21.15.83:0/3436709386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0908004810 0x7f0908004c90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f090c001780 tx=0x7f090c01c420 comp rx=0 tx=0).stop 2024-03-30T13:08:43.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 -- 172.21.15.83:0/3436709386 shutdown_connections 2024-03-30T13:08:43.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 --2- 172.21.15.83:0/3436709386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0908004810 0x7f0908004c90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:43.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 -- 172.21.15.83:0/3436709386 >> 172.21.15.83:0/3436709386 conn(0x7f091c0b68c0 msgr2=0x7f091c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:43.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 -- 172.21.15.83:0/3436709386 shutdown_connections 2024-03-30T13:08:43.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 -- 172.21.15.83:0/3436709386 wait complete. 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 Processor -- start 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 -- start start 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0908004810 0x7f091c0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c15de60 0x7f091c1510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f091c0cb8e0 0x7f091c0b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f091c0af230 con 0x7f091c0cb8e0 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f091c0af0b0 con 0x7f091c15de60 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0923aaa640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f091c0af3b0 con 0x7f0908004810 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0922047640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f091c0cb8e0 0x7f091c0b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0922047640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f091c0cb8e0 0x7f091c0b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59818/0 (socket says 172.21.15.83:59818) 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.204+0000 7f0922047640 1 -- 172.21.15.83:0/1811223177 learned_addr learned my addr 172.21.15.83:0/1811223177 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0921846640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0908004810 0x7f091c0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0921045640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c15de60 0x7f091c1510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0922047640 1 -- 172.21.15.83:0/1811223177 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0908004810 msgr2=0x7f091c0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:43.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0922047640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0908004810 0x7f091c0cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:43.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0922047640 1 -- 172.21.15.83:0/1811223177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c15de60 msgr2=0x7f091c1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:43.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0922047640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c15de60 0x7f091c1510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:43.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0922047640 1 -- 172.21.15.83:0/1811223177 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f091c0cbd60 con 0x7f091c0cb8e0 2024-03-30T13:08:43.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0922047640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f091c0cb8e0 0x7f091c0b2020 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f091400e4f0 tx=0x7f091400e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:43.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f09127fc640 1 -- 172.21.15.83:0/1811223177 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0914019070 con 0x7f091c0cb8e0 2024-03-30T13:08:43.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0923aaa640 1 -- 172.21.15.83:0/1811223177 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f091c0cc050 con 0x7f091c0cb8e0 2024-03-30T13:08:43.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0923aaa640 1 -- 172.21.15.83:0/1811223177 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f091c0cc610 con 0x7f091c0cb8e0 2024-03-30T13:08:43.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f09127fc640 1 -- 172.21.15.83:0/1811223177 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0914010510 con 0x7f091c0cb8e0 2024-03-30T13:08:43.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f09127fc640 1 -- 172.21.15.83:0/1811223177 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0914010900 con 0x7f091c0cb8e0 2024-03-30T13:08:43.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0923aaa640 1 -- 172.21.15.83:0/1811223177 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09040052a0 con 0x7f091c0cb8e0 2024-03-30T13:08:43.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f09127fc640 1 -- 172.21.15.83:0/1811223177 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f0914010aa0 con 0x7f091c0cb8e0 2024-03-30T13:08:43.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f09127fc640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0900068040 0x7f090006a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:43.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f09127fc640 1 -- 172.21.15.83:0/1811223177 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0914085520 con 0x7f091c0cb8e0 2024-03-30T13:08:43.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0921846640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0900068040 0x7f090006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:43.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.208+0000 7f0921846640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0900068040 0x7f090006a500 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f091c1facc0 tx=0x7f091800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:43.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.212+0000 7f09127fc640 1 -- 172.21.15.83:0/1811223177 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f0914055820 con 0x7f091c0cb8e0 2024-03-30T13:08:43.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.396+0000 7f0923aaa640 1 -- 172.21.15.83:0/1811223177 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0904005860 con 0x7f091c0cb8e0 2024-03-30T13:08:43.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.396+0000 7f09127fc640 1 -- 172.21.15.83:0/1811223177 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f0914059b20 con 0x7f091c0cb8e0 2024-03-30T13:08:43.405 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:08:43.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.400+0000 7f0923aaa640 1 -- 172.21.15.83:0/1811223177 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0900068040 msgr2=0x7f090006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:43.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.400+0000 7f0923aaa640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0900068040 0x7f090006a500 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f091c1facc0 tx=0x7f091800b040 comp rx=0 tx=0).stop 2024-03-30T13:08:43.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.400+0000 7f0923aaa640 1 -- 172.21.15.83:0/1811223177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f091c0cb8e0 msgr2=0x7f091c0b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:43.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.400+0000 7f0923aaa640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f091c0cb8e0 0x7f091c0b2020 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f091400e4f0 tx=0x7f091400e9b0 comp rx=0 tx=0).stop 2024-03-30T13:08:43.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.400+0000 7f0923aaa640 1 -- 172.21.15.83:0/1811223177 shutdown_connections 2024-03-30T13:08:43.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.400+0000 7f0923aaa640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0900068040 0x7f090006a500 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:43.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.400+0000 7f0923aaa640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f091c0cb8e0 0x7f091c0b2020 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:43.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.400+0000 7f0923aaa640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f091c15de60 0x7f091c1510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:43.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.400+0000 7f0923aaa640 1 --2- 172.21.15.83:0/1811223177 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0908004810 0x7f091c0cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:43.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.400+0000 7f0923aaa640 1 -- 172.21.15.83:0/1811223177 >> 172.21.15.83:0/1811223177 conn(0x7f091c0b68c0 msgr2=0x7f091c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:43.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.400+0000 7f0923aaa640 1 -- 172.21.15.83:0/1811223177 shutdown_connections 2024-03-30T13:08:43.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43.400+0000 7f0923aaa640 1 -- 172.21.15.83:0/1811223177 wait complete. 2024-03-30T13:08:43.423 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:08:43.425 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:08:43.425 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-03-30T13:08:43.425 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-30T13:08:43.425 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-30T13:08:43.425 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:08:43.425 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:08:43.425 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:08:43.425 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:08:43.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:43.426 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-03-30T13:08:43.431 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:08:43.431 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:08:43.431 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:08:43.432 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:43.432 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-03-30T13:08:43.432 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:43.432 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:08:43.432 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:43.432 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-03-30T13:08:43.432 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:08:43.432 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:43.432 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-03-30T13:08:43.432 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:08:43.432 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:43.432 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:08:43.433 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:43.433 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-30T13:08:43.433 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42471sec preferred_lft 42471sec 2024-03-30T13:08:43.433 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link 2024-03-30T13:08:43.433 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:43.433 INFO:teuthology.orchestra.run.smithi083.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-30T13:08:43.433 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 02:42:4c:95:04:e4 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:43.433 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-30T13:08:43.433 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:43.433 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-30T13:08:43.434 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:43.434 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-03-30T13:08:43.434 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2024-03-30T13:08:43.434 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2024-03-30T13:08:43.434 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2024-03-30T13:08:43.434 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-30T13:08:43.434 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-03-30T13:08:43.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:43.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:43.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:43.552 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:08:43.606 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-03-30T13:08:43.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:43.607 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-03-30T13:08:43.675 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-03-30T13:08:43.675 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:08:43.675 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-30T13:08:43.675 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:08:43.675 INFO:teuthology.orchestra.run.smithi083.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-03-30T13:08:43.675 INFO:teuthology.orchestra.run.smithi083.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-30T13:08:43.675 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:08:43.675 INFO:teuthology.orchestra.run.smithi083.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:08:43.675 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:08:43.675 INFO:teuthology.orchestra.run.smithi083.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:08:43.676 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:08:43.676 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:43.676 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-03-30T13:08:43.676 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:08:43.676 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:08:43.676 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:08:43.676 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-03-30T13:08:43.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:43.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:43.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:43.798 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-03-30T13:08:43.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:43.805 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2024-03-30T13:08:43.850 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:43.850 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-03-30T13:08:43.850 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:43.850 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-30T13:08:43.850 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-03-30T13:08:43.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:43.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:43.969 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-30T13:08:43.969 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:43.970 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-03-30T13:08:43.970 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-30T13:08:43.970 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-30T13:08:43.970 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-30T13:08:43.970 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-30T13:08:43.970 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-30T13:08:43.970 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-03-30T13:08:44.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:44.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:44.079 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:44.079 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-03-30T13:08:44.079 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2024-03-30T13:08:44.079 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2024-03-30T13:08:44.079 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-03-30T13:08:44.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:44.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:44.181 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-30T13:08:44.181 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:08:44.181 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-30T13:08:44.230 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:08:44.230 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:08:44.230 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-30T13:08:44.277 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-03-30T13:08:44.334 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:08:44.386 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-03-30T13:08:44.386 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-03-30T13:08:44.386 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-03-30T13:08:44.386 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-03-30T13:08:44.386 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-03-30T13:08:44.386 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-03-30T13:08:44.386 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-03-30T13:08:44.386 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/run/lock 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/fs/nfsd 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:08:44.387 INFO:teuthology.orchestra.run.smithi083.stdout:/run/rpc_pipefs 2024-03-30T13:08:44.388 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-03-30T13:08:44.388 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-03-30T13:08:44.388 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-0 2024-03-30T13:08:44.388 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-1 2024-03-30T13:08:44.388 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-2 2024-03-30T13:08:44.388 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-3 2024-03-30T13:08:44.388 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-03-30T13:08:44.388 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:44.388 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:44.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:44.389 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-03-30T13:08:44.437 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-30T13:08:44.437 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-30T13:08:44.482 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-03-30T13:08:44.496 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:08:44.541 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-03-30T13:08:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-03-30T13:08:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-03-30T13:08:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-03-30T13:08:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-03-30T13:08:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-03-30T13:08:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-03-30T13:08:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-03-30T13:08:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:/run/lock 2024-03-30T13:08:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-03-30T13:08:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-03-30T13:08:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/fs/nfsd 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/run/rpc_pipefs 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-0 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-1 2024-03-30T13:08:44.543 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-2 2024-03-30T13:08:44.544 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-3 2024-03-30T13:08:44.544 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-03-30T13:08:44.544 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:44.544 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:44.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:44.545 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-03-30T13:08:44.561 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:2024-03-30T13:08:44.556+0000 7efd37b9b580 -1 init, newargv = 0x55c77ef6f510 newargc=15 2024-03-30T13:08:44.561 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:ceph-fuse[34921]: starting ceph client 2024-03-30T13:08:44.568 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:ceph-fuse[34921]: starting fuse 2024-03-30T13:08:45.667 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-03-30T13:08:45.683 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:08:45.731 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-03-30T13:08:45.731 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-03-30T13:08:45.731 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-03-30T13:08:45.731 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-03-30T13:08:45.731 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-03-30T13:08:45.731 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-03-30T13:08:45.731 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-03-30T13:08:45.731 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-03-30T13:08:45.731 INFO:teuthology.orchestra.run.smithi083.stdout:/run/lock 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/fs/nfsd 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/run/rpc_pipefs 2024-03-30T13:08:45.732 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-03-30T13:08:45.733 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-03-30T13:08:45.733 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-0 2024-03-30T13:08:45.733 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-1 2024-03-30T13:08:45.733 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-2 2024-03-30T13:08:45.733 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-3 2024-03-30T13:08:45.733 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-03-30T13:08:45.733 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:45.733 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:45.733 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-30T13:08:45.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:45.734 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-03-30T13:08:45.782 INFO:teuthology.orchestra.run.smithi083.stdout:45 2024-03-30T13:08:45.783 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-03-30T13:08:45.783 DEBUG:teuthology.orchestra.run.smithi083:> sudo stdin-killer -- python3 -c ' 2024-03-30T13:08:45.783 DEBUG:teuthology.orchestra.run.smithi083:> import glob 2024-03-30T13:08:45.783 DEBUG:teuthology.orchestra.run.smithi083:> import re 2024-03-30T13:08:45.783 DEBUG:teuthology.orchestra.run.smithi083:> import os 2024-03-30T13:08:45.783 DEBUG:teuthology.orchestra.run.smithi083:> import subprocess 2024-03-30T13:08:45.783 DEBUG:teuthology.orchestra.run.smithi083:> 2024-03-30T13:08:45.783 DEBUG:teuthology.orchestra.run.smithi083:> def _find_admin_socket(client_name): 2024-03-30T13:08:45.783 DEBUG:teuthology.orchestra.run.smithi083:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-30T13:08:45.783 DEBUG:teuthology.orchestra.run.smithi083:> files = glob.glob(asok_path) 2024-03-30T13:08:45.783 DEBUG:teuthology.orchestra.run.smithi083:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> # Given a non-glob path, it better be there 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> if "*" not in asok_path: 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> assert(len(files) == 1) 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> return files[0] 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> for f in files: 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> contents = proc_f.read() 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> if mountpoint in contents: 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> return f 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> 2024-03-30T13:08:45.784 DEBUG:teuthology.orchestra.run.smithi083:> print(_find_admin_socket("client.0")) 2024-03-30T13:08:45.785 DEBUG:teuthology.orchestra.run.smithi083:> ' 2024-03-30T13:08:45.905 INFO:teuthology.orchestra.run.smithi083.stdout:/var/run/ceph/ceph-client.0.34921.asok 2024-03-30T13:08:45.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:45.916 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34921.asok 2024-03-30T13:08:45.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:45.917 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34921.asok status 2024-03-30T13:08:46.067 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:08:46.068 INFO:teuthology.orchestra.run.smithi083.stdout: "metadata": { 2024-03-30T13:08:46.068 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_sha1": "ac1710396f9f7c389fa4b407711bc5157a8c0bf7", 2024-03-30T13:08:46.068 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.0.0-2519-gac171039 (ac1710396f9f7c389fa4b407711bc5157a8c0bf7) squid (dev)", 2024-03-30T13:08:46.068 INFO:teuthology.orchestra.run.smithi083.stdout: "entity_id": "0", 2024-03-30T13:08:46.068 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": "smithi083", 2024-03-30T13:08:46.068 INFO:teuthology.orchestra.run.smithi083.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-30T13:08:46.068 INFO:teuthology.orchestra.run.smithi083.stdout: "pid": "34921", 2024-03-30T13:08:46.068 INFO:teuthology.orchestra.run.smithi083.stdout: "root": "/" 2024-03-30T13:08:46.068 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:08:46.068 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_count": 0, 2024-03-30T13:08:46.069 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_pinned_count": 0, 2024-03-30T13:08:46.069 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4671, 2024-03-30T13:08:46.069 INFO:teuthology.orchestra.run.smithi083.stdout: "inst": { 2024-03-30T13:08:46.069 INFO:teuthology.orchestra.run.smithi083.stdout: "name": { 2024-03-30T13:08:46.069 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "client", 2024-03-30T13:08:46.069 INFO:teuthology.orchestra.run.smithi083.stdout: "num": 4671 2024-03-30T13:08:46.069 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:08:46.069 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-03-30T13:08:46.069 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-03-30T13:08:46.069 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-03-30T13:08:46.070 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 787025711 2024-03-30T13:08:46.070 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:08:46.070 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:08:46.070 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-03-30T13:08:46.070 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-03-30T13:08:46.070 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-03-30T13:08:46.070 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 787025711 2024-03-30T13:08:46.070 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:08:46.070 INFO:teuthology.orchestra.run.smithi083.stdout: "inst_str": "client.4671 192.168.0.1:0/787025711", 2024-03-30T13:08:46.070 INFO:teuthology.orchestra.run.smithi083.stdout: "addr_str": "192.168.0.1:0/787025711", 2024-03-30T13:08:46.070 INFO:teuthology.orchestra.run.smithi083.stdout: "inode_count": 1, 2024-03-30T13:08:46.071 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_epoch": 6, 2024-03-30T13:08:46.071 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch": 21, 2024-03-30T13:08:46.071 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch_barrier": 0, 2024-03-30T13:08:46.071 INFO:teuthology.orchestra.run.smithi083.stdout: "blocklisted": false, 2024-03-30T13:08:46.071 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs" 2024-03-30T13:08:46.071 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:08:46.081 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:08:46.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.192+0000 7f3d70f2f640 1 Processor -- start 2024-03-30T13:08:46.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.192+0000 7f3d70f2f640 1 -- start start 2024-03-30T13:08:46.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d70f2f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3d6c0b4830 0x7f3d6c15d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:46.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d70f2f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3d6c06dfe0 0x7f3d6c06e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:46.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d70f2f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d6c15d880 con 0x7f3d6c0aed20 2024-03-30T13:08:46.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d70f2f640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f3d6c156e00 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d70f2f640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f3d6c0ad040 con 0x7f3d6c0b4830 2024-03-30T13:08:46.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d6ad9d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3d6c06dfe0 0x7f3d6c06e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:46.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d61d9b640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3d6c0aed20 0x7f3d6c0af1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:56514/0 (socket says 172.21.15.83:56514) 2024-03-30T13:08:46.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d61d9b640 1 -- 172.21.15.83:0/2045254277 learned_addr learned my addr 172.21.15.83:0/2045254277 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:46.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d6a59c640 1 --2- 172.21.15.83:0/2045254277 >> v2:172.21.15.153:3300/0 conn(0x7f3d6c0b4830 0x7f3d6c15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:46.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d6ad9d640 1 -- 172.21.15.83:0/2045254277 >> v2:172.21.15.153:3300/0 conn(0x7f3d6c0b4830 msgr2=0x7f3d6c15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:46.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d6ad9d640 1 --2- 172.21.15.83:0/2045254277 >> v2:172.21.15.153:3300/0 conn(0x7f3d6c0b4830 0x7f3d6c15d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:46.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d6ad9d640 1 -- 172.21.15.83:0/2045254277 >> v1:172.21.15.83:6789/0 conn(0x7f3d6c0aed20 legacy=0x7f3d6c0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:46.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d6ad9d640 1 -- 172.21.15.83:0/2045254277 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6c0cfcb0 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d6ad9d640 1 --2- 172.21.15.83:0/2045254277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d6c06dfe0 0x7f3d6c06e3e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0b2a10 tx=0x7f3d6401c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea271f77346cbfb7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:46.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d69d9b640 1 -- 172.21.15.83:0/2045254277 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d640b2070 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d69d9b640 1 -- 172.21.15.83:0/2045254277 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d640a58a0 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.196+0000 7f3d69d9b640 1 -- 172.21.15.83:0/2045254277 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d640a5c70 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 -- 172.21.15.83:0/2045254277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d6c06dfe0 msgr2=0x7f3d6c06e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:46.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 --2- 172.21.15.83:0/2045254277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d6c06dfe0 0x7f3d6c06e3e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0b2a10 tx=0x7f3d6401c7e0 comp rx=0 tx=0).stop 2024-03-30T13:08:46.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 -- 172.21.15.83:0/2045254277 shutdown_connections 2024-03-30T13:08:46.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 --2- 172.21.15.83:0/2045254277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d6c06dfe0 0x7f3d6c06e3e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:46.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 --2- 172.21.15.83:0/2045254277 >> v2:172.21.15.153:3300/0 conn(0x7f3d6c0b4830 0x7f3d6c15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:46.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 -- 172.21.15.83:0/2045254277 >> 172.21.15.83:0/2045254277 conn(0x7f3d6c0b1d60 msgr2=0x7f3d6c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:46.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 -- 172.21.15.83:0/2045254277 shutdown_connections 2024-03-30T13:08:46.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 -- 172.21.15.83:0/2045254277 wait complete. 2024-03-30T13:08:46.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 Processor -- start 2024-03-30T13:08:46.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 -- start start 2024-03-30T13:08:46.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d6c06dfe0 0x7f3d6c09c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:46.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d6c0aed20 0x7f3d6c15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:46.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d6c0b4830 0x7f3d6c0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c0cf860 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c06fa90 con 0x7f3d6c0b4830 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d6c0cf9e0 con 0x7f3d6c0aed20 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d6a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d6c06dfe0 0x7f3d6c09c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d6a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d6c06dfe0 0x7f3d6c09c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59824/0 (socket says 172.21.15.83:59824) 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d6a59c640 1 -- 172.21.15.83:0/1356557247 learned_addr learned my addr 172.21.15.83:0/1356557247 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d61d9b640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d6c0aed20 0x7f3d6c15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d6ad9d640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d6c0b4830 0x7f3d6c0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d6a59c640 1 -- 172.21.15.83:0/1356557247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d6c0aed20 msgr2=0x7f3d6c15c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d6a59c640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d6c0aed20 0x7f3d6c15c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d6a59c640 1 -- 172.21.15.83:0/1356557247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d6c0b4830 msgr2=0x7f3d6c0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d6a59c640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d6c0b4830 0x7f3d6c0cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d6a59c640 1 -- 172.21.15.83:0/1356557247 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6c14fc00 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d61d9b640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d6c0aed20 0x7f3d6c15c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:46.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d6a59c640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d6c06dfe0 0x7f3d6c09c820 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00d830 tx=0x7f3d5c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:46.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d637fe640 1 -- 172.21.15.83:0/1356557247 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c00b6c0 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d637fe640 1 -- 172.21.15.83:0/1356557247 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c019070 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 -- 172.21.15.83:0/1356557247 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6c14eb60 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d637fe640 1 -- 172.21.15.83:0/1356557247 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c00ba60 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.200+0000 7f3d70f2f640 1 -- 172.21.15.83:0/1356557247 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d6c14f120 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.204+0000 7f3d70f2f640 1 -- 172.21.15.83:0/1356557247 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d6c0686c0 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.204+0000 7f3d637fe640 1 -- 172.21.15.83:0/1356557247 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f3d5c01e460 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.204+0000 7f3d637fe640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d4c067ff0 0x7f3d4c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:46.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.204+0000 7f3d637fe640 1 -- 172.21.15.83:0/1356557247 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3d5c086b70 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.204+0000 7f3d61d9b640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d4c067ff0 0x7f3d4c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:46.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.204+0000 7f3d61d9b640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d4c067ff0 0x7f3d4c06a4b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3d54007fd0 tx=0x7f3d54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:46.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.208+0000 7f3d637fe640 1 -- 172.21.15.83:0/1356557247 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3d5c0573b0 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.400+0000 7f3d70f2f640 1 -- 172.21.15.83:0/1356557247 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3d6c0b4ca0 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.400+0000 7f3d637fe640 1 -- 172.21.15.83:0/1356557247 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f3d5c056cb0 con 0x7f3d6c06dfe0 2024-03-30T13:08:46.409 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:08:46.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.404+0000 7f3d70f2f640 1 -- 172.21.15.83:0/1356557247 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d4c067ff0 msgr2=0x7f3d4c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:46.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.404+0000 7f3d70f2f640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d4c067ff0 0x7f3d4c06a4b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3d54007fd0 tx=0x7f3d54009040 comp rx=0 tx=0).stop 2024-03-30T13:08:46.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.404+0000 7f3d70f2f640 1 -- 172.21.15.83:0/1356557247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d6c06dfe0 msgr2=0x7f3d6c09c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:46.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.404+0000 7f3d70f2f640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d6c06dfe0 0x7f3d6c09c820 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00d830 tx=0x7f3d5c00dcf0 comp rx=0 tx=0).stop 2024-03-30T13:08:46.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.404+0000 7f3d70f2f640 1 -- 172.21.15.83:0/1356557247 shutdown_connections 2024-03-30T13:08:46.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.404+0000 7f3d70f2f640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d4c067ff0 0x7f3d4c06a4b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:46.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.404+0000 7f3d70f2f640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d6c0b4830 0x7f3d6c0cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:46.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.404+0000 7f3d70f2f640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d6c0aed20 0x7f3d6c15c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:46.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.404+0000 7f3d70f2f640 1 --2- 172.21.15.83:0/1356557247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d6c06dfe0 0x7f3d6c09c820 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:46.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.404+0000 7f3d70f2f640 1 -- 172.21.15.83:0/1356557247 >> 172.21.15.83:0/1356557247 conn(0x7f3d6c0b1d60 msgr2=0x7f3d6c14fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:46.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.404+0000 7f3d70f2f640 1 -- 172.21.15.83:0/1356557247 shutdown_connections 2024-03-30T13:08:46.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46.404+0000 7f3d70f2f640 1 -- 172.21.15.83:0/1356557247 wait complete. 2024-03-30T13:08:46.426 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:08:46.426 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:08:46.426 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-03-30T13:08:46.426 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-30T13:08:46.427 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-30T13:08:46.427 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:08:46.427 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:08:46.427 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:08:46.427 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-30T13:08:46.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:46.427 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-03-30T13:08:46.433 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42468sec preferred_lft 42468sec 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 02:42:4c:95:04:e4 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T13:08:46.434 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.435 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-30T13:08:46.435 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.435 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:08:46.435 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:46.435 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-30T13:08:46.435 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:46.435 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:08:46.486 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-03-30T13:08:46.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:46.487 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-03-30T13:08:46.540 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-03-30T13:08:46.540 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:08:46.540 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-30T13:08:46.540 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:08:46.540 INFO:teuthology.orchestra.run.smithi083.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-03-30T13:08:46.540 INFO:teuthology.orchestra.run.smithi083.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-30T13:08:46.541 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:08:46.541 INFO:teuthology.orchestra.run.smithi083.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:08:46.541 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:08:46.541 INFO:teuthology.orchestra.run.smithi083.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:08:46.541 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:08:46.541 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:46.541 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-03-30T13:08:46.541 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:08:46.541 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:08:46.541 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:08:46.541 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-03-30T13:08:46.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:46.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:46.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:46.661 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-03-30T13:08:46.710 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-30T13:08:46.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:46.711 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2024-03-30T13:08:46.757 INFO:teuthology.orchestra.run.smithi083.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-30T13:08:46.758 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:46.758 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-03-30T13:08:46.758 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:08:46.758 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-30T13:08:46.758 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-03-30T13:08:46.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:46.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:46.875 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-30T13:08:46.886 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:08:46.887 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:08:46.887 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:08:46.887 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.887 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-03-30T13:08:46.887 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.887 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:08:46.887 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 5a:69:1b:3b:31:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T13:08:46.887 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T13:08:46.887 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.887 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::5869:1bff:fe3b:31eb/64 scope link 2024-03-30T13:08:46.887 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:46.888 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-30T13:08:46.939 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:08:46.939 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:08:46.939 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:08:46.939 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.939 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-03-30T13:08:46.939 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.939 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:08:46.939 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 5a:69:1b:3b:31:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T13:08:46.939 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T13:08:46.940 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.940 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::5869:1bff:fe3b:31eb/64 scope link 2024-03-30T13:08:46.940 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:46.941 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-30T13:08:46.941 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:46.941 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-03-30T13:08:46.941 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-30T13:08:46.941 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-30T13:08:46.941 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-30T13:08:46.941 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-30T13:08:46.941 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-30T13:08:46.941 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-03-30T13:08:47.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:47.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:47.086 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:47.086 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-03-30T13:08:47.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.1 up 2024-03-30T13:08:47.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.1 master ceph-brx 2024-03-30T13:08:47.086 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-03-30T13:08:47.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:47.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:47.143 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-03-30T13:08:47.144 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:08:47.144 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-30T13:08:47.189 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-30T13:08:47.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:08:47.190 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-30T13:08:47.237 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-03-30T13:08:47.295 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:08:47.342 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-03-30T13:08:47.342 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-03-30T13:08:47.342 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-03-30T13:08:47.342 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-03-30T13:08:47.342 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-03-30T13:08:47.342 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-03-30T13:08:47.342 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-03-30T13:08:47.342 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/run/lock 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/fs/nfsd 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:08:47.343 INFO:teuthology.orchestra.run.smithi083.stdout:/run/rpc_pipefs 2024-03-30T13:08:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-03-30T13:08:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-03-30T13:08:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-0 2024-03-30T13:08:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-1 2024-03-30T13:08:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-2 2024-03-30T13:08:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-3 2024-03-30T13:08:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-03-30T13:08:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-30T13:08:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:08:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:08:47.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:47.345 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-03-30T13:08:47.394 INFO:teuthology.orchestra.run.smithi083.stdout:45 2024-03-30T13:08:47.394 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-03-30T13:08:47.394 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-03-30T13:08:47.439 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-03-30T13:08:47.453 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:08:47.502 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/run/lock 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-03-30T13:08:47.503 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/fs/nfsd 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/run/rpc_pipefs 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-0 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-1 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-2 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-3 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:47.504 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-30T13:08:47.505 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:08:47.505 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:08:47.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:47.505 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-03-30T13:08:47.516 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi083.stderr:2024-03-30T13:08:47.508+0000 7fad80f65580 -1 init, newargv = 0x5595e6dc38e0 newargc=15 2024-03-30T13:08:47.516 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi083.stderr:ceph-fuse[35066]: starting ceph client 2024-03-30T13:08:47.520 INFO:teuthology.orchestra.run.smithi083.stdout:45 2024-03-30T13:08:47.523 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi083.stderr:ceph-fuse[35066]: starting fuse 2024-03-30T13:08:48.622 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-03-30T13:08:48.639 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:08:48.687 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-03-30T13:08:48.687 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-03-30T13:08:48.687 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-03-30T13:08:48.687 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-03-30T13:08:48.687 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-03-30T13:08:48.687 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-03-30T13:08:48.687 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-03-30T13:08:48.687 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-03-30T13:08:48.687 INFO:teuthology.orchestra.run.smithi083.stdout:/run/lock 2024-03-30T13:08:48.687 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/fs/nfsd 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/run/rpc_pipefs 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-03-30T13:08:48.688 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-0 2024-03-30T13:08:48.689 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-1 2024-03-30T13:08:48.689 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-2 2024-03-30T13:08:48.689 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-3 2024-03-30T13:08:48.689 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-03-30T13:08:48.689 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:48.689 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:08:48.689 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-30T13:08:48.689 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:08:48.689 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:08:48.689 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/mnt.2 2024-03-30T13:08:48.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:48.690 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-03-30T13:08:48.742 INFO:teuthology.orchestra.run.smithi083.stdout:45 2024-03-30T13:08:48.742 INFO:teuthology.orchestra.run.smithi083.stdout:46 2024-03-30T13:08:48.742 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-03-30T13:08:48.742 DEBUG:teuthology.orchestra.run.smithi083:> sudo stdin-killer -- python3 -c ' 2024-03-30T13:08:48.742 DEBUG:teuthology.orchestra.run.smithi083:> import glob 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> import re 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> import os 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> import subprocess 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> def _find_admin_socket(client_name): 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> files = glob.glob(asok_path) 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> # Given a non-glob path, it better be there 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> if "*" not in asok_path: 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> assert(len(files) == 1) 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> return files[0] 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> for f in files: 2024-03-30T13:08:48.743 DEBUG:teuthology.orchestra.run.smithi083:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-30T13:08:48.744 DEBUG:teuthology.orchestra.run.smithi083:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-30T13:08:48.744 DEBUG:teuthology.orchestra.run.smithi083:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-30T13:08:48.744 DEBUG:teuthology.orchestra.run.smithi083:> contents = proc_f.read() 2024-03-30T13:08:48.744 DEBUG:teuthology.orchestra.run.smithi083:> if mountpoint in contents: 2024-03-30T13:08:48.744 DEBUG:teuthology.orchestra.run.smithi083:> return f 2024-03-30T13:08:48.744 DEBUG:teuthology.orchestra.run.smithi083:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-30T13:08:48.744 DEBUG:teuthology.orchestra.run.smithi083:> 2024-03-30T13:08:48.744 DEBUG:teuthology.orchestra.run.smithi083:> print(_find_admin_socket("client.2")) 2024-03-30T13:08:48.744 DEBUG:teuthology.orchestra.run.smithi083:> ' 2024-03-30T13:08:48.864 INFO:teuthology.orchestra.run.smithi083.stdout:/var/run/ceph/ceph-client.2.35066.asok 2024-03-30T13:08:48.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:48.876 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.35066.asok 2024-03-30T13:08:48.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:48.876 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.35066.asok status 2024-03-30T13:08:49.027 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:08:49.027 INFO:teuthology.orchestra.run.smithi083.stdout: "metadata": { 2024-03-30T13:08:49.027 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_sha1": "ac1710396f9f7c389fa4b407711bc5157a8c0bf7", 2024-03-30T13:08:49.027 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.0.0-2519-gac171039 (ac1710396f9f7c389fa4b407711bc5157a8c0bf7) squid (dev)", 2024-03-30T13:08:49.027 INFO:teuthology.orchestra.run.smithi083.stdout: "entity_id": "2", 2024-03-30T13:08:49.027 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": "smithi083", 2024-03-30T13:08:49.027 INFO:teuthology.orchestra.run.smithi083.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-03-30T13:08:49.027 INFO:teuthology.orchestra.run.smithi083.stdout: "pid": "35066", 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: "root": "/" 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_count": 0, 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_pinned_count": 0, 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4686, 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: "inst": { 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: "name": { 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "client", 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: "num": 4686 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.2:0", 2024-03-30T13:08:49.028 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2764872650 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.2:0", 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2764872650 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: "inst_str": "client.4686 192.168.0.2:0/2764872650", 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: "addr_str": "192.168.0.2:0/2764872650", 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: "inode_count": 1, 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_epoch": 6, 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch": 21, 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch_barrier": 0, 2024-03-30T13:08:49.029 INFO:teuthology.orchestra.run.smithi083.stdout: "blocklisted": false, 2024-03-30T13:08:49.030 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs" 2024-03-30T13:08:49.030 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:08:49.040 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:08:49.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.156+0000 7f91e5c4f640 1 Processor -- start 2024-03-30T13:08:49.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91e5c4f640 1 -- start start 2024-03-30T13:08:49.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91e5c4f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91e00aed20 0x7f91e00af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:49.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91e5c4f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e00cfcb0 con 0x7f91e00b4830 2024-03-30T13:08:49.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91e5c4f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e00ad290 con 0x7f91e006dfe0 2024-03-30T13:08:49.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91e5c4f640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f91e0156e00 con 0x7f91e00aed20 2024-03-30T13:08:49.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91df7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f91e00b4830 0x7f91e015d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60034/0 (socket says 172.21.15.83:60034) 2024-03-30T13:08:49.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91df7fe640 1 -- 172.21.15.83:0/707268631 learned_addr learned my addr 172.21.15.83:0/707268631 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:49.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91deffd640 1 --2- 172.21.15.83:0/707268631 >> v2:172.21.15.153:3300/0 conn(0x7f91e00aed20 0x7f91e00af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:49.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 845500176 0 0) 0x7f91e00cfcb0 con 0x7f91e00b4830 2024-03-30T13:08:49.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91c8003530 con 0x7f91e00b4830 2024-03-30T13:08:49.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1012214571 0 0) 0x7f91c8003530 con 0x7f91e00b4830 2024-03-30T13:08:49.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 >> v2:172.21.15.153:3300/0 conn(0x7f91e00aed20 msgr2=0x7f91e00af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:49.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 --2- 172.21.15.83:0/707268631 >> v2:172.21.15.153:3300/0 conn(0x7f91e00aed20 0x7f91e00af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:49.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 >> v1:172.21.15.153:6789/0 conn(0x7f91e006dfe0 legacy=0x7f91e006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:49.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e00ad570 con 0x7f91e00b4830 2024-03-30T13:08:49.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f91d0001680 con 0x7f91e00b4830 2024-03-30T13:08:49.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 >> v1:172.21.15.83:6789/0 conn(0x7f91e00b4830 legacy=0x7f91e015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:49.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 --2- 172.21.15.83:0/707268631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91c80039c0 0x7f91c8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:49.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 --2- 172.21.15.83:0/707268631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c8004810 0x7f91c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:49.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 --2- 172.21.15.83:0/707268631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c80051d0 0x7f91c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:49.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f91e0156e00 con 0x7f91c80051d0 2024-03-30T13:08:49.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91c800c120 con 0x7f91c8004810 2024-03-30T13:08:49.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f91c800c320 con 0x7f91c80039c0 2024-03-30T13:08:49.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91dffff640 1 --2- 172.21.15.83:0/707268631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c80051d0 0x7f91c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:49.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91deffd640 1 --2- 172.21.15.83:0/707268631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c8004810 0x7f91c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:49.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91df7fe640 1 --2- 172.21.15.83:0/707268631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91c80039c0 0x7f91c8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:49.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91dffff640 1 -- 172.21.15.83:0/707268631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91c80039c0 msgr2=0x7f91c8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:49.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91dffff640 1 --2- 172.21.15.83:0/707268631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91c80039c0 0x7f91c8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:49.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91dffff640 1 -- 172.21.15.83:0/707268631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c8004810 msgr2=0x7f91c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:49.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91dffff640 1 --2- 172.21.15.83:0/707268631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c8004810 0x7f91c8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:49.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91dffff640 1 -- 172.21.15.83:0/707268631 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c8003530 con 0x7f91c80051d0 2024-03-30T13:08:49.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.160+0000 7f91deffd640 1 --2- 172.21.15.83:0/707268631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91c8004810 0x7f91c8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:49.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91dffff640 1 -- 172.21.15.83:0/707268631 reap_dead start 2024-03-30T13:08:49.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91dffff640 1 --2- 172.21.15.83:0/707268631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c80051d0 0x7f91c800b9d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f91d8001f60 tx=0x7f91d801eff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a97b54271bf7f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:49.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8001b60 con 0x7f91c80051d0 2024-03-30T13:08:49.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d80a8c10 con 0x7f91c80051d0 2024-03-30T13:08:49.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91de7fc640 1 -- 172.21.15.83:0/707268631 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8003980 con 0x7f91c80051d0 2024-03-30T13:08:49.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 -- 172.21.15.83:0/707268631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c80051d0 msgr2=0x7f91c800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:49.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 --2- 172.21.15.83:0/707268631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c80051d0 0x7f91c800b9d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f91d8001f60 tx=0x7f91d801eff0 comp rx=0 tx=0).stop 2024-03-30T13:08:49.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 -- 172.21.15.83:0/707268631 shutdown_connections 2024-03-30T13:08:49.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 --2- 172.21.15.83:0/707268631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c80051d0 0x7f91c800b9d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:49.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 -- 172.21.15.83:0/707268631 >> 172.21.15.83:0/707268631 conn(0x7f91e00b1d60 msgr2=0x7f91e00b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:49.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 -- 172.21.15.83:0/707268631 shutdown_connections 2024-03-30T13:08:49.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 -- 172.21.15.83:0/707268631 wait complete. 2024-03-30T13:08:49.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 Processor -- start 2024-03-30T13:08:49.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 -- start start 2024-03-30T13:08:49.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91c80051d0 0x7f91e009a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:49.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91e009dc80 0x7f91e01483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:49.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91e014f8a0 0x7f91e00b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:49.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f91e006fa90 con 0x7f91e014f8a0 2024-03-30T13:08:49.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91e00ad040 con 0x7f91e009dc80 2024-03-30T13:08:49.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91e5c4f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f91e00cf860 con 0x7f91c80051d0 2024-03-30T13:08:49.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91dffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91e014f8a0 0x7f91e00b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:49.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91dffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91e014f8a0 0x7f91e00b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48088/0 (socket says 172.21.15.83:48088) 2024-03-30T13:08:49.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.164+0000 7f91dffff640 1 -- 172.21.15.83:0/2778810396 learned_addr learned my addr 172.21.15.83:0/2778810396 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:49.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91deffd640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91e009dc80 0x7f91e01483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:49.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91df7fe640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91c80051d0 0x7f91e009a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:49.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91dffff640 1 -- 172.21.15.83:0/2778810396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91c80051d0 msgr2=0x7f91e009a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:49.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91dffff640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91c80051d0 0x7f91e009a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:49.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91dffff640 1 -- 172.21.15.83:0/2778810396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91e009dc80 msgr2=0x7f91e01483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:49.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91dffff640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91e009dc80 0x7f91e01483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:49.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91dffff640 1 -- 172.21.15.83:0/2778810396 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e015f900 con 0x7f91e014f8a0 2024-03-30T13:08:49.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91dffff640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91e014f8a0 0x7f91e00b0e80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f91d800a030 tx=0x7f91c8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:49.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91c7fff640 1 -- 172.21.15.83:0/2778810396 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8001b40 con 0x7f91e014f8a0 2024-03-30T13:08:49.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91c7fff640 1 -- 172.21.15.83:0/2778810396 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d8006b60 con 0x7f91e014f8a0 2024-03-30T13:08:49.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91e5c4f640 1 -- 172.21.15.83:0/2778810396 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e009a880 con 0x7f91e014f8a0 2024-03-30T13:08:49.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91c7fff640 1 -- 172.21.15.83:0/2778810396 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80050d0 con 0x7f91e014f8a0 2024-03-30T13:08:49.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91e5c4f640 1 -- 172.21.15.83:0/2778810396 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e009ae40 con 0x7f91e014f8a0 2024-03-30T13:08:49.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91e5c4f640 1 -- 172.21.15.83:0/2778810396 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e00686c0 con 0x7f91e014f8a0 2024-03-30T13:08:49.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91c7fff640 1 -- 172.21.15.83:0/2778810396 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f91d8005270 con 0x7f91e014f8a0 2024-03-30T13:08:49.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91c7fff640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f91cc067fc0 0x7f91cc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:49.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91c7fff640 1 -- 172.21.15.83:0/2778810396 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f91d8123630 con 0x7f91e014f8a0 2024-03-30T13:08:49.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91df7fe640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f91cc067fc0 0x7f91cc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:49.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.168+0000 7f91df7fe640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f91cc067fc0 0x7f91cc06a480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f91d0000c10 tx=0x7f91d0007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:49.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.172+0000 7f91c7fff640 1 -- 172.21.15.83:0/2778810396 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f91d8018d00 con 0x7f91e014f8a0 2024-03-30T13:08:49.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.372+0000 7f91e5c4f640 1 -- 172.21.15.83:0/2778810396 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f91e0156270 con 0x7f91e014f8a0 2024-03-30T13:08:49.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.372+0000 7f91c7fff640 1 -- 172.21.15.83:0/2778810396 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f91d80f3820 con 0x7f91e014f8a0 2024-03-30T13:08:49.381 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:08:49.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.376+0000 7f91e5c4f640 1 -- 172.21.15.83:0/2778810396 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f91cc067fc0 msgr2=0x7f91cc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:49.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.376+0000 7f91e5c4f640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f91cc067fc0 0x7f91cc06a480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f91d0000c10 tx=0x7f91d0007040 comp rx=0 tx=0).stop 2024-03-30T13:08:49.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.376+0000 7f91e5c4f640 1 -- 172.21.15.83:0/2778810396 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91e014f8a0 msgr2=0x7f91e00b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:49.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.376+0000 7f91e5c4f640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91e014f8a0 0x7f91e00b0e80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f91d800a030 tx=0x7f91c8005840 comp rx=0 tx=0).stop 2024-03-30T13:08:49.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.376+0000 7f91e5c4f640 1 -- 172.21.15.83:0/2778810396 shutdown_connections 2024-03-30T13:08:49.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.376+0000 7f91e5c4f640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f91cc067fc0 0x7f91cc06a480 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:49.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.376+0000 7f91e5c4f640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91e014f8a0 0x7f91e00b0e80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:49.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.376+0000 7f91e5c4f640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91e009dc80 0x7f91e01483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:49.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.376+0000 7f91e5c4f640 1 --2- 172.21.15.83:0/2778810396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91c80051d0 0x7f91e009a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:49.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.376+0000 7f91e5c4f640 1 -- 172.21.15.83:0/2778810396 >> 172.21.15.83:0/2778810396 conn(0x7f91e00b1d60 msgr2=0x7f91e00af150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:49.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.376+0000 7f91e5c4f640 1 -- 172.21.15.83:0/2778810396 shutdown_connections 2024-03-30T13:08:49.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:49.376+0000 7f91e5c4f640 1 -- 172.21.15.83:0/2778810396 wait complete. 2024-03-30T13:08:49.400 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:08:49.400 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:08:49.400 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-03-30T13:08:49.400 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-30T13:08:49.400 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-30T13:08:49.400 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:08:49.400 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:08:49.400 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:08:49.400 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:08:49.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:49.400 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-03-30T13:08:49.407 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:08:49.408 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:08:49.408 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:08:49.408 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:49.408 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-03-30T13:08:49.408 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:49.408 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:08:49.408 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:49.408 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-03-30T13:08:49.408 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:08:49.408 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:49.408 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-03-30T13:08:49.409 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:08:49.409 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:49.409 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:08:49.409 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:49.409 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-30T13:08:49.409 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42466sec preferred_lft 42466sec 2024-03-30T13:08:49.409 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-03-30T13:08:49.409 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:49.409 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-30T13:08:49.409 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:0b:ab:5b:f5 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:49.409 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-30T13:08:49.409 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:49.410 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-30T13:08:49.410 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:49.410 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-30T13:08:49.410 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2024-03-30T13:08:49.410 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2024-03-30T13:08:49.410 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2024-03-30T13:08:49.410 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-30T13:08:49.410 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-30T13:08:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:49.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:49.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:49.534 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:08:49.544 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-03-30T13:08:49.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:49.545 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-03-30T13:08:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-03-30T13:08:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:08:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-30T13:08:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:08:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-03-30T13:08:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-30T13:08:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:08:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:08:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:08:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:08:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:08:49.618 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:49.618 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-30T13:08:49.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:08:49.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:08:49.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:08:49.618 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-30T13:08:49.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:49.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:49.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:49.732 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-03-30T13:08:49.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:49.780 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-03-30T13:08:49.828 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:49.829 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-30T13:08:49.829 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:49.829 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-30T13:08:49.829 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-30T13:08:49.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:49.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:49.940 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-30T13:08:49.940 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:49.940 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-30T13:08:49.940 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-30T13:08:49.940 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-30T13:08:49.940 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-30T13:08:49.940 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-30T13:08:49.940 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-30T13:08:49.941 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-30T13:08:50.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:50.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:50.084 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:50.084 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-30T13:08:50.084 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-03-30T13:08:50.085 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2024-03-30T13:08:50.085 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-30T13:08:50.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:50.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:50.190 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-30T13:08:50.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:08:50.190 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-30T13:08:50.238 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:08:50.239 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:08:50.239 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-30T13:08:50.286 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-03-30T13:08:50.341 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:08:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-03-30T13:08:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-03-30T13:08:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-03-30T13:08:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-03-30T13:08:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-03-30T13:08:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-03-30T13:08:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-03-30T13:08:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/run/lock 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/fs/nfsd 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-03-30T13:08:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:08:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:/run/rpc_pipefs 2024-03-30T13:08:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-03-30T13:08:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-03-30T13:08:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-4 2024-03-30T13:08:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-5 2024-03-30T13:08:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-6 2024-03-30T13:08:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-7 2024-03-30T13:08:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-03-30T13:08:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:50.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:50.390 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-03-30T13:08:50.434 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-30T13:08:50.435 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-30T13:08:50.480 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-03-30T13:08:50.492 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/run/lock 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-03-30T13:08:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:08:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-03-30T13:08:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-03-30T13:08:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-03-30T13:08:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-03-30T13:08:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/fs/nfsd 2024-03-30T13:08:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-03-30T13:08:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-03-30T13:08:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:08:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:/run/rpc_pipefs 2024-03-30T13:08:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-03-30T13:08:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-03-30T13:08:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-4 2024-03-30T13:08:50.542 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-5 2024-03-30T13:08:50.542 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-6 2024-03-30T13:08:50.542 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-7 2024-03-30T13:08:50.542 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-03-30T13:08:50.542 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:50.542 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:50.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:50.543 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-03-30T13:08:50.549 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:2024-03-30T13:08:50.541+0000 7fdb55fd1580 -1 init, newargv = 0x55c87cbd2870 newargc=15 2024-03-30T13:08:50.549 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[32899]: starting ceph client 2024-03-30T13:08:50.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[32899]: starting fuse 2024-03-30T13:08:51.655 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-03-30T13:08:51.671 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:08:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-03-30T13:08:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-03-30T13:08:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-03-30T13:08:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-03-30T13:08:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-03-30T13:08:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-03-30T13:08:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/run/lock 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/fs/nfsd 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-03-30T13:08:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:08:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:/run/rpc_pipefs 2024-03-30T13:08:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-03-30T13:08:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-03-30T13:08:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-4 2024-03-30T13:08:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-5 2024-03-30T13:08:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-6 2024-03-30T13:08:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-7 2024-03-30T13:08:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-03-30T13:08:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-30T13:08:51.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:51.723 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-03-30T13:08:51.770 INFO:teuthology.orchestra.run.smithi153.stdout:45 2024-03-30T13:08:51.771 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-03-30T13:08:51.771 DEBUG:teuthology.orchestra.run.smithi153:> sudo stdin-killer -- python3 -c ' 2024-03-30T13:08:51.771 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-03-30T13:08:51.771 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-03-30T13:08:51.771 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-03-30T13:08:51.771 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-03-30T13:08:51.771 DEBUG:teuthology.orchestra.run.smithi153:> 2024-03-30T13:08:51.771 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-03-30T13:08:51.771 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-03-30T13:08:51.772 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-30T13:08:51.773 DEBUG:teuthology.orchestra.run.smithi153:> 2024-03-30T13:08:51.773 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.1")) 2024-03-30T13:08:51.773 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-03-30T13:08:51.894 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.1.32899.asok 2024-03-30T13:08:51.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:51.906 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.32899.asok 2024-03-30T13:08:51.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:51.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.32899.asok status 2024-03-30T13:08:52.058 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-30T13:08:52.058 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-03-30T13:08:52.058 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "ac1710396f9f7c389fa4b407711bc5157a8c0bf7", 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 19.0.0-2519-gac171039 (ac1710396f9f7c389fa4b407711bc5157a8c0bf7) squid (dev)", 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "1", 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "32899", 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4481, 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-03-30T13:08:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 4481 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 596950757 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 596950757 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.4481 192.168.0.1:0/596950757", 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/596950757", 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-03-30T13:08:52.060 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 6, 2024-03-30T13:08:52.061 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 21, 2024-03-30T13:08:52.061 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-03-30T13:08:52.061 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-03-30T13:08:52.061 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-03-30T13:08:52.061 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-30T13:08:52.072 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:08:52.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.196+0000 7fc49b0dc640 1 Processor -- start 2024-03-30T13:08:52.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.196+0000 7fc49b0dc640 1 -- start start 2024-03-30T13:08:52.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc49b0dc640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc49415ca10 0x7fc49406ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:52.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc49b0dc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49406efa0 0x7fc4940c5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:52.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc49b0dc640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc494160820 con 0x7fc494156b00 2024-03-30T13:08:52.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc49b0dc640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc494160b00 con 0x7fc49415ca10 2024-03-30T13:08:52.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc49b0dc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc49406e260 con 0x7fc49406efa0 2024-03-30T13:08:52.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc498e78640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc494156b00 0x7fc49415ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60036/0 (socket says 172.21.15.83:60036) 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc498e78640 1 -- 172.21.15.83:0/2972059817 learned_addr learned my addr 172.21.15.83:0/2972059817 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc493fff640 1 --2- 172.21.15.83:0/2972059817 >> v2:172.21.15.153:3300/0 conn(0x7fc49415ca10 0x7fc49406ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc499679640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49406efa0 0x7fc4940c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57271297 0 0) 0x7fc494160820 con 0x7fc494156b00 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc47c003530 con 0x7fc494156b00 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 442174933 0 0) 0x7fc47c003530 con 0x7fc494156b00 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49406efa0 msgr2=0x7fc4940c5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49406efa0 0x7fc4940c5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 >> v2:172.21.15.153:3300/0 conn(0x7fc49415ca10 msgr2=0x7fc49406ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 --2- 172.21.15.83:0/2972059817 >> v2:172.21.15.153:3300/0 conn(0x7fc49415ca10 0x7fc49406ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49406e540 con 0x7fc494156b00 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fc484001680 con 0x7fc494156b00 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 >> v1:172.21.15.83:6789/0 conn(0x7fc494156b00 legacy=0x7fc49415ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc47c0039c0 0x7fc47c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49406efa0 0x7fc47c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc47c004d50 0x7fc47c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc494160b00 con 0x7fc47c0039c0 2024-03-30T13:08:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc49406e260 con 0x7fc47c004d50 2024-03-30T13:08:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc47c00b9d0 con 0x7fc49406efa0 2024-03-30T13:08:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc498e78640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc47c0039c0 0x7fc47c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc493fff640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49406efa0 0x7fc47c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc499679640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc47c004d50 0x7fc47c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc498e78640 1 -- 172.21.15.83:0/2972059817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49406efa0 msgr2=0x7fc47c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc498e78640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49406efa0 0x7fc47c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc498e78640 1 -- 172.21.15.83:0/2972059817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc47c004d50 msgr2=0x7fc47c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc498e78640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc47c004d50 0x7fc47c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc498e78640 1 -- 172.21.15.83:0/2972059817 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47c003530 con 0x7fc47c0039c0 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.200+0000 7fc493fff640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49406efa0 0x7fc47c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc498e78640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc47c0039c0 0x7fc47c003de0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc48400c2c0 tx=0x7fc48401cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3683f56ec8bd7a4e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484007d60 con 0x7fc47c0039c0 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4840a9020 con 0x7fc47c0039c0 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc4937fe640 1 -- 172.21.15.83:0/2972059817 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484005ae0 con 0x7fc47c0039c0 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 -- 172.21.15.83:0/2972059817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc47c0039c0 msgr2=0x7fc47c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 --2- 172.21.15.83:0/2972059817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc47c0039c0 0x7fc47c003de0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc48400c2c0 tx=0x7fc48401cd40 comp rx=0 tx=0).stop 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc499679640 1 -- 172.21.15.83:0/2972059817 reap_dead start 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 -- 172.21.15.83:0/2972059817 shutdown_connections 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 -- 172.21.15.83:0/2972059817 >> 172.21.15.83:0/2972059817 conn(0x7fc494067970 msgr2=0x7fc49406b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 -- 172.21.15.83:0/2972059817 shutdown_connections 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 -- 172.21.15.83:0/2972059817 wait complete. 2024-03-30T13:08:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 Processor -- start 2024-03-30T13:08:52.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 -- start start 2024-03-30T13:08:52.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc47c0039c0 0x7fc494136760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:52.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc49414b410 0x7fc4941390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:52.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49414b870 0x7fc4941488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:52.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc494167430 con 0x7fc49414b410 2024-03-30T13:08:52.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4941672b0 con 0x7fc47c0039c0 2024-03-30T13:08:52.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4941675b0 con 0x7fc49414b870 2024-03-30T13:08:52.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc493fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc49414b410 0x7fc4941390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:52.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc493fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc49414b410 0x7fc4941390a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48110/0 (socket says 172.21.15.83:48110) 2024-03-30T13:08:52.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc493fff640 1 -- 172.21.15.83:0/109829341 learned_addr learned my addr 172.21.15.83:0/109829341 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:52.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc498e78640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc47c0039c0 0x7fc494136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:52.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc499679640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49414b870 0x7fc4941488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:52.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc493fff640 1 -- 172.21.15.83:0/109829341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49414b870 msgr2=0x7fc4941488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:52.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc493fff640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49414b870 0x7fc4941488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:52.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc493fff640 1 -- 172.21.15.83:0/109829341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc47c0039c0 msgr2=0x7fc494136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:52.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc493fff640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc47c0039c0 0x7fc494136760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:52.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc493fff640 1 -- 172.21.15.83:0/109829341 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49406ea60 con 0x7fc49414b410 2024-03-30T13:08:52.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc498e78640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc47c0039c0 0x7fc494136760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:52.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc493fff640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc49414b410 0x7fc4941390a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc488010980 tx=0x7fc488010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:52.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc4917fa640 1 -- 172.21.15.83:0/109829341 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48800f040 con 0x7fc49414b410 2024-03-30T13:08:52.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc4917fa640 1 -- 172.21.15.83:0/109829341 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc488004220 con 0x7fc49414b410 2024-03-30T13:08:52.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 -- 172.21.15.83:0/109829341 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc494139b60 con 0x7fc49414b410 2024-03-30T13:08:52.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc4917fa640 1 -- 172.21.15.83:0/109829341 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48800e9c0 con 0x7fc49414b410 2024-03-30T13:08:52.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.204+0000 7fc49b0dc640 1 -- 172.21.15.83:0/109829341 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc49414ac10 con 0x7fc49414b410 2024-03-30T13:08:52.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.208+0000 7fc49b0dc640 1 -- 172.21.15.83:0/109829341 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4940686c0 con 0x7fc49414b410 2024-03-30T13:08:52.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.208+0000 7fc4917fa640 1 -- 172.21.15.83:0/109829341 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc48800eb60 con 0x7fc49414b410 2024-03-30T13:08:52.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.208+0000 7fc4917fa640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc480067fc0 0x7fc48006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:52.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.208+0000 7fc4917fa640 1 -- 172.21.15.83:0/109829341 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc488086480 con 0x7fc49414b410 2024-03-30T13:08:52.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.208+0000 7fc498e78640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc480067fc0 0x7fc48006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:52.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.208+0000 7fc498e78640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc480067fc0 0x7fc48006a480 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc4840aa000 tx=0x7fc484001a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:52.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.212+0000 7fc4917fa640 1 -- 172.21.15.83:0/109829341 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fc488018030 con 0x7fc49414b410 2024-03-30T13:08:52.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 -- 172.21.15.83:0/109829341 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc49414ef30 con 0x7fc49414b410 2024-03-30T13:08:52.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc4917fa640 1 -- 172.21.15.83:0/109829341 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fc488056cc0 con 0x7fc49414b410 2024-03-30T13:08:52.415 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:08:52.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 -- 172.21.15.83:0/109829341 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc480067fc0 msgr2=0x7fc48006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:52.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc480067fc0 0x7fc48006a480 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc4840aa000 tx=0x7fc484001a50 comp rx=0 tx=0).stop 2024-03-30T13:08:52.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 -- 172.21.15.83:0/109829341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc49414b410 msgr2=0x7fc4941390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:52.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc49414b410 0x7fc4941390a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc488010980 tx=0x7fc488010e40 comp rx=0 tx=0).stop 2024-03-30T13:08:52.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 -- 172.21.15.83:0/109829341 shutdown_connections 2024-03-30T13:08:52.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc480067fc0 0x7fc48006a480 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:52.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc49414b870 0x7fc4941488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:52.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc49414b410 0x7fc4941390a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:52.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 --2- 172.21.15.83:0/109829341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc47c0039c0 0x7fc494136760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:52.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 -- 172.21.15.83:0/109829341 >> 172.21.15.83:0/109829341 conn(0x7fc494067970 msgr2=0x7fc49414e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:52.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 -- 172.21.15.83:0/109829341 shutdown_connections 2024-03-30T13:08:52.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:52.408+0000 7fc49b0dc640 1 -- 172.21.15.83:0/109829341 wait complete. 2024-03-30T13:08:52.433 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:08:52.433 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:08:52.433 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-03-30T13:08:52.433 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-30T13:08:52.433 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-30T13:08:52.433 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:08:52.434 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:08:52.434 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:08:52.434 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-30T13:08:52.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:52.434 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-03-30T13:08:52.440 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:08:52.440 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:08:52.440 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-30T13:08:52.441 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42463sec preferred_lft 42463sec 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:0b:ab:5b:f5 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:08:52.442 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:52.443 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-30T13:08:52.443 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:52.443 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:08:52.494 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-03-30T13:08:52.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:52.496 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-03-30T13:08:52.547 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-03-30T13:08:52.547 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:08:52.547 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-30T13:08:52.547 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:08:52.547 INFO:teuthology.orchestra.run.smithi153.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-03-30T13:08:52.547 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-30T13:08:52.547 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:08:52.547 INFO:teuthology.orchestra.run.smithi153.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:08:52.547 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:08:52.547 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:08:52.547 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:08:52.548 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:52.548 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-30T13:08:52.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:08:52.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:08:52.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:08:52.548 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-30T13:08:52.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:52.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:52.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:52.665 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-03-30T13:08:52.711 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-30T13:08:52.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:52.712 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-03-30T13:08:52.759 INFO:teuthology.orchestra.run.smithi153.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-30T13:08:52.759 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:52.759 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-30T13:08:52.759 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:08:52.759 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-30T13:08:52.759 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-30T13:08:52.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:52.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:52.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:52.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-30T13:08:52.925 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:08:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:08:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:08:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-03-30T13:08:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.926 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:08:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ba:28:71:bc:ec:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T13:08:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T13:08:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::b828:71ff:febc:ec57/64 scope link 2024-03-30T13:08:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:52.927 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-30T13:08:52.980 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:08:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:08:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:08:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-03-30T13:08:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.981 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:08:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ba:28:71:bc:ec:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T13:08:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T13:08:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::b828:71ff:febc:ec57/64 scope link 2024-03-30T13:08:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:08:52.982 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-30T13:08:52.982 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:52.982 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-30T13:08:52.983 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-30T13:08:52.983 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-30T13:08:52.983 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-30T13:08:52.983 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-30T13:08:52.983 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-30T13:08:52.983 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-30T13:08:53.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:53.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:53.112 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:08:53.112 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-30T13:08:53.112 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.1 up 2024-03-30T13:08:53.112 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.1 master ceph-brx 2024-03-30T13:08:53.112 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-30T13:08:53.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:08:53.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:53.216 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-03-30T13:08:53.217 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:08:53.217 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-30T13:08:53.263 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-30T13:08:53.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:08:53.263 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-30T13:08:53.310 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-03-30T13:08:53.363 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:08:53.412 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-03-30T13:08:53.412 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-03-30T13:08:53.412 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-03-30T13:08:53.412 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/run/lock 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/fs/nfsd 2024-03-30T13:08:53.413 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/run/rpc_pipefs 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-4 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-5 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-6 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-7 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-30T13:08:53.414 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:08:53.415 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:08:53.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:53.416 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-03-30T13:08:53.467 INFO:teuthology.orchestra.run.smithi153.stdout:45 2024-03-30T13:08:53.467 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-03-30T13:08:53.467 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-03-30T13:08:53.516 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-03-30T13:08:53.530 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:08:53.575 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-03-30T13:08:53.576 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-03-30T13:08:53.576 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-03-30T13:08:53.576 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-03-30T13:08:53.576 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-03-30T13:08:53.576 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-03-30T13:08:53.576 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-03-30T13:08:53.576 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-03-30T13:08:53.576 INFO:teuthology.orchestra.run.smithi153.stdout:/run/lock 2024-03-30T13:08:53.576 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-03-30T13:08:53.576 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-03-30T13:08:53.576 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-03-30T13:08:53.576 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/fs/nfsd 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/run/rpc_pipefs 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-4 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-5 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-6 2024-03-30T13:08:53.577 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-7 2024-03-30T13:08:53.578 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-03-30T13:08:53.578 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:53.578 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:53.578 INFO:teuthology.orchestra.run.smithi153.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-30T13:08:53.578 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:08:53.578 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:08:53.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:53.578 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-03-30T13:08:53.585 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi153.stderr:2024-03-30T13:08:53.581+0000 7f53ba92e580 -1 init, newargv = 0x55b2b8012750 newargc=15 2024-03-30T13:08:53.585 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi153.stderr:ceph-fuse[33018]: starting ceph client 2024-03-30T13:08:53.589 INFO:teuthology.orchestra.run.smithi153.stdout:45 2024-03-30T13:08:53.592 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi153.stderr:ceph-fuse[33018]: starting fuse 2024-03-30T13:08:54.691 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-03-30T13:08:54.706 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:08:54.730 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:08:54.733 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:08:54.752 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-03-30T13:08:54.752 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-03-30T13:08:54.752 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-03-30T13:08:54.752 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-03-30T13:08:54.752 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-03-30T13:08:54.752 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-03-30T13:08:54.752 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-03-30T13:08:54.752 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-03-30T13:08:54.752 INFO:teuthology.orchestra.run.smithi153.stdout:/run/lock 2024-03-30T13:08:54.752 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-03-30T13:08:54.752 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-03-30T13:08:54.752 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/fs/nfsd 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/run/rpc_pipefs 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-4 2024-03-30T13:08:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-5 2024-03-30T13:08:54.754 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-6 2024-03-30T13:08:54.754 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-7 2024-03-30T13:08:54.754 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-03-30T13:08:54.754 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:54.754 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:08:54.754 INFO:teuthology.orchestra.run.smithi153.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-30T13:08:54.754 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:08:54.754 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:08:54.754 INFO:teuthology.orchestra.run.smithi153.stdout:/home/ubuntu/cephtest/mnt.3 2024-03-30T13:08:54.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:54.755 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-03-30T13:08:54.838 INFO:teuthology.orchestra.run.smithi153.stdout:45 2024-03-30T13:08:54.838 INFO:teuthology.orchestra.run.smithi153.stdout:46 2024-03-30T13:08:54.838 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> sudo stdin-killer -- python3 -c ' 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-03-30T13:08:54.839 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.3")) 2024-03-30T13:08:54.840 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-03-30T13:08:54.964 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.3.33018.asok 2024-03-30T13:08:54.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:08:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:08:54.975 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.33018.asok 2024-03-30T13:08:54.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:54.975 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.33018.asok status 2024-03-30T13:08:55.185 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-30T13:08:55.185 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-03-30T13:08:55.185 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "ac1710396f9f7c389fa4b407711bc5157a8c0bf7", 2024-03-30T13:08:55.185 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 19.0.0-2519-gac171039 (ac1710396f9f7c389fa4b407711bc5157a8c0bf7) squid (dev)", 2024-03-30T13:08:55.185 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "3", 2024-03-30T13:08:55.185 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-03-30T13:08:55.185 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-03-30T13:08:55.185 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "33018", 2024-03-30T13:08:55.185 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-03-30T13:08:55.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4681, 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 4681 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.2:0", 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2805906858 2024-03-30T13:08:55.186 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.2:0", 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2805906858 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.4681 192.168.0.2:0/2805906858", 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.2:0/2805906858", 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 6, 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 21, 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-03-30T13:08:55.187 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-03-30T13:08:55.188 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-03-30T13:08:55.188 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-30T13:08:55.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:55.198 DEBUG:teuthology.orchestra.run.smithi083:> stat --file-system '--printf=%T 2024-03-30T13:08:55.199 DEBUG:teuthology.orchestra.run.smithi083:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-30T13:08:55.206 INFO:teuthology.orchestra.run.smithi083.stdout:fuseblk 2024-03-30T13:08:55.206 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-30T13:08:55.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:55.206 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-30T13:08:55.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:55.265 DEBUG:teuthology.orchestra.run.smithi083:> stat --file-system '--printf=%T 2024-03-30T13:08:55.265 DEBUG:teuthology.orchestra.run.smithi083:> ' -- /home/ubuntu/cephtest/mnt.2 2024-03-30T13:08:55.315 INFO:teuthology.orchestra.run.smithi083.stdout:fuseblk 2024-03-30T13:08:55.316 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-03-30T13:08:55.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:55.316 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-30T13:08:55.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:55.376 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-03-30T13:08:55.376 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-30T13:08:55.382 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-03-30T13:08:55.382 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-30T13:08:55.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:55.383 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-30T13:08:55.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:55.440 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-03-30T13:08:55.440 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.3 2024-03-30T13:08:55.491 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-03-30T13:08:55.492 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-03-30T13:08:55.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:08:55.492 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-30T13:08:55.551 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-30T13:08:55.567 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:55.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f3838640 1 Processor -- start 2024-03-30T13:08:55.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f3838640 1 -- start start 2024-03-30T13:08:55.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f3838640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec072d20 0x7f79ec0af060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:55.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f3838640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ec15edd0 con 0x7f79ec0735d0 2024-03-30T13:08:55.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f3838640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ec0b3c40 con 0x7f79ec0739b0 2024-03-30T13:08:55.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f3838640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f79ec0b3f20 con 0x7f79ec072d20 2024-03-30T13:08:55.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f15d4640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f79ec0735d0 0x7f79ec06d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60042/0 (socket says 172.21.15.83:60042) 2024-03-30T13:08:55.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f15d4640 1 -- 172.21.15.83:0/663488568 learned_addr learned my addr 172.21.15.83:0/663488568 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:55.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f1dd5640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec072d20 0x7f79ec0af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:55.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 40844389 0 0) 0x7f79e8001120 con 0x7f79ec0735d0 2024-03-30T13:08:55.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79d8003530 con 0x7f79ec0735d0 2024-03-30T13:08:55.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3708151669 0 0) 0x7f79d8003530 con 0x7f79ec0735d0 2024-03-30T13:08:55.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec072d20 msgr2=0x7f79ec0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:55.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec072d20 0x7f79ec0af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:55.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 >> v1:172.21.15.153:6789/0 conn(0x7f79ec0739b0 legacy=0x7f79ec0b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:55.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec0b4200 con 0x7f79ec0735d0 2024-03-30T13:08:55.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f79e8001850 con 0x7f79ec0735d0 2024-03-30T13:08:55.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 >> v1:172.21.15.83:6789/0 conn(0x7f79ec0735d0 legacy=0x7f79ec06d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:55.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec072d20 0x7f79d80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:55.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79d8003f70 0x7f79d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:55.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79d8004d50 0x7f79d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:55.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec0b3f20 con 0x7f79d8004d50 2024-03-30T13:08:55.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f79d800bab0 con 0x7f79d8003f70 2024-03-30T13:08:55.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f79d800bcb0 con 0x7f79ec072d20 2024-03-30T13:08:55.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f1dd5640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79d8004d50 0x7f79d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:55.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f1dd5640 1 -- 172.21.15.83:0/663488568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec072d20 msgr2=0x7f79d80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:55.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f15d4640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec072d20 0x7f79d80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:55.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f0dd3640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79d8003f70 0x7f79d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:55.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f1dd5640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec072d20 0x7f79d80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:55.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f1dd5640 1 -- 172.21.15.83:0/663488568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79d8003f70 msgr2=0x7f79d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:55.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f1dd5640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79d8003f70 0x7f79d8004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:55.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f1dd5640 1 -- 172.21.15.83:0/663488568 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d8003530 con 0x7f79d8004d50 2024-03-30T13:08:55.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.696+0000 7f79f15d4640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec072d20 0x7f79d80039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:55.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f1dd5640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79d8004d50 0x7f79d80051d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009f90 tx=0x7f79e401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29ffbaac00aa8f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:55.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40b2070 con 0x7f79d8004d50 2024-03-30T13:08:55.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e40a5c50 con 0x7f79d8004d50 2024-03-30T13:08:55.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79e3fff640 1 -- 172.21.15.83:0/663488568 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e4009c10 con 0x7f79d8004d50 2024-03-30T13:08:55.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 -- 172.21.15.83:0/663488568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79d8004d50 msgr2=0x7f79d80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:55.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 --2- 172.21.15.83:0/663488568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79d8004d50 0x7f79d80051d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009f90 tx=0x7f79e401cc40 comp rx=0 tx=0).stop 2024-03-30T13:08:55.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f1dd5640 1 -- 172.21.15.83:0/663488568 reap_dead start 2024-03-30T13:08:55.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 -- 172.21.15.83:0/663488568 shutdown_connections 2024-03-30T13:08:55.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 -- 172.21.15.83:0/663488568 >> 172.21.15.83:0/663488568 conn(0x7f79ec0b1d60 msgr2=0x7f79ec0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:55.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 -- 172.21.15.83:0/663488568 shutdown_connections 2024-03-30T13:08:55.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 -- 172.21.15.83:0/663488568 wait complete. 2024-03-30T13:08:55.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 Processor -- start 2024-03-30T13:08:55.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 -- start start 2024-03-30T13:08:55.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79ec099a00 0x7f79ec0b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:55.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec0b28c0 0x7f79ec0b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:55.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79ec159090 0x7f79ec0ad580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec06deb0 con 0x7f79ec159090 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec0b47c0 con 0x7f79ec099a00 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f3838640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f79ec06e030 con 0x7f79ec0b28c0 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f1dd5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79ec159090 0x7f79ec0ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f1dd5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79ec159090 0x7f79ec0ad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48134/0 (socket says 172.21.15.83:48134) 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f1dd5640 1 -- 172.21.15.83:0/215271943 learned_addr learned my addr 172.21.15.83:0/215271943 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f0dd3640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec0b28c0 0x7f79ec0b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f15d4640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79ec099a00 0x7f79ec0b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f1dd5640 1 -- 172.21.15.83:0/215271943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec0b28c0 msgr2=0x7f79ec0b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f1dd5640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec0b28c0 0x7f79ec0b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f1dd5640 1 -- 172.21.15.83:0/215271943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79ec099a00 msgr2=0x7f79ec0b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f1dd5640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79ec099a00 0x7f79ec0b11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:55.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f1dd5640 1 -- 172.21.15.83:0/215271943 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec157ee0 con 0x7f79ec159090 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.700+0000 7f79f0dd3640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec0b28c0 0x7f79ec0b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.704+0000 7f79f1dd5640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79ec159090 0x7f79ec0ad580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009f90 tx=0x7f79e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.704+0000 7f79e1ffb640 1 -- 172.21.15.83:0/215271943 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40bb070 con 0x7f79ec159090 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.704+0000 7f79e1ffb640 1 -- 172.21.15.83:0/215271943 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e40a5a50 con 0x7f79ec159090 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.704+0000 7f79f3838640 1 -- 172.21.15.83:0/215271943 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ec1e9e20 con 0x7f79ec159090 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.704+0000 7f79e1ffb640 1 -- 172.21.15.83:0/215271943 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40b2040 con 0x7f79ec159090 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.704+0000 7f79f3838640 1 -- 172.21.15.83:0/215271943 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ec15f8e0 con 0x7f79ec159090 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.704+0000 7f79f3838640 1 -- 172.21.15.83:0/215271943 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ec0ae6b0 con 0x7f79ec159090 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.704+0000 7f79e1ffb640 1 -- 172.21.15.83:0/215271943 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f79e40be070 con 0x7f79ec159090 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.704+0000 7f79e1ffb640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f79d0067ff0 0x7f79d006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.704+0000 7f79e1ffb640 1 -- 172.21.15.83:0/215271943 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f79e41200f0 con 0x7f79ec159090 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.704+0000 7f79f15d4640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f79d0067ff0 0x7f79d006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:55.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.704+0000 7f79f15d4640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f79d0067ff0 0x7f79d006a4b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79e80019c0 tx=0x7f79e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:55.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.708+0000 7f79e1ffb640 1 -- 172.21.15.83:0/215271943 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f79e4016950 con 0x7f79ec159090 2024-03-30T13:08:55.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.868+0000 7f79f3838640 1 -- 172.21.15.83:0/215271943 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79ec0686c0 con 0x7f79ec159090 2024-03-30T13:08:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79e1ffb640 1 -- 172.21.15.83:0/215271943 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f79e40f02e0 con 0x7f79ec159090 2024-03-30T13:08:55.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:55.878 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:55.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79f3838640 1 -- 172.21.15.83:0/215271943 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f79d0067ff0 msgr2=0x7f79d006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:55.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79f3838640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f79d0067ff0 0x7f79d006a4b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79e80019c0 tx=0x7f79e8009040 comp rx=0 tx=0).stop 2024-03-30T13:08:55.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79f3838640 1 -- 172.21.15.83:0/215271943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79ec159090 msgr2=0x7f79ec0ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:55.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79f3838640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79ec159090 0x7f79ec0ad580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009f90 tx=0x7f79e4009750 comp rx=0 tx=0).stop 2024-03-30T13:08:55.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79f3838640 1 -- 172.21.15.83:0/215271943 shutdown_connections 2024-03-30T13:08:55.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79f3838640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f79d0067ff0 0x7f79d006a4b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:55.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79f3838640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79ec159090 0x7f79ec0ad580 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:55.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79f3838640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79ec0b28c0 0x7f79ec0b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:55.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79f3838640 1 --2- 172.21.15.83:0/215271943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79ec099a00 0x7f79ec0b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:55.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79f3838640 1 -- 172.21.15.83:0/215271943 >> 172.21.15.83:0/215271943 conn(0x7f79ec0b1d60 msgr2=0x7f79ec0b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:55.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79f3838640 1 -- 172.21.15.83:0/215271943 shutdown_connections 2024-03-30T13:08:55.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:55.872+0000 7f79f3838640 1 -- 172.21.15.83:0/215271943 wait complete. 2024-03-30T13:08:55.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:08:55.899 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:08:56.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbaca45d640 1 Processor -- start 2024-03-30T13:08:56.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbaca45d640 1 -- start start 2024-03-30T13:08:56.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbaca45d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbac415d3d0 0x7fbac4166ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbaca45d640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbac40ae040 con 0x7fbac40b4680 2024-03-30T13:08:56.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbaca45d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbac40ae320 con 0x7fbac415c8e0 2024-03-30T13:08:56.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbaca45d640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fbac40b31e0 con 0x7fbac415d3d0 2024-03-30T13:08:56.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbac89fa640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbac415d3d0 0x7fbac4166ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbac37fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fbac40b4680 0x7fbac415ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60044/0 (socket says 172.21.15.83:60044) 2024-03-30T13:08:56.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbac89fa640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbac415d3d0 0x7fbac4166ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48140/0 (socket says 172.21.15.83:48140) 2024-03-30T13:08:56.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbac37fe640 1 -- 172.21.15.83:0/2923473936 learned_addr learned my addr 172.21.15.83:0/2923473936 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:56.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbac89fa640 1 -- 172.21.15.83:0/2923473936 >> v1:172.21.15.153:6789/0 conn(0x7fbac415c8e0 legacy=0x7fbac40ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:56.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbac2ffd640 1 -- 172.21.15.83:0/2923473936 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2324973447 0 0) 0x7fbac40ae040 con 0x7fbac40b4680 2024-03-30T13:08:56.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbac89fa640 1 -- 172.21.15.83:0/2923473936 >> v1:172.21.15.83:6789/0 conn(0x7fbac40b4680 legacy=0x7fbac415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.004+0000 7fbac89fa640 1 -- 172.21.15.83:0/2923473936 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac40ae600 con 0x7fbac415d3d0 2024-03-30T13:08:56.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbac89fa640 1 --2- 172.21.15.83:0/2923473936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbac415d3d0 0x7fbac4166ea0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbabc009d90 tx=0x7fbabc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf305d45a3f321d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:56.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbac2ffd640 1 -- 172.21.15.83:0/2923473936 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc0b2070 con 0x7fbac415d3d0 2024-03-30T13:08:56.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbac2ffd640 1 -- 172.21.15.83:0/2923473936 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbabc0a58b0 con 0x7fbac415d3d0 2024-03-30T13:08:56.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbac2ffd640 1 -- 172.21.15.83:0/2923473936 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc0a5c80 con 0x7fbac415d3d0 2024-03-30T13:08:56.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbaca45d640 1 -- 172.21.15.83:0/2923473936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbac415d3d0 msgr2=0x7fbac4166ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbaca45d640 1 --2- 172.21.15.83:0/2923473936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbac415d3d0 0x7fbac4166ea0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbabc009d90 tx=0x7fbabc01c8e0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbaca45d640 1 -- 172.21.15.83:0/2923473936 shutdown_connections 2024-03-30T13:08:56.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbaca45d640 1 --2- 172.21.15.83:0/2923473936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbac415d3d0 0x7fbac4166ea0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbaca45d640 1 -- 172.21.15.83:0/2923473936 >> 172.21.15.83:0/2923473936 conn(0x7fbac406b660 msgr2=0x7fbac406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:56.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbaca45d640 1 -- 172.21.15.83:0/2923473936 shutdown_connections 2024-03-30T13:08:56.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbaca45d640 1 -- 172.21.15.83:0/2923473936 wait complete. 2024-03-30T13:08:56.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbaca45d640 1 Processor -- start 2024-03-30T13:08:56.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.008+0000 7fbaca45d640 1 -- start start 2024-03-30T13:08:56.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbaca45d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac40b4680 0x7fbac415daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbaca45d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac415c8e0 0x7fbac4145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbaca45d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbac415d3d0 0x7fbac415e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbaca45d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbac4169d80 con 0x7fbac415d3d0 2024-03-30T13:08:56.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbaca45d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbac4169c00 con 0x7fbac415c8e0 2024-03-30T13:08:56.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbaca45d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbac4169f00 con 0x7fbac40b4680 2024-03-30T13:08:56.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac89fa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbac415d3d0 0x7fbac415e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac89fa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbac415d3d0 0x7fbac415e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48148/0 (socket says 172.21.15.83:48148) 2024-03-30T13:08:56.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac89fa640 1 -- 172.21.15.83:0/2208479504 learned_addr learned my addr 172.21.15.83:0/2208479504 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:56.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac3fff640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac40b4680 0x7fbac415daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac37fe640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac415c8e0 0x7fbac4145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac89fa640 1 -- 172.21.15.83:0/2208479504 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac40b4680 msgr2=0x7fbac415daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac89fa640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac40b4680 0x7fbac415daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac89fa640 1 -- 172.21.15.83:0/2208479504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac415c8e0 msgr2=0x7fbac4145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac89fa640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac415c8e0 0x7fbac4145810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac89fa640 1 -- 172.21.15.83:0/2208479504 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac4146150 con 0x7fbac415d3d0 2024-03-30T13:08:56.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac37fe640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac415c8e0 0x7fbac4145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:56.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac89fa640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbac415d3d0 0x7fbac415e420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0194f0 tx=0x7fbabc019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:56.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac0ff9640 1 -- 172.21.15.83:0/2208479504 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc0b2050 con 0x7fbac415d3d0 2024-03-30T13:08:56.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac0ff9640 1 -- 172.21.15.83:0/2208479504 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbabc0be070 con 0x7fbac415d3d0 2024-03-30T13:08:56.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbaca45d640 1 -- 172.21.15.83:0/2208479504 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac4146430 con 0x7fbac415d3d0 2024-03-30T13:08:56.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac0ff9640 1 -- 172.21.15.83:0/2208479504 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc0ada90 con 0x7fbac415d3d0 2024-03-30T13:08:56.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbaca45d640 1 -- 172.21.15.83:0/2208479504 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac41469f0 con 0x7fbac415d3d0 2024-03-30T13:08:56.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbaca45d640 1 -- 172.21.15.83:0/2208479504 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac404f9e0 con 0x7fbac415d3d0 2024-03-30T13:08:56.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac0ff9640 1 -- 172.21.15.83:0/2208479504 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fbabc0adc30 con 0x7fbac415d3d0 2024-03-30T13:08:56.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac0ff9640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbab0067fc0 0x7fbab006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac3fff640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbab0067fc0 0x7fbab006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac0ff9640 1 -- 172.21.15.83:0/2208479504 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbabc1216e0 con 0x7fbac415d3d0 2024-03-30T13:08:56.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.012+0000 7fbac3fff640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbab0067fc0 0x7fbab006a480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbac4152f90 tx=0x7fbab4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:56.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.016+0000 7fbac0ff9640 1 -- 172.21.15.83:0/2208479504 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fbabc016560 con 0x7fbac415d3d0 2024-03-30T13:08:56.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.168+0000 7fbaca45d640 1 -- 172.21.15.83:0/2208479504 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbac414a0b0 con 0x7fbac415d3d0 2024-03-30T13:08:56.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.168+0000 7fbac0ff9640 1 -- 172.21.15.83:0/2208479504 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fbabc0f1f20 con 0x7fbac415d3d0 2024-03-30T13:08:56.176 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:08:56.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.172+0000 7fbaca45d640 1 -- 172.21.15.83:0/2208479504 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbab0067fc0 msgr2=0x7fbab006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.172+0000 7fbaca45d640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbab0067fc0 0x7fbab006a480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbac4152f90 tx=0x7fbab4009040 comp rx=0 tx=0).stop 2024-03-30T13:08:56.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.172+0000 7fbaca45d640 1 -- 172.21.15.83:0/2208479504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbac415d3d0 msgr2=0x7fbac415e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.172+0000 7fbaca45d640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbac415d3d0 0x7fbac415e420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0194f0 tx=0x7fbabc019680 comp rx=0 tx=0).stop 2024-03-30T13:08:56.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.172+0000 7fbaca45d640 1 -- 172.21.15.83:0/2208479504 shutdown_connections 2024-03-30T13:08:56.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.172+0000 7fbaca45d640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbab0067fc0 0x7fbab006a480 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.172+0000 7fbaca45d640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbac415d3d0 0x7fbac415e420 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.172+0000 7fbaca45d640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac415c8e0 0x7fbac4145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.172+0000 7fbaca45d640 1 --2- 172.21.15.83:0/2208479504 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac40b4680 0x7fbac415daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.172+0000 7fbaca45d640 1 -- 172.21.15.83:0/2208479504 >> 172.21.15.83:0/2208479504 conn(0x7fbac406b660 msgr2=0x7fbac4149320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:56.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.172+0000 7fbaca45d640 1 -- 172.21.15.83:0/2208479504 shutdown_connections 2024-03-30T13:08:56.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.172+0000 7fbaca45d640 1 -- 172.21.15.83:0/2208479504 wait complete. 2024-03-30T13:08:56.193 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:08:56.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a7940640 1 Processor -- start 2024-03-30T13:08:56.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a7940640 1 -- start start 2024-03-30T13:08:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a7940640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a0161bc0 0x7fb2a00b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a7940640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2a006ede0 0x7fb2a00ae500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a7940640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a00add40 con 0x7fb2a00721d0 2024-03-30T13:08:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a7940640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb2a00b4440 con 0x7fb2a006ede0 2024-03-30T13:08:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a7940640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a00b4720 con 0x7fb2a0161bc0 2024-03-30T13:08:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a56dc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a0161bc0 0x7fb2a00b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a56dc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a0161bc0 0x7fb2a00b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:40280/0 (socket says 172.21.15.83:40280) 2024-03-30T13:08:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a56dc640 1 -- 172.21.15.83:0/1987926370 learned_addr learned my addr 172.21.15.83:0/1987926370 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a5edd640 1 --2- 172.21.15.83:0/1987926370 >> v2:172.21.15.153:3300/0 conn(0x7fb2a006ede0 0x7fb2a00ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a56dc640 1 -- 172.21.15.83:0/1987926370 >> v2:172.21.15.153:3300/0 conn(0x7fb2a006ede0 msgr2=0x7fb2a00ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a56dc640 1 --2- 172.21.15.83:0/1987926370 >> v2:172.21.15.153:3300/0 conn(0x7fb2a006ede0 0x7fb2a00ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a56dc640 1 -- 172.21.15.83:0/1987926370 >> v1:172.21.15.153:6789/0 conn(0x7fb2a00721d0 legacy=0x7fb2a006e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.308+0000 7fb2a56dc640 1 -- 172.21.15.83:0/1987926370 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a00b4a00 con 0x7fb2a0161bc0 2024-03-30T13:08:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a56dc640 1 --2- 172.21.15.83:0/1987926370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a0161bc0 0x7fb2a00b3bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009870 tx=0x7fb29c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76e2cd586ca7f7d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb293fff640 1 -- 172.21.15.83:0/1987926370 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0b2070 con 0x7fb2a0161bc0 2024-03-30T13:08:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb293fff640 1 -- 172.21.15.83:0/1987926370 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29c0a9070 con 0x7fb2a0161bc0 2024-03-30T13:08:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb293fff640 1 -- 172.21.15.83:0/1987926370 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0ad880 con 0x7fb2a0161bc0 2024-03-30T13:08:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 -- 172.21.15.83:0/1987926370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a0161bc0 msgr2=0x7fb2a00b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 --2- 172.21.15.83:0/1987926370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a0161bc0 0x7fb2a00b3bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009870 tx=0x7fb29c01c560 comp rx=0 tx=0).stop 2024-03-30T13:08:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 -- 172.21.15.83:0/1987926370 shutdown_connections 2024-03-30T13:08:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 --2- 172.21.15.83:0/1987926370 >> v2:172.21.15.153:3300/0 conn(0x7fb2a006ede0 0x7fb2a00ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 --2- 172.21.15.83:0/1987926370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a0161bc0 0x7fb2a00b3bf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 -- 172.21.15.83:0/1987926370 >> 172.21.15.83:0/1987926370 conn(0x7fb2a006b660 msgr2=0x7fb2a006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 -- 172.21.15.83:0/1987926370 shutdown_connections 2024-03-30T13:08:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 -- 172.21.15.83:0/1987926370 wait complete. 2024-03-30T13:08:56.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 Processor -- start 2024-03-30T13:08:56.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 -- start start 2024-03-30T13:08:56.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a006ede0 0x7fb2a0155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a00721d0 0x7fb2a0158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2a0161bc0 0x7fb2a014e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a00af5e0 con 0x7fb2a0161bc0 2024-03-30T13:08:56.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a00af460 con 0x7fb2a006ede0 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.312+0000 7fb2a7940640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a00af760 con 0x7fb2a00721d0 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a5edd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2a0161bc0 0x7fb2a014e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a5edd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2a0161bc0 0x7fb2a014e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48150/0 (socket says 172.21.15.83:48150) 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a5edd640 1 -- 172.21.15.83:0/1605887443 learned_addr learned my addr 172.21.15.83:0/1605887443 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a4edb640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a00721d0 0x7fb2a0158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a56dc640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a006ede0 0x7fb2a0155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a5edd640 1 -- 172.21.15.83:0/1605887443 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a00721d0 msgr2=0x7fb2a0158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a5edd640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a00721d0 0x7fb2a0158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a5edd640 1 -- 172.21.15.83:0/1605887443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a006ede0 msgr2=0x7fb2a0155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a5edd640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a006ede0 0x7fb2a0155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a5edd640 1 -- 172.21.15.83:0/1605887443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a01542f0 con 0x7fb2a0161bc0 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a56dc640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a006ede0 0x7fb2a0155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:56.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a5edd640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2a0161bc0 0x7fb2a014e610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb298009d30 tx=0x7fb29800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:56.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb291ffb640 1 -- 172.21.15.83:0/1605887443 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298018020 con 0x7fb2a0161bc0 2024-03-30T13:08:56.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a7940640 1 -- 172.21.15.83:0/1605887443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a0154590 con 0x7fb2a0161bc0 2024-03-30T13:08:56.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb291ffb640 1 -- 172.21.15.83:0/1605887443 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb298014480 con 0x7fb2a0161bc0 2024-03-30T13:08:56.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb291ffb640 1 -- 172.21.15.83:0/1605887443 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298014870 con 0x7fb2a0161bc0 2024-03-30T13:08:56.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a7940640 1 -- 172.21.15.83:0/1605887443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a0154b50 con 0x7fb2a0161bc0 2024-03-30T13:08:56.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a7940640 1 -- 172.21.15.83:0/1605887443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a009e540 con 0x7fb2a0161bc0 2024-03-30T13:08:56.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb291ffb640 1 -- 172.21.15.83:0/1605887443 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb29801b020 con 0x7fb2a0161bc0 2024-03-30T13:08:56.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb291ffb640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb284067fc0 0x7fb28406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb291ffb640 1 -- 172.21.15.83:0/1605887443 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb298086ea0 con 0x7fb2a0161bc0 2024-03-30T13:08:56.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a56dc640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb284067fc0 0x7fb28406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.316+0000 7fb2a56dc640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb284067fc0 0x7fb28406a480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0af000 tx=0x7fb29c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:56.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.320+0000 7fb291ffb640 1 -- 172.21.15.83:0/1605887443 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb298022070 con 0x7fb2a0161bc0 2024-03-30T13:08:56.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.484+0000 7fb2a7940640 1 -- 172.21.15.83:0/1605887443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb2a004f9e0 con 0x7fb2a0161bc0 2024-03-30T13:08:56.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.484+0000 7fb291ffb640 1 -- 172.21.15.83:0/1605887443 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fb298010040 con 0x7fb2a0161bc0 2024-03-30T13:08:56.492 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:08:56.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.488+0000 7fb2a7940640 1 -- 172.21.15.83:0/1605887443 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb284067fc0 msgr2=0x7fb28406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.488+0000 7fb2a7940640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb284067fc0 0x7fb28406a480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0af000 tx=0x7fb29c0a7000 comp rx=0 tx=0).stop 2024-03-30T13:08:56.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.488+0000 7fb2a7940640 1 -- 172.21.15.83:0/1605887443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2a0161bc0 msgr2=0x7fb2a014e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.488+0000 7fb2a7940640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2a0161bc0 0x7fb2a014e610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb298009d30 tx=0x7fb29800c490 comp rx=0 tx=0).stop 2024-03-30T13:08:56.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.488+0000 7fb2a7940640 1 -- 172.21.15.83:0/1605887443 shutdown_connections 2024-03-30T13:08:56.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.488+0000 7fb2a7940640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb284067fc0 0x7fb28406a480 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.488+0000 7fb2a7940640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2a0161bc0 0x7fb2a014e610 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.488+0000 7fb2a7940640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a00721d0 0x7fb2a0158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.488+0000 7fb2a7940640 1 --2- 172.21.15.83:0/1605887443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a006ede0 0x7fb2a0155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.488+0000 7fb2a7940640 1 -- 172.21.15.83:0/1605887443 >> 172.21.15.83:0/1605887443 conn(0x7fb2a006b660 msgr2=0x7fb2a0156230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:56.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.488+0000 7fb2a7940640 1 -- 172.21.15.83:0/1605887443 shutdown_connections 2024-03-30T13:08:56.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.488+0000 7fb2a7940640 1 -- 172.21.15.83:0/1605887443 wait complete. 2024-03-30T13:08:56.511 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:08:56.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fd0075f6640 1 Processor -- start 2024-03-30T13:08:56.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fd0075f6640 1 -- start start 2024-03-30T13:08:56.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fd0075f6640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd0000b4d90 0x7fd000072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fd0075f6640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd000071830 con 0x7fd00015a8b0 2024-03-30T13:08:56.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fd0075f6640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd000071ad0 con 0x7fd000073630 2024-03-30T13:08:56.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fd0075f6640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fd000071db0 con 0x7fd0000b4d90 2024-03-30T13:08:56.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fd005392640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd00015a8b0 0x7fd000072f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60052/0 (socket says 172.21.15.83:60052) 2024-03-30T13:08:56.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fd005392640 1 -- 172.21.15.83:0/1398267154 learned_addr learned my addr 172.21.15.83:0/1398267154 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:56.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fd005b93640 1 --2- 172.21.15.83:0/1398267154 >> v2:172.21.15.83:3300/0 conn(0x7fd0000b4d90 0x7fd000072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fcff7fff640 1 -- 172.21.15.83:0/1398267154 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731815067 0 0) 0x7fd000071830 con 0x7fd00015a8b0 2024-03-30T13:08:56.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fd005b93640 1 -- 172.21.15.83:0/1398267154 >> v1:172.21.15.153:6789/0 conn(0x7fd000073630 legacy=0x7fd0000b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:56.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fd005b93640 1 -- 172.21.15.83:0/1398267154 >> v1:172.21.15.83:6789/0 conn(0x7fd00015a8b0 legacy=0x7fd000072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.624+0000 7fd005b93640 1 -- 172.21.15.83:0/1398267154 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd000072090 con 0x7fd0000b4d90 2024-03-30T13:08:56.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd005b93640 1 --2- 172.21.15.83:0/1398267154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0000b4d90 0x7fd000072890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009d90 tx=0x7fcff801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79d2bfa60f25d62 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:56.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fcff7fff640 1 -- 172.21.15.83:0/1398267154 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff80b2070 con 0x7fd0000b4d90 2024-03-30T13:08:56.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fcff7fff640 1 -- 172.21.15.83:0/1398267154 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff80a58b0 con 0x7fd0000b4d90 2024-03-30T13:08:56.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fcff7fff640 1 -- 172.21.15.83:0/1398267154 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff80a5c80 con 0x7fd0000b4d90 2024-03-30T13:08:56.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 -- 172.21.15.83:0/1398267154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0000b4d90 msgr2=0x7fd000072890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 --2- 172.21.15.83:0/1398267154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0000b4d90 0x7fd000072890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009d90 tx=0x7fcff801c940 comp rx=0 tx=0).stop 2024-03-30T13:08:56.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 -- 172.21.15.83:0/1398267154 shutdown_connections 2024-03-30T13:08:56.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 --2- 172.21.15.83:0/1398267154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0000b4d90 0x7fd000072890 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 -- 172.21.15.83:0/1398267154 >> 172.21.15.83:0/1398267154 conn(0x7fd00006b660 msgr2=0x7fd00006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:56.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 -- 172.21.15.83:0/1398267154 shutdown_connections 2024-03-30T13:08:56.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 -- 172.21.15.83:0/1398267154 wait complete. 2024-03-30T13:08:56.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 Processor -- start 2024-03-30T13:08:56.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 -- start start 2024-03-30T13:08:56.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd000073630 0x7fd00014c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0000b4d90 0x7fd0001f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd00015a8b0 0x7fd0001f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd000168d50 con 0x7fd00015a8b0 2024-03-30T13:08:56.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd000168bd0 con 0x7fd0000b4d90 2024-03-30T13:08:56.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd0075f6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd000168ed0 con 0x7fd000073630 2024-03-30T13:08:56.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd005b93640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd00015a8b0 0x7fd0001f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd005b93640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd00015a8b0 0x7fd0001f57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48178/0 (socket says 172.21.15.83:48178) 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.628+0000 7fd005b93640 1 -- 172.21.15.83:0/217418983 learned_addr learned my addr 172.21.15.83:0/217418983 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd005392640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd000073630 0x7fd00014c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd004b91640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0000b4d90 0x7fd0001f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd005b93640 1 -- 172.21.15.83:0/217418983 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd000073630 msgr2=0x7fd00014c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd005b93640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd000073630 0x7fd00014c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd005b93640 1 -- 172.21.15.83:0/217418983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0000b4d90 msgr2=0x7fd0001f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd005b93640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0000b4d90 0x7fd0001f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd005b93640 1 -- 172.21.15.83:0/217418983 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0001f5e30 con 0x7fd00015a8b0 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd004b91640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0000b4d90 0x7fd0001f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd005b93640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd00015a8b0 0x7fd0001f57c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcff80b0040 tx=0x7fcff80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fcff5ffb640 1 -- 172.21.15.83:0/217418983 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff80b2040 con 0x7fd00015a8b0 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fcff5ffb640 1 -- 172.21.15.83:0/217418983 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff80bf070 con 0x7fd00015a8b0 2024-03-30T13:08:56.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd0075f6640 1 -- 172.21.15.83:0/217418983 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0001f6110 con 0x7fd00015a8b0 2024-03-30T13:08:56.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fcff5ffb640 1 -- 172.21.15.83:0/217418983 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff80ad900 con 0x7fd00015a8b0 2024-03-30T13:08:56.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd0075f6640 1 -- 172.21.15.83:0/217418983 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0001f66d0 con 0x7fd00015a8b0 2024-03-30T13:08:56.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd0075f6640 1 -- 172.21.15.83:0/217418983 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd00009e540 con 0x7fd00015a8b0 2024-03-30T13:08:56.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fcff5ffb640 1 -- 172.21.15.83:0/217418983 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fcff80adaa0 con 0x7fd00015a8b0 2024-03-30T13:08:56.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fcff5ffb640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcfe4067fc0 0x7fcfe406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fcff5ffb640 1 -- 172.21.15.83:0/217418983 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcff8121760 con 0x7fd00015a8b0 2024-03-30T13:08:56.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd005392640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcfe4067fc0 0x7fcfe406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.632+0000 7fd005392640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcfe4067fc0 0x7fcfe406a480 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcff0000f70 tx=0x7fcff0007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:56.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.636+0000 7fcff5ffb640 1 -- 172.21.15.83:0/217418983 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fcff8016560 con 0x7fd00015a8b0 2024-03-30T13:08:56.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.796+0000 7fd0075f6640 1 -- 172.21.15.83:0/217418983 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd00004f9e0 con 0x7fd00015a8b0 2024-03-30T13:08:56.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.796+0000 7fcff5ffb640 1 -- 172.21.15.83:0/217418983 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fcff80f2060 con 0x7fd00015a8b0 2024-03-30T13:08:56.804 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:08:56.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.800+0000 7fd0075f6640 1 -- 172.21.15.83:0/217418983 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcfe4067fc0 msgr2=0x7fcfe406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.800+0000 7fd0075f6640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcfe4067fc0 0x7fcfe406a480 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcff0000f70 tx=0x7fcff0007d10 comp rx=0 tx=0).stop 2024-03-30T13:08:56.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.800+0000 7fd0075f6640 1 -- 172.21.15.83:0/217418983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd00015a8b0 msgr2=0x7fd0001f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.800+0000 7fd0075f6640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd00015a8b0 0x7fd0001f57c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcff80b0040 tx=0x7fcff80196e0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.800+0000 7fd0075f6640 1 -- 172.21.15.83:0/217418983 shutdown_connections 2024-03-30T13:08:56.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.800+0000 7fd0075f6640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcfe4067fc0 0x7fcfe406a480 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.800+0000 7fd0075f6640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd00015a8b0 0x7fd0001f57c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.800+0000 7fd0075f6640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0000b4d90 0x7fd0001f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.800+0000 7fd0075f6640 1 --2- 172.21.15.83:0/217418983 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd000073630 0x7fd00014c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.800+0000 7fd0075f6640 1 -- 172.21.15.83:0/217418983 >> 172.21.15.83:0/217418983 conn(0x7fd00006b660 msgr2=0x7fd00006e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:56.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.800+0000 7fd0075f6640 1 -- 172.21.15.83:0/217418983 shutdown_connections 2024-03-30T13:08:56.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.800+0000 7fd0075f6640 1 -- 172.21.15.83:0/217418983 wait complete. 2024-03-30T13:08:56.824 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:56.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f51a5085640 1 Processor -- start 2024-03-30T13:08:56.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f51a5085640 1 -- start start 2024-03-30T13:08:56.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f51a5085640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a015da30 0x7f51a0070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f51a5085640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f51a00cfe30 0x7f51a009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f51a5085640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51a00714a0 con 0x7f51a00717e0 2024-03-30T13:08:56.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f51a5085640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f51a009be10 con 0x7f51a00cfe30 2024-03-30T13:08:56.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f51a5085640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f51a0070ee0 con 0x7f51a015da30 2024-03-30T13:08:56.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f519e59c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f51a00cfe30 0x7f51a009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f519e59c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f51a00cfe30 0x7f51a009aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58550/0 (socket says 172.21.15.83:58550) 2024-03-30T13:08:56.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f519e59c640 1 -- 172.21.15.83:0/2108839388 learned_addr learned my addr 172.21.15.83:0/2108839388 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:56.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f519ed9d640 1 --2- 172.21.15.83:0/2108839388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a015da30 0x7f51a0070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f519e59c640 1 -- 172.21.15.83:0/2108839388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a015da30 msgr2=0x7f51a0070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:56.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f519e59c640 1 --2- 172.21.15.83:0/2108839388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a015da30 0x7f51a0070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f519e59c640 1 -- 172.21.15.83:0/2108839388 >> v1:172.21.15.153:6789/0 conn(0x7f51a00717e0 legacy=0x7f51a00ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.928+0000 7f519e59c640 1 -- 172.21.15.83:0/2108839388 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a00711c0 con 0x7f51a00cfe30 2024-03-30T13:08:56.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519e59c640 1 --2- 172.21.15.83:0/2108839388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51a00cfe30 0x7f51a009aa50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5188009870 tx=0x7f518801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198114f06d077ad5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:56.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519dd9b640 1 -- 172.21.15.83:0/2108839388 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51880b0070 con 0x7f51a00cfe30 2024-03-30T13:08:56.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519dd9b640 1 -- 172.21.15.83:0/2108839388 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51880ab600 con 0x7f51a00cfe30 2024-03-30T13:08:56.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519dd9b640 1 -- 172.21.15.83:0/2108839388 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51880ab9d0 con 0x7f51a00cfe30 2024-03-30T13:08:56.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 -- 172.21.15.83:0/2108839388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51a00cfe30 msgr2=0x7f51a009aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 --2- 172.21.15.83:0/2108839388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51a00cfe30 0x7f51a009aa50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5188009870 tx=0x7f518801c410 comp rx=0 tx=0).stop 2024-03-30T13:08:56.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 -- 172.21.15.83:0/2108839388 shutdown_connections 2024-03-30T13:08:56.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 --2- 172.21.15.83:0/2108839388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51a00cfe30 0x7f51a009aa50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 --2- 172.21.15.83:0/2108839388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a015da30 0x7f51a0070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 -- 172.21.15.83:0/2108839388 >> 172.21.15.83:0/2108839388 conn(0x7f51a00d2260 msgr2=0x7f51a00d2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:56.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 -- 172.21.15.83:0/2108839388 shutdown_connections 2024-03-30T13:08:56.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 -- 172.21.15.83:0/2108839388 wait complete. 2024-03-30T13:08:56.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 Processor -- start 2024-03-30T13:08:56.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 -- start start 2024-03-30T13:08:56.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51a00717e0 0x7f51a00c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a00cfe30 0x7f51a01539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51a015da30 0x7f51a00b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f51a009b3a0 con 0x7f51a015da30 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0169d30 con 0x7f51a00717e0 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f51a5085640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f51a0169eb0 con 0x7f51a00cfe30 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519f59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51a015da30 0x7f51a00b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519f59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51a015da30 0x7f51a00b6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58560/0 (socket says 172.21.15.83:58560) 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519f59e640 1 -- 172.21.15.83:0/4113844547 learned_addr learned my addr 172.21.15.83:0/4113844547 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519ed9d640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51a00717e0 0x7f51a00c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519e59c640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a00cfe30 0x7f51a01539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519f59e640 1 -- 172.21.15.83:0/4113844547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a00cfe30 msgr2=0x7f51a01539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519f59e640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a00cfe30 0x7f51a01539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519f59e640 1 -- 172.21.15.83:0/4113844547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51a00717e0 msgr2=0x7f51a00c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:56.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519f59e640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51a00717e0 0x7f51a00c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:56.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519f59e640 1 -- 172.21.15.83:0/4113844547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a00c7ec0 con 0x7f51a015da30 2024-03-30T13:08:56.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.932+0000 7f519f59e640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51a015da30 0x7f51a00b6690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f519000c370 tx=0x7f519000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:56.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.936+0000 7f51977fe640 1 -- 172.21.15.83:0/4113844547 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190005220 con 0x7f51a015da30 2024-03-30T13:08:56.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.936+0000 7f51977fe640 1 -- 172.21.15.83:0/4113844547 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51900053c0 con 0x7f51a015da30 2024-03-30T13:08:56.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.936+0000 7f51a5085640 1 -- 172.21.15.83:0/4113844547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a00b5bf0 con 0x7f51a015da30 2024-03-30T13:08:56.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.936+0000 7f51977fe640 1 -- 172.21.15.83:0/4113844547 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190007270 con 0x7f51a015da30 2024-03-30T13:08:56.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.936+0000 7f51a5085640 1 -- 172.21.15.83:0/4113844547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a00b5e90 con 0x7f51a015da30 2024-03-30T13:08:56.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.936+0000 7f51a5085640 1 -- 172.21.15.83:0/4113844547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a0068dd0 con 0x7f51a015da30 2024-03-30T13:08:56.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.936+0000 7f51977fe640 1 -- 172.21.15.83:0/4113844547 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5190019020 con 0x7f51a015da30 2024-03-30T13:08:56.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.936+0000 7f51977fe640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5180067fc0 0x7f518006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:56.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.936+0000 7f519ed9d640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5180067fc0 0x7f518006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:56.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.936+0000 7f51977fe640 1 -- 172.21.15.83:0/4113844547 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5190085740 con 0x7f51a015da30 2024-03-30T13:08:56.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.936+0000 7f519ed9d640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5180067fc0 0x7f518006a480 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f51a015cc70 tx=0x7f519800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:56.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:56.940+0000 7f51977fe640 1 -- 172.21.15.83:0/4113844547 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5190055f80 con 0x7f51a015da30 2024-03-30T13:08:57.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.088+0000 7f51a5085640 1 -- 172.21.15.83:0/4113844547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51a00d2e50 con 0x7f51a015da30 2024-03-30T13:08:57.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51977fe640 1 -- 172.21.15.83:0/4113844547 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f5190055880 con 0x7f51a015da30 2024-03-30T13:08:57.099 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:57.099 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:57.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51a5085640 1 -- 172.21.15.83:0/4113844547 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5180067fc0 msgr2=0x7f518006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51a5085640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5180067fc0 0x7f518006a480 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f51a015cc70 tx=0x7f519800b040 comp rx=0 tx=0).stop 2024-03-30T13:08:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51a5085640 1 -- 172.21.15.83:0/4113844547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51a015da30 msgr2=0x7f51a00b6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51a5085640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51a015da30 0x7f51a00b6690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f519000c370 tx=0x7f519000c830 comp rx=0 tx=0).stop 2024-03-30T13:08:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51a5085640 1 -- 172.21.15.83:0/4113844547 shutdown_connections 2024-03-30T13:08:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51a5085640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5180067fc0 0x7f518006a480 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51a5085640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51a015da30 0x7f51a00b6690 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51a5085640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a00cfe30 0x7f51a01539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51a5085640 1 --2- 172.21.15.83:0/4113844547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51a00717e0 0x7f51a00c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51a5085640 1 -- 172.21.15.83:0/4113844547 >> 172.21.15.83:0/4113844547 conn(0x7f51a00d2260 msgr2=0x7f51a0159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51a5085640 1 -- 172.21.15.83:0/4113844547 shutdown_connections 2024-03-30T13:08:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.092+0000 7f51a5085640 1 -- 172.21.15.83:0/4113844547 wait complete. 2024-03-30T13:08:57.116 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:08:57.117 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:08:57.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff18e053640 1 Processor -- start 2024-03-30T13:08:57.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff18e053640 1 -- start start 2024-03-30T13:08:57.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff18e053640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff18815c8e0 0x7ff1880ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff18e053640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1880b4680 0x7ff188165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff18e053640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1880ae040 con 0x7ff1880adac0 2024-03-30T13:08:57.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff18e053640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff1880b31e0 con 0x7ff18815c8e0 2024-03-30T13:08:57.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff18e053640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff1880ae320 con 0x7ff1880b4680 2024-03-30T13:08:57.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff1877fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff18815c8e0 0x7ff1880ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff187fff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1880b4680 0x7ff188165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff186ffd640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff1880adac0 0x7ff18815ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:38082/0 (socket says 172.21.15.83:38082) 2024-03-30T13:08:57.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff186ffd640 1 -- 172.21.15.83:0/1034254515 learned_addr learned my addr 172.21.15.83:0/1034254515 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:57.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff1877fe640 1 -- 172.21.15.83:0/1034254515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1880b4680 msgr2=0x7ff188165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:57.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff1877fe640 1 --2- 172.21.15.83:0/1034254515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1880b4680 0x7ff188165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff1877fe640 1 -- 172.21.15.83:0/1034254515 >> v1:172.21.15.153:6789/0 conn(0x7ff1880adac0 legacy=0x7ff18815ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff1877fe640 1 -- 172.21.15.83:0/1034254515 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1880ae600 con 0x7ff18815c8e0 2024-03-30T13:08:57.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.224+0000 7ff187fff640 1 --2- 172.21.15.83:0/1034254515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1880b4680 0x7ff188165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:57.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff1877fe640 1 --2- 172.21.15.83:0/1034254515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18815c8e0 0x7ff1880ad580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1780097c0 tx=0x7ff17801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31203bcd31ebe5f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:57.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff1867fc640 1 -- 172.21.15.83:0/1034254515 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1780b0070 con 0x7ff18815c8e0 2024-03-30T13:08:57.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff1867fc640 1 -- 172.21.15.83:0/1034254515 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1780ab600 con 0x7ff18815c8e0 2024-03-30T13:08:57.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff1867fc640 1 -- 172.21.15.83:0/1034254515 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1780ab9d0 con 0x7ff18815c8e0 2024-03-30T13:08:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff18e053640 1 -- 172.21.15.83:0/1034254515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18815c8e0 msgr2=0x7ff1880ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff18e053640 1 --2- 172.21.15.83:0/1034254515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18815c8e0 0x7ff1880ad580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1780097c0 tx=0x7ff17801c4a0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff18e053640 1 -- 172.21.15.83:0/1034254515 shutdown_connections 2024-03-30T13:08:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff18e053640 1 --2- 172.21.15.83:0/1034254515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1880b4680 0x7ff188165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff18e053640 1 --2- 172.21.15.83:0/1034254515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18815c8e0 0x7ff1880ad580 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff18e053640 1 -- 172.21.15.83:0/1034254515 >> 172.21.15.83:0/1034254515 conn(0x7ff18806b660 msgr2=0x7ff18806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff18e053640 1 -- 172.21.15.83:0/1034254515 shutdown_connections 2024-03-30T13:08:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff18e053640 1 -- 172.21.15.83:0/1034254515 wait complete. 2024-03-30T13:08:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff18e053640 1 Processor -- start 2024-03-30T13:08:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.228+0000 7ff18e053640 1 -- start start 2024-03-30T13:08:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff18e053640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1880adac0 0x7ff188156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff18e053640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1880b4680 0x7ff188157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff18e053640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18815c8e0 0x7ff188138b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff18e053640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff188168f80 con 0x7ff1880b4680 2024-03-30T13:08:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff18e053640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff188168e00 con 0x7ff18815c8e0 2024-03-30T13:08:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff18e053640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff188169100 con 0x7ff1880adac0 2024-03-30T13:08:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff186ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1880b4680 0x7ff188157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff186ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1880b4680 0x7ff188157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58566/0 (socket says 172.21.15.83:58566) 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff186ffd640 1 -- 172.21.15.83:0/2609995017 learned_addr learned my addr 172.21.15.83:0/2609995017 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff1877fe640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1880adac0 0x7ff188156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff187fff640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18815c8e0 0x7ff188138b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff186ffd640 1 -- 172.21.15.83:0/2609995017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1880adac0 msgr2=0x7ff188156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff186ffd640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1880adac0 0x7ff188156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff186ffd640 1 -- 172.21.15.83:0/2609995017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18815c8e0 msgr2=0x7ff188138b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff186ffd640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18815c8e0 0x7ff188138b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff186ffd640 1 -- 172.21.15.83:0/2609995017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff188148620 con 0x7ff1880b4680 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff186ffd640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1880b4680 0x7ff188157d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff17000c370 tx=0x7ff17000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff17ffff640 1 -- 172.21.15.83:0/2609995017 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff170017070 con 0x7ff1880b4680 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff17ffff640 1 -- 172.21.15.83:0/2609995017 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff170005cf0 con 0x7ff1880b4680 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff18e053640 1 -- 172.21.15.83:0/2609995017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff188148900 con 0x7ff1880b4680 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff17ffff640 1 -- 172.21.15.83:0/2609995017 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1700072f0 con 0x7ff1880b4680 2024-03-30T13:08:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff18e053640 1 -- 172.21.15.83:0/2609995017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18815a770 con 0x7ff1880b4680 2024-03-30T13:08:57.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff18e053640 1 -- 172.21.15.83:0/2609995017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff18804f9e0 con 0x7ff1880b4680 2024-03-30T13:08:57.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff17ffff640 1 -- 172.21.15.83:0/2609995017 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff17001a070 con 0x7ff1880b4680 2024-03-30T13:08:57.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff17ffff640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff168067fc0 0x7ff16806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff17ffff640 1 -- 172.21.15.83:0/2609995017 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff170085830 con 0x7ff1880b4680 2024-03-30T13:08:57.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff1877fe640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff168067fc0 0x7ff16806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.232+0000 7ff1877fe640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff168067fc0 0x7ff16806a480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff1780ad000 tx=0x7ff1780a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:57.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.236+0000 7ff17ffff640 1 -- 172.21.15.83:0/2609995017 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff170056070 con 0x7ff1880b4680 2024-03-30T13:08:57.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.396+0000 7ff18e053640 1 -- 172.21.15.83:0/2609995017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff1880b3fd0 con 0x7ff1880b4680 2024-03-30T13:08:57.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.396+0000 7ff17ffff640 1 -- 172.21.15.83:0/2609995017 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7ff170055970 con 0x7ff1880b4680 2024-03-30T13:08:57.404 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:08:57.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.400+0000 7ff18e053640 1 -- 172.21.15.83:0/2609995017 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff168067fc0 msgr2=0x7ff16806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.400+0000 7ff18e053640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff168067fc0 0x7ff16806a480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff1780ad000 tx=0x7ff1780a6000 comp rx=0 tx=0).stop 2024-03-30T13:08:57.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.400+0000 7ff18e053640 1 -- 172.21.15.83:0/2609995017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1880b4680 msgr2=0x7ff188157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.400+0000 7ff18e053640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1880b4680 0x7ff188157d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff17000c370 tx=0x7ff17000c830 comp rx=0 tx=0).stop 2024-03-30T13:08:57.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.400+0000 7ff18e053640 1 -- 172.21.15.83:0/2609995017 shutdown_connections 2024-03-30T13:08:57.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.400+0000 7ff18e053640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff168067fc0 0x7ff16806a480 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.400+0000 7ff18e053640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff18815c8e0 0x7ff188138b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.400+0000 7ff18e053640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1880b4680 0x7ff188157d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.400+0000 7ff18e053640 1 --2- 172.21.15.83:0/2609995017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1880adac0 0x7ff188156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.400+0000 7ff18e053640 1 -- 172.21.15.83:0/2609995017 >> 172.21.15.83:0/2609995017 conn(0x7ff18806b660 msgr2=0x7ff18806de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.400+0000 7ff18e053640 1 -- 172.21.15.83:0/2609995017 shutdown_connections 2024-03-30T13:08:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.400+0000 7ff18e053640 1 -- 172.21.15.83:0/2609995017 wait complete. 2024-03-30T13:08:57.422 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:08:57.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e9d191640 1 Processor -- start 2024-03-30T13:08:57.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e9d191640 1 -- start start 2024-03-30T13:08:57.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e9d191640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e980b4680 0x7f1e9815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e9d191640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e9815d200 0x7f1e98165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e9d191640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e980ae040 con 0x7f1e9815c8e0 2024-03-30T13:08:57.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e9d191640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1e980b31e0 con 0x7f1e9815d200 2024-03-30T13:08:57.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e9d191640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1e980ae320 con 0x7f1e980b4680 2024-03-30T13:08:57.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e96d9d640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f1e9815c8e0 0x7f1e980ad580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46126/0 (socket says 172.21.15.83:46126) 2024-03-30T13:08:57.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e96d9d640 1 -- 172.21.15.83:0/1015271748 learned_addr learned my addr 172.21.15.83:0/1015271748 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:57.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e9659c640 1 --2- 172.21.15.83:0/1015271748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e980b4680 0x7f1e9815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e9759e640 1 --2- 172.21.15.83:0/1015271748 >> v2:172.21.15.153:3300/0 conn(0x7f1e9815d200 0x7f1e98165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2715371464 0 0) 0x7f1e980ae040 con 0x7f1e9815c8e0 2024-03-30T13:08:57.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e80003530 con 0x7f1e9815c8e0 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3131300210 0 0) 0x7f1e80003530 con 0x7f1e9815c8e0 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e980b4680 msgr2=0x7f1e9815ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 --2- 172.21.15.83:0/1015271748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e980b4680 0x7f1e9815ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 >> v2:172.21.15.153:3300/0 conn(0x7f1e9815d200 msgr2=0x7f1e98165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 --2- 172.21.15.83:0/1015271748 >> v2:172.21.15.153:3300/0 conn(0x7f1e9815d200 0x7f1e98165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e980ae600 con 0x7f1e9815c8e0 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f1e88001680 con 0x7f1e9815c8e0 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 >> v1:172.21.15.83:6789/0 conn(0x7f1e9815c8e0 legacy=0x7f1e980ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 --2- 172.21.15.83:0/1015271748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e800039c0 0x7f1e80003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 --2- 172.21.15.83:0/1015271748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e980b4680 0x7f1e80004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 --2- 172.21.15.83:0/1015271748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e80004d50 0x7f1e800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1e980b31e0 con 0x7f1e800039c0 2024-03-30T13:08:57.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1e980ae320 con 0x7f1e80004d50 2024-03-30T13:08:57.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1e8000b9d0 con 0x7f1e980b4680 2024-03-30T13:08:57.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e96d9d640 1 --2- 172.21.15.83:0/1015271748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e800039c0 0x7f1e80003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e9659c640 1 --2- 172.21.15.83:0/1015271748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e980b4680 0x7f1e80004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e96d9d640 1 -- 172.21.15.83:0/1015271748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e980b4680 msgr2=0x7f1e80004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:57.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e96d9d640 1 --2- 172.21.15.83:0/1015271748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e980b4680 0x7f1e80004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e96d9d640 1 -- 172.21.15.83:0/1015271748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e80004d50 msgr2=0x7f1e800051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:57.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e96d9d640 1 --2- 172.21.15.83:0/1015271748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e80004d50 0x7f1e800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.528+0000 7f1e96d9d640 1 -- 172.21.15.83:0/1015271748 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e80003530 con 0x7f1e800039c0 2024-03-30T13:08:57.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e96d9d640 1 --2- 172.21.15.83:0/1015271748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e800039c0 0x7f1e80003de0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e88001060 tx=0x7f1e8801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98598996db4c7277 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:57.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e88007d80 con 0x7f1e800039c0 2024-03-30T13:08:57.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e880a9020 con 0x7f1e800039c0 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e95d9b640 1 -- 172.21.15.83:0/1015271748 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e88005b00 con 0x7f1e800039c0 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 -- 172.21.15.83:0/1015271748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e800039c0 msgr2=0x7f1e80003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 --2- 172.21.15.83:0/1015271748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e800039c0 0x7f1e80003de0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e88001060 tx=0x7f1e8801cca0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9759e640 1 -- 172.21.15.83:0/1015271748 reap_dead start 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 -- 172.21.15.83:0/1015271748 shutdown_connections 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 -- 172.21.15.83:0/1015271748 >> 172.21.15.83:0/1015271748 conn(0x7f1e9806b660 msgr2=0x7f1e9806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 -- 172.21.15.83:0/1015271748 shutdown_connections 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 -- 172.21.15.83:0/1015271748 wait complete. 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 Processor -- start 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 -- start start 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e800039c0 0x7f1e9815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e9814e360 0x7f1e9814db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e980cd320 0x7f1e980cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1e980adc90 con 0x7f1e9814e360 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1e98166be0 con 0x7f1e980cd320 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9d191640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1e980cea40 con 0x7f1e800039c0 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e9814e360 0x7f1e9814db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e9814e360 0x7f1e9814db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58588/0 (socket says 172.21.15.83:58588) 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.532+0000 7f1e9659c640 1 -- 172.21.15.83:0/446634975 learned_addr learned my addr 172.21.15.83:0/446634975 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e96d9d640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e800039c0 0x7f1e9815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e9659c640 1 -- 172.21.15.83:0/446634975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e800039c0 msgr2=0x7f1e9815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e9659c640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e800039c0 0x7f1e9815e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e9659c640 1 -- 172.21.15.83:0/446634975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e980cd320 msgr2=0x7f1e980cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e9759e640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e980cd320 0x7f1e980cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e9659c640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e980cd320 0x7f1e980cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e9659c640 1 -- 172.21.15.83:0/446634975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9815e960 con 0x7f1e9814e360 2024-03-30T13:08:57.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e9659c640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e9814e360 0x7f1e9814db30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0108c0 tx=0x7f1e8c010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:57.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e7f7fe640 1 -- 172.21.15.83:0/446634975 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00f040 con 0x7f1e9814e360 2024-03-30T13:08:57.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e7f7fe640 1 -- 172.21.15.83:0/446634975 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8c00eb60 con 0x7f1e9814e360 2024-03-30T13:08:57.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e9d191640 1 -- 172.21.15.83:0/446634975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e980ce1a0 con 0x7f1e9814e360 2024-03-30T13:08:57.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e7f7fe640 1 -- 172.21.15.83:0/446634975 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c01c400 con 0x7f1e9814e360 2024-03-30T13:08:57.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e9d191640 1 -- 172.21.15.83:0/446634975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e980ce760 con 0x7f1e9814e360 2024-03-30T13:08:57.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e9d191640 1 -- 172.21.15.83:0/446634975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e9814e130 con 0x7f1e9814e360 2024-03-30T13:08:57.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e7f7fe640 1 -- 172.21.15.83:0/446634975 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f1e8c01c5a0 con 0x7f1e9814e360 2024-03-30T13:08:57.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e7f7fe640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1e84067fc0 0x7f1e8406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e7f7fe640 1 -- 172.21.15.83:0/446634975 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1e8c086ac0 con 0x7f1e9814e360 2024-03-30T13:08:57.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e96d9d640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1e84067fc0 0x7f1e8406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.536+0000 7f1e96d9d640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1e84067fc0 0x7f1e8406a480 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1e880aa000 tx=0x7f1e88001a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:57.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.540+0000 7f1e7f7fe640 1 -- 172.21.15.83:0/446634975 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f1e8c018030 con 0x7f1e9814e360 2024-03-30T13:08:57.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.688+0000 7f1e9d191640 1 -- 172.21.15.83:0/446634975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1e9804f9e0 con 0x7f1e9814e360 2024-03-30T13:08:57.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e7f7fe640 1 -- 172.21.15.83:0/446634975 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f1e8c057300 con 0x7f1e9814e360 2024-03-30T13:08:57.698 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:08:57.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e9d191640 1 -- 172.21.15.83:0/446634975 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1e84067fc0 msgr2=0x7f1e8406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e9d191640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1e84067fc0 0x7f1e8406a480 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1e880aa000 tx=0x7f1e88001a50 comp rx=0 tx=0).stop 2024-03-30T13:08:57.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e9d191640 1 -- 172.21.15.83:0/446634975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e9814e360 msgr2=0x7f1e9814db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e9d191640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e9814e360 0x7f1e9814db30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0108c0 tx=0x7f1e8c010d80 comp rx=0 tx=0).stop 2024-03-30T13:08:57.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e9d191640 1 -- 172.21.15.83:0/446634975 shutdown_connections 2024-03-30T13:08:57.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e9d191640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1e84067fc0 0x7f1e8406a480 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e9d191640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e980cd320 0x7f1e980cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e9d191640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e9814e360 0x7f1e9814db30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e9d191640 1 --2- 172.21.15.83:0/446634975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e800039c0 0x7f1e9815e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e9d191640 1 -- 172.21.15.83:0/446634975 >> 172.21.15.83:0/446634975 conn(0x7f1e9806b660 msgr2=0x7f1e9815a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:57.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e9d191640 1 -- 172.21.15.83:0/446634975 shutdown_connections 2024-03-30T13:08:57.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.692+0000 7f1e9d191640 1 -- 172.21.15.83:0/446634975 wait complete. 2024-03-30T13:08:57.715 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:08:57.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f231cfc8640 1 Processor -- start 2024-03-30T13:08:57.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f231cfc8640 1 -- start start 2024-03-30T13:08:57.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f231cfc8640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f231815c8e0 0x7f23180ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f231cfc8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23180adac0 0x7f231815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f231cfc8640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23180ae040 con 0x7f231815d200 2024-03-30T13:08:57.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f231cfc8640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f23180b31e0 con 0x7f231815c8e0 2024-03-30T13:08:57.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f231cfc8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f23180ae320 con 0x7f23180adac0 2024-03-30T13:08:57.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f2315d9b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23180adac0 0x7f231815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f2315d9b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23180adac0 0x7f231815ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:33528/0 (socket says 172.21.15.83:33528) 2024-03-30T13:08:57.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f231659c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f231815c8e0 0x7f23180ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f2315d9b640 1 -- 172.21.15.83:0/822548472 learned_addr learned my addr 172.21.15.83:0/822548472 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:57.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f2315d9b640 1 -- 172.21.15.83:0/822548472 >> v2:172.21.15.153:3300/0 conn(0x7f231815c8e0 msgr2=0x7f23180ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:57.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f2315d9b640 1 --2- 172.21.15.83:0/822548472 >> v2:172.21.15.153:3300/0 conn(0x7f231815c8e0 0x7f23180ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f2315d9b640 1 -- 172.21.15.83:0/822548472 >> v1:172.21.15.153:6789/0 conn(0x7f231815d200 legacy=0x7f23180b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.828+0000 7f2315d9b640 1 -- 172.21.15.83:0/822548472 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23180ae600 con 0x7f23180adac0 2024-03-30T13:08:57.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f2315d9b640 1 --2- 172.21.15.83:0/822548472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23180adac0 0x7f231815ccc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2308009870 tx=0x7f230801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fd121a9b6b0289e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:57.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231559a640 1 -- 172.21.15.83:0/822548472 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23080a7070 con 0x7f23180adac0 2024-03-30T13:08:57.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231559a640 1 -- 172.21.15.83:0/822548472 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23080b0070 con 0x7f23180adac0 2024-03-30T13:08:57.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231559a640 1 -- 172.21.15.83:0/822548472 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23080ab890 con 0x7f23180adac0 2024-03-30T13:08:57.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 -- 172.21.15.83:0/822548472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23180adac0 msgr2=0x7f231815ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 --2- 172.21.15.83:0/822548472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23180adac0 0x7f231815ccc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2308009870 tx=0x7f230801c560 comp rx=0 tx=0).stop 2024-03-30T13:08:57.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 -- 172.21.15.83:0/822548472 shutdown_connections 2024-03-30T13:08:57.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 --2- 172.21.15.83:0/822548472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23180adac0 0x7f231815ccc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 --2- 172.21.15.83:0/822548472 >> v2:172.21.15.153:3300/0 conn(0x7f231815c8e0 0x7f23180ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 -- 172.21.15.83:0/822548472 >> 172.21.15.83:0/822548472 conn(0x7f231806b660 msgr2=0x7f231806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:57.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 -- 172.21.15.83:0/822548472 shutdown_connections 2024-03-30T13:08:57.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 -- 172.21.15.83:0/822548472 wait complete. 2024-03-30T13:08:57.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 Processor -- start 2024-03-30T13:08:57.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 -- start start 2024-03-30T13:08:57.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23180adac0 0x7f2318143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f231815c8e0 0x7f2318150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f231815d200 0x7f2318099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f23180b4710 con 0x7f231815c8e0 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23180b4590 con 0x7f23180adac0 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.832+0000 7f231cfc8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f23180b4890 con 0x7f231815d200 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f2315d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f231815c8e0 0x7f2318150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f2315d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f231815c8e0 0x7f2318150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58600/0 (socket says 172.21.15.83:58600) 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f2315d9b640 1 -- 172.21.15.83:0/3592654961 learned_addr learned my addr 172.21.15.83:0/3592654961 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f231659c640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23180adac0 0x7f2318143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f2316d9d640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f231815d200 0x7f2318099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f2315d9b640 1 -- 172.21.15.83:0/3592654961 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f231815d200 msgr2=0x7f2318099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f2315d9b640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f231815d200 0x7f2318099a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f2315d9b640 1 -- 172.21.15.83:0/3592654961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23180adac0 msgr2=0x7f2318143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f2315d9b640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23180adac0 0x7f2318143da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f2315d9b640 1 -- 172.21.15.83:0/3592654961 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2318149e00 con 0x7f231815c8e0 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f2315d9b640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f231815c8e0 0x7f2318150210 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23080ad040 tx=0x7f230801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f230effd640 1 -- 172.21.15.83:0/3592654961 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23080be5f0 con 0x7f231815c8e0 2024-03-30T13:08:57.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f230effd640 1 -- 172.21.15.83:0/3592654961 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23080be7b0 con 0x7f231815c8e0 2024-03-30T13:08:57.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f231cfc8640 1 -- 172.21.15.83:0/3592654961 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231814a0e0 con 0x7f231815c8e0 2024-03-30T13:08:57.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f230effd640 1 -- 172.21.15.83:0/3592654961 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23080beba0 con 0x7f231815c8e0 2024-03-30T13:08:57.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f231cfc8640 1 -- 172.21.15.83:0/3592654961 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23181585f0 con 0x7f231815c8e0 2024-03-30T13:08:57.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f231cfc8640 1 -- 172.21.15.83:0/3592654961 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f231814a2b0 con 0x7f231815c8e0 2024-03-30T13:08:57.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f230effd640 1 -- 172.21.15.83:0/3592654961 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f23080b43f0 con 0x7f231815c8e0 2024-03-30T13:08:57.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f230effd640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f22f8067ff0 0x7f22f806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:57.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f231659c640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f22f8067ff0 0x7f22f806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:57.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f230effd640 1 -- 172.21.15.83:0/3592654961 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f23081211c0 con 0x7f231815c8e0 2024-03-30T13:08:57.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.836+0000 7f231659c640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f22f8067ff0 0x7f22f806a4b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f231814ecb0 tx=0x7f231000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:57.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.840+0000 7f230effd640 1 -- 172.21.15.83:0/3592654961 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f23080c4060 con 0x7f231815c8e0 2024-03-30T13:08:57.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.988+0000 7f231cfc8640 1 -- 172.21.15.83:0/3592654961 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f231804f9e0 con 0x7f231815c8e0 2024-03-30T13:08:57.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.988+0000 7f230effd640 1 -- 172.21.15.83:0/3592654961 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f2308016150 con 0x7f231815c8e0 2024-03-30T13:08:57.997 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:08:57.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.992+0000 7f231cfc8640 1 -- 172.21.15.83:0/3592654961 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f22f8067ff0 msgr2=0x7f22f806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.992+0000 7f231cfc8640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f22f8067ff0 0x7f22f806a4b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f231814ecb0 tx=0x7f231000b040 comp rx=0 tx=0).stop 2024-03-30T13:08:57.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.992+0000 7f231cfc8640 1 -- 172.21.15.83:0/3592654961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f231815c8e0 msgr2=0x7f2318150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:57.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.992+0000 7f231cfc8640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f231815c8e0 0x7f2318150210 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23080ad040 tx=0x7f230801ada0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.992+0000 7f231cfc8640 1 -- 172.21.15.83:0/3592654961 shutdown_connections 2024-03-30T13:08:57.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.992+0000 7f231cfc8640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f22f8067ff0 0x7f22f806a4b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.992+0000 7f231cfc8640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f231815d200 0x7f2318099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.992+0000 7f231cfc8640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f231815c8e0 0x7f2318150210 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:57.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.992+0000 7f231cfc8640 1 --2- 172.21.15.83:0/3592654961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23180adac0 0x7f2318143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.992+0000 7f231cfc8640 1 -- 172.21.15.83:0/3592654961 >> 172.21.15.83:0/3592654961 conn(0x7f231806b660 msgr2=0x7f23181507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:58.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.992+0000 7f231cfc8640 1 -- 172.21.15.83:0/3592654961 shutdown_connections 2024-03-30T13:08:58.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:57.992+0000 7f231cfc8640 1 -- 172.21.15.83:0/3592654961 wait complete. 2024-03-30T13:08:58.014 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:58.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.128+0000 7f1c29a7c640 1 Processor -- start 2024-03-30T13:08:58.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.128+0000 7f1c29a7c640 1 -- start start 2024-03-30T13:08:58.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.128+0000 7f1c29a7c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c2406bd70 0x7f1c240b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.128+0000 7f1c29a7c640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c240b3be0 con 0x7f1c2415c510 2024-03-30T13:08:58.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.128+0000 7f1c29a7c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c240cde30 con 0x7f1c240ce910 2024-03-30T13:08:58.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.128+0000 7f1c29a7c640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1c240ce110 con 0x7f1c2406bd70 2024-03-30T13:08:58.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.128+0000 7f1c237fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f1c2415c510 0x7f1c2406b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46132/0 (socket says 172.21.15.83:46132) 2024-03-30T13:08:58.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.128+0000 7f1c237fe640 1 -- 172.21.15.83:0/2864912735 learned_addr learned my addr 172.21.15.83:0/2864912735 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:58.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.128+0000 7f1c22ffd640 1 --2- 172.21.15.83:0/2864912735 >> v2:172.21.15.153:3300/0 conn(0x7f1c2406bd70 0x7f1c240b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.128+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282068628 0 0) 0x7f1c240b3be0 con 0x7f1c2415c510 2024-03-30T13:08:58.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c0c003530 con 0x7f1c2415c510 2024-03-30T13:08:58.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3047793056 0 0) 0x7f1c0c003530 con 0x7f1c2415c510 2024-03-30T13:08:58.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 >> v2:172.21.15.153:3300/0 conn(0x7f1c2406bd70 msgr2=0x7f1c240b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:58.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 --2- 172.21.15.83:0/2864912735 >> v2:172.21.15.153:3300/0 conn(0x7f1c2406bd70 0x7f1c240b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 >> v1:172.21.15.153:6789/0 conn(0x7f1c240ce910 legacy=0x7f1c240c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c240ce3f0 con 0x7f1c2415c510 2024-03-30T13:08:58.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f1c14001680 con 0x7f1c2415c510 2024-03-30T13:08:58.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 >> v1:172.21.15.83:6789/0 conn(0x7f1c2415c510 legacy=0x7f1c2406b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 --2- 172.21.15.83:0/2864912735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c0c0039c0 0x7f1c0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 --2- 172.21.15.83:0/2864912735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c0c004810 0x7f1c0c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 --2- 172.21.15.83:0/2864912735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c0c0051d0 0x7f1c0c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1c240ce110 con 0x7f1c0c0051d0 2024-03-30T13:08:58.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c00c170 con 0x7f1c0c004810 2024-03-30T13:08:58.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1c0c00c370 con 0x7f1c0c0039c0 2024-03-30T13:08:58.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c23fff640 1 --2- 172.21.15.83:0/2864912735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c0c0051d0 0x7f1c0c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c237fe640 1 --2- 172.21.15.83:0/2864912735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c0c0039c0 0x7f1c0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c22ffd640 1 --2- 172.21.15.83:0/2864912735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c0c004810 0x7f1c0c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c23fff640 1 -- 172.21.15.83:0/2864912735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c0c0039c0 msgr2=0x7f1c0c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:58.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c23fff640 1 --2- 172.21.15.83:0/2864912735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c0c0039c0 0x7f1c0c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c23fff640 1 -- 172.21.15.83:0/2864912735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c0c004810 msgr2=0x7f1c0c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:58.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c23fff640 1 --2- 172.21.15.83:0/2864912735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c0c004810 0x7f1c0c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c23fff640 1 -- 172.21.15.83:0/2864912735 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0c003530 con 0x7f1c0c0051d0 2024-03-30T13:08:58.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c22ffd640 1 --2- 172.21.15.83:0/2864912735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c0c004810 0x7f1c0c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:58.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c23fff640 1 -- 172.21.15.83:0/2864912735 reap_dead start 2024-03-30T13:08:58.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c23fff640 1 --2- 172.21.15.83:0/2864912735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c0c0051d0 0x7f1c0c00b9d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c001e70 tx=0x7f1c1c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb7680df146b1f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:58.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c001a90 con 0x7f1c0c0051d0 2024-03-30T13:08:58.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c003bc0 con 0x7f1c0c0051d0 2024-03-30T13:08:58.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c227fc640 1 -- 172.21.15.83:0/2864912735 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0050d0 con 0x7f1c0c0051d0 2024-03-30T13:08:58.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c29a7c640 1 -- 172.21.15.83:0/2864912735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c0c0051d0 msgr2=0x7f1c0c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c29a7c640 1 --2- 172.21.15.83:0/2864912735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c0c0051d0 0x7f1c0c00b9d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c001e70 tx=0x7f1c1c01c780 comp rx=0 tx=0).stop 2024-03-30T13:08:58.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c29a7c640 1 -- 172.21.15.83:0/2864912735 shutdown_connections 2024-03-30T13:08:58.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c29a7c640 1 --2- 172.21.15.83:0/2864912735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c0c0051d0 0x7f1c0c00b9d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c29a7c640 1 -- 172.21.15.83:0/2864912735 >> 172.21.15.83:0/2864912735 conn(0x7f1c2409aa50 msgr2=0x7f1c240b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:58.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c29a7c640 1 -- 172.21.15.83:0/2864912735 shutdown_connections 2024-03-30T13:08:58.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.132+0000 7f1c29a7c640 1 -- 172.21.15.83:0/2864912735 wait complete. 2024-03-30T13:08:58.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c29a7c640 1 Processor -- start 2024-03-30T13:08:58.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c29a7c640 1 -- start start 2024-03-30T13:08:58.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c29a7c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c0c0051d0 0x7f1c2415e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c29a7c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c240b4080 0x7f1c2415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c29a7c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c240cb880 0x7f1c240cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c29a7c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2415ca70 con 0x7f1c240cb880 2024-03-30T13:08:58.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c29a7c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2415c8f0 con 0x7f1c0c0051d0 2024-03-30T13:08:58.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c29a7c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1c240b0840 con 0x7f1c240b4080 2024-03-30T13:08:58.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c240cb880 0x7f1c240cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c240cb880 0x7f1c240cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58606/0 (socket says 172.21.15.83:58606) 2024-03-30T13:08:58.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c23fff640 1 -- 172.21.15.83:0/3986264405 learned_addr learned my addr 172.21.15.83:0/3986264405 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:58.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c22ffd640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c240b4080 0x7f1c2415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c237fe640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c0c0051d0 0x7f1c2415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c23fff640 1 -- 172.21.15.83:0/3986264405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c240b4080 msgr2=0x7f1c2415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c23fff640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c240b4080 0x7f1c2415efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c23fff640 1 -- 172.21.15.83:0/3986264405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c0c0051d0 msgr2=0x7f1c2415e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c23fff640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c0c0051d0 0x7f1c2415e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c23fff640 1 -- 172.21.15.83:0/3986264405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c240b6b40 con 0x7f1c240cb880 2024-03-30T13:08:58.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c22ffd640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c240b4080 0x7f1c2415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:58.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c23fff640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c240cb880 0x7f1c240cbd00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c01d020 tx=0x7f1c0c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:58.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c0bfff640 1 -- 172.21.15.83:0/3986264405 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c007dc0 con 0x7f1c240cb880 2024-03-30T13:08:58.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c0bfff640 1 -- 172.21.15.83:0/3986264405 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c0af070 con 0x7f1c240cb880 2024-03-30T13:08:58.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c0bfff640 1 -- 172.21.15.83:0/3986264405 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c001a90 con 0x7f1c240cb880 2024-03-30T13:08:58.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c29a7c640 1 -- 172.21.15.83:0/3986264405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c240b6e20 con 0x7f1c240cb880 2024-03-30T13:08:58.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c29a7c640 1 -- 172.21.15.83:0/3986264405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c2415dc10 con 0x7f1c240cb880 2024-03-30T13:08:58.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.136+0000 7f1c29a7c640 1 -- 172.21.15.83:0/3986264405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c24068dd0 con 0x7f1c240cb880 2024-03-30T13:08:58.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.140+0000 7f1c0bfff640 1 -- 172.21.15.83:0/3986264405 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f1c1c0b1030 con 0x7f1c240cb880 2024-03-30T13:08:58.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.140+0000 7f1c0bfff640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1c10067ff0 0x7f1c1006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.140+0000 7f1c0bfff640 1 -- 172.21.15.83:0/3986264405 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1c1c11f3b0 con 0x7f1c240cb880 2024-03-30T13:08:58.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.140+0000 7f1c237fe640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1c10067ff0 0x7f1c1006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.140+0000 7f1c237fe640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1c10067ff0 0x7f1c1006a4b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1c14004880 tx=0x7f1c140047f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:58.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.144+0000 7f1c0bfff640 1 -- 172.21.15.83:0/3986264405 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f1c1c016490 con 0x7f1c240cb880 2024-03-30T13:08:58.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.304+0000 7f1c29a7c640 1 -- 172.21.15.83:0/3986264405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c2415dde0 con 0x7f1c240cb880 2024-03-30T13:08:58.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.304+0000 7f1c0bfff640 1 -- 172.21.15.83:0/3986264405 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f1c1c0efb60 con 0x7f1c240cb880 2024-03-30T13:08:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:58.313 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:58.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.308+0000 7f1c29a7c640 1 -- 172.21.15.83:0/3986264405 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1c10067ff0 msgr2=0x7f1c1006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.308+0000 7f1c29a7c640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1c10067ff0 0x7f1c1006a4b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1c14004880 tx=0x7f1c140047f0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.308+0000 7f1c29a7c640 1 -- 172.21.15.83:0/3986264405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c240cb880 msgr2=0x7f1c240cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.308+0000 7f1c29a7c640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c240cb880 0x7f1c240cbd00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c01d020 tx=0x7f1c0c005840 comp rx=0 tx=0).stop 2024-03-30T13:08:58.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.308+0000 7f1c29a7c640 1 -- 172.21.15.83:0/3986264405 shutdown_connections 2024-03-30T13:08:58.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.308+0000 7f1c29a7c640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1c10067ff0 0x7f1c1006a4b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.308+0000 7f1c29a7c640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c240cb880 0x7f1c240cbd00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.308+0000 7f1c29a7c640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c240b4080 0x7f1c2415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.308+0000 7f1c29a7c640 1 --2- 172.21.15.83:0/3986264405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c0c0051d0 0x7f1c2415e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.308+0000 7f1c29a7c640 1 -- 172.21.15.83:0/3986264405 >> 172.21.15.83:0/3986264405 conn(0x7f1c2409aa50 msgr2=0x7f1c2406b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:58.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.308+0000 7f1c29a7c640 1 -- 172.21.15.83:0/3986264405 shutdown_connections 2024-03-30T13:08:58.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.308+0000 7f1c29a7c640 1 -- 172.21.15.83:0/3986264405 wait complete. 2024-03-30T13:08:58.330 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:08:58.331 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:08:58.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bfce5640 1 Processor -- start 2024-03-30T13:08:58.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bfce5640 1 -- start start 2024-03-30T13:08:58.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bfce5640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2b815b050 0x7fb2b8073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bfce5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb2b80b3ca0 0x7fb2b806f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bfce5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b806f690 0x7fb2b8071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bfce5640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b806fb00 con 0x7fb2b80b3ca0 2024-03-30T13:08:58.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bfce5640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b8073ab0 con 0x7fb2b815b050 2024-03-30T13:08:58.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bfce5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b80b31e0 con 0x7fb2b806f690 2024-03-30T13:08:58.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bd280640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb2b80b3ca0 0x7fb2b806f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bd280640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb2b80b3ca0 0x7fb2b806f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58608/0 (socket says 172.21.15.83:58608) 2024-03-30T13:08:58.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bd280640 1 -- 172.21.15.83:0/1361432309 learned_addr learned my addr 172.21.15.83:0/1361432309 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:58.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bda81640 1 --2- 172.21.15.83:0/1361432309 >> v2:172.21.15.153:3300/0 conn(0x7fb2b815b050 0x7fb2b8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2be282640 1 --2- 172.21.15.83:0/1361432309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b806f690 0x7fb2b8071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bd280640 1 -- 172.21.15.83:0/1361432309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b806f690 msgr2=0x7fb2b8071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:58.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bd280640 1 --2- 172.21.15.83:0/1361432309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b806f690 0x7fb2b8071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bd280640 1 -- 172.21.15.83:0/1361432309 >> v2:172.21.15.153:3300/0 conn(0x7fb2b815b050 msgr2=0x7fb2b8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:58.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bd280640 1 --2- 172.21.15.83:0/1361432309 >> v2:172.21.15.153:3300/0 conn(0x7fb2b815b050 0x7fb2b8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bd280640 1 -- 172.21.15.83:0/1361432309 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b80ad4f0 con 0x7fb2b80b3ca0 2024-03-30T13:08:58.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bd280640 1 --2- 172.21.15.83:0/1361432309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b80b3ca0 0x7fb2b806f150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2b806d8d0 tx=0x7fb2a801e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35aeba5dee42aa server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:58.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.436+0000 7fb2bca7f640 1 -- 172.21.15.83:0/1361432309 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a80b4070 con 0x7fb2b80b3ca0 2024-03-30T13:08:58.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bca7f640 1 -- 172.21.15.83:0/1361432309 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a80a7990 con 0x7fb2b80b3ca0 2024-03-30T13:08:58.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bca7f640 1 -- 172.21.15.83:0/1361432309 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a80a7d60 con 0x7fb2b80b3ca0 2024-03-30T13:08:58.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 -- 172.21.15.83:0/1361432309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b80b3ca0 msgr2=0x7fb2b806f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 --2- 172.21.15.83:0/1361432309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b80b3ca0 0x7fb2b806f150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2b806d8d0 tx=0x7fb2a801e900 comp rx=0 tx=0).stop 2024-03-30T13:08:58.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 -- 172.21.15.83:0/1361432309 shutdown_connections 2024-03-30T13:08:58.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 --2- 172.21.15.83:0/1361432309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b806f690 0x7fb2b8071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 --2- 172.21.15.83:0/1361432309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b80b3ca0 0x7fb2b806f150 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 --2- 172.21.15.83:0/1361432309 >> v2:172.21.15.153:3300/0 conn(0x7fb2b815b050 0x7fb2b8073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 -- 172.21.15.83:0/1361432309 >> 172.21.15.83:0/1361432309 conn(0x7fb2b806b660 msgr2=0x7fb2b806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:58.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 -- 172.21.15.83:0/1361432309 shutdown_connections 2024-03-30T13:08:58.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 -- 172.21.15.83:0/1361432309 wait complete. 2024-03-30T13:08:58.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 Processor -- start 2024-03-30T13:08:58.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 -- start start 2024-03-30T13:08:58.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b806f690 0x7fb2b814da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b80b3ca0 0x7fb2b8099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b815b050 0x7fb2b8156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b80b4110 con 0x7fb2b815b050 2024-03-30T13:08:58.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b80ad1c0 con 0x7fb2b80b3ca0 2024-03-30T13:08:58.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b80b4c10 con 0x7fb2b806f690 2024-03-30T13:08:58.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2be282640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b815b050 0x7fb2b8156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2be282640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b815b050 0x7fb2b8156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58612/0 (socket says 172.21.15.83:58612) 2024-03-30T13:08:58.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2be282640 1 -- 172.21.15.83:0/2527619378 learned_addr learned my addr 172.21.15.83:0/2527619378 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:58.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bd280640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b80b3ca0 0x7fb2b8099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2be282640 1 -- 172.21.15.83:0/2527619378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b806f690 msgr2=0x7fb2b814da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bda81640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b806f690 0x7fb2b814da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2be282640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b806f690 0x7fb2b814da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2be282640 1 -- 172.21.15.83:0/2527619378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b80b3ca0 msgr2=0x7fb2b8099900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2be282640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b80b3ca0 0x7fb2b8099900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2be282640 1 -- 172.21.15.83:0/2527619378 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b814e080 con 0x7fb2b815b050 2024-03-30T13:08:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bd280640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b80b3ca0 0x7fb2b8099900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2be282640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b815b050 0x7fb2b8156c80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0007e90 tx=0x7fb2b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2ae7fc640 1 -- 172.21.15.83:0/2527619378 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0014420 con 0x7fb2b815b050 2024-03-30T13:08:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2ae7fc640 1 -- 172.21.15.83:0/2527619378 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b0019070 con 0x7fb2b815b050 2024-03-30T13:08:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 -- 172.21.15.83:0/2527619378 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b8157ce0 con 0x7fb2b815b050 2024-03-30T13:08:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2ae7fc640 1 -- 172.21.15.83:0/2527619378 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0014800 con 0x7fb2b815b050 2024-03-30T13:08:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.440+0000 7fb2bfce5640 1 -- 172.21.15.83:0/2527619378 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b8099e40 con 0x7fb2b815b050 2024-03-30T13:08:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.444+0000 7fb2bfce5640 1 -- 172.21.15.83:0/2527619378 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b809e540 con 0x7fb2b815b050 2024-03-30T13:08:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.444+0000 7fb2ae7fc640 1 -- 172.21.15.83:0/2527619378 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb2b00149a0 con 0x7fb2b815b050 2024-03-30T13:08:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.444+0000 7fb2ae7fc640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb29c067ff0 0x7fb29c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.444+0000 7fb2ae7fc640 1 -- 172.21.15.83:0/2527619378 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb2b0087710 con 0x7fb2b815b050 2024-03-30T13:08:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.444+0000 7fb2bda81640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb29c067ff0 0x7fb29c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.444+0000 7fb2bda81640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb29c067ff0 0x7fb29c06a4b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009710 tx=0x7fb2b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.448+0000 7fb2ae7fc640 1 -- 172.21.15.83:0/2527619378 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb2b0058030 con 0x7fb2b815b050 2024-03-30T13:08:58.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.596+0000 7fb2bfce5640 1 -- 172.21.15.83:0/2527619378 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb2b80b1910 con 0x7fb2b815b050 2024-03-30T13:08:58.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.596+0000 7fb2ae7fc640 1 -- 172.21.15.83:0/2527619378 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fb2b0057930 con 0x7fb2b815b050 2024-03-30T13:08:58.604 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:08:58.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.600+0000 7fb2bfce5640 1 -- 172.21.15.83:0/2527619378 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb29c067ff0 msgr2=0x7fb29c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.600+0000 7fb2bfce5640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb29c067ff0 0x7fb29c06a4b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009710 tx=0x7fb2b4008040 comp rx=0 tx=0).stop 2024-03-30T13:08:58.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.600+0000 7fb2bfce5640 1 -- 172.21.15.83:0/2527619378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b815b050 msgr2=0x7fb2b8156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.600+0000 7fb2bfce5640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b815b050 0x7fb2b8156c80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0007e90 tx=0x7fb2b000e4b0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.600+0000 7fb2bfce5640 1 -- 172.21.15.83:0/2527619378 shutdown_connections 2024-03-30T13:08:58.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.600+0000 7fb2bfce5640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb29c067ff0 0x7fb29c06a4b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.600+0000 7fb2bfce5640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b815b050 0x7fb2b8156c80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.600+0000 7fb2bfce5640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b80b3ca0 0x7fb2b8099900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.600+0000 7fb2bfce5640 1 --2- 172.21.15.83:0/2527619378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b806f690 0x7fb2b814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.600+0000 7fb2bfce5640 1 -- 172.21.15.83:0/2527619378 >> 172.21.15.83:0/2527619378 conn(0x7fb2b806b660 msgr2=0x7fb2b814e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:58.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.600+0000 7fb2bfce5640 1 -- 172.21.15.83:0/2527619378 shutdown_connections 2024-03-30T13:08:58.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.600+0000 7fb2bfce5640 1 -- 172.21.15.83:0/2527619378 wait complete. 2024-03-30T13:08:58.622 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:08:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.724+0000 7f690b71e640 1 Processor -- start 2024-03-30T13:08:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.724+0000 7f690b71e640 1 -- start start 2024-03-30T13:08:58.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f690b71e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f690415c8e0 0x7f69040ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f690b71e640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69040ae040 con 0x7f69040adac0 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f690b71e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69040ae320 con 0x7f69040b4680 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f690b71e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f69040b31e0 con 0x7f690415c8e0 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f6908cb9640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f69040adac0 0x7f690415ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46146/0 (socket says 172.21.15.83:46146) 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f6908cb9640 1 -- 172.21.15.83:0/4210955021 learned_addr learned my addr 172.21.15.83:0/4210955021 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f69094ba640 1 --2- 172.21.15.83:0/4210955021 >> v2:172.21.15.153:3300/0 conn(0x7f690415c8e0 0x7f69040ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 565630205 0 0) 0x7f69040ae040 con 0x7f69040adac0 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68f0003530 con 0x7f69040adac0 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4199764928 0 0) 0x7f68f0003530 con 0x7f69040adac0 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 >> v2:172.21.15.153:3300/0 conn(0x7f690415c8e0 msgr2=0x7f69040ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 --2- 172.21.15.83:0/4210955021 >> v2:172.21.15.153:3300/0 conn(0x7f690415c8e0 0x7f69040ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 >> v1:172.21.15.153:6789/0 conn(0x7f69040b4680 legacy=0x7f6904165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69040ae600 con 0x7f69040adac0 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f68f4001680 con 0x7f69040adac0 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 >> v1:172.21.15.83:6789/0 conn(0x7f69040adac0 legacy=0x7f690415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 --2- 172.21.15.83:0/4210955021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68f00039c0 0x7f68f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 --2- 172.21.15.83:0/4210955021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f0004810 0x7f68f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 --2- 172.21.15.83:0/4210955021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68f00051d0 0x7f68f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f69040b31e0 con 0x7f68f0004810 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68f000c070 con 0x7f68f00039c0 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f68f000c270 con 0x7f68f00051d0 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f6908cb9640 1 --2- 172.21.15.83:0/4210955021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f0004810 0x7f68f0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f69094ba640 1 --2- 172.21.15.83:0/4210955021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68f00039c0 0x7f68f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f6909cbb640 1 --2- 172.21.15.83:0/4210955021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68f00051d0 0x7f68f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f6908cb9640 1 -- 172.21.15.83:0/4210955021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68f00051d0 msgr2=0x7f68f000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f6908cb9640 1 --2- 172.21.15.83:0/4210955021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68f00051d0 0x7f68f000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f6908cb9640 1 -- 172.21.15.83:0/4210955021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68f00039c0 msgr2=0x7f68f0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f6908cb9640 1 --2- 172.21.15.83:0/4210955021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68f00039c0 0x7f68f0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f6908cb9640 1 -- 172.21.15.83:0/4210955021 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f0003530 con 0x7f68f0004810 2024-03-30T13:08:58.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f6909cbb640 1 -- 172.21.15.83:0/4210955021 reap_dead start 2024-03-30T13:08:58.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f6908cb9640 1 --2- 172.21.15.83:0/4210955021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f0004810 0x7f68f0004c90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f68f400c210 tx=0x7f68f401f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9365bfffacae31a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:58.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4007d40 con 0x7f68f0004810 2024-03-30T13:08:58.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f4005b00 con 0x7f68f0004810 2024-03-30T13:08:58.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.728+0000 7f68fbfff640 1 -- 172.21.15.83:0/4210955021 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4007070 con 0x7f68f0004810 2024-03-30T13:08:58.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 -- 172.21.15.83:0/4210955021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f0004810 msgr2=0x7f68f0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 --2- 172.21.15.83:0/4210955021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f0004810 0x7f68f0004c90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f68f400c210 tx=0x7f68f401f3f0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 -- 172.21.15.83:0/4210955021 shutdown_connections 2024-03-30T13:08:58.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 --2- 172.21.15.83:0/4210955021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f0004810 0x7f68f0004c90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 -- 172.21.15.83:0/4210955021 >> 172.21.15.83:0/4210955021 conn(0x7f690406b660 msgr2=0x7f690406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:58.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 -- 172.21.15.83:0/4210955021 shutdown_connections 2024-03-30T13:08:58.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 -- 172.21.15.83:0/4210955021 wait complete. 2024-03-30T13:08:58.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 Processor -- start 2024-03-30T13:08:58.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 -- start start 2024-03-30T13:08:58.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68f0004810 0x7f6904152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69041567d0 0x7f690415de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f690415e3b0 0x7f69041ea1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f69040ad580 con 0x7f69041567d0 2024-03-30T13:08:58.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f690406f8e0 con 0x7f68f0004810 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f69040ad700 con 0x7f690415e3b0 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f6908cb9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69041567d0 0x7f690415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f6908cb9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69041567d0 0x7f690415de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58624/0 (socket says 172.21.15.83:58624) 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f6908cb9640 1 -- 172.21.15.83:0/219603087 learned_addr learned my addr 172.21.15.83:0/219603087 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f69094ba640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68f0004810 0x7f6904152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f6909cbb640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f690415e3b0 0x7f69041ea1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f6908cb9640 1 -- 172.21.15.83:0/219603087 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f690415e3b0 msgr2=0x7f69041ea1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f6908cb9640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f690415e3b0 0x7f69041ea1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f6908cb9640 1 -- 172.21.15.83:0/219603087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68f0004810 msgr2=0x7f6904152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f6908cb9640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68f0004810 0x7f6904152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f6908cb9640 1 -- 172.21.15.83:0/219603087 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6904155730 con 0x7f69041567d0 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f6908cb9640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69041567d0 0x7f690415de70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f68f401f220 tx=0x7f68f0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f68f9ffb640 1 -- 172.21.15.83:0/219603087 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4001640 con 0x7f69041567d0 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f68f9ffb640 1 -- 172.21.15.83:0/219603087 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f40b6070 con 0x7f69041567d0 2024-03-30T13:08:58.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 -- 172.21.15.83:0/219603087 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6904155a10 con 0x7f69041567d0 2024-03-30T13:08:58.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f68f9ffb640 1 -- 172.21.15.83:0/219603087 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f40049f0 con 0x7f69041567d0 2024-03-30T13:08:58.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.732+0000 7f690b71e640 1 -- 172.21.15.83:0/219603087 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6904155fd0 con 0x7f69041567d0 2024-03-30T13:08:58.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.736+0000 7f690b71e640 1 -- 172.21.15.83:0/219603087 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f690404f9e0 con 0x7f69041567d0 2024-03-30T13:08:58.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.736+0000 7f68f9ffb640 1 -- 172.21.15.83:0/219603087 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f68f40b8020 con 0x7f69041567d0 2024-03-30T13:08:58.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.736+0000 7f68f9ffb640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f68e8067fc0 0x7f68e806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:58.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.736+0000 7f69094ba640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f68e8067fc0 0x7f68e806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:58.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.736+0000 7f68f9ffb640 1 -- 172.21.15.83:0/219603087 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f68f41238b0 con 0x7f69041567d0 2024-03-30T13:08:58.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.736+0000 7f69094ba640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f68e8067fc0 0x7f68e806a480 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f690415db20 tx=0x7f6900008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:58.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.740+0000 7f68f9ffb640 1 -- 172.21.15.83:0/219603087 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f68f4019100 con 0x7f69041567d0 2024-03-30T13:08:58.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 -- 172.21.15.83:0/219603087 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f690406ef90 con 0x7f69041567d0 2024-03-30T13:08:58.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f68f9ffb640 1 -- 172.21.15.83:0/219603087 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f68f40f40f0 con 0x7f69041567d0 2024-03-30T13:08:58.894 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:08:58.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 -- 172.21.15.83:0/219603087 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f68e8067fc0 msgr2=0x7f68e806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f68e8067fc0 0x7f68e806a480 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f690415db20 tx=0x7f6900008040 comp rx=0 tx=0).stop 2024-03-30T13:08:58.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 -- 172.21.15.83:0/219603087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69041567d0 msgr2=0x7f690415de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:58.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69041567d0 0x7f690415de70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f68f401f220 tx=0x7f68f0005840 comp rx=0 tx=0).stop 2024-03-30T13:08:58.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 -- 172.21.15.83:0/219603087 shutdown_connections 2024-03-30T13:08:58.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f68e8067fc0 0x7f68e806a480 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f690415e3b0 0x7f69041ea1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69041567d0 0x7f690415de70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 --2- 172.21.15.83:0/219603087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68f0004810 0x7f6904152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:58.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 -- 172.21.15.83:0/219603087 >> 172.21.15.83:0/219603087 conn(0x7f690406b660 msgr2=0x7f690415b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:58.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 -- 172.21.15.83:0/219603087 shutdown_connections 2024-03-30T13:08:58.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:58.888+0000 7f690b71e640 1 -- 172.21.15.83:0/219603087 wait complete. 2024-03-30T13:08:58.911 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:08:59.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f1098d5b640 1 Processor -- start 2024-03-30T13:08:59.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f1098d5b640 1 -- start start 2024-03-30T13:08:59.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f1098d5b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f10940b38f0 0x7f10940ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f1098d5b640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10940700c0 con 0x7f10940d01a0 2024-03-30T13:08:59.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f1098d5b640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10940703a0 con 0x7f10940cf250 2024-03-30T13:08:59.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f1098d5b640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1094070960 con 0x7f10940b38f0 2024-03-30T13:08:59.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109259c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f10940d01a0 0x7f10940d0880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46162/0 (socket says 172.21.15.83:46162) 2024-03-30T13:08:59.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109259c640 1 -- 172.21.15.83:0/2751828974 learned_addr learned my addr 172.21.15.83:0/2751828974 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:59.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f1091d9b640 1 --2- 172.21.15.83:0/2751828974 >> v2:172.21.15.153:3300/0 conn(0x7f10940b38f0 0x7f10940ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258515784 0 0) 0x7f10940700c0 con 0x7f10940d01a0 2024-03-30T13:08:59.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f107c003530 con 0x7f10940d01a0 2024-03-30T13:08:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 997110833 0 0) 0x7f10940703a0 con 0x7f10940cf250 2024-03-30T13:08:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10940700c0 con 0x7f10940cf250 2024-03-30T13:08:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2409264908 0 0) 0x7f107c003530 con 0x7f10940d01a0 2024-03-30T13:08:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 >> v2:172.21.15.153:3300/0 conn(0x7f10940b38f0 msgr2=0x7f10940ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 --2- 172.21.15.83:0/2751828974 >> v2:172.21.15.153:3300/0 conn(0x7f10940b38f0 0x7f10940ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 >> v1:172.21.15.153:6789/0 conn(0x7f10940cf250 legacy=0x7f109406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1094070680 con 0x7f10940d01a0 2024-03-30T13:08:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f108c001980 con 0x7f10940d01a0 2024-03-30T13:08:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 >> v1:172.21.15.83:6789/0 conn(0x7f10940d01a0 legacy=0x7f10940d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f107c003ba0 0x7f107c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f107c004810 0x7f107c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f107c005220 0x7f107c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1094070960 con 0x7f107c003ba0 2024-03-30T13:08:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f107c00c150 con 0x7f107c004810 2024-03-30T13:08:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f107c00c350 con 0x7f107c005220 2024-03-30T13:08:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109259c640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f107c003ba0 0x7f107c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f1091d9b640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f107c004810 0x7f107c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f1092d9d640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f107c005220 0x7f107c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109259c640 1 -- 172.21.15.83:0/2751828974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f107c005220 msgr2=0x7f107c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109259c640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f107c005220 0x7f107c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109259c640 1 -- 172.21.15.83:0/2751828974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f107c004810 msgr2=0x7f107c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109259c640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f107c004810 0x7f107c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f109259c640 1 -- 172.21.15.83:0/2751828974 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c003530 con 0x7f107c003ba0 2024-03-30T13:08:59.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f1091d9b640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f107c004810 0x7f107c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:08:59.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f1092d9d640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f107c005220 0x7f107c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:59.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.012+0000 7f1092d9d640 1 -- 172.21.15.83:0/2751828974 reap_dead start 2024-03-30T13:08:59.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.016+0000 7f109259c640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f107c003ba0 0x7f107c003fa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f108c00a6f0 tx=0x7f108c01d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4479323dcfbf4b1c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:59.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.016+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c00a310 con 0x7f107c003ba0 2024-03-30T13:08:59.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.016+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108c007350 con 0x7f107c003ba0 2024-03-30T13:08:59.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.016+0000 7f109159a640 1 -- 172.21.15.83:0/2751828974 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c007780 con 0x7f107c003ba0 2024-03-30T13:08:59.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.016+0000 7f1098d5b640 1 -- 172.21.15.83:0/2751828974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f107c003ba0 msgr2=0x7f107c003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.016+0000 7f1098d5b640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f107c003ba0 0x7f107c003fa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f108c00a6f0 tx=0x7f108c01d200 comp rx=0 tx=0).stop 2024-03-30T13:08:59.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.016+0000 7f1098d5b640 1 -- 172.21.15.83:0/2751828974 shutdown_connections 2024-03-30T13:08:59.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.016+0000 7f1098d5b640 1 --2- 172.21.15.83:0/2751828974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f107c003ba0 0x7f107c003fa0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.016+0000 7f1098d5b640 1 -- 172.21.15.83:0/2751828974 >> 172.21.15.83:0/2751828974 conn(0x7f10940b2d70 msgr2=0x7f10940b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:59.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.016+0000 7f1098d5b640 1 -- 172.21.15.83:0/2751828974 shutdown_connections 2024-03-30T13:08:59.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.016+0000 7f1098d5b640 1 -- 172.21.15.83:0/2751828974 wait complete. 2024-03-30T13:08:59.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1098d5b640 1 Processor -- start 2024-03-30T13:08:59.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1098d5b640 1 -- start start 2024-03-30T13:08:59.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1098d5b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f107c003ba0 0x7f1094160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1098d5b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10941613e0 0x7f10940b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1098d5b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f109412a100 0x7f109412a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1098d5b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f109406c020 con 0x7f10941613e0 2024-03-30T13:08:59.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1098d5b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f109406bea0 con 0x7f107c003ba0 2024-03-30T13:08:59.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1098d5b640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f109406c1a0 con 0x7f109412a100 2024-03-30T13:08:59.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1091d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10941613e0 0x7f10940b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1091d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10941613e0 0x7f10940b5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58652/0 (socket says 172.21.15.83:58652) 2024-03-30T13:08:59.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1091d9b640 1 -- 172.21.15.83:0/29392759 learned_addr learned my addr 172.21.15.83:0/29392759 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:59.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f109259c640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f107c003ba0 0x7f1094160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1092d9d640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f109412a100 0x7f109412a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1091d9b640 1 -- 172.21.15.83:0/29392759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f109412a100 msgr2=0x7f109412a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1091d9b640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f109412a100 0x7f109412a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1091d9b640 1 -- 172.21.15.83:0/29392759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f107c003ba0 msgr2=0x7f1094160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1091d9b640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f107c003ba0 0x7f1094160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1091d9b640 1 -- 172.21.15.83:0/29392759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10940b5e60 con 0x7f10941613e0 2024-03-30T13:08:59.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1091d9b640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10941613e0 0x7f10940b5580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f10880116a0 tx=0x7f1088011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:59.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1082ffd640 1 -- 172.21.15.83:0/29392759 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088004220 con 0x7f10941613e0 2024-03-30T13:08:59.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1082ffd640 1 -- 172.21.15.83:0/29392759 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10880043c0 con 0x7f10941613e0 2024-03-30T13:08:59.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1098d5b640 1 -- 172.21.15.83:0/29392759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10940b6140 con 0x7f10941613e0 2024-03-30T13:08:59.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1082ffd640 1 -- 172.21.15.83:0/29392759 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108800f960 con 0x7f10941613e0 2024-03-30T13:08:59.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1098d5b640 1 -- 172.21.15.83:0/29392759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109412c880 con 0x7f10941613e0 2024-03-30T13:08:59.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1098d5b640 1 -- 172.21.15.83:0/29392759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f109412c390 con 0x7f10941613e0 2024-03-30T13:08:59.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1082ffd640 1 -- 172.21.15.83:0/29392759 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f108800fb00 con 0x7f10941613e0 2024-03-30T13:08:59.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1082ffd640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1074067fc0 0x7f107406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f1082ffd640 1 -- 172.21.15.83:0/29392759 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1088086bd0 con 0x7f10941613e0 2024-03-30T13:08:59.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.020+0000 7f109259c640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1074067fc0 0x7f107406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.024+0000 7f109259c640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1074067fc0 0x7f107406a480 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f108c00a6c0 tx=0x7f108c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:59.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.024+0000 7f1082ffd640 1 -- 172.21.15.83:0/29392759 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f1088019030 con 0x7f10941613e0 2024-03-30T13:08:59.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.180+0000 7f1098d5b640 1 -- 172.21.15.83:0/29392759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f109409f3d0 con 0x7f10941613e0 2024-03-30T13:08:59.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.180+0000 7f1082ffd640 1 -- 172.21.15.83:0/29392759 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f1088057410 con 0x7f10941613e0 2024-03-30T13:08:59.188 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:08:59.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.180+0000 7f1098d5b640 1 -- 172.21.15.83:0/29392759 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1074067fc0 msgr2=0x7f107406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.184+0000 7f1098d5b640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1074067fc0 0x7f107406a480 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f108c00a6c0 tx=0x7f108c0a7000 comp rx=0 tx=0).stop 2024-03-30T13:08:59.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.184+0000 7f1098d5b640 1 -- 172.21.15.83:0/29392759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10941613e0 msgr2=0x7f10940b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.184+0000 7f1098d5b640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10941613e0 0x7f10940b5580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f10880116a0 tx=0x7f1088011b60 comp rx=0 tx=0).stop 2024-03-30T13:08:59.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.184+0000 7f1098d5b640 1 -- 172.21.15.83:0/29392759 shutdown_connections 2024-03-30T13:08:59.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.184+0000 7f1098d5b640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1074067fc0 0x7f107406a480 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.184+0000 7f1098d5b640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f109412a100 0x7f109412a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.184+0000 7f1098d5b640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10941613e0 0x7f10940b5580 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.184+0000 7f1098d5b640 1 --2- 172.21.15.83:0/29392759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f107c003ba0 0x7f1094160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.184+0000 7f1098d5b640 1 -- 172.21.15.83:0/29392759 >> 172.21.15.83:0/29392759 conn(0x7f10940b2d70 msgr2=0x7f10941646b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:59.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.184+0000 7f1098d5b640 1 -- 172.21.15.83:0/29392759 shutdown_connections 2024-03-30T13:08:59.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.184+0000 7f1098d5b640 1 -- 172.21.15.83:0/29392759 wait complete. 2024-03-30T13:08:59.205 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:08:59.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4c594640 1 Processor -- start 2024-03-30T13:08:59.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4c594640 1 -- start start 2024-03-30T13:08:59.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4c594640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6c440721c0 0x7f6c44072670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4c594640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c440b3f80 0x7f6c440b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4c594640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c4406f540 con 0x7f6c4415a980 2024-03-30T13:08:59.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4c594640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6c440b3530 con 0x7f6c440721c0 2024-03-30T13:08:59.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4c594640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4406f820 con 0x7f6c440b3f80 2024-03-30T13:08:59.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4ab31640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c440b3f80 0x7f6c440b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4a330640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6c4415a980 0x7f6c4406ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:38118/0 (socket says 172.21.15.83:38118) 2024-03-30T13:08:59.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4a330640 1 -- 172.21.15.83:0/180397057 learned_addr learned my addr 172.21.15.83:0/180397057 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:59.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c49b2f640 1 --2- 172.21.15.83:0/180397057 >> v2:172.21.15.153:3300/0 conn(0x7f6c440721c0 0x7f6c44072670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4932e640 1 -- 172.21.15.83:0/180397057 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034413866 0 0) 0x7f6c4406f540 con 0x7f6c4415a980 2024-03-30T13:08:59.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4932e640 1 -- 172.21.15.83:0/180397057 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c30003530 con 0x7f6c4415a980 2024-03-30T13:08:59.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c49b2f640 1 -- 172.21.15.83:0/180397057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c440b3f80 msgr2=0x7f6c440b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:59.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c49b2f640 1 --2- 172.21.15.83:0/180397057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c440b3f80 0x7f6c440b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c49b2f640 1 -- 172.21.15.83:0/180397057 >> v1:172.21.15.153:6789/0 conn(0x7f6c4415a980 legacy=0x7f6c4406ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c49b2f640 1 -- 172.21.15.83:0/180397057 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c440b3780 con 0x7f6c440721c0 2024-03-30T13:08:59.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.308+0000 7f6c4ab31640 1 --2- 172.21.15.83:0/180397057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c440b3f80 0x7f6c440b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:08:59.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c49b2f640 1 --2- 172.21.15.83:0/180397057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c440721c0 0x7f6c44072670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6c400097c0 tx=0x7f6c4001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6cd162d49a580f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:59.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4932e640 1 -- 172.21.15.83:0/180397057 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c400b0070 con 0x7f6c440721c0 2024-03-30T13:08:59.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4932e640 1 -- 172.21.15.83:0/180397057 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c400ab600 con 0x7f6c440721c0 2024-03-30T13:08:59.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4932e640 1 -- 172.21.15.83:0/180397057 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c400ab9b0 con 0x7f6c440721c0 2024-03-30T13:08:59.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4c594640 1 -- 172.21.15.83:0/180397057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c440721c0 msgr2=0x7f6c44072670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4c594640 1 --2- 172.21.15.83:0/180397057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c440721c0 0x7f6c44072670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6c400097c0 tx=0x7f6c4001c4a0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4c594640 1 -- 172.21.15.83:0/180397057 shutdown_connections 2024-03-30T13:08:59.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4c594640 1 --2- 172.21.15.83:0/180397057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c440b3f80 0x7f6c440b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4c594640 1 --2- 172.21.15.83:0/180397057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c440721c0 0x7f6c44072670 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4c594640 1 -- 172.21.15.83:0/180397057 >> 172.21.15.83:0/180397057 conn(0x7f6c440b1d60 msgr2=0x7f6c440b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:59.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4c594640 1 -- 172.21.15.83:0/180397057 shutdown_connections 2024-03-30T13:08:59.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4c594640 1 -- 172.21.15.83:0/180397057 wait complete. 2024-03-30T13:08:59.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4c594640 1 Processor -- start 2024-03-30T13:08:59.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.312+0000 7f6c4c594640 1 -- start start 2024-03-30T13:08:59.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4c594640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c440721c0 0x7f6c44153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4c594640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c440b3f80 0x7f6c441516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4c594640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c4415a980 0x7f6c44151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4c594640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4415ad60 con 0x7f6c440b3f80 2024-03-30T13:08:59.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4c594640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4406f150 con 0x7f6c4415a980 2024-03-30T13:08:59.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4c594640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c441527c0 con 0x7f6c440721c0 2024-03-30T13:08:59.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c49b2f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c440b3f80 0x7f6c441516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c49b2f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c440b3f80 0x7f6c441516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58658/0 (socket says 172.21.15.83:58658) 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c49b2f640 1 -- 172.21.15.83:0/1715938795 learned_addr learned my addr 172.21.15.83:0/1715938795 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4ab31640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c4415a980 0x7f6c44151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4a330640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c440721c0 0x7f6c44153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c49b2f640 1 -- 172.21.15.83:0/1715938795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c440721c0 msgr2=0x7f6c44153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c49b2f640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c440721c0 0x7f6c44153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c49b2f640 1 -- 172.21.15.83:0/1715938795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c4415a980 msgr2=0x7f6c44151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c49b2f640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c4415a980 0x7f6c44151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c49b2f640 1 -- 172.21.15.83:0/1715938795 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c44152200 con 0x7f6c440b3f80 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4a330640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c440721c0 0x7f6c44153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c49b2f640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c440b3f80 0x7f6c441516e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6c40000c10 tx=0x7f6c40019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c3affd640 1 -- 172.21.15.83:0/1715938795 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c400ba070 con 0x7f6c440b3f80 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c3affd640 1 -- 172.21.15.83:0/1715938795 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c400ab9b0 con 0x7f6c440b3f80 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4c594640 1 -- 172.21.15.83:0/1715938795 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c441524e0 con 0x7f6c440b3f80 2024-03-30T13:08:59.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c3affd640 1 -- 172.21.15.83:0/1715938795 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c400b0040 con 0x7f6c440b3f80 2024-03-30T13:08:59.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4c594640 1 -- 172.21.15.83:0/1715938795 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c44146b90 con 0x7f6c440b3f80 2024-03-30T13:08:59.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4c594640 1 -- 172.21.15.83:0/1715938795 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c440686c0 con 0x7f6c440b3f80 2024-03-30T13:08:59.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c3affd640 1 -- 172.21.15.83:0/1715938795 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6c400bd070 con 0x7f6c440b3f80 2024-03-30T13:08:59.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c3affd640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c28067fc0 0x7f6c2806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c3affd640 1 -- 172.21.15.83:0/1715938795 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6c4011f630 con 0x7f6c440b3f80 2024-03-30T13:08:59.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4a330640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c28067fc0 0x7f6c2806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.316+0000 7f6c4a330640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c28067fc0 0x7f6c2806a480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6c34005890 tx=0x7f6c34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:59.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.320+0000 7f6c3affd640 1 -- 172.21.15.83:0/1715938795 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6c40016090 con 0x7f6c440b3f80 2024-03-30T13:08:59.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.472+0000 7f6c4c594640 1 -- 172.21.15.83:0/1715938795 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c440b3310 con 0x7f6c440b3f80 2024-03-30T13:08:59.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.472+0000 7f6c3affd640 1 -- 172.21.15.83:0/1715938795 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f6c400efe70 con 0x7f6c440b3f80 2024-03-30T13:08:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:08:59.480 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:08:59.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.476+0000 7f6c4c594640 1 -- 172.21.15.83:0/1715938795 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c28067fc0 msgr2=0x7f6c2806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.476+0000 7f6c4c594640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c28067fc0 0x7f6c2806a480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6c34005890 tx=0x7f6c34009040 comp rx=0 tx=0).stop 2024-03-30T13:08:59.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.476+0000 7f6c4c594640 1 -- 172.21.15.83:0/1715938795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c440b3f80 msgr2=0x7f6c441516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.476+0000 7f6c4c594640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c440b3f80 0x7f6c441516e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6c40000c10 tx=0x7f6c40019240 comp rx=0 tx=0).stop 2024-03-30T13:08:59.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.476+0000 7f6c4c594640 1 -- 172.21.15.83:0/1715938795 shutdown_connections 2024-03-30T13:08:59.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.476+0000 7f6c4c594640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c28067fc0 0x7f6c2806a480 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.476+0000 7f6c4c594640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c4415a980 0x7f6c44151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.476+0000 7f6c4c594640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c440b3f80 0x7f6c441516e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.476+0000 7f6c4c594640 1 --2- 172.21.15.83:0/1715938795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c440721c0 0x7f6c44153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.476+0000 7f6c4c594640 1 -- 172.21.15.83:0/1715938795 >> 172.21.15.83:0/1715938795 conn(0x7f6c440b1d60 msgr2=0x7f6c440d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:59.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.476+0000 7f6c4c594640 1 -- 172.21.15.83:0/1715938795 shutdown_connections 2024-03-30T13:08:59.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.476+0000 7f6c4c594640 1 -- 172.21.15.83:0/1715938795 wait complete. 2024-03-30T13:08:59.497 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:08:59.498 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:08:59.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 Processor -- start 2024-03-30T13:08:59.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- start start 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7440b4d90 0x7ff744072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff744071830 con 0x7ff74415a8b0 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff744071ad0 con 0x7ff744073630 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff744071db0 con 0x7ff7440b4d90 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff749a35640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff74415a8b0 0x7ff744072f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46172/0 (socket says 172.21.15.83:46172) 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff749a35640 1 -- 172.21.15.83:0/3542249178 learned_addr learned my addr 172.21.15.83:0/3542249178 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 --2- 172.21.15.83:0/3542249178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7440b4d90 0x7ff744072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2098101962 0 0) 0x7ff744071830 con 0x7ff74415a8b0 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff730003530 con 0x7ff74415a8b0 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 487177870 0 0) 0x7ff730003530 con 0x7ff74415a8b0 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7440b4d90 msgr2=0x7ff744072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 --2- 172.21.15.83:0/3542249178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7440b4d90 0x7ff744072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 >> v1:172.21.15.153:6789/0 conn(0x7ff744073630 legacy=0x7ff7440b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff744072090 con 0x7ff74415a8b0 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7ff740001680 con 0x7ff74415a8b0 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 >> v1:172.21.15.83:6789/0 conn(0x7ff74415a8b0 legacy=0x7ff744072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 --2- 172.21.15.83:0/3542249178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7440b4d90 0x7ff7300039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 --2- 172.21.15.83:0/3542249178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff730004020 0x7ff730004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 --2- 172.21.15.83:0/3542249178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff730004d50 0x7ff7300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff744071db0 con 0x7ff730004d50 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff73000bb90 con 0x7ff730004020 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff73000dfa0 con 0x7ff7440b4d90 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 --2- 172.21.15.83:0/3542249178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff730004d50 0x7ff7300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff749a35640 1 --2- 172.21.15.83:0/3542249178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7440b4d90 0x7ff7300039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff749234640 1 --2- 172.21.15.83:0/3542249178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff730004020 0x7ff730004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 -- 172.21.15.83:0/3542249178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7440b4d90 msgr2=0x7ff7300039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:59.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 --2- 172.21.15.83:0/3542249178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7440b4d90 0x7ff7300039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 -- 172.21.15.83:0/3542249178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff730004020 msgr2=0x7ff730004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 --2- 172.21.15.83:0/3542249178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff730004020 0x7ff730004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 -- 172.21.15.83:0/3542249178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff730003530 con 0x7ff730004d50 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 --2- 172.21.15.83:0/3542249178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff730004d50 0x7ff7300051d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff73c007360 tx=0x7ff73c01ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75815fdb2b75cf6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0b2070 con 0x7ff730004d50 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73c0a5d40 con 0x7ff730004d50 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff748a33640 1 -- 172.21.15.83:0/3542249178 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c009be0 con 0x7ff730004d50 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- 172.21.15.83:0/3542249178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff730004d50 msgr2=0x7ff7300051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 --2- 172.21.15.83:0/3542249178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff730004d50 0x7ff7300051d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff73c007360 tx=0x7ff73c01ce40 comp rx=0 tx=0).stop 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 -- 172.21.15.83:0/3542249178 reap_dead start 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- 172.21.15.83:0/3542249178 shutdown_connections 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- 172.21.15.83:0/3542249178 >> 172.21.15.83:0/3542249178 conn(0x7ff74406b660 msgr2=0x7ff74406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- 172.21.15.83:0/3542249178 shutdown_connections 2024-03-30T13:08:59.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- 172.21.15.83:0/3542249178 wait complete. 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 Processor -- start 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- start start 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7441f4270 0x7ff74415d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff74409c330 0x7ff74409c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7441f7ef0 0x7ff7441f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff74415ae10 con 0x7ff7441f7ef0 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff74415ac90 con 0x7ff74409c330 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff744072890 con 0x7ff7441f4270 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7441f7ef0 0x7ff7441f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7441f7ef0 0x7ff7441f83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58668/0 (socket says 172.21.15.83:58668) 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 -- 172.21.15.83:0/747531436 learned_addr learned my addr 172.21.15.83:0/747531436 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff749234640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff74409c330 0x7ff74409c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff749a35640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7441f4270 0x7ff74415d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 -- 172.21.15.83:0/747531436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7441f4270 msgr2=0x7ff74415d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7441f4270 0x7ff74415d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 -- 172.21.15.83:0/747531436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff74409c330 msgr2=0x7ff74409c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff74409c330 0x7ff74409c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 -- 172.21.15.83:0/747531436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74414f9e0 con 0x7ff7441f7ef0 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74a236640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7441f7ef0 0x7ff7441f83a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff73c002240 tx=0x7ff730005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff73a7fc640 1 -- 172.21.15.83:0/747531436 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0bb070 con 0x7ff7441f7ef0 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff73a7fc640 1 -- 172.21.15.83:0/747531436 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73c0a5b40 con 0x7ff7441f7ef0 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- 172.21.15.83:0/747531436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74415bd10 con 0x7ff7441f7ef0 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff73a7fc640 1 -- 172.21.15.83:0/747531436 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0b2040 con 0x7ff7441f7ef0 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.608+0000 7ff74bc99640 1 -- 172.21.15.83:0/747531436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74415c2d0 con 0x7ff7441f7ef0 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.612+0000 7ff74bc99640 1 -- 172.21.15.83:0/747531436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff74409e540 con 0x7ff7441f7ef0 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.612+0000 7ff73a7fc640 1 -- 172.21.15.83:0/747531436 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff73c0be070 con 0x7ff7441f7ef0 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.612+0000 7ff73a7fc640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff728067ff0 0x7ff72806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.612+0000 7ff73a7fc640 1 -- 172.21.15.83:0/747531436 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff73c1200e0 con 0x7ff7441f7ef0 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.612+0000 7ff749a35640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff728067ff0 0x7ff72806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.612+0000 7ff749a35640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff728067ff0 0x7ff72806a4b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff740001ec0 tx=0x7ff740009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:59.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.616+0000 7ff73a7fc640 1 -- 172.21.15.83:0/747531436 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff73c016b50 con 0x7ff7441f7ef0 2024-03-30T13:08:59.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 -- 172.21.15.83:0/747531436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff744150b00 con 0x7ff7441f7ef0 2024-03-30T13:08:59.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff73a7fc640 1 -- 172.21.15.83:0/747531436 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7ff73c0f01b0 con 0x7ff7441f7ef0 2024-03-30T13:08:59.772 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:08:59.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 -- 172.21.15.83:0/747531436 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff728067ff0 msgr2=0x7ff72806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff728067ff0 0x7ff72806a4b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff740001ec0 tx=0x7ff740009040 comp rx=0 tx=0).stop 2024-03-30T13:08:59.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 -- 172.21.15.83:0/747531436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7441f7ef0 msgr2=0x7ff7441f83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7441f7ef0 0x7ff7441f83a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff73c002240 tx=0x7ff730005840 comp rx=0 tx=0).stop 2024-03-30T13:08:59.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 -- 172.21.15.83:0/747531436 shutdown_connections 2024-03-30T13:08:59.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff728067ff0 0x7ff72806a4b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7441f7ef0 0x7ff7441f83a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff74409c330 0x7ff74409c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 --2- 172.21.15.83:0/747531436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7441f4270 0x7ff74415d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 -- 172.21.15.83:0/747531436 >> 172.21.15.83:0/747531436 conn(0x7ff74406b660 msgr2=0x7ff74406edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:59.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 -- 172.21.15.83:0/747531436 shutdown_connections 2024-03-30T13:08:59.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.768+0000 7ff74bc99640 1 -- 172.21.15.83:0/747531436 wait complete. 2024-03-30T13:08:59.789 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:08:59.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.904+0000 7f8b47236640 1 Processor -- start 2024-03-30T13:08:59.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.904+0000 7f8b47236640 1 -- start start 2024-03-30T13:08:59.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b47236640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8b40073570 0x7f8b4006f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b47236640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b400b31e0 con 0x7f8b4015b050 2024-03-30T13:08:59.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b47236640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b400ad4f0 con 0x7f8b4006f690 2024-03-30T13:08:59.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b47236640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f8b4006fb00 con 0x7f8b40073570 2024-03-30T13:08:59.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b3ffff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8b40073570 0x7f8b4006f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b44fd2640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f8b4015b050 0x7f8b400b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46182/0 (socket says 172.21.15.83:46182) 2024-03-30T13:08:59.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b44fd2640 1 -- 172.21.15.83:0/3989934132 learned_addr learned my addr 172.21.15.83:0/3989934132 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:08:59.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b3ffff640 1 -- 172.21.15.83:0/3989934132 >> v1:172.21.15.153:6789/0 conn(0x7f8b4006f690 legacy=0x7f8b4015b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:08:59.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b3ffff640 1 -- 172.21.15.83:0/3989934132 >> v1:172.21.15.83:6789/0 conn(0x7f8b4015b050 legacy=0x7f8b400b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b3ffff640 1 -- 172.21.15.83:0/3989934132 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b400ad7d0 con 0x7f8b40073570 2024-03-30T13:08:59.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b3f7fe640 1 -- 172.21.15.83:0/3989934132 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1018865333 0 0) 0x7f8b400b31e0 con 0x7f8b4015b050 2024-03-30T13:08:59.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b3ffff640 1 --2- 172.21.15.83:0/3989934132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b40073570 0x7f8b4006f150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8b300097c0 tx=0x7f8b3001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18027e66b767990e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:59.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b3f7fe640 1 -- 172.21.15.83:0/3989934132 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b300ab430 con 0x7f8b40073570 2024-03-30T13:08:59.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b3f7fe640 1 -- 172.21.15.83:0/3989934132 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b300b0070 con 0x7f8b40073570 2024-03-30T13:08:59.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b3f7fe640 1 -- 172.21.15.83:0/3989934132 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b300ab7f0 con 0x7f8b40073570 2024-03-30T13:08:59.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b47236640 1 -- 172.21.15.83:0/3989934132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b40073570 msgr2=0x7f8b4006f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b47236640 1 --2- 172.21.15.83:0/3989934132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b40073570 0x7f8b4006f150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8b300097c0 tx=0x7f8b3001c430 comp rx=0 tx=0).stop 2024-03-30T13:08:59.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b47236640 1 -- 172.21.15.83:0/3989934132 shutdown_connections 2024-03-30T13:08:59.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b47236640 1 --2- 172.21.15.83:0/3989934132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b40073570 0x7f8b4006f150 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b47236640 1 -- 172.21.15.83:0/3989934132 >> 172.21.15.83:0/3989934132 conn(0x7f8b4006b660 msgr2=0x7f8b4006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:08:59.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b47236640 1 -- 172.21.15.83:0/3989934132 shutdown_connections 2024-03-30T13:08:59.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.908+0000 7f8b47236640 1 -- 172.21.15.83:0/3989934132 wait complete. 2024-03-30T13:08:59.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b47236640 1 Processor -- start 2024-03-30T13:08:59.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b47236640 1 -- start start 2024-03-30T13:08:59.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b47236640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4006f690 0x7f8b40145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b47236640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b40073570 0x7f8b40144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b47236640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b4015b050 0x7f8b40145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b47236640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8b400b4c10 con 0x7f8b4006f690 2024-03-30T13:08:59.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b47236640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b400739c0 con 0x7f8b40073570 2024-03-30T13:08:59.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b47236640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8b400b4d90 con 0x7f8b4015b050 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b44fd2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4006f690 0x7f8b40145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b44fd2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4006f690 0x7f8b40145090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58684/0 (socket says 172.21.15.83:58684) 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b44fd2640 1 -- 172.21.15.83:0/75509164 learned_addr learned my addr 172.21.15.83:0/75509164 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b3ffff640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b40073570 0x7f8b40144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b457d3640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b4015b050 0x7f8b40145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b44fd2640 1 -- 172.21.15.83:0/75509164 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b4015b050 msgr2=0x7f8b40145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b44fd2640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b4015b050 0x7f8b40145d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b44fd2640 1 -- 172.21.15.83:0/75509164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b40073570 msgr2=0x7f8b40144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b44fd2640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b40073570 0x7f8b40144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b44fd2640 1 -- 172.21.15.83:0/75509164 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b400b0800 con 0x7f8b4006f690 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b457d3640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b4015b050 0x7f8b40145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b44fd2640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4006f690 0x7f8b40145090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8b340011f0 tx=0x7f8b3400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b3d7fa640 1 -- 172.21.15.83:0/75509164 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34018070 con 0x7f8b4006f690 2024-03-30T13:08:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b3d7fa640 1 -- 172.21.15.83:0/75509164 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b340074e0 con 0x7f8b4006f690 2024-03-30T13:08:59.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b47236640 1 -- 172.21.15.83:0/75509164 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b40144e40 con 0x7f8b4006f690 2024-03-30T13:08:59.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b3d7fa640 1 -- 172.21.15.83:0/75509164 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34004a10 con 0x7f8b4006f690 2024-03-30T13:08:59.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b47236640 1 -- 172.21.15.83:0/75509164 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b401520b0 con 0x7f8b4006f690 2024-03-30T13:08:59.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b47236640 1 -- 172.21.15.83:0/75509164 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b4009e540 con 0x7f8b4006f690 2024-03-30T13:08:59.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.912+0000 7f8b3d7fa640 1 -- 172.21.15.83:0/75509164 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f8b3401b070 con 0x7f8b4006f690 2024-03-30T13:08:59.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.916+0000 7f8b3d7fa640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8b2c067fc0 0x7f8b2c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:08:59.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.916+0000 7f8b3d7fa640 1 -- 172.21.15.83:0/75509164 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8b34085830 con 0x7f8b4006f690 2024-03-30T13:08:59.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.916+0000 7f8b3ffff640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8b2c067fc0 0x7f8b2c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:08:59.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.916+0000 7f8b3ffff640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8b2c067fc0 0x7f8b2c06a480 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8b300af000 tx=0x7f8b300a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:08:59.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:08:59.920+0000 7f8b3d7fa640 1 -- 172.21.15.83:0/75509164 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f8b34055fe0 con 0x7f8b4006f690 2024-03-30T13:09:00.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 -- 172.21.15.83:0/75509164 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8b40145b50 con 0x7f8b4006f690 2024-03-30T13:09:00.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b3d7fa640 1 -- 172.21.15.83:0/75509164 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f8b3405ae20 con 0x7f8b4006f690 2024-03-30T13:09:00.127 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:09:00.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 -- 172.21.15.83:0/75509164 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8b2c067fc0 msgr2=0x7f8b2c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8b2c067fc0 0x7f8b2c06a480 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8b300af000 tx=0x7f8b300a7000 comp rx=0 tx=0).stop 2024-03-30T13:09:00.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 -- 172.21.15.83:0/75509164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4006f690 msgr2=0x7f8b40145090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4006f690 0x7f8b40145090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8b340011f0 tx=0x7f8b3400c9b0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 -- 172.21.15.83:0/75509164 shutdown_connections 2024-03-30T13:09:00.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8b2c067fc0 0x7f8b2c06a480 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b4015b050 0x7f8b40145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b40073570 0x7f8b40144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 --2- 172.21.15.83:0/75509164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4006f690 0x7f8b40145090 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 -- 172.21.15.83:0/75509164 >> 172.21.15.83:0/75509164 conn(0x7f8b4006b660 msgr2=0x7f8b400b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:00.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 -- 172.21.15.83:0/75509164 shutdown_connections 2024-03-30T13:09:00.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.124+0000 7f8b47236640 1 -- 172.21.15.83:0/75509164 wait complete. 2024-03-30T13:09:00.145 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:09:00.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc29c774640 1 Processor -- start 2024-03-30T13:09:00.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc29c774640 1 -- start start 2024-03-30T13:09:00.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc29c774640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc2940cf3e0 0x7fc2940d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc29c774640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2940d1fa0 con 0x7fc29415e920 2024-03-30T13:09:00.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc29c774640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29409b500 con 0x7fc2940b4990 2024-03-30T13:09:00.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc29c774640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc2940af150 con 0x7fc2940cf3e0 2024-03-30T13:09:00.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc29a510640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc29415e920 0x7fc2940cecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46184/0 (socket says 172.21.15.83:46184) 2024-03-30T13:09:00.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc29a510640 1 -- 172.21.15.83:0/542894704 learned_addr learned my addr 172.21.15.83:0/542894704 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:00.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc299d0f640 1 --2- 172.21.15.83:0/542894704 >> v2:172.21.15.83:3300/0 conn(0x7fc2940cf3e0 0x7fc2940d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc29950e640 1 -- 172.21.15.83:0/542894704 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4257705527 0 0) 0x7fc2940d1fa0 con 0x7fc29415e920 2024-03-30T13:09:00.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc29950e640 1 -- 172.21.15.83:0/542894704 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc280003530 con 0x7fc29415e920 2024-03-30T13:09:00.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc299d0f640 1 -- 172.21.15.83:0/542894704 >> v1:172.21.15.153:6789/0 conn(0x7fc2940b4990 legacy=0x7fc2940af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc299d0f640 1 -- 172.21.15.83:0/542894704 >> v1:172.21.15.83:6789/0 conn(0x7fc29415e920 legacy=0x7fc2940cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.268+0000 7fc299d0f640 1 -- 172.21.15.83:0/542894704 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29409b7e0 con 0x7fc2940cf3e0 2024-03-30T13:09:00.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc299d0f640 1 --2- 172.21.15.83:0/542894704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2940cf3e0 0x7fc2940d19a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc2840097c0 tx=0x7fc28401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12a821a76e0f4ac server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:00.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc29950e640 1 -- 172.21.15.83:0/542894704 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840b1070 con 0x7fc2940cf3e0 2024-03-30T13:09:00.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc29950e640 1 -- 172.21.15.83:0/542894704 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2840ac410 con 0x7fc2940cf3e0 2024-03-30T13:09:00.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc29950e640 1 -- 172.21.15.83:0/542894704 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840ac7c0 con 0x7fc2940cf3e0 2024-03-30T13:09:00.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc29c774640 1 -- 172.21.15.83:0/542894704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2940cf3e0 msgr2=0x7fc2940d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc29c774640 1 --2- 172.21.15.83:0/542894704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2940cf3e0 0x7fc2940d19a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc2840097c0 tx=0x7fc28401c4a0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc29c774640 1 -- 172.21.15.83:0/542894704 shutdown_connections 2024-03-30T13:09:00.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc29c774640 1 --2- 172.21.15.83:0/542894704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2940cf3e0 0x7fc2940d19a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc29c774640 1 -- 172.21.15.83:0/542894704 >> 172.21.15.83:0/542894704 conn(0x7fc2940b3e70 msgr2=0x7fc2940b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:00.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc29c774640 1 -- 172.21.15.83:0/542894704 shutdown_connections 2024-03-30T13:09:00.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc29c774640 1 -- 172.21.15.83:0/542894704 wait complete. 2024-03-30T13:09:00.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc29c774640 1 Processor -- start 2024-03-30T13:09:00.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.272+0000 7fc29c774640 1 -- start start 2024-03-30T13:09:00.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29c774640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2940b4990 0x7fc294157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29c774640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2940cf3e0 0x7fc2940b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29c774640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc29415e920 0x7fc2941622c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29c774640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc29416c6b0 con 0x7fc2940cf3e0 2024-03-30T13:09:00.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29c774640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940b0ab0 con 0x7fc2940b4990 2024-03-30T13:09:00.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29c774640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc29416c830 con 0x7fc29415e920 2024-03-30T13:09:00.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc299d0f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2940cf3e0 0x7fc2940b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc299d0f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2940cf3e0 0x7fc2940b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58704/0 (socket says 172.21.15.83:58704) 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc299d0f640 1 -- 172.21.15.83:0/2052716457 learned_addr learned my addr 172.21.15.83:0/2052716457 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29a510640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2940b4990 0x7fc294157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29ad11640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc29415e920 0x7fc2941622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc299d0f640 1 -- 172.21.15.83:0/2052716457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc29415e920 msgr2=0x7fc2941622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc299d0f640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc29415e920 0x7fc2941622c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc299d0f640 1 -- 172.21.15.83:0/2052716457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2940b4990 msgr2=0x7fc294157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc299d0f640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2940b4990 0x7fc294157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc299d0f640 1 -- 172.21.15.83:0/2052716457 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc294156b10 con 0x7fc2940cf3e0 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc299d0f640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2940cf3e0 0x7fc2940b3360 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2840af040 tx=0x7fc284019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc28affd640 1 -- 172.21.15.83:0/2052716457 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840bc070 con 0x7fc2940cf3e0 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc28affd640 1 -- 172.21.15.83:0/2052716457 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2840acd70 con 0x7fc2940cf3e0 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29c774640 1 -- 172.21.15.83:0/2052716457 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc294156df0 con 0x7fc2940cf3e0 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc28affd640 1 -- 172.21.15.83:0/2052716457 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840b1040 con 0x7fc2940cf3e0 2024-03-30T13:09:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29c774640 1 -- 172.21.15.83:0/2052716457 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2941573b0 con 0x7fc2940cf3e0 2024-03-30T13:09:00.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29c774640 1 -- 172.21.15.83:0/2052716457 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2940a04d0 con 0x7fc2940cf3e0 2024-03-30T13:09:00.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc28affd640 1 -- 172.21.15.83:0/2052716457 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc2840bf070 con 0x7fc2940cf3e0 2024-03-30T13:09:00.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc28affd640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc278067fc0 0x7fc27806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc28affd640 1 -- 172.21.15.83:0/2052716457 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc28411f490 con 0x7fc2940cf3e0 2024-03-30T13:09:00.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29a510640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc278067fc0 0x7fc27806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.276+0000 7fc29a510640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc278067fc0 0x7fc27806a480 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc2900011f0 tx=0x7fc290007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:00.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.280+0000 7fc28affd640 1 -- 172.21.15.83:0/2052716457 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fc284016090 con 0x7fc2940cf3e0 2024-03-30T13:09:00.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.436+0000 7fc29c774640 1 -- 172.21.15.83:0/2052716457 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc29404f9e0 con 0x7fc2940cf3e0 2024-03-30T13:09:00.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.436+0000 7fc28affd640 1 -- 172.21.15.83:0/2052716457 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fc2840ef5d0 con 0x7fc2940cf3e0 2024-03-30T13:09:00.440 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:09:00.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.440+0000 7fc29c774640 1 -- 172.21.15.83:0/2052716457 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc278067fc0 msgr2=0x7fc27806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.440+0000 7fc29c774640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc278067fc0 0x7fc27806a480 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc2900011f0 tx=0x7fc290007d40 comp rx=0 tx=0).stop 2024-03-30T13:09:00.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.440+0000 7fc29c774640 1 -- 172.21.15.83:0/2052716457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2940cf3e0 msgr2=0x7fc2940b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.440+0000 7fc29c774640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2940cf3e0 0x7fc2940b3360 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2840af040 tx=0x7fc284019240 comp rx=0 tx=0).stop 2024-03-30T13:09:00.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.440+0000 7fc29c774640 1 -- 172.21.15.83:0/2052716457 shutdown_connections 2024-03-30T13:09:00.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.440+0000 7fc29c774640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc278067fc0 0x7fc27806a480 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.440+0000 7fc29c774640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc29415e920 0x7fc2941622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.440+0000 7fc29c774640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2940cf3e0 0x7fc2940b3360 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.440+0000 7fc29c774640 1 --2- 172.21.15.83:0/2052716457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2940b4990 0x7fc294157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.440+0000 7fc29c774640 1 -- 172.21.15.83:0/2052716457 >> 172.21.15.83:0/2052716457 conn(0x7fc2940b3e70 msgr2=0x7fc2940cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:00.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.440+0000 7fc29c774640 1 -- 172.21.15.83:0/2052716457 shutdown_connections 2024-03-30T13:09:00.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.440+0000 7fc29c774640 1 -- 172.21.15.83:0/2052716457 wait complete. 2024-03-30T13:09:00.464 INFO:tasks.cephfs_test_runner:Starting test: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:09:00.465 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:00.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66cb365640 1 Processor -- start 2024-03-30T13:09:00.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66cb365640 1 -- start start 2024-03-30T13:09:00.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66cb365640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c40b4830 0x7f66c415d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66cb365640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f66c406dfe0 0x7f66c406e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66cb365640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66c415d880 con 0x7f66c40aed20 2024-03-30T13:09:00.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66cb365640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f66c4156e00 con 0x7f66c406dfe0 2024-03-30T13:09:00.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66cb365640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f66c40ad040 con 0x7f66c40b4830 2024-03-30T13:09:00.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66c9902640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f66c406dfe0 0x7f66c406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66c9902640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f66c406dfe0 0x7f66c406e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58706/0 (socket says 172.21.15.83:58706) 2024-03-30T13:09:00.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66c9902640 1 -- 172.21.15.83:0/3532147509 learned_addr learned my addr 172.21.15.83:0/3532147509 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:00.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66c9101640 1 --2- 172.21.15.83:0/3532147509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c40b4830 0x7f66c415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66c9902640 1 -- 172.21.15.83:0/3532147509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c40b4830 msgr2=0x7f66c415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:00.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66c9902640 1 --2- 172.21.15.83:0/3532147509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c40b4830 0x7f66c415d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66c9902640 1 -- 172.21.15.83:0/3532147509 >> v1:172.21.15.153:6789/0 conn(0x7f66c40aed20 legacy=0x7f66c40af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:00.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66c9902640 1 -- 172.21.15.83:0/3532147509 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c40cfcb0 con 0x7f66c406dfe0 2024-03-30T13:09:00.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66c9101640 1 --2- 172.21.15.83:0/3532147509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c40b4830 0x7f66c415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:00.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.572+0000 7f66c9902640 1 --2- 172.21.15.83:0/3532147509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c406dfe0 0x7f66c406e410 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009e50 tx=0x7f66bc01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6da458bccb7cfa server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:00.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66bbfff640 1 -- 172.21.15.83:0/3532147509 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc0a5720 con 0x7f66c406dfe0 2024-03-30T13:09:00.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66bbfff640 1 -- 172.21.15.83:0/3532147509 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66bc0a58c0 con 0x7f66c406dfe0 2024-03-30T13:09:00.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66bbfff640 1 -- 172.21.15.83:0/3532147509 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc0a5c90 con 0x7f66c406dfe0 2024-03-30T13:09:00.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 -- 172.21.15.83:0/3532147509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c406dfe0 msgr2=0x7f66c406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 --2- 172.21.15.83:0/3532147509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c406dfe0 0x7f66c406e410 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009e50 tx=0x7f66bc01c8a0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 -- 172.21.15.83:0/3532147509 shutdown_connections 2024-03-30T13:09:00.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 --2- 172.21.15.83:0/3532147509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c406dfe0 0x7f66c406e410 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 --2- 172.21.15.83:0/3532147509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c40b4830 0x7f66c415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 -- 172.21.15.83:0/3532147509 >> 172.21.15.83:0/3532147509 conn(0x7f66c40b1d60 msgr2=0x7f66c40b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:00.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 -- 172.21.15.83:0/3532147509 shutdown_connections 2024-03-30T13:09:00.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 -- 172.21.15.83:0/3532147509 wait complete. 2024-03-30T13:09:00.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 Processor -- start 2024-03-30T13:09:00.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 -- start start 2024-03-30T13:09:00.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c406dfe0 0x7f66c4099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c40aed20 0x7f66c414c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c40b4830 0x7f66c41551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f66c40cf860 con 0x7f66c406dfe0 2024-03-30T13:09:00.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66c406fa90 con 0x7f66c40aed20 2024-03-30T13:09:00.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66cb365640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f66c40cf9e0 con 0x7f66c40b4830 2024-03-30T13:09:00.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66c9101640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c406dfe0 0x7f66c4099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66c9101640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c406dfe0 0x7f66c4099a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58708/0 (socket says 172.21.15.83:58708) 2024-03-30T13:09:00.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66c9101640 1 -- 172.21.15.83:0/2816452858 learned_addr learned my addr 172.21.15.83:0/2816452858 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:00.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66c9902640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c40b4830 0x7f66c41551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66c8900640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c40aed20 0x7f66c414c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66c9101640 1 -- 172.21.15.83:0/2816452858 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c40b4830 msgr2=0x7f66c41551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66c9101640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c40b4830 0x7f66c41551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66c9101640 1 -- 172.21.15.83:0/2816452858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c40aed20 msgr2=0x7f66c414c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66c9101640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c40aed20 0x7f66c414c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66c9101640 1 -- 172.21.15.83:0/2816452858 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c40ccee0 con 0x7f66c406dfe0 2024-03-30T13:09:00.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66c9101640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c406dfe0 0x7f66c4099a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f66b400c7c0 tx=0x7f66b400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:00.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.576+0000 7f66b9ffb640 1 -- 172.21.15.83:0/2816452858 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4007a30 con 0x7f66c406dfe0 2024-03-30T13:09:00.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.580+0000 7f66b9ffb640 1 -- 172.21.15.83:0/2816452858 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b4007bd0 con 0x7f66c406dfe0 2024-03-30T13:09:00.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.580+0000 7f66b9ffb640 1 -- 172.21.15.83:0/2816452858 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b40113f0 con 0x7f66c406dfe0 2024-03-30T13:09:00.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.580+0000 7f66cb365640 1 -- 172.21.15.83:0/2816452858 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c414ced0 con 0x7f66c406dfe0 2024-03-30T13:09:00.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.580+0000 7f66cb365640 1 -- 172.21.15.83:0/2816452858 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c414d490 con 0x7f66c406dfe0 2024-03-30T13:09:00.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.580+0000 7f66cb365640 1 -- 172.21.15.83:0/2816452858 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c40686c0 con 0x7f66c406dfe0 2024-03-30T13:09:00.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.580+0000 7f66b9ffb640 1 -- 172.21.15.83:0/2816452858 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f66b4011590 con 0x7f66c406dfe0 2024-03-30T13:09:00.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.580+0000 7f66b9ffb640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f66a8067fc0 0x7f66a806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.580+0000 7f66c8900640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f66a8067fc0 0x7f66a806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.580+0000 7f66b9ffb640 1 -- 172.21.15.83:0/2816452858 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f66b4086670 con 0x7f66c406dfe0 2024-03-30T13:09:00.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.580+0000 7f66c8900640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f66a8067fc0 0x7f66a806a480 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f66c406e620 tx=0x7f66c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:00.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.584+0000 7f66b9ffb640 1 -- 172.21.15.83:0/2816452858 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f66b4015020 con 0x7f66c406dfe0 2024-03-30T13:09:00.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.740+0000 7f66cb365640 1 -- 172.21.15.83:0/2816452858 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66c40cd0b0 con 0x7f66c406dfe0 2024-03-30T13:09:00.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.740+0000 7f66b9ffb640 1 -- 172.21.15.83:0/2816452858 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f66b4056eb0 con 0x7f66c406dfe0 2024-03-30T13:09:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:00.745 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:00.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.744+0000 7f66cb365640 1 -- 172.21.15.83:0/2816452858 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f66a8067fc0 msgr2=0x7f66a806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.744+0000 7f66cb365640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f66a8067fc0 0x7f66a806a480 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f66c406e620 tx=0x7f66c0008040 comp rx=0 tx=0).stop 2024-03-30T13:09:00.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.744+0000 7f66cb365640 1 -- 172.21.15.83:0/2816452858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c406dfe0 msgr2=0x7f66c4099a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.744+0000 7f66cb365640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c406dfe0 0x7f66c4099a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f66b400c7c0 tx=0x7f66b400cc80 comp rx=0 tx=0).stop 2024-03-30T13:09:00.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.744+0000 7f66cb365640 1 -- 172.21.15.83:0/2816452858 shutdown_connections 2024-03-30T13:09:00.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.744+0000 7f66cb365640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f66a8067fc0 0x7f66a806a480 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.744+0000 7f66cb365640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c40b4830 0x7f66c41551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.744+0000 7f66cb365640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c40aed20 0x7f66c414c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.744+0000 7f66cb365640 1 --2- 172.21.15.83:0/2816452858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66c406dfe0 0x7f66c4099a20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.744+0000 7f66cb365640 1 -- 172.21.15.83:0/2816452858 >> 172.21.15.83:0/2816452858 conn(0x7f66c40b1d60 msgr2=0x7f66c40afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:00.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.744+0000 7f66cb365640 1 -- 172.21.15.83:0/2816452858 shutdown_connections 2024-03-30T13:09:00.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.744+0000 7f66cb365640 1 -- 172.21.15.83:0/2816452858 wait complete. 2024-03-30T13:09:00.762 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:09:00.763 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:09:00.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.868+0000 7f851e7a5640 1 Processor -- start 2024-03-30T13:09:00.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.868+0000 7f851e7a5640 1 -- start start 2024-03-30T13:09:00.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f851e7a5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f851815ed40 0x7f851806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f851e7a5640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f85180b14c0 0x7f851809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f851e7a5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f851809af90 0x7f85180d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f851e7a5640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f85180cce00 con 0x7f851815ed40 2024-03-30T13:09:00.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f851e7a5640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f851806dd70 con 0x7f85180b14c0 2024-03-30T13:09:00.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f851e7a5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f851806e050 con 0x7f851809af90 2024-03-30T13:09:00.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f8517fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f851815ed40 0x7f851806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f8517fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f851815ed40 0x7f851806d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58718/0 (socket says 172.21.15.83:58718) 2024-03-30T13:09:00.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f8517fff640 1 -- 172.21.15.83:0/780901272 learned_addr learned my addr 172.21.15.83:0/780901272 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:00.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f85177fe640 1 --2- 172.21.15.83:0/780901272 >> v2:172.21.15.153:3300/0 conn(0x7f85180b14c0 0x7f851809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f8517fff640 1 -- 172.21.15.83:0/780901272 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f851809af90 msgr2=0x7f85180d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:00.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f851cd42640 1 --2- 172.21.15.83:0/780901272 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f851809af90 0x7f85180d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f8517fff640 1 --2- 172.21.15.83:0/780901272 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f851809af90 0x7f85180d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f8517fff640 1 -- 172.21.15.83:0/780901272 >> v2:172.21.15.153:3300/0 conn(0x7f85180b14c0 msgr2=0x7f851809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:00.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f8517fff640 1 --2- 172.21.15.83:0/780901272 >> v2:172.21.15.153:3300/0 conn(0x7f85180b14c0 0x7f851809aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f8517fff640 1 -- 172.21.15.83:0/780901272 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85180cca90 con 0x7f851815ed40 2024-03-30T13:09:00.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f851cd42640 1 --2- 172.21.15.83:0/780901272 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f851809af90 0x7f85180d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:00.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f8517fff640 1 --2- 172.21.15.83:0/780901272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f851815ed40 0x7f851806d790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f85180729f0 tx=0x7f850801c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac63ad9ad6cfb52 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:00.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f8516ffd640 1 -- 172.21.15.83:0/780901272 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85080b0070 con 0x7f851815ed40 2024-03-30T13:09:00.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f8516ffd640 1 -- 172.21.15.83:0/780901272 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85080ab600 con 0x7f851815ed40 2024-03-30T13:09:00.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f8516ffd640 1 -- 172.21.15.83:0/780901272 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85080ab9d0 con 0x7f851815ed40 2024-03-30T13:09:00.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f851e7a5640 1 -- 172.21.15.83:0/780901272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f851815ed40 msgr2=0x7f851806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.872+0000 7f851e7a5640 1 --2- 172.21.15.83:0/780901272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f851815ed40 0x7f851806d790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f85180729f0 tx=0x7f850801c1d0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 -- 172.21.15.83:0/780901272 shutdown_connections 2024-03-30T13:09:00.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 --2- 172.21.15.83:0/780901272 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f851809af90 0x7f85180d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 --2- 172.21.15.83:0/780901272 >> v2:172.21.15.153:3300/0 conn(0x7f85180b14c0 0x7f851809aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 --2- 172.21.15.83:0/780901272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f851815ed40 0x7f851806d790 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 -- 172.21.15.83:0/780901272 >> 172.21.15.83:0/780901272 conn(0x7f85180b3d90 msgr2=0x7f85180b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:00.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 -- 172.21.15.83:0/780901272 shutdown_connections 2024-03-30T13:09:00.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 -- 172.21.15.83:0/780901272 wait complete. 2024-03-30T13:09:00.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 Processor -- start 2024-03-30T13:09:00.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 -- start start 2024-03-30T13:09:00.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f851809af90 0x7f8518154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85180b14c0 0x7f85181f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85181f80f0 0x7f85180b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f85180cde30 con 0x7f851809af90 2024-03-30T13:09:00.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f85180cdcb0 con 0x7f85180b14c0 2024-03-30T13:09:00.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f85180cdfb0 con 0x7f85181f80f0 2024-03-30T13:09:00.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f8517fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f851809af90 0x7f8518154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f8517fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f851809af90 0x7f8518154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58734/0 (socket says 172.21.15.83:58734) 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f8517fff640 1 -- 172.21.15.83:0/926904152 learned_addr learned my addr 172.21.15.83:0/926904152 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851cd42640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85181f80f0 0x7f85180b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f8517fff640 1 -- 172.21.15.83:0/926904152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85181f80f0 msgr2=0x7f85180b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f8517fff640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85181f80f0 0x7f85180b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f8517fff640 1 -- 172.21.15.83:0/926904152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85180b14c0 msgr2=0x7f85181f7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f85177fe640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85180b14c0 0x7f85181f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f8517fff640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85180b14c0 0x7f85181f7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f8517fff640 1 -- 172.21.15.83:0/926904152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85181f86c0 con 0x7f851809af90 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f8517fff640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f851809af90 0x7f8518154960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f85080097c0 tx=0x7f850801aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f8514ff9640 1 -- 172.21.15.83:0/926904152 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85080ba020 con 0x7f851809af90 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f8514ff9640 1 -- 172.21.15.83:0/926904152 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85080abe10 con 0x7f851809af90 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 -- 172.21.15.83:0/926904152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85181f89a0 con 0x7f851809af90 2024-03-30T13:09:00.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f8514ff9640 1 -- 172.21.15.83:0/926904152 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85080b0040 con 0x7f851809af90 2024-03-30T13:09:00.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.876+0000 7f851e7a5640 1 -- 172.21.15.83:0/926904152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8518154ea0 con 0x7f851809af90 2024-03-30T13:09:00.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.880+0000 7f851e7a5640 1 -- 172.21.15.83:0/926904152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85181f8b70 con 0x7f851809af90 2024-03-30T13:09:00.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.880+0000 7f8514ff9640 1 -- 172.21.15.83:0/926904152 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f85080bd020 con 0x7f851809af90 2024-03-30T13:09:00.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.880+0000 7f8514ff9640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8504067fc0 0x7f850406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:00.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.880+0000 7f8514ff9640 1 -- 172.21.15.83:0/926904152 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f85081207f0 con 0x7f851809af90 2024-03-30T13:09:00.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.880+0000 7f85177fe640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8504067fc0 0x7f850406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:00.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.880+0000 7f85177fe640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8504067fc0 0x7f850406a480 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f850c009790 tx=0x7f850c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:00.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:00.884+0000 7f8514ff9640 1 -- 172.21.15.83:0/926904152 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f85181f8b70 con 0x7f851809af90 2024-03-30T13:09:01.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 -- 172.21.15.83:0/926904152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f85180a03d0 con 0x7f851809af90 2024-03-30T13:09:01.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f8514ff9640 1 -- 172.21.15.83:0/926904152 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f85080c4030 con 0x7f851809af90 2024-03-30T13:09:01.035 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:09:01.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 -- 172.21.15.83:0/926904152 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8504067fc0 msgr2=0x7f850406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8504067fc0 0x7f850406a480 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f850c009790 tx=0x7f850c008040 comp rx=0 tx=0).stop 2024-03-30T13:09:01.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 -- 172.21.15.83:0/926904152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f851809af90 msgr2=0x7f8518154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f851809af90 0x7f8518154960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f85080097c0 tx=0x7f850801aa10 comp rx=0 tx=0).stop 2024-03-30T13:09:01.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 -- 172.21.15.83:0/926904152 shutdown_connections 2024-03-30T13:09:01.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8504067fc0 0x7f850406a480 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85181f80f0 0x7f85180b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85180b14c0 0x7f85181f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 --2- 172.21.15.83:0/926904152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f851809af90 0x7f8518154960 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 -- 172.21.15.83:0/926904152 >> 172.21.15.83:0/926904152 conn(0x7f85180b3d90 msgr2=0x7f85180ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:01.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 -- 172.21.15.83:0/926904152 shutdown_connections 2024-03-30T13:09:01.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.032+0000 7f851e7a5640 1 -- 172.21.15.83:0/926904152 wait complete. 2024-03-30T13:09:01.052 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:09:01.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.156+0000 7fac57982640 1 Processor -- start 2024-03-30T13:09:01.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.156+0000 7fac57982640 1 -- start start 2024-03-30T13:09:01.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac57982640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fac5015a8b0 0x7fac50072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac57982640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fac500b4d90 0x7fac500733b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac57982640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac50071830 con 0x7fac50072f20 2024-03-30T13:09:01.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac57982640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fac50071ad0 con 0x7fac5015a8b0 2024-03-30T13:09:01.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac57982640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fac50071db0 con 0x7fac500b4d90 2024-03-30T13:09:01.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac5571e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fac5015a8b0 0x7fac50072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac54f1d640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fac50072f20 0x7fac500b4680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46198/0 (socket says 172.21.15.83:46198) 2024-03-30T13:09:01.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac54f1d640 1 -- 172.21.15.83:0/3789524525 learned_addr learned my addr 172.21.15.83:0/3789524525 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:01.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac5571e640 1 -- 172.21.15.83:0/3789524525 >> v2:172.21.15.153:3300/0 conn(0x7fac500b4d90 msgr2=0x7fac500733b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:01.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac5571e640 1 --2- 172.21.15.83:0/3789524525 >> v2:172.21.15.153:3300/0 conn(0x7fac500b4d90 0x7fac500733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac5571e640 1 -- 172.21.15.83:0/3789524525 >> v1:172.21.15.83:6789/0 conn(0x7fac50072f20 legacy=0x7fac500b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac5571e640 1 -- 172.21.15.83:0/3789524525 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac50072090 con 0x7fac5015a8b0 2024-03-30T13:09:01.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac5571e640 1 --2- 172.21.15.83:0/3789524525 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac5015a8b0 0x7fac50072890 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fac500ade20 tx=0x7fac4801da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a1a60936b2f14b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:01.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac4ffff640 1 -- 172.21.15.83:0/3789524525 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac480b3070 con 0x7fac5015a8b0 2024-03-30T13:09:01.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac4ffff640 1 -- 172.21.15.83:0/3789524525 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac480a68c0 con 0x7fac5015a8b0 2024-03-30T13:09:01.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac4ffff640 1 -- 172.21.15.83:0/3789524525 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac480a6c90 con 0x7fac5015a8b0 2024-03-30T13:09:01.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac57982640 1 -- 172.21.15.83:0/3789524525 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac5015a8b0 msgr2=0x7fac50072890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac57982640 1 --2- 172.21.15.83:0/3789524525 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac5015a8b0 0x7fac50072890 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fac500ade20 tx=0x7fac4801da40 comp rx=0 tx=0).stop 2024-03-30T13:09:01.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac57982640 1 -- 172.21.15.83:0/3789524525 shutdown_connections 2024-03-30T13:09:01.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac57982640 1 --2- 172.21.15.83:0/3789524525 >> v2:172.21.15.153:3300/0 conn(0x7fac500b4d90 0x7fac500733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac57982640 1 --2- 172.21.15.83:0/3789524525 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac5015a8b0 0x7fac50072890 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.160+0000 7fac57982640 1 -- 172.21.15.83:0/3789524525 >> 172.21.15.83:0/3789524525 conn(0x7fac5006b660 msgr2=0x7fac5006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:01.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 -- 172.21.15.83:0/3789524525 shutdown_connections 2024-03-30T13:09:01.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 -- 172.21.15.83:0/3789524525 wait complete. 2024-03-30T13:09:01.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 Processor -- start 2024-03-30T13:09:01.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 -- start start 2024-03-30T13:09:01.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac50072f20 0x7fac50155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac500b4d90 0x7fac501538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac5015a8b0 0x7fac50153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fac500ae950 con 0x7fac50072f20 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac500ae7d0 con 0x7fac500b4d90 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fac500aead0 con 0x7fac5015a8b0 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac5571e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac50072f20 0x7fac50155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac5571e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac50072f20 0x7fac50155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58754/0 (socket says 172.21.15.83:58754) 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac5571e640 1 -- 172.21.15.83:0/836161406 learned_addr learned my addr 172.21.15.83:0/836161406 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac55f1f640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac5015a8b0 0x7fac50153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac54f1d640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac500b4d90 0x7fac501538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac5571e640 1 -- 172.21.15.83:0/836161406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac5015a8b0 msgr2=0x7fac50153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac5571e640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac5015a8b0 0x7fac50153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac5571e640 1 -- 172.21.15.83:0/836161406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac500b4d90 msgr2=0x7fac501538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac5571e640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac500b4d90 0x7fac501538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac5571e640 1 -- 172.21.15.83:0/836161406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5009cf50 con 0x7fac50072f20 2024-03-30T13:09:01.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac55f1f640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac5015a8b0 0x7fac50153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:01.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac54f1d640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac500b4d90 0x7fac501538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:01.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac5571e640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac50072f20 0x7fac50155a00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fac480b1040 tx=0x7fac4801a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:01.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac4dffb640 1 -- 172.21.15.83:0/836161406 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac480b3050 con 0x7fac50072f20 2024-03-30T13:09:01.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac4dffb640 1 -- 172.21.15.83:0/836161406 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac480b4040 con 0x7fac50072f20 2024-03-30T13:09:01.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 -- 172.21.15.83:0/836161406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5009d230 con 0x7fac50072f20 2024-03-30T13:09:01.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac4dffb640 1 -- 172.21.15.83:0/836161406 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac480ae850 con 0x7fac50072f20 2024-03-30T13:09:01.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 -- 172.21.15.83:0/836161406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5009d7f0 con 0x7fac50072f20 2024-03-30T13:09:01.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.164+0000 7fac57982640 1 -- 172.21.15.83:0/836161406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5009e540 con 0x7fac50072f20 2024-03-30T13:09:01.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.168+0000 7fac4dffb640 1 -- 172.21.15.83:0/836161406 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fac480bf020 con 0x7fac50072f20 2024-03-30T13:09:01.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.168+0000 7fac4dffb640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fac3c068040 0x7fac3c06a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.168+0000 7fac54f1d640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fac3c068040 0x7fac3c06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.168+0000 7fac4dffb640 1 -- 172.21.15.83:0/836161406 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fac48120710 con 0x7fac50072f20 2024-03-30T13:09:01.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.168+0000 7fac54f1d640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fac3c068040 0x7fac3c06a500 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac44000f70 tx=0x7fac44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:01.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.172+0000 7fac4dffb640 1 -- 172.21.15.83:0/836161406 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fac48017630 con 0x7fac50072f20 2024-03-30T13:09:01.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 -- 172.21.15.83:0/836161406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fac50156af0 con 0x7fac50072f20 2024-03-30T13:09:01.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac4dffb640 1 -- 172.21.15.83:0/836161406 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fac480f1030 con 0x7fac50072f20 2024-03-30T13:09:01.322 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:09:01.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 -- 172.21.15.83:0/836161406 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fac3c068040 msgr2=0x7fac3c06a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fac3c068040 0x7fac3c06a500 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac44000f70 tx=0x7fac44009040 comp rx=0 tx=0).stop 2024-03-30T13:09:01.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 -- 172.21.15.83:0/836161406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac50072f20 msgr2=0x7fac50155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac50072f20 0x7fac50155a00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fac480b1040 tx=0x7fac4801a7e0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 -- 172.21.15.83:0/836161406 shutdown_connections 2024-03-30T13:09:01.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fac3c068040 0x7fac3c06a500 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac5015a8b0 0x7fac50153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac500b4d90 0x7fac501538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 --2- 172.21.15.83:0/836161406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac50072f20 0x7fac50155a00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 -- 172.21.15.83:0/836161406 >> 172.21.15.83:0/836161406 conn(0x7fac5006b660 msgr2=0x7fac500cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:01.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 -- 172.21.15.83:0/836161406 shutdown_connections 2024-03-30T13:09:01.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.320+0000 7fac57982640 1 -- 172.21.15.83:0/836161406 wait complete. 2024-03-30T13:09:01.340 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:09:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.448+0000 7f7c11729640 1 Processor -- start 2024-03-30T13:09:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c11729640 1 -- start start 2024-03-30T13:09:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c11729640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7c0c0d31e0 0x7f7c0c0d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c11729640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c0c0d1370 0x7f7c0c06c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c11729640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0c0d51f0 con 0x7f7c0c15e840 2024-03-30T13:09:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c11729640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f7c0c15ec20 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c11729640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0c0d2d50 con 0x7f7c0c0d1370 2024-03-30T13:09:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c03fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7c0c0d31e0 0x7f7c0c0d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c0affd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f7c0c15e840 0x7f7c0c0cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46208/0 (socket says 172.21.15.83:46208) 2024-03-30T13:09:01.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c0affd640 1 -- 172.21.15.83:0/2633230316 learned_addr learned my addr 172.21.15.83:0/2633230316 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:01.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c0b7fe640 1 --2- 172.21.15.83:0/2633230316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c0c0d1370 0x7f7c0c06c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c03fff640 1 -- 172.21.15.83:0/2633230316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c0c0d1370 msgr2=0x7f7c0c06c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:01.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c03fff640 1 --2- 172.21.15.83:0/2633230316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c0c0d1370 0x7f7c0c06c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c03fff640 1 -- 172.21.15.83:0/2633230316 >> v1:172.21.15.83:6789/0 conn(0x7f7c0c15e840 legacy=0x7f7c0c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c0a7fc640 1 -- 172.21.15.83:0/2633230316 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973867940 0 0) 0x7f7bfc001120 con 0x7f7c0c15e840 2024-03-30T13:09:01.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c03fff640 1 -- 172.21.15.83:0/2633230316 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c0d2140 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c0b7fe640 1 --2- 172.21.15.83:0/2633230316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c0c0d1370 0x7f7c0c06c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:01.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c03fff640 1 --2- 172.21.15.83:0/2633230316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c0c0d31e0 0x7f7c0c0d0e30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40097c0 tx=0x7f7bf401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31baea5005ef616f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:01.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c0a7fc640 1 -- 172.21.15.83:0/2633230316 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40b0070 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c0a7fc640 1 -- 172.21.15.83:0/2633230316 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf40ab600 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.452+0000 7f7c0a7fc640 1 -- 172.21.15.83:0/2633230316 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40ab9d0 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 -- 172.21.15.83:0/2633230316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c0c0d31e0 msgr2=0x7f7c0c0d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 --2- 172.21.15.83:0/2633230316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c0c0d31e0 0x7f7c0c0d0e30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40097c0 tx=0x7f7bf401c410 comp rx=0 tx=0).stop 2024-03-30T13:09:01.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 -- 172.21.15.83:0/2633230316 shutdown_connections 2024-03-30T13:09:01.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 --2- 172.21.15.83:0/2633230316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c0c0d1370 0x7f7c0c06c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 --2- 172.21.15.83:0/2633230316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c0c0d31e0 0x7f7c0c0d0e30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 -- 172.21.15.83:0/2633230316 >> 172.21.15.83:0/2633230316 conn(0x7f7c0c09d7f0 msgr2=0x7f7c0c0d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:01.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 -- 172.21.15.83:0/2633230316 shutdown_connections 2024-03-30T13:09:01.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 -- 172.21.15.83:0/2633230316 wait complete. 2024-03-30T13:09:01.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 Processor -- start 2024-03-30T13:09:01.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 -- start start 2024-03-30T13:09:01.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c0c0d1370 0x7f7c0c0c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c0c0d31e0 0x7f7c0c0b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c0c15e840 0x7f7c0c1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c0d04a0 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c0d0320 con 0x7f7c0c0d1370 2024-03-30T13:09:01.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0c16b5f0 con 0x7f7c0c15e840 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c03fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c0c0d31e0 0x7f7c0c0b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c03fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c0c0d31e0 0x7f7c0c0b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58766/0 (socket says 172.21.15.83:58766) 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c03fff640 1 -- 172.21.15.83:0/139272410 learned_addr learned my addr 172.21.15.83:0/139272410 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c0b7fe640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c0c15e840 0x7f7c0c1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c0affd640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c0c0d1370 0x7f7c0c0c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c03fff640 1 -- 172.21.15.83:0/139272410 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c0c15e840 msgr2=0x7f7c0c1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c03fff640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c0c15e840 0x7f7c0c1542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c03fff640 1 -- 172.21.15.83:0/139272410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c0c0d1370 msgr2=0x7f7c0c0c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c03fff640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c0c0d1370 0x7f7c0c0c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c03fff640 1 -- 172.21.15.83:0/139272410 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c1fb240 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c0affd640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c0c0d1370 0x7f7c0c0c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c03fff640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c0c0d31e0 0x7f7c0c0b2570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40097c0 tx=0x7f7bf401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c037fe640 1 -- 172.21.15.83:0/139272410 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40bc070 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c037fe640 1 -- 172.21.15.83:0/139272410 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf40b1040 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c037fe640 1 -- 172.21.15.83:0/139272410 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40b0050 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 -- 172.21.15.83:0/139272410 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0c1fb4e0 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.456+0000 7f7c11729640 1 -- 172.21.15.83:0/139272410 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0c1fbaa0 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.460+0000 7f7c11729640 1 -- 172.21.15.83:0/139272410 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0c0a23d0 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.460+0000 7f7c037fe640 1 -- 172.21.15.83:0/139272410 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f7c0c06d470 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.460+0000 7f7c037fe640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7bec067fc0 0x7f7bec06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.460+0000 7f7c037fe640 1 -- 172.21.15.83:0/139272410 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7bf411fe10 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.460+0000 7f7c0affd640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7bec067fc0 0x7f7bec06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.460+0000 7f7c0affd640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7bec067fc0 0x7f7bec06a480 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc007fd0 tx=0x7f7bfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:01.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.464+0000 7f7c037fe640 1 -- 172.21.15.83:0/139272410 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f7bf4016090 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 -- 172.21.15.83:0/139272410 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7c0c15a8d0 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c037fe640 1 -- 172.21.15.83:0/139272410 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f7bf40f05c0 con 0x7f7c0c0d31e0 2024-03-30T13:09:01.614 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:09:01.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 -- 172.21.15.83:0/139272410 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7bec067fc0 msgr2=0x7f7bec06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7bec067fc0 0x7f7bec06a480 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc007fd0 tx=0x7f7bfc009040 comp rx=0 tx=0).stop 2024-03-30T13:09:01.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 -- 172.21.15.83:0/139272410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c0c0d31e0 msgr2=0x7f7c0c0b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c0c0d31e0 0x7f7c0c0b2570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40097c0 tx=0x7f7bf401ac50 comp rx=0 tx=0).stop 2024-03-30T13:09:01.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 -- 172.21.15.83:0/139272410 shutdown_connections 2024-03-30T13:09:01.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7bec067fc0 0x7f7bec06a480 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c0c15e840 0x7f7c0c1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c0c0d31e0 0x7f7c0c0b2570 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 --2- 172.21.15.83:0/139272410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c0c0d1370 0x7f7c0c0c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 -- 172.21.15.83:0/139272410 >> 172.21.15.83:0/139272410 conn(0x7f7c0c09d7f0 msgr2=0x7f7c0c157f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:01.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 -- 172.21.15.83:0/139272410 shutdown_connections 2024-03-30T13:09:01.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.612+0000 7f7c11729640 1 -- 172.21.15.83:0/139272410 wait complete. 2024-03-30T13:09:01.632 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining' 2024-03-30T13:09:01.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72e2594640 1 Processor -- start 2024-03-30T13:09:01.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72e2594640 1 -- start start 2024-03-30T13:09:01.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72e2594640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f72dc0735d0 0x7f72dc06d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72e2594640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f72dc0739b0 0x7f72dc06dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72e2594640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72dc15edd0 con 0x7f72dc0b3060 2024-03-30T13:09:01.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72e2594640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc0b3c40 con 0x7f72dc0735d0 2024-03-30T13:09:01.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72e2594640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc0b3f20 con 0x7f72dc0739b0 2024-03-30T13:09:01.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72e0b31640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f72dc0b3060 0x7f72dc0b3470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46218/0 (socket says 172.21.15.83:46218) 2024-03-30T13:09:01.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72e0b31640 1 -- 172.21.15.83:0/1707470398 learned_addr learned my addr 172.21.15.83:0/1707470398 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:01.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72dbfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f72dc0735d0 0x7f72dc06d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72db7fe640 1 --2- 172.21.15.83:0/1707470398 >> v2:172.21.15.153:3300/0 conn(0x7f72dc0739b0 0x7f72dc06dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72dbfff640 1 -- 172.21.15.83:0/1707470398 >> v2:172.21.15.153:3300/0 conn(0x7f72dc0739b0 msgr2=0x7f72dc06dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:01.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72dbfff640 1 --2- 172.21.15.83:0/1707470398 >> v2:172.21.15.153:3300/0 conn(0x7f72dc0739b0 0x7f72dc06dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72dbfff640 1 -- 172.21.15.83:0/1707470398 >> v1:172.21.15.83:6789/0 conn(0x7f72dc0b3060 legacy=0x7f72dc0b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72dbfff640 1 -- 172.21.15.83:0/1707470398 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc0b4200 con 0x7f72dc0735d0 2024-03-30T13:09:01.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.744+0000 7f72daffd640 1 -- 172.21.15.83:0/1707470398 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136556709 0 0) 0x7f72d40014a0 con 0x7f72dc0b3060 2024-03-30T13:09:01.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72dbfff640 1 --2- 172.21.15.83:0/1707470398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72dc0735d0 0x7f72dc06d7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b2ac0 tx=0x7f72cc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851873e97c645210 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:01.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72daffd640 1 -- 172.21.15.83:0/1707470398 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0ab650 con 0x7f72dc0735d0 2024-03-30T13:09:01.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72daffd640 1 -- 172.21.15.83:0/1707470398 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc0b0070 con 0x7f72dc0735d0 2024-03-30T13:09:01.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72daffd640 1 -- 172.21.15.83:0/1707470398 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0aba10 con 0x7f72dc0735d0 2024-03-30T13:09:01.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72e2594640 1 -- 172.21.15.83:0/1707470398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72dc0735d0 msgr2=0x7f72dc06d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72e2594640 1 --2- 172.21.15.83:0/1707470398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72dc0735d0 0x7f72dc06d7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b2ac0 tx=0x7f72cc01c450 comp rx=0 tx=0).stop 2024-03-30T13:09:01.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72e2594640 1 -- 172.21.15.83:0/1707470398 shutdown_connections 2024-03-30T13:09:01.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72e2594640 1 --2- 172.21.15.83:0/1707470398 >> v2:172.21.15.153:3300/0 conn(0x7f72dc0739b0 0x7f72dc06dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72e2594640 1 --2- 172.21.15.83:0/1707470398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72dc0735d0 0x7f72dc06d7a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72e2594640 1 -- 172.21.15.83:0/1707470398 >> 172.21.15.83:0/1707470398 conn(0x7f72dc0b1d60 msgr2=0x7f72dc0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:01.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72e2594640 1 -- 172.21.15.83:0/1707470398 shutdown_connections 2024-03-30T13:09:01.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72e2594640 1 -- 172.21.15.83:0/1707470398 wait complete. 2024-03-30T13:09:01.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72e2594640 1 Processor -- start 2024-03-30T13:09:01.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.748+0000 7f72e2594640 1 -- start start 2024-03-30T13:09:01.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e2594640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc0735d0 0x7f72dc154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e2594640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72dc0739b0 0x7f72dc1605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e2594640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72dc0b3060 0x7f72dc160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e2594640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc071d10 con 0x7f72dc0b3060 2024-03-30T13:09:01.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e2594640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc0afa80 con 0x7f72dc0735d0 2024-03-30T13:09:01.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e2594640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc071e90 con 0x7f72dc0739b0 2024-03-30T13:09:01.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e0b31640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72dc0b3060 0x7f72dc160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e0b31640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72dc0b3060 0x7f72dc160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58784/0 (socket says 172.21.15.83:58784) 2024-03-30T13:09:01.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e0b31640 1 -- 172.21.15.83:0/1376101322 learned_addr learned my addr 172.21.15.83:0/1376101322 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:01.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72dbfff640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc0735d0 0x7f72dc154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72db7fe640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72dc0739b0 0x7f72dc1605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e0b31640 1 -- 172.21.15.83:0/1376101322 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72dc0739b0 msgr2=0x7f72dc1605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e0b31640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72dc0739b0 0x7f72dc1605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e0b31640 1 -- 172.21.15.83:0/1376101322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc0735d0 msgr2=0x7f72dc154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:01.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e0b31640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc0735d0 0x7f72dc154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:01.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e0b31640 1 -- 172.21.15.83:0/1376101322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc155450 con 0x7f72dc0b3060 2024-03-30T13:09:01.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72db7fe640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72dc0739b0 0x7f72dc1605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:01.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e0b31640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72dc0b3060 0x7f72dc160ae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c780 tx=0x7f72d400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:01.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72d8ff9640 1 -- 172.21.15.83:0/1376101322 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4018070 con 0x7f72dc0b3060 2024-03-30T13:09:01.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72d8ff9640 1 -- 172.21.15.83:0/1376101322 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d4004d70 con 0x7f72dc0b3060 2024-03-30T13:09:01.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e2594640 1 -- 172.21.15.83:0/1376101322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc0998e0 con 0x7f72dc0b3060 2024-03-30T13:09:01.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72d8ff9640 1 -- 172.21.15.83:0/1376101322 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d400a880 con 0x7f72dc0b3060 2024-03-30T13:09:01.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e2594640 1 -- 172.21.15.83:0/1376101322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc099040 con 0x7f72dc0b3060 2024-03-30T13:09:01.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72e2594640 1 -- 172.21.15.83:0/1376101322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72dc0686c0 con 0x7f72dc0b3060 2024-03-30T13:09:01.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72d8ff9640 1 -- 172.21.15.83:0/1376101322 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f72d401b070 con 0x7f72dc0b3060 2024-03-30T13:09:01.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72d8ff9640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f72c8067fc0 0x7f72c806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:01.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72d8ff9640 1 -- 172.21.15.83:0/1376101322 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f72d40859f0 con 0x7f72dc0b3060 2024-03-30T13:09:01.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72dbfff640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f72c8067fc0 0x7f72c806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:01.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.752+0000 7f72dbfff640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f72c8067fc0 0x7f72c806a480 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0af000 tx=0x7f72cc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:01.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.756+0000 7f72d8ff9640 1 -- 172.21.15.83:0/1376101322 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f72dc15edd0 con 0x7f72dc0b3060 2024-03-30T13:09:01.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:01.964+0000 7f72e2594640 1 -- 172.21.15.83:0/1376101322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]} v 0) -- 0x7f72dc16a1d0 con 0x7f72dc0b3060 2024-03-30T13:09:02.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.392+0000 7f72d8ff9640 1 -- 172.21.15.83:0/1376101322 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]}]=0 v54) ==== 150+0+0 (secure 0 0 0) 0x7f72d4056230 con 0x7f72dc0b3060 2024-03-30T13:09:02.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.396+0000 7f72e2594640 1 -- 172.21.15.83:0/1376101322 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f72c8067fc0 msgr2=0x7f72c806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:02.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.396+0000 7f72e2594640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f72c8067fc0 0x7f72c806a480 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0af000 tx=0x7f72cc0a7000 comp rx=0 tx=0).stop 2024-03-30T13:09:02.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.396+0000 7f72e2594640 1 -- 172.21.15.83:0/1376101322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72dc0b3060 msgr2=0x7f72dc160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:02.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.396+0000 7f72e2594640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72dc0b3060 0x7f72dc160ae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c780 tx=0x7f72d400cc40 comp rx=0 tx=0).stop 2024-03-30T13:09:02.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.396+0000 7f72e2594640 1 -- 172.21.15.83:0/1376101322 shutdown_connections 2024-03-30T13:09:02.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.396+0000 7f72e2594640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f72c8067fc0 0x7f72c806a480 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.396+0000 7f72e2594640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72dc0b3060 0x7f72dc160ae0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.396+0000 7f72e2594640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72dc0739b0 0x7f72dc1605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.396+0000 7f72e2594640 1 --2- 172.21.15.83:0/1376101322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc0735d0 0x7f72dc154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.396+0000 7f72e2594640 1 -- 172.21.15.83:0/1376101322 >> 172.21.15.83:0/1376101322 conn(0x7f72dc0b1d60 msgr2=0x7f72dc0b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:02.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.396+0000 7f72e2594640 1 -- 172.21.15.83:0/1376101322 shutdown_connections 2024-03-30T13:09:02.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.396+0000 7f72e2594640 1 -- 172.21.15.83:0/1376101322 wait complete. 2024-03-30T13:09:02.419 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-30T13:09:02.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc3279bc640 1 Processor -- start 2024-03-30T13:09:02.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc3279bc640 1 -- start start 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc3279bc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc32015b050 0x7fc320073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc3279bc640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3200b3ca0 0x7fc32006f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc3279bc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc32006f690 0x7fc320071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc3279bc640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc32006fad0 con 0x7fc32006f690 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc3279bc640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc320073ab0 con 0x7fc3200b3ca0 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc3279bc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc3200b31e0 con 0x7fc32015b050 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc325f59640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc32006f690 0x7fc320071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc325f59640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc32006f690 0x7fc320071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58796/0 (socket says 172.21.15.83:58796) 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc325f59640 1 -- 172.21.15.83:0/1806124842 learned_addr learned my addr 172.21.15.83:0/1806124842 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc325758640 1 --2- 172.21.15.83:0/1806124842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc32015b050 0x7fc320073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc325f59640 1 -- 172.21.15.83:0/1806124842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc32015b050 msgr2=0x7fc320073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc324f57640 1 --2- 172.21.15.83:0/1806124842 >> v2:172.21.15.153:3300/0 conn(0x7fc3200b3ca0 0x7fc32006f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc325f59640 1 --2- 172.21.15.83:0/1806124842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc32015b050 0x7fc320073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc325f59640 1 -- 172.21.15.83:0/1806124842 >> v2:172.21.15.153:3300/0 conn(0x7fc3200b3ca0 msgr2=0x7fc32006f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:02.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc325f59640 1 --2- 172.21.15.83:0/1806124842 >> v2:172.21.15.153:3300/0 conn(0x7fc3200b3ca0 0x7fc32006f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc325f59640 1 -- 172.21.15.83:0/1806124842 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3200ad4f0 con 0x7fc32006f690 2024-03-30T13:09:02.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.540+0000 7fc324f57640 1 --2- 172.21.15.83:0/1806124842 >> v2:172.21.15.153:3300/0 conn(0x7fc3200b3ca0 0x7fc32006f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:02.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc325f59640 1 --2- 172.21.15.83:0/1806124842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc32006f690 0x7fc320071790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc32006d7e0 tx=0x7fc31801e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13798c8bd40e9a19 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:02.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc317fff640 1 -- 172.21.15.83:0/1806124842 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31800b2d0 con 0x7fc32006f690 2024-03-30T13:09:02.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc317fff640 1 -- 172.21.15.83:0/1806124842 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31800b470 con 0x7fc32006f690 2024-03-30T13:09:02.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc317fff640 1 -- 172.21.15.83:0/1806124842 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3180a79b0 con 0x7fc32006f690 2024-03-30T13:09:02.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 -- 172.21.15.83:0/1806124842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc32006f690 msgr2=0x7fc320071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:02.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 --2- 172.21.15.83:0/1806124842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc32006f690 0x7fc320071790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc32006d7e0 tx=0x7fc31801e900 comp rx=0 tx=0).stop 2024-03-30T13:09:02.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 -- 172.21.15.83:0/1806124842 shutdown_connections 2024-03-30T13:09:02.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 --2- 172.21.15.83:0/1806124842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc32006f690 0x7fc320071790 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 --2- 172.21.15.83:0/1806124842 >> v2:172.21.15.153:3300/0 conn(0x7fc3200b3ca0 0x7fc32006f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 --2- 172.21.15.83:0/1806124842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc32015b050 0x7fc320073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 -- 172.21.15.83:0/1806124842 >> 172.21.15.83:0/1806124842 conn(0x7fc32006b660 msgr2=0x7fc32006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:02.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 -- 172.21.15.83:0/1806124842 shutdown_connections 2024-03-30T13:09:02.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 -- 172.21.15.83:0/1806124842 wait complete. 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 Processor -- start 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 -- start start 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc32006f690 0x7fc32014b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3200b3ca0 0x7fc320151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc32015b050 0x7fc32014d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc3200b4c10 con 0x7fc3200b3ca0 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc3200ad1c0 con 0x7fc32006f690 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc3200b4d90 con 0x7fc32015b050 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc324f57640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3200b3ca0 0x7fc320151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc324f57640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3200b3ca0 0x7fc320151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58804/0 (socket says 172.21.15.83:58804) 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc324f57640 1 -- 172.21.15.83:0/4025729170 learned_addr learned my addr 172.21.15.83:0/4025729170 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc325758640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc32006f690 0x7fc32014b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:02.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc325f59640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc32015b050 0x7fc32014d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc324f57640 1 -- 172.21.15.83:0/4025729170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc32015b050 msgr2=0x7fc32014d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc324f57640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc32015b050 0x7fc32014d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc324f57640 1 -- 172.21.15.83:0/4025729170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc32006f690 msgr2=0x7fc32014b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc324f57640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc32006f690 0x7fc32014b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc324f57640 1 -- 172.21.15.83:0/4025729170 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32014bfb0 con 0x7fc3200b3ca0 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc325f59640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc32015b050 0x7fc32014d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc325758640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc32006f690 0x7fc32014b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc324f57640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3200b3ca0 0x7fc320151210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c7f0 tx=0x7fc31000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc315ffb640 1 -- 172.21.15.83:0/4025729170 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc310007a30 con 0x7fc3200b3ca0 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc315ffb640 1 -- 172.21.15.83:0/4025729170 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc310007bd0 con 0x7fc3200b3ca0 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc315ffb640 1 -- 172.21.15.83:0/4025729170 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3100113f0 con 0x7fc3200b3ca0 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 -- 172.21.15.83:0/4025729170 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32014c290 con 0x7fc3200b3ca0 2024-03-30T13:09:02.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.544+0000 7fc3279bc640 1 -- 172.21.15.83:0/4025729170 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc32014c850 con 0x7fc3200b3ca0 2024-03-30T13:09:02.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.548+0000 7fc3279bc640 1 -- 172.21.15.83:0/4025729170 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc32009e540 con 0x7fc3200b3ca0 2024-03-30T13:09:02.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.548+0000 7fc315ffb640 1 -- 172.21.15.83:0/4025729170 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc310011590 con 0x7fc3200b3ca0 2024-03-30T13:09:02.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.548+0000 7fc315ffb640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc304067fc0 0x7fc30406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:02.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.548+0000 7fc315ffb640 1 -- 172.21.15.83:0/4025729170 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc310086710 con 0x7fc3200b3ca0 2024-03-30T13:09:02.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.548+0000 7fc325758640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc304067fc0 0x7fc30406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:02.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.548+0000 7fc325758640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc304067fc0 0x7fc30406a480 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0097c0 tx=0x7fc31c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:02.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.552+0000 7fc315ffb640 1 -- 172.21.15.83:0/4025729170 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fc310015020 con 0x7fc3200b3ca0 2024-03-30T13:09:02.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.720+0000 7fc3279bc640 1 -- 172.21.15.83:0/4025729170 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc3200b2d90 con 0x7fc3200b3ca0 2024-03-30T13:09:02.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc315ffb640 1 -- 172.21.15.83:0/4025729170 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fc310056ec0 con 0x7fc3200b3ca0 2024-03-30T13:09:02.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc3279bc640 1 -- 172.21.15.83:0/4025729170 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc304067fc0 msgr2=0x7fc30406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:02.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc3279bc640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc304067fc0 0x7fc30406a480 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0097c0 tx=0x7fc31c008040 comp rx=0 tx=0).stop 2024-03-30T13:09:02.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc3279bc640 1 -- 172.21.15.83:0/4025729170 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3200b3ca0 msgr2=0x7fc320151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:02.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc3279bc640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3200b3ca0 0x7fc320151210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c7f0 tx=0x7fc31000ccb0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc3279bc640 1 -- 172.21.15.83:0/4025729170 shutdown_connections 2024-03-30T13:09:02.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc3279bc640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc304067fc0 0x7fc30406a480 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc3279bc640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc32015b050 0x7fc32014d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc3279bc640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3200b3ca0 0x7fc320151210 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc3279bc640 1 --2- 172.21.15.83:0/4025729170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc32006f690 0x7fc32014b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:02.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc3279bc640 1 -- 172.21.15.83:0/4025729170 >> 172.21.15.83:0/4025729170 conn(0x7fc32006b660 msgr2=0x7fc3200afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:02.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc3279bc640 1 -- 172.21.15.83:0/4025729170 shutdown_connections 2024-03-30T13:09:02.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:02.728+0000 7fc3279bc640 1 -- 172.21.15.83:0/4025729170 wait complete. 2024-03-30T13:09:02.748 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-30T13:09:02.749 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T13:09:02.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T13:09:02.820 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-30T13:09:02.820 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:09:02.820 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:09:02.826 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:09:02.826 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:09:02.874 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:03.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f6415d55640 1 Processor -- start 2024-03-30T13:09:03.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f6415d55640 1 -- start start 2024-03-30T13:09:03.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f6415d55640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f64100b4830 0x7f641015d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f6415d55640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64100aed20 0x7f64100af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f6415d55640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f641015fee0 0x7f6410160310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f6415d55640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f6410156e00 con 0x7f641015fee0 2024-03-30T13:09:03.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f6415d55640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f64100ad040 con 0x7f64100b4830 2024-03-30T13:09:03.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f6415d55640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f641015d880 con 0x7f64100aed20 2024-03-30T13:09:03.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f640ffff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f641015fee0 0x7f6410160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f640ffff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f641015fee0 0x7f6410160310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58814/0 (socket says 172.21.15.83:58814) 2024-03-30T13:09:03.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f640ffff640 1 -- 172.21.15.83:0/645951100 learned_addr learned my addr 172.21.15.83:0/645951100 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:03.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f640effd640 1 --2- 172.21.15.83:0/645951100 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64100aed20 0x7f64100af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f640f7fe640 1 --2- 172.21.15.83:0/645951100 >> v2:172.21.15.153:3300/0 conn(0x7f64100b4830 0x7f641015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f640ffff640 1 -- 172.21.15.83:0/645951100 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64100aed20 msgr2=0x7f64100af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:03.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f640ffff640 1 --2- 172.21.15.83:0/645951100 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64100aed20 0x7f64100af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f640ffff640 1 -- 172.21.15.83:0/645951100 >> v2:172.21.15.153:3300/0 conn(0x7f64100b4830 msgr2=0x7f641015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:03.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f640ffff640 1 --2- 172.21.15.83:0/645951100 >> v2:172.21.15.153:3300/0 conn(0x7f64100b4830 0x7f641015d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.032+0000 7f640ffff640 1 -- 172.21.15.83:0/645951100 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64100cfcb0 con 0x7f641015fee0 2024-03-30T13:09:03.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f640ffff640 1 --2- 172.21.15.83:0/645951100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f641015fee0 0x7f6410160310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f64100b2a10 tx=0x7f640801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8e3f82379fe92e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:03.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f640e7fc640 1 -- 172.21.15.83:0/645951100 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64080a5720 con 0x7f641015fee0 2024-03-30T13:09:03.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f640e7fc640 1 -- 172.21.15.83:0/645951100 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64080a58c0 con 0x7f641015fee0 2024-03-30T13:09:03.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f640e7fc640 1 -- 172.21.15.83:0/645951100 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64080a5c90 con 0x7f641015fee0 2024-03-30T13:09:03.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 -- 172.21.15.83:0/645951100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f641015fee0 msgr2=0x7f6410160310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 --2- 172.21.15.83:0/645951100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f641015fee0 0x7f6410160310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f64100b2a10 tx=0x7f640801c8a0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 -- 172.21.15.83:0/645951100 shutdown_connections 2024-03-30T13:09:03.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 --2- 172.21.15.83:0/645951100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f641015fee0 0x7f6410160310 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 --2- 172.21.15.83:0/645951100 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64100aed20 0x7f64100af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 --2- 172.21.15.83:0/645951100 >> v2:172.21.15.153:3300/0 conn(0x7f64100b4830 0x7f641015d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 -- 172.21.15.83:0/645951100 >> 172.21.15.83:0/645951100 conn(0x7f64100b1d60 msgr2=0x7f64100b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:03.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 -- 172.21.15.83:0/645951100 shutdown_connections 2024-03-30T13:09:03.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 -- 172.21.15.83:0/645951100 wait complete. 2024-03-30T13:09:03.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 Processor -- start 2024-03-30T13:09:03.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 -- start start 2024-03-30T13:09:03.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64100aed20 0x7f641014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64100b4830 0x7f641014bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641015fee0 0x7f641014c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f64100af6e0 con 0x7f64100aed20 2024-03-30T13:09:03.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f641006fa90 con 0x7f64100b4830 2024-03-30T13:09:03.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f6415d55640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6410160c60 con 0x7f641015fee0 2024-03-30T13:09:03.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f640f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64100aed20 0x7f641014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f640f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64100aed20 0x7f641014b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58818/0 (socket says 172.21.15.83:58818) 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f640f7fe640 1 -- 172.21.15.83:0/1833410822 learned_addr learned my addr 172.21.15.83:0/1833410822 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.036+0000 7f640ffff640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641015fee0 0x7f641014c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f640f7fe640 1 -- 172.21.15.83:0/1833410822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641015fee0 msgr2=0x7f641014c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f640f7fe640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641015fee0 0x7f641014c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f640f7fe640 1 -- 172.21.15.83:0/1833410822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64100b4830 msgr2=0x7f641014bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f640f7fe640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64100b4830 0x7f641014bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f640f7fe640 1 -- 172.21.15.83:0/1833410822 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64100b43b0 con 0x7f64100aed20 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f640f7fe640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64100aed20 0x7f641014b720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f640400d620 tx=0x7f640400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f63f7fff640 1 -- 172.21.15.83:0/1833410822 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640400b620 con 0x7f64100aed20 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f6415d55640 1 -- 172.21.15.83:0/1833410822 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6410155b90 con 0x7f64100aed20 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f6415d55640 1 -- 172.21.15.83:0/1833410822 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64100b3df0 con 0x7f64100aed20 2024-03-30T13:09:03.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f63f7fff640 1 -- 172.21.15.83:0/1833410822 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6404019070 con 0x7f64100aed20 2024-03-30T13:09:03.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f63f7fff640 1 -- 172.21.15.83:0/1833410822 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640400b9c0 con 0x7f64100aed20 2024-03-30T13:09:03.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f6415d55640 1 -- 172.21.15.83:0/1833410822 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64100686c0 con 0x7f64100aed20 2024-03-30T13:09:03.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f63f7fff640 1 -- 172.21.15.83:0/1833410822 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f640400bb60 con 0x7f64100aed20 2024-03-30T13:09:03.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f63f7fff640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f63fc067fc0 0x7f63fc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f63f7fff640 1 -- 172.21.15.83:0/1833410822 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6404086850 con 0x7f64100aed20 2024-03-30T13:09:03.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f640effd640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f63fc067fc0 0x7f63fc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.040+0000 7f640effd640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f63fc067fc0 0x7f63fc06a480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6410167240 tx=0x7f6400008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:03.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.044+0000 7f63f7fff640 1 -- 172.21.15.83:0/1833410822 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6404011340 con 0x7f64100aed20 2024-03-30T13:09:03.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.192+0000 7f6415d55640 1 -- 172.21.15.83:0/1833410822 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64100b4ca0 con 0x7f64100aed20 2024-03-30T13:09:03.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f63f7fff640 1 -- 172.21.15.83:0/1833410822 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f6404057090 con 0x7f64100aed20 2024-03-30T13:09:03.199 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:03.199 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:03.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f6415d55640 1 -- 172.21.15.83:0/1833410822 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f63fc067fc0 msgr2=0x7f63fc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f6415d55640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f63fc067fc0 0x7f63fc06a480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6410167240 tx=0x7f6400008040 comp rx=0 tx=0).stop 2024-03-30T13:09:03.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f6415d55640 1 -- 172.21.15.83:0/1833410822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64100aed20 msgr2=0x7f641014b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f6415d55640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64100aed20 0x7f641014b720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f640400d620 tx=0x7f640400dae0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f6415d55640 1 -- 172.21.15.83:0/1833410822 shutdown_connections 2024-03-30T13:09:03.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f6415d55640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f63fc067fc0 0x7f63fc06a480 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f6415d55640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f641015fee0 0x7f641014c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f6415d55640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64100b4830 0x7f641014bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f6415d55640 1 --2- 172.21.15.83:0/1833410822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64100aed20 0x7f641014b720 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f6415d55640 1 -- 172.21.15.83:0/1833410822 >> 172.21.15.83:0/1833410822 conn(0x7f64100b1d60 msgr2=0x7f641015da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:03.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f6415d55640 1 -- 172.21.15.83:0/1833410822 shutdown_connections 2024-03-30T13:09:03.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.196+0000 7f6415d55640 1 -- 172.21.15.83:0/1833410822 wait complete. 2024-03-30T13:09:03.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:09:03.217 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:09:03.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.320+0000 7ff5f53ad640 1 Processor -- start 2024-03-30T13:09:03.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.320+0000 7ff5f53ad640 1 -- start start 2024-03-30T13:09:03.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5f53ad640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5f006b660 0x7ff5f006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5f53ad640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff5f0160880 0x7ff5f015df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5f53ad640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f015cd90 con 0x7ff5f015d830 2024-03-30T13:09:03.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5f53ad640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f0161140 con 0x7ff5f0160880 2024-03-30T13:09:03.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5f53ad640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f015d3a0 con 0x7ff5f006b660 2024-03-30T13:09:03.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5ef7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff5f0160880 0x7ff5f015df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5ef7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff5f0160880 0x7ff5f015df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58824/0 (socket says 172.21.15.83:58824) 2024-03-30T13:09:03.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5ef7fe640 1 -- 172.21.15.83:0/2171385376 learned_addr learned my addr 172.21.15.83:0/2171385376 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:03.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5eeffd640 1 --2- 172.21.15.83:0/2171385376 >> v2:172.21.15.153:3300/0 conn(0x7ff5f006b660 0x7ff5f006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5ef7fe640 1 -- 172.21.15.83:0/2171385376 >> v2:172.21.15.153:3300/0 conn(0x7ff5f006b660 msgr2=0x7ff5f006ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:03.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5ef7fe640 1 --2- 172.21.15.83:0/2171385376 >> v2:172.21.15.153:3300/0 conn(0x7ff5f006b660 0x7ff5f006ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5ef7fe640 1 -- 172.21.15.83:0/2171385376 >> v1:172.21.15.153:6789/0 conn(0x7ff5f015d830 legacy=0x7ff5f0160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5ef7fe640 1 -- 172.21.15.83:0/2171385376 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f006bf80 con 0x7ff5f0160880 2024-03-30T13:09:03.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5ef7fe640 1 --2- 172.21.15.83:0/2171385376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5f0160880 0x7ff5f015df50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0069ce0 tx=0x7ff5e801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc328c41846581ca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:03.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5ee7fc640 1 -- 172.21.15.83:0/2171385376 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80a5620 con 0x7ff5f0160880 2024-03-30T13:09:03.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5ee7fc640 1 -- 172.21.15.83:0/2171385376 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e80a57c0 con 0x7ff5f0160880 2024-03-30T13:09:03.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.324+0000 7ff5ee7fc640 1 -- 172.21.15.83:0/2171385376 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80a5b90 con 0x7ff5f0160880 2024-03-30T13:09:03.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2171385376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5f0160880 msgr2=0x7ff5f015df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 --2- 172.21.15.83:0/2171385376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5f0160880 0x7ff5f015df50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0069ce0 tx=0x7ff5e801c960 comp rx=0 tx=0).stop 2024-03-30T13:09:03.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2171385376 shutdown_connections 2024-03-30T13:09:03.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 --2- 172.21.15.83:0/2171385376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5f0160880 0x7ff5f015df50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 --2- 172.21.15.83:0/2171385376 >> v2:172.21.15.153:3300/0 conn(0x7ff5f006b660 0x7ff5f006ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2171385376 >> 172.21.15.83:0/2171385376 conn(0x7ff5f0072d40 msgr2=0x7ff5f00b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:03.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2171385376 shutdown_connections 2024-03-30T13:09:03.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2171385376 wait complete. 2024-03-30T13:09:03.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 Processor -- start 2024-03-30T13:09:03.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 -- start start 2024-03-30T13:09:03.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5f006b660 0x7ff5f013ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5f015d830 0x7ff5f015bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5f0160880 0x7ff5f00b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f0169690 con 0x7ff5f006b660 2024-03-30T13:09:03.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f0169510 con 0x7ff5f0160880 2024-03-30T13:09:03.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f0169810 con 0x7ff5f015d830 2024-03-30T13:09:03.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5eeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5f006b660 0x7ff5f013ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5eeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5f006b660 0x7ff5f013ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58836/0 (socket says 172.21.15.83:58836) 2024-03-30T13:09:03.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5eeffd640 1 -- 172.21.15.83:0/2905171963 learned_addr learned my addr 172.21.15.83:0/2905171963 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:03.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5e7fff640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5f015d830 0x7ff5f015bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5eeffd640 1 -- 172.21.15.83:0/2905171963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5f015d830 msgr2=0x7ff5f015bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5eeffd640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5f015d830 0x7ff5f015bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5eeffd640 1 -- 172.21.15.83:0/2905171963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5f0160880 msgr2=0x7ff5f00b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5ef7fe640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5f0160880 0x7ff5f00b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5eeffd640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5f0160880 0x7ff5f00b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5eeffd640 1 -- 172.21.15.83:0/2905171963 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f00b45e0 con 0x7ff5f006b660 2024-03-30T13:09:03.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5eeffd640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5f006b660 0x7ff5f013ef30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000d800 tx=0x7ff5e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:03.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5e77fe640 1 -- 172.21.15.83:0/2905171963 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e000b6c0 con 0x7ff5f006b660 2024-03-30T13:09:03.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5e77fe640 1 -- 172.21.15.83:0/2905171963 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e0019070 con 0x7ff5f006b660 2024-03-30T13:09:03.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2905171963 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f00b48c0 con 0x7ff5f006b660 2024-03-30T13:09:03.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5e77fe640 1 -- 172.21.15.83:0/2905171963 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e000bae0 con 0x7ff5f006b660 2024-03-30T13:09:03.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.328+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2905171963 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f00b4e80 con 0x7ff5f006b660 2024-03-30T13:09:03.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.332+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2905171963 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f015f150 con 0x7ff5f006b660 2024-03-30T13:09:03.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.332+0000 7ff5e77fe640 1 -- 172.21.15.83:0/2905171963 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff5e000bc80 con 0x7ff5f006b660 2024-03-30T13:09:03.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.332+0000 7ff5e77fe640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff5d0067ff0 0x7ff5d006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.332+0000 7ff5e77fe640 1 -- 172.21.15.83:0/2905171963 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff5e0086a70 con 0x7ff5f006b660 2024-03-30T13:09:03.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.332+0000 7ff5e7fff640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff5d0067ff0 0x7ff5d006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.332+0000 7ff5e7fff640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff5d0067ff0 0x7ff5d006a4b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0142300 tx=0x7ff5d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:03.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.336+0000 7ff5e77fe640 1 -- 172.21.15.83:0/2905171963 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff5e0057180 con 0x7ff5f006b660 2024-03-30T13:09:03.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2905171963 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff5f004f9e0 con 0x7ff5f006b660 2024-03-30T13:09:03.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5e77fe640 1 -- 172.21.15.83:0/2905171963 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7ff5e0056a80 con 0x7ff5f006b660 2024-03-30T13:09:03.491 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:09:03.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2905171963 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff5d0067ff0 msgr2=0x7ff5d006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff5d0067ff0 0x7ff5d006a4b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0142300 tx=0x7ff5d8009040 comp rx=0 tx=0).stop 2024-03-30T13:09:03.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2905171963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5f006b660 msgr2=0x7ff5f013ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5f006b660 0x7ff5f013ef30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000d800 tx=0x7ff5e000dcc0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2905171963 shutdown_connections 2024-03-30T13:09:03.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff5d0067ff0 0x7ff5d006a4b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5f0160880 0x7ff5f00b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5f015d830 0x7ff5f015bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 --2- 172.21.15.83:0/2905171963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5f006b660 0x7ff5f013ef30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2905171963 >> 172.21.15.83:0/2905171963 conn(0x7ff5f0072d40 msgr2=0x7ff5f00ae260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:03.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2905171963 shutdown_connections 2024-03-30T13:09:03.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.488+0000 7ff5f53ad640 1 -- 172.21.15.83:0/2905171963 wait complete. 2024-03-30T13:09:03.509 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:09:03.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.612+0000 7efd194ff640 1 Processor -- start 2024-03-30T13:09:03.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.612+0000 7efd194ff640 1 -- start start 2024-03-30T13:09:03.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd194ff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efd1415c8e0 0x7efd140ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd194ff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd140b4680 0x7efd14165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd194ff640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd140ae040 con 0x7efd140adac0 2024-03-30T13:09:03.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd194ff640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efd140b31e0 con 0x7efd1415c8e0 2024-03-30T13:09:03.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd194ff640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efd140ae320 con 0x7efd140b4680 2024-03-30T13:09:03.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd137fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd140b4680 0x7efd14165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd137fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd140b4680 0x7efd14165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:33810/0 (socket says 172.21.15.83:33810) 2024-03-30T13:09:03.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd137fe640 1 -- 172.21.15.83:0/1343247730 learned_addr learned my addr 172.21.15.83:0/1343247730 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:03.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd12ffd640 1 --2- 172.21.15.83:0/1343247730 >> v2:172.21.15.153:3300/0 conn(0x7efd1415c8e0 0x7efd140ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd11ffb640 1 -- 172.21.15.83:0/1343247730 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 451221771 0 0) 0x7efd140ae040 con 0x7efd140adac0 2024-03-30T13:09:03.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd11ffb640 1 -- 172.21.15.83:0/1343247730 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcfc003530 con 0x7efd140adac0 2024-03-30T13:09:03.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd137fe640 1 -- 172.21.15.83:0/1343247730 >> v2:172.21.15.153:3300/0 conn(0x7efd1415c8e0 msgr2=0x7efd140ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:03.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd137fe640 1 --2- 172.21.15.83:0/1343247730 >> v2:172.21.15.153:3300/0 conn(0x7efd1415c8e0 0x7efd140ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd137fe640 1 -- 172.21.15.83:0/1343247730 >> v1:172.21.15.153:6789/0 conn(0x7efd140adac0 legacy=0x7efd1415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd137fe640 1 -- 172.21.15.83:0/1343247730 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd140ae600 con 0x7efd140b4680 2024-03-30T13:09:03.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.616+0000 7efd12ffd640 1 --2- 172.21.15.83:0/1343247730 >> v2:172.21.15.153:3300/0 conn(0x7efd1415c8e0 0x7efd140ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:09:03.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd137fe640 1 --2- 172.21.15.83:0/1343247730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd140b4680 0x7efd14165e90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009e50 tx=0x7efd0c01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46bb8a97ea232717 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:03.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd11ffb640 1 -- 172.21.15.83:0/1343247730 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0a5700 con 0x7efd140b4680 2024-03-30T13:09:03.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd11ffb640 1 -- 172.21.15.83:0/1343247730 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0c0a58a0 con 0x7efd140b4680 2024-03-30T13:09:03.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd11ffb640 1 -- 172.21.15.83:0/1343247730 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0a5c50 con 0x7efd140b4680 2024-03-30T13:09:03.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd194ff640 1 -- 172.21.15.83:0/1343247730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd140b4680 msgr2=0x7efd14165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd194ff640 1 --2- 172.21.15.83:0/1343247730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd140b4680 0x7efd14165e90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009e50 tx=0x7efd0c01ca30 comp rx=0 tx=0).stop 2024-03-30T13:09:03.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd194ff640 1 -- 172.21.15.83:0/1343247730 shutdown_connections 2024-03-30T13:09:03.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd194ff640 1 --2- 172.21.15.83:0/1343247730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd140b4680 0x7efd14165e90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd194ff640 1 --2- 172.21.15.83:0/1343247730 >> v2:172.21.15.153:3300/0 conn(0x7efd1415c8e0 0x7efd140ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd194ff640 1 -- 172.21.15.83:0/1343247730 >> 172.21.15.83:0/1343247730 conn(0x7efd1406b660 msgr2=0x7efd1406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:03.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd194ff640 1 -- 172.21.15.83:0/1343247730 shutdown_connections 2024-03-30T13:09:03.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd194ff640 1 -- 172.21.15.83:0/1343247730 wait complete. 2024-03-30T13:09:03.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd194ff640 1 Processor -- start 2024-03-30T13:09:03.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.620+0000 7efd194ff640 1 -- start start 2024-03-30T13:09:03.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd194ff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd140adac0 0x7efd14099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd194ff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd140b4680 0x7efd140b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd194ff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd1415c8e0 0x7efd1414cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd194ff640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efd14168f80 con 0x7efd1415c8e0 2024-03-30T13:09:03.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd194ff640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd14168e00 con 0x7efd140b4680 2024-03-30T13:09:03.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd194ff640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efd14169100 con 0x7efd140adac0 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd137fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd1415c8e0 0x7efd1414cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd137fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd1415c8e0 0x7efd1414cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58842/0 (socket says 172.21.15.83:58842) 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd137fe640 1 -- 172.21.15.83:0/3227106266 learned_addr learned my addr 172.21.15.83:0/3227106266 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd12ffd640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd140adac0 0x7efd14099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd127fc640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd140b4680 0x7efd140b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd137fe640 1 -- 172.21.15.83:0/3227106266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd140adac0 msgr2=0x7efd14099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd137fe640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd140adac0 0x7efd14099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd137fe640 1 -- 172.21.15.83:0/3227106266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd140b4680 msgr2=0x7efd140b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd137fe640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd140b4680 0x7efd140b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd137fe640 1 -- 172.21.15.83:0/3227106266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd140b17d0 con 0x7efd1415c8e0 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd127fc640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd140b4680 0x7efd140b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd137fe640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd1415c8e0 0x7efd1414cf30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efd0c01a660 tx=0x7efd0c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efcfb7fe640 1 -- 172.21.15.83:0/3227106266 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0b8470 con 0x7efd1415c8e0 2024-03-30T13:09:03.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efcfb7fe640 1 -- 172.21.15.83:0/3227106266 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0c0b8650 con 0x7efd1415c8e0 2024-03-30T13:09:03.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd194ff640 1 -- 172.21.15.83:0/3227106266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd140b1ab0 con 0x7efd1415c8e0 2024-03-30T13:09:03.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efcfb7fe640 1 -- 172.21.15.83:0/3227106266 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0b8a40 con 0x7efd1415c8e0 2024-03-30T13:09:03.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd194ff640 1 -- 172.21.15.83:0/3227106266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd14157270 con 0x7efd1415c8e0 2024-03-30T13:09:03.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd194ff640 1 -- 172.21.15.83:0/3227106266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd1404f9e0 con 0x7efd1415c8e0 2024-03-30T13:09:03.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efcfb7fe640 1 -- 172.21.15.83:0/3227106266 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7efd0c0c0020 con 0x7efd1415c8e0 2024-03-30T13:09:03.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efcfb7fe640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efd00067fc0 0x7efd0006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efcfb7fe640 1 -- 172.21.15.83:0/3227106266 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efd0c1218f0 con 0x7efd1415c8e0 2024-03-30T13:09:03.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd12ffd640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efd00067fc0 0x7efd0006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.624+0000 7efd12ffd640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efd00067fc0 0x7efd0006a480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efd04009580 tx=0x7efd04009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:03.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.632+0000 7efcfb7fe640 1 -- 172.21.15.83:0/3227106266 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7efd0c016620 con 0x7efd1415c8e0 2024-03-30T13:09:03.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.776+0000 7efd194ff640 1 -- 172.21.15.83:0/3227106266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efd140ad7b0 con 0x7efd1415c8e0 2024-03-30T13:09:03.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.776+0000 7efcfb7fe640 1 -- 172.21.15.83:0/3227106266 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7efd0c0f2120 con 0x7efd1415c8e0 2024-03-30T13:09:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:09:03.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.780+0000 7efd194ff640 1 -- 172.21.15.83:0/3227106266 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efd00067fc0 msgr2=0x7efd0006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.780+0000 7efd194ff640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efd00067fc0 0x7efd0006a480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efd04009580 tx=0x7efd04009190 comp rx=0 tx=0).stop 2024-03-30T13:09:03.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.780+0000 7efd194ff640 1 -- 172.21.15.83:0/3227106266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd1415c8e0 msgr2=0x7efd1414cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.780+0000 7efd194ff640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd1415c8e0 0x7efd1414cf30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efd0c01a660 tx=0x7efd0c0197d0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.780+0000 7efd194ff640 1 -- 172.21.15.83:0/3227106266 shutdown_connections 2024-03-30T13:09:03.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.780+0000 7efd194ff640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efd00067fc0 0x7efd0006a480 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.780+0000 7efd194ff640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd1415c8e0 0x7efd1414cf30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.780+0000 7efd194ff640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd140b4680 0x7efd140b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.780+0000 7efd194ff640 1 --2- 172.21.15.83:0/3227106266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd140adac0 0x7efd14099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.780+0000 7efd194ff640 1 -- 172.21.15.83:0/3227106266 >> 172.21.15.83:0/3227106266 conn(0x7efd1406b660 msgr2=0x7efd1415a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:03.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.780+0000 7efd194ff640 1 -- 172.21.15.83:0/3227106266 shutdown_connections 2024-03-30T13:09:03.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.780+0000 7efd194ff640 1 -- 172.21.15.83:0/3227106266 wait complete. 2024-03-30T13:09:03.798 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:09:03.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.904+0000 7f9f2c833640 1 Processor -- start 2024-03-30T13:09:03.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.904+0000 7f9f2c833640 1 -- start start 2024-03-30T13:09:03.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9f2815e770 0x7f9f280cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9f280d4ed0 0x7f9f280d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f280d17d0 con 0x7f9f280d13c0 2024-03-30T13:09:03.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2815eb50 con 0x7f9f2815e770 2024-03-30T13:09:03.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9f280d20e0 con 0x7f9f280d4ed0 2024-03-30T13:09:03.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f26d9d640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f9f280d13c0 0x7f9f2806caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46220/0 (socket says 172.21.15.83:46220) 2024-03-30T13:09:03.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f26d9d640 1 -- 172.21.15.83:0/3316805797 learned_addr learned my addr 172.21.15.83:0/3316805797 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:03.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2659c640 1 --2- 172.21.15.83:0/3316805797 >> v2:172.21.15.83:3300/0 conn(0x7f9f2815e770 0x7f9f280cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2559a640 1 -- 172.21.15.83:0/3316805797 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2991351852 0 0) 0x7f9f200014a0 con 0x7f9f280d13c0 2024-03-30T13:09:03.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2559a640 1 -- 172.21.15.83:0/3316805797 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f10003530 con 0x7f9f280d13c0 2024-03-30T13:09:03.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f25d9b640 1 --2- 172.21.15.83:0/3316805797 >> v2:172.21.15.153:3300/0 conn(0x7f9f280d4ed0 0x7f9f280d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2559a640 1 -- 172.21.15.83:0/3316805797 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1926259794 0 0) 0x7f9f10003530 con 0x7f9f280d13c0 2024-03-30T13:09:03.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2659c640 1 -- 172.21.15.83:0/3316805797 >> v2:172.21.15.153:3300/0 conn(0x7f9f280d4ed0 msgr2=0x7f9f280d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:03.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2659c640 1 --2- 172.21.15.83:0/3316805797 >> v2:172.21.15.153:3300/0 conn(0x7f9f280d4ed0 0x7f9f280d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2659c640 1 -- 172.21.15.83:0/3316805797 >> v1:172.21.15.83:6789/0 conn(0x7f9f280d13c0 legacy=0x7f9f2806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2659c640 1 -- 172.21.15.83:0/3316805797 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f280cfbb0 con 0x7f9f2815e770 2024-03-30T13:09:03.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2659c640 1 --2- 172.21.15.83:0/3316805797 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2815e770 0x7f9f280cf4a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9f2808ce50 tx=0x7f9f1801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8436196b66a76d16 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:03.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2559a640 1 -- 172.21.15.83:0/3316805797 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f180b0070 con 0x7f9f2815e770 2024-03-30T13:09:03.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2559a640 1 -- 172.21.15.83:0/3316805797 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f180ab400 con 0x7f9f2815e770 2024-03-30T13:09:03.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2559a640 1 -- 172.21.15.83:0/3316805797 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f20001bd0 con 0x7f9f2815e770 2024-03-30T13:09:03.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 -- 172.21.15.83:0/3316805797 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2815e770 msgr2=0x7f9f280cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 --2- 172.21.15.83:0/3316805797 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2815e770 0x7f9f280cf4a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9f2808ce50 tx=0x7f9f1801c3a0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 -- 172.21.15.83:0/3316805797 shutdown_connections 2024-03-30T13:09:03.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 --2- 172.21.15.83:0/3316805797 >> v2:172.21.15.153:3300/0 conn(0x7f9f280d4ed0 0x7f9f280d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 --2- 172.21.15.83:0/3316805797 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2815e770 0x7f9f280cf4a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 -- 172.21.15.83:0/3316805797 >> 172.21.15.83:0/3316805797 conn(0x7f9f2808bfe0 msgr2=0x7f9f280d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:03.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 -- 172.21.15.83:0/3316805797 shutdown_connections 2024-03-30T13:09:03.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.908+0000 7f9f2c833640 1 -- 172.21.15.83:0/3316805797 wait complete. 2024-03-30T13:09:03.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2c833640 1 Processor -- start 2024-03-30T13:09:03.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2c833640 1 -- start start 2024-03-30T13:09:03.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2c833640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f280d13c0 0x7f9f280b9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2c833640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f280d4ed0 0x7f9f28154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2c833640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f2815e770 0x7f9f2815fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2c833640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9f280d0010 con 0x7f9f280d13c0 2024-03-30T13:09:03.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2c833640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9f280cfe90 con 0x7f9f280d4ed0 2024-03-30T13:09:03.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2c833640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2816b230 con 0x7f9f2815e770 2024-03-30T13:09:03.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f280d13c0 0x7f9f280b9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f280d13c0 0x7f9f280b9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58862/0 (socket says 172.21.15.83:58862) 2024-03-30T13:09:03.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2659c640 1 -- 172.21.15.83:0/3508393451 learned_addr learned my addr 172.21.15.83:0/3508393451 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:03.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2659c640 1 -- 172.21.15.83:0/3508393451 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f2815e770 msgr2=0x7f9f2815fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2659c640 1 --2- 172.21.15.83:0/3508393451 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f2815e770 0x7f9f2815fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2659c640 1 -- 172.21.15.83:0/3508393451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f280d4ed0 msgr2=0x7f9f28154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:03.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2659c640 1 --2- 172.21.15.83:0/3508393451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f280d4ed0 0x7f9f28154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:03.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2659c640 1 -- 172.21.15.83:0/3508393451 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f28153bb0 con 0x7f9f280d13c0 2024-03-30T13:09:03.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2659c640 1 --2- 172.21.15.83:0/3508393451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f280d13c0 0x7f9f280b9500 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9f18000c10 tx=0x7f9f18019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:03.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f16ffd640 1 -- 172.21.15.83:0/3508393451 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f180b9020 con 0x7f9f280d13c0 2024-03-30T13:09:03.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f16ffd640 1 -- 172.21.15.83:0/3508393451 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f180038a0 con 0x7f9f280d13c0 2024-03-30T13:09:03.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2c833640 1 -- 172.21.15.83:0/3508393451 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f280b9d80 con 0x7f9f280d13c0 2024-03-30T13:09:03.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f16ffd640 1 -- 172.21.15.83:0/3508393451 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f180b0040 con 0x7f9f280d13c0 2024-03-30T13:09:03.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2c833640 1 -- 172.21.15.83:0/3508393451 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f28154130 con 0x7f9f280d13c0 2024-03-30T13:09:03.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.912+0000 7f9f2c833640 1 -- 172.21.15.83:0/3508393451 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f280a23e0 con 0x7f9f280d13c0 2024-03-30T13:09:03.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.916+0000 7f9f16ffd640 1 -- 172.21.15.83:0/3508393451 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9f180bc020 con 0x7f9f280d13c0 2024-03-30T13:09:03.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.916+0000 7f9f16ffd640 1 --2- 172.21.15.83:0/3508393451 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f08067fc0 0x7f9f0806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:03.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.916+0000 7f9f16ffd640 1 -- 172.21.15.83:0/3508393451 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f18120400 con 0x7f9f280d13c0 2024-03-30T13:09:03.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.916+0000 7f9f25d9b640 1 --2- 172.21.15.83:0/3508393451 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f08067fc0 0x7f9f0806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:03.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.916+0000 7f9f25d9b640 1 --2- 172.21.15.83:0/3508393451 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f08067fc0 0x7f9f0806a480 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c006fd0 tx=0x7f9f1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:03.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:03.920+0000 7f9f16ffd640 1 -- 172.21.15.83:0/3508393451 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9f180c3030 con 0x7f9f280d13c0 2024-03-30T13:09:04.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.076+0000 7f9f2c833640 1 -- 172.21.15.83:0/3508393451 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9f28161d10 con 0x7f9f280d13c0 2024-03-30T13:09:04.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.076+0000 7f9f16ffd640 1 -- 172.21.15.83:0/3508393451 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f9f18015f90 con 0x7f9f280d13c0 2024-03-30T13:09:04.081 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:09:04.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.080+0000 7f9f2c833640 1 -- 172.21.15.83:0/3508393451 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f08067fc0 msgr2=0x7f9f0806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.080+0000 7f9f2c833640 1 --2- 172.21.15.83:0/3508393451 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f08067fc0 0x7f9f0806a480 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c006fd0 tx=0x7f9f1c008040 comp rx=0 tx=0).stop 2024-03-30T13:09:04.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.080+0000 7f9f2c833640 1 -- 172.21.15.83:0/3508393451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f280d13c0 msgr2=0x7f9f280b9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.080+0000 7f9f2c833640 1 --2- 172.21.15.83:0/3508393451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f280d13c0 0x7f9f280b9500 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9f18000c10 tx=0x7f9f18019140 comp rx=0 tx=0).stop 2024-03-30T13:09:04.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.080+0000 7f9f2c833640 1 -- 172.21.15.83:0/3508393451 shutdown_connections 2024-03-30T13:09:04.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.080+0000 7f9f2c833640 1 --2- 172.21.15.83:0/3508393451 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f08067fc0 0x7f9f0806a480 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.080+0000 7f9f2c833640 1 --2- 172.21.15.83:0/3508393451 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f2815e770 0x7f9f2815fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.080+0000 7f9f2c833640 1 --2- 172.21.15.83:0/3508393451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f280d4ed0 0x7f9f28154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.080+0000 7f9f2c833640 1 --2- 172.21.15.83:0/3508393451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f280d13c0 0x7f9f280b9500 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.080+0000 7f9f2c833640 1 -- 172.21.15.83:0/3508393451 >> 172.21.15.83:0/3508393451 conn(0x7f9f2808bfe0 msgr2=0x7f9f2815b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:04.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.080+0000 7f9f2c833640 1 -- 172.21.15.83:0/3508393451 shutdown_connections 2024-03-30T13:09:04.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.080+0000 7f9f2c833640 1 -- 172.21.15.83:0/3508393451 wait complete. 2024-03-30T13:09:04.100 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:09:04.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.212+0000 7f106c6f0640 1 Processor -- start 2024-03-30T13:09:04.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.212+0000 7f106c6f0640 1 -- start start 2024-03-30T13:09:04.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f106415e840 0x7f10640d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f10640d1540 0x7f10640d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10640d51f0 con 0x7f10640cfc10 2024-03-30T13:09:04.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f106415ec20 con 0x7f10640d1540 2024-03-30T13:09:04.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f10640d2d50 con 0x7f106415e840 2024-03-30T13:09:04.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106ac8d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f10640d1540 0x7f10640d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106ac8d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f10640d1540 0x7f10640d0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58868/0 (socket says 172.21.15.83:58868) 2024-03-30T13:09:04.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106ac8d640 1 -- 172.21.15.83:0/1472976604 learned_addr learned my addr 172.21.15.83:0/1472976604 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:04.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106a48c640 1 --2- 172.21.15.83:0/1472976604 >> v2:172.21.15.153:3300/0 conn(0x7f106415e840 0x7f10640d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106ac8d640 1 -- 172.21.15.83:0/1472976604 >> v2:172.21.15.153:3300/0 conn(0x7f106415e840 msgr2=0x7f10640d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:04.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106ac8d640 1 --2- 172.21.15.83:0/1472976604 >> v2:172.21.15.153:3300/0 conn(0x7f106415e840 0x7f10640d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106ac8d640 1 -- 172.21.15.83:0/1472976604 >> v1:172.21.15.153:6789/0 conn(0x7f10640cfc10 legacy=0x7f10640d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:04.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106ac8d640 1 -- 172.21.15.83:0/1472976604 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10640d2140 con 0x7f10640d1540 2024-03-30T13:09:04.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106ac8d640 1 --2- 172.21.15.83:0/1472976604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10640d1540 0x7f10640d0070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f106408e370 tx=0x7f105c01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a96a42e05b6360 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:04.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106948a640 1 -- 172.21.15.83:0/1472976604 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c0a5600 con 0x7f10640d1540 2024-03-30T13:09:04.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106948a640 1 -- 172.21.15.83:0/1472976604 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f105c0a57a0 con 0x7f10640d1540 2024-03-30T13:09:04.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106948a640 1 -- 172.21.15.83:0/1472976604 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c0a5b70 con 0x7f10640d1540 2024-03-30T13:09:04.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 -- 172.21.15.83:0/1472976604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10640d1540 msgr2=0x7f10640d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 --2- 172.21.15.83:0/1472976604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10640d1540 0x7f10640d0070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f106408e370 tx=0x7f105c01c740 comp rx=0 tx=0).stop 2024-03-30T13:09:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 -- 172.21.15.83:0/1472976604 shutdown_connections 2024-03-30T13:09:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 --2- 172.21.15.83:0/1472976604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10640d1540 0x7f10640d0070 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 --2- 172.21.15.83:0/1472976604 >> v2:172.21.15.153:3300/0 conn(0x7f106415e840 0x7f10640d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 -- 172.21.15.83:0/1472976604 >> 172.21.15.83:0/1472976604 conn(0x7f106409d7f0 msgr2=0x7f10640d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 -- 172.21.15.83:0/1472976604 shutdown_connections 2024-03-30T13:09:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.216+0000 7f106c6f0640 1 -- 172.21.15.83:0/1472976604 wait complete. 2024-03-30T13:09:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106c6f0640 1 Processor -- start 2024-03-30T13:09:04.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106c6f0640 1 -- start start 2024-03-30T13:09:04.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106c6f0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10640cfc10 0x7f106415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106c6f0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10640d1540 0x7f106415c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106c6f0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f106415e840 0x7f106415c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106c6f0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f106406d0b0 con 0x7f10640cfc10 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106c6f0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f106406cf30 con 0x7f106415e840 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106c6f0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f106406d230 con 0x7f10640d1540 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106a48c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10640cfc10 0x7f106415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106a48c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10640cfc10 0x7f106415a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58882/0 (socket says 172.21.15.83:58882) 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106a48c640 1 -- 172.21.15.83:0/2447073357 learned_addr learned my addr 172.21.15.83:0/2447073357 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f1069c8b640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10640d1540 0x7f106415c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106ac8d640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f106415e840 0x7f106415c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106a48c640 1 -- 172.21.15.83:0/2447073357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10640d1540 msgr2=0x7f106415c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106a48c640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10640d1540 0x7f106415c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106a48c640 1 -- 172.21.15.83:0/2447073357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f106415e840 msgr2=0x7f106415c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106a48c640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f106415e840 0x7f106415c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106a48c640 1 -- 172.21.15.83:0/2447073357 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106414db40 con 0x7f10640cfc10 2024-03-30T13:09:04.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106a48c640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10640cfc10 0x7f106415a790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f106000d5f0 tx=0x7f106000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:04.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f105affd640 1 -- 172.21.15.83:0/2447073357 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10600125f0 con 0x7f10640cfc10 2024-03-30T13:09:04.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f105affd640 1 -- 172.21.15.83:0/2447073357 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1060019070 con 0x7f10640cfc10 2024-03-30T13:09:04.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106c6f0640 1 -- 172.21.15.83:0/2447073357 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10641596f0 con 0x7f10640cfc10 2024-03-30T13:09:04.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f105affd640 1 -- 172.21.15.83:0/2447073357 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10600129b0 con 0x7f10640cfc10 2024-03-30T13:09:04.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106c6f0640 1 -- 172.21.15.83:0/2447073357 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1064159cb0 con 0x7f10640cfc10 2024-03-30T13:09:04.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f106c6f0640 1 -- 172.21.15.83:0/2447073357 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10640a23d0 con 0x7f10640cfc10 2024-03-30T13:09:04.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.220+0000 7f105affd640 1 -- 172.21.15.83:0/2447073357 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f1060012b50 con 0x7f10640cfc10 2024-03-30T13:09:04.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.224+0000 7f105affd640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1048067fc0 0x7f104806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.224+0000 7f105affd640 1 -- 172.21.15.83:0/2447073357 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f10600867f0 con 0x7f10640cfc10 2024-03-30T13:09:04.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.224+0000 7f1069c8b640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1048067fc0 0x7f104806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.224+0000 7f1069c8b640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1048067fc0 0x7f104806a480 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f10641fa9b0 tx=0x7f1054007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:04.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.228+0000 7f105affd640 1 -- 172.21.15.83:0/2447073357 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f1060057030 con 0x7f10640cfc10 2024-03-30T13:09:04.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.392+0000 7f106c6f0640 1 -- 172.21.15.83:0/2447073357 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f106414dde0 con 0x7f10640cfc10 2024-03-30T13:09:04.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.392+0000 7f105affd640 1 -- 172.21.15.83:0/2447073357 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f1060056930 con 0x7f10640cfc10 2024-03-30T13:09:04.395 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-03-30T13:09:04.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.396+0000 7f106c6f0640 1 -- 172.21.15.83:0/2447073357 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1048067fc0 msgr2=0x7f104806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.396+0000 7f106c6f0640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1048067fc0 0x7f104806a480 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f10641fa9b0 tx=0x7f1054007e40 comp rx=0 tx=0).stop 2024-03-30T13:09:04.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.396+0000 7f106c6f0640 1 -- 172.21.15.83:0/2447073357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10640cfc10 msgr2=0x7f106415a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.396+0000 7f106c6f0640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10640cfc10 0x7f106415a790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f106000d5f0 tx=0x7f106000dab0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.396+0000 7f106c6f0640 1 -- 172.21.15.83:0/2447073357 shutdown_connections 2024-03-30T13:09:04.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.396+0000 7f106c6f0640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1048067fc0 0x7f104806a480 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.396+0000 7f106c6f0640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f106415e840 0x7f106415c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.396+0000 7f106c6f0640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10640d1540 0x7f106415c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.396+0000 7f106c6f0640 1 --2- 172.21.15.83:0/2447073357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10640cfc10 0x7f106415a790 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.396+0000 7f106c6f0640 1 -- 172.21.15.83:0/2447073357 >> 172.21.15.83:0/2447073357 conn(0x7f106409d7f0 msgr2=0x7f10640d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:04.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.396+0000 7f106c6f0640 1 -- 172.21.15.83:0/2447073357 shutdown_connections 2024-03-30T13:09:04.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.396+0000 7f106c6f0640 1 -- 172.21.15.83:0/2447073357 wait complete. 2024-03-30T13:09:04.414 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:09:04.414 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:09:04.419 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:04.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7aa4b8d640 1 Processor -- start 2024-03-30T13:09:04.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7aa4b8d640 1 -- start start 2024-03-30T13:09:04.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7aa4b8d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7aa006eff0 0x7f7aa0167270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7aa4b8d640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa00cfcb0 con 0x7f7aa00b4830 2024-03-30T13:09:04.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7aa4b8d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa00ad290 con 0x7f7aa00aed20 2024-03-30T13:09:04.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7aa4b8d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa0156e00 con 0x7f7aa006eff0 2024-03-30T13:09:04.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9e59c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f7aa00b4830 0x7f7aa015d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46232/0 (socket says 172.21.15.83:46232) 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9e59c640 1 -- 172.21.15.83:0/1864696408 learned_addr learned my addr 172.21.15.83:0/1864696408 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9ed9d640 1 --2- 172.21.15.83:0/1864696408 >> v2:172.21.15.153:3300/0 conn(0x7f7aa006eff0 0x7f7aa0167270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79404538 0 0) 0x7f7aa00cfcb0 con 0x7f7aa00b4830 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a8c003530 con 0x7f7aa00b4830 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2887788448 0 0) 0x7f7a8c003530 con 0x7f7aa00b4830 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 >> v2:172.21.15.153:3300/0 conn(0x7f7aa006eff0 msgr2=0x7f7aa0167270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 --2- 172.21.15.83:0/1864696408 >> v2:172.21.15.153:3300/0 conn(0x7f7aa006eff0 0x7f7aa0167270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 >> v1:172.21.15.153:6789/0 conn(0x7f7aa00aed20 legacy=0x7f7aa00af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa00ad570 con 0x7f7aa00b4830 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f7a90001680 con 0x7f7aa00b4830 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 >> v1:172.21.15.83:6789/0 conn(0x7f7aa00b4830 legacy=0x7f7aa015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 --2- 172.21.15.83:0/1864696408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a8c0039c0 0x7f7a8c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 --2- 172.21.15.83:0/1864696408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a8c004810 0x7f7a8c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 --2- 172.21.15.83:0/1864696408 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c0052f0 0x7f7a8c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa0156e00 con 0x7f7a8c0039c0 2024-03-30T13:09:04.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c00c1c0 con 0x7f7a8c004810 2024-03-30T13:09:04.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8c00c3c0 con 0x7f7a8c0052f0 2024-03-30T13:09:04.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9e59c640 1 --2- 172.21.15.83:0/1864696408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a8c0039c0 0x7f7a8c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9e59c640 1 -- 172.21.15.83:0/1864696408 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c0052f0 msgr2=0x7f7a8c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:04.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9e59c640 1 --2- 172.21.15.83:0/1864696408 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c0052f0 0x7f7a8c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9e59c640 1 -- 172.21.15.83:0/1864696408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a8c004810 msgr2=0x7f7a8c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:04.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9e59c640 1 --2- 172.21.15.83:0/1864696408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a8c004810 0x7f7a8c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9e59c640 1 -- 172.21.15.83:0/1864696408 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c003530 con 0x7f7a8c0039c0 2024-03-30T13:09:04.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.572+0000 7f7a9ed9d640 1 -- 172.21.15.83:0/1864696408 reap_dead start 2024-03-30T13:09:04.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9e59c640 1 --2- 172.21.15.83:0/1864696408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a8c0039c0 0x7f7a8c003de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000c190 tx=0x7f7a9001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d009ab7b16d82e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:04.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90007d00 con 0x7f7a8c0039c0 2024-03-30T13:09:04.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a900a9020 con 0x7f7a8c0039c0 2024-03-30T13:09:04.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9d59a640 1 -- 172.21.15.83:0/1864696408 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90005ae0 con 0x7f7a8c0039c0 2024-03-30T13:09:04.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/1864696408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a8c0039c0 msgr2=0x7f7a8c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 --2- 172.21.15.83:0/1864696408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a8c0039c0 0x7f7a8c003de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000c190 tx=0x7f7a9001cbe0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/1864696408 shutdown_connections 2024-03-30T13:09:04.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 --2- 172.21.15.83:0/1864696408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a8c0039c0 0x7f7a8c003de0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/1864696408 >> 172.21.15.83:0/1864696408 conn(0x7f7aa00b1d60 msgr2=0x7f7aa00b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:04.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/1864696408 shutdown_connections 2024-03-30T13:09:04.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/1864696408 wait complete. 2024-03-30T13:09:04.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 Processor -- start 2024-03-30T13:09:04.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 -- start start 2024-03-30T13:09:04.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c0039c0 0x7f7aa009a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aa009c110 0x7f7aa009d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7aa009c590 0x7f7aa009dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa00cf9e0 con 0x7f7aa009c590 2024-03-30T13:09:04.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa00cf860 con 0x7f7aa009c110 2024-03-30T13:09:04.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa00af510 con 0x7f7a8c0039c0 2024-03-30T13:09:04.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7aa009c590 0x7f7aa009dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7aa009c590 0x7f7aa009dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58898/0 (socket says 172.21.15.83:58898) 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9ed9d640 1 -- 172.21.15.83:0/3021844110 learned_addr learned my addr 172.21.15.83:0/3021844110 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9e59c640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c0039c0 0x7f7aa009a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9dd9b640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aa009c110 0x7f7aa009d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9ed9d640 1 -- 172.21.15.83:0/3021844110 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c0039c0 msgr2=0x7f7aa009a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9ed9d640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c0039c0 0x7f7aa009a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9ed9d640 1 -- 172.21.15.83:0/3021844110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aa009c110 msgr2=0x7f7aa009d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9ed9d640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aa009c110 0x7f7aa009d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9ed9d640 1 -- 172.21.15.83:0/3021844110 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa009cb30 con 0x7f7aa009c590 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a9ed9d640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7aa009c590 0x7f7aa009dc20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7aa006db20 tx=0x7f7a9800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a96ffd640 1 -- 172.21.15.83:0/3021844110 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800bb10 con 0x7f7aa009c590 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a96ffd640 1 -- 172.21.15.83:0/3021844110 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a9801a070 con 0x7f7aa009c590 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/3021844110 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa009ce10 con 0x7f7aa009c590 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7a96ffd640 1 -- 172.21.15.83:0/3021844110 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98014400 con 0x7f7aa009c590 2024-03-30T13:09:04.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.576+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/3021844110 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa009a900 con 0x7f7aa009c590 2024-03-30T13:09:04.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.580+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/3021844110 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa00686c0 con 0x7f7aa009c590 2024-03-30T13:09:04.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.580+0000 7f7a96ffd640 1 -- 172.21.15.83:0/3021844110 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f7a98013070 con 0x7f7aa009c590 2024-03-30T13:09:04.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.580+0000 7f7a96ffd640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7a80067fc0 0x7f7a8006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.580+0000 7f7a96ffd640 1 -- 172.21.15.83:0/3021844110 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7a980865b0 con 0x7f7aa009c590 2024-03-30T13:09:04.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.580+0000 7f7a9e59c640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7a80067fc0 0x7f7a8006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.580+0000 7f7a9e59c640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7a80067fc0 0x7f7a8006a480 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7a900aa000 tx=0x7f7aa015c8f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:04.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.584+0000 7f7a96ffd640 1 -- 172.21.15.83:0/3021844110 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f7a98056d60 con 0x7f7aa009c590 2024-03-30T13:09:04.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.732+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/3021844110 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7aa00b4ca0 con 0x7f7aa009c590 2024-03-30T13:09:04.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7a96ffd640 1 -- 172.21.15.83:0/3021844110 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f7a98056660 con 0x7f7aa009c590 2024-03-30T13:09:04.738 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:04.738 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:04.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/3021844110 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7a80067fc0 msgr2=0x7f7a8006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7aa4b8d640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7a80067fc0 0x7f7a8006a480 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7a900aa000 tx=0x7f7aa015c8f0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/3021844110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7aa009c590 msgr2=0x7f7aa009dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7aa4b8d640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7aa009c590 0x7f7aa009dc20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7aa006db20 tx=0x7f7a9800eec0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/3021844110 shutdown_connections 2024-03-30T13:09:04.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7aa4b8d640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7a80067fc0 0x7f7a8006a480 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7aa4b8d640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7aa009c590 0x7f7aa009dc20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7aa4b8d640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aa009c110 0x7f7aa009d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7aa4b8d640 1 --2- 172.21.15.83:0/3021844110 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c0039c0 0x7f7aa009a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/3021844110 >> 172.21.15.83:0/3021844110 conn(0x7f7aa00b1d60 msgr2=0x7f7aa015fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:04.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/3021844110 shutdown_connections 2024-03-30T13:09:04.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.736+0000 7f7aa4b8d640 1 -- 172.21.15.83:0/3021844110 wait complete. 2024-03-30T13:09:04.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:09:04.756 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:09:04.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.864+0000 7f802d289640 1 Processor -- start 2024-03-30T13:09:04.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.864+0000 7f802d289640 1 -- start start 2024-03-30T13:09:04.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f802d289640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802815a8b0 0x7f8028072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f802d289640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8028071830 con 0x7f8028072f20 2024-03-30T13:09:04.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f802d289640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8028071ad0 con 0x7f80280b4d90 2024-03-30T13:09:04.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f802d289640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8028071db0 con 0x7f802815a8b0 2024-03-30T13:09:04.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f80267fc640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f8028072f20 0x7f80280b4680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46240/0 (socket says 172.21.15.83:46240) 2024-03-30T13:09:04.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f80267fc640 1 -- 172.21.15.83:0/3329636054 learned_addr learned my addr 172.21.15.83:0/3329636054 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:04.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8026ffd640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802815a8b0 0x7f8028072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2770932637 0 0) 0x7f8028071830 con 0x7f8028072f20 2024-03-30T13:09:04.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8010003530 con 0x7f8028072f20 2024-03-30T13:09:04.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1253605212 0 0) 0x7f8010003530 con 0x7f8028072f20 2024-03-30T13:09:04.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802815a8b0 msgr2=0x7f8028072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:04.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802815a8b0 0x7f8028072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 >> v1:172.21.15.153:6789/0 conn(0x7f80280b4d90 legacy=0x7f80280ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8028072090 con 0x7f8028072f20 2024-03-30T13:09:04.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f801c0016a0 con 0x7f8028072f20 2024-03-30T13:09:04.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 >> v1:172.21.15.83:6789/0 conn(0x7f8028072f20 legacy=0x7f80280b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802815a8b0 0x7f80100039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8010003f70 0x7f8010004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8010004d50 0x7f80100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8028071db0 con 0x7f8010003f70 2024-03-30T13:09:04.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f801000bab0 con 0x7f8010004d50 2024-03-30T13:09:04.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f801000bcb0 con 0x7f802815a8b0 2024-03-30T13:09:04.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f80267fc640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8010003f70 0x7f8010004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f80277fe640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8010004d50 0x7f80100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8026ffd640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802815a8b0 0x7f80100039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f80267fc640 1 -- 172.21.15.83:0/3329636054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802815a8b0 msgr2=0x7f80100039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:04.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f80267fc640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802815a8b0 0x7f80100039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f80267fc640 1 -- 172.21.15.83:0/3329636054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8010004d50 msgr2=0x7f80100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:04.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f80267fc640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8010004d50 0x7f80100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f80267fc640 1 -- 172.21.15.83:0/3329636054 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8010003530 con 0x7f8010003f70 2024-03-30T13:09:04.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.868+0000 7f8026ffd640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802815a8b0 0x7f80100039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:04.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f80267fc640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8010003f70 0x7f8010004810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c210 tx=0x7f801c01f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53045284357b038e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c007d40 con 0x7f8010003f70 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801c005ae0 con 0x7f8010003f70 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f8025ffb640 1 -- 172.21.15.83:0/3329636054 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c007070 con 0x7f8010003f70 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 -- 172.21.15.83:0/3329636054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8010003f70 msgr2=0x7f8010004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 --2- 172.21.15.83:0/3329636054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8010003f70 0x7f8010004810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c210 tx=0x7f801c01f3b0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f80277fe640 1 -- 172.21.15.83:0/3329636054 reap_dead start 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 -- 172.21.15.83:0/3329636054 shutdown_connections 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 -- 172.21.15.83:0/3329636054 >> 172.21.15.83:0/3329636054 conn(0x7f802806b660 msgr2=0x7f802806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 -- 172.21.15.83:0/3329636054 shutdown_connections 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 -- 172.21.15.83:0/3329636054 wait complete. 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 Processor -- start 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 -- start start 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8010003f70 0x7f8028147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80280b07c0 0x7f80281467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802814c080 0x7f80280b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f802815ae10 con 0x7f802814c080 2024-03-30T13:09:04.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f802815ac90 con 0x7f8010003f70 2024-03-30T13:09:04.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8028072890 con 0x7f80280b07c0 2024-03-30T13:09:04.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f80277fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802814c080 0x7f80280b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f80277fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802814c080 0x7f80280b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58920/0 (socket says 172.21.15.83:58920) 2024-03-30T13:09:04.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f80277fe640 1 -- 172.21.15.83:0/2331376534 learned_addr learned my addr 172.21.15.83:0/2331376534 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:04.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f8026ffd640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8010003f70 0x7f8028147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f80267fc640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80280b07c0 0x7f80281467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f80277fe640 1 -- 172.21.15.83:0/2331376534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80280b07c0 msgr2=0x7f80281467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f80277fe640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80280b07c0 0x7f80281467e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f80277fe640 1 -- 172.21.15.83:0/2331376534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8010003f70 msgr2=0x7f8028147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f80277fe640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8010003f70 0x7f8028147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f80277fe640 1 -- 172.21.15.83:0/2331376534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8028147370 con 0x7f802814c080 2024-03-30T13:09:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f80277fe640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802814c080 0x7f80280b0d10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f80280ade50 tx=0x7f8020010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f800f7fe640 1 -- 172.21.15.83:0/2331376534 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8020003600 con 0x7f802814c080 2024-03-30T13:09:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f800f7fe640 1 -- 172.21.15.83:0/2331376534 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80200037e0 con 0x7f802814c080 2024-03-30T13:09:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f802d289640 1 -- 172.21.15.83:0/2331376534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802806f040 con 0x7f802814c080 2024-03-30T13:09:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.872+0000 7f800f7fe640 1 -- 172.21.15.83:0/2331376534 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8020003bd0 con 0x7f802814c080 2024-03-30T13:09:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.876+0000 7f802d289640 1 -- 172.21.15.83:0/2331376534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8028146d20 con 0x7f802814c080 2024-03-30T13:09:04.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.876+0000 7f802d289640 1 -- 172.21.15.83:0/2331376534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f802809e540 con 0x7f802814c080 2024-03-30T13:09:04.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.876+0000 7f800f7fe640 1 -- 172.21.15.83:0/2331376534 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f802000c050 con 0x7f802814c080 2024-03-30T13:09:04.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.876+0000 7f800f7fe640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8014067fc0 0x7f801406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:04.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.876+0000 7f800f7fe640 1 -- 172.21.15.83:0/2331376534 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8020088840 con 0x7f802814c080 2024-03-30T13:09:04.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.876+0000 7f8026ffd640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8014067fc0 0x7f801406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:04.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.876+0000 7f8026ffd640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8014067fc0 0x7f801406a480 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8018007520 tx=0x7f801800d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:04.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:04.880+0000 7f800f7fe640 1 -- 172.21.15.83:0/2331376534 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f802806f040 con 0x7f802814c080 2024-03-30T13:09:05.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.040+0000 7f802d289640 1 -- 172.21.15.83:0/2331376534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f802804f9e0 con 0x7f802814c080 2024-03-30T13:09:05.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.040+0000 7f800f7fe640 1 -- 172.21.15.83:0/2331376534 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f802005de20 con 0x7f802814c080 2024-03-30T13:09:05.044 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:09:05.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.044+0000 7f802d289640 1 -- 172.21.15.83:0/2331376534 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8014067fc0 msgr2=0x7f801406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.044+0000 7f802d289640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8014067fc0 0x7f801406a480 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8018007520 tx=0x7f801800d040 comp rx=0 tx=0).stop 2024-03-30T13:09:05.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.044+0000 7f802d289640 1 -- 172.21.15.83:0/2331376534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802814c080 msgr2=0x7f80280b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.044+0000 7f802d289640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802814c080 0x7f80280b0d10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f80280ade50 tx=0x7f8020010ab0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.044+0000 7f802d289640 1 -- 172.21.15.83:0/2331376534 shutdown_connections 2024-03-30T13:09:05.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.044+0000 7f802d289640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8014067fc0 0x7f801406a480 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.044+0000 7f802d289640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802814c080 0x7f80280b0d10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.044+0000 7f802d289640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80280b07c0 0x7f80281467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.044+0000 7f802d289640 1 --2- 172.21.15.83:0/2331376534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8010003f70 0x7f8028147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.044+0000 7f802d289640 1 -- 172.21.15.83:0/2331376534 >> 172.21.15.83:0/2331376534 conn(0x7f802806b660 msgr2=0x7f80280b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:05.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.044+0000 7f802d289640 1 -- 172.21.15.83:0/2331376534 shutdown_connections 2024-03-30T13:09:05.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.044+0000 7f802d289640 1 -- 172.21.15.83:0/2331376534 wait complete. 2024-03-30T13:09:05.062 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:09:05.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f034b56c640 1 Processor -- start 2024-03-30T13:09:05.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f034b56c640 1 -- start start 2024-03-30T13:09:05.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f034b56c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f034415c8e0 0x7f03440ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f034b56c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f03440adac0 0x7f034415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f034b56c640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03440ae040 con 0x7f034415d200 2024-03-30T13:09:05.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f034b56c640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f03440b31e0 con 0x7f03440adac0 2024-03-30T13:09:05.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f034b56c640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f03440ae320 con 0x7f034415c8e0 2024-03-30T13:09:05.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f0348b07640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f03440adac0 0x7f034415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f0349b09640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f034415d200 0x7f03440b3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46250/0 (socket says 172.21.15.83:46250) 2024-03-30T13:09:05.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f0349b09640 1 -- 172.21.15.83:0/817075968 learned_addr learned my addr 172.21.15.83:0/817075968 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:05.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f0349308640 1 --2- 172.21.15.83:0/817075968 >> v2:172.21.15.153:3300/0 conn(0x7f034415c8e0 0x7f03440ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f0348b07640 1 -- 172.21.15.83:0/817075968 >> v2:172.21.15.153:3300/0 conn(0x7f034415c8e0 msgr2=0x7f03440ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:05.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f0348b07640 1 --2- 172.21.15.83:0/817075968 >> v2:172.21.15.153:3300/0 conn(0x7f034415c8e0 0x7f03440ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f0348b07640 1 -- 172.21.15.83:0/817075968 >> v1:172.21.15.83:6789/0 conn(0x7f034415d200 legacy=0x7f03440b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f0348b07640 1 -- 172.21.15.83:0/817075968 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03440ae600 con 0x7f03440adac0 2024-03-30T13:09:05.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f033bfff640 1 -- 172.21.15.83:0/817075968 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471965187 0 0) 0x7f03440ae040 con 0x7f034415d200 2024-03-30T13:09:05.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f0348b07640 1 --2- 172.21.15.83:0/817075968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03440adac0 0x7f034415ccc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f03440b4ee0 tx=0x7f033401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcca117f796122ca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:05.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f033bfff640 1 -- 172.21.15.83:0/817075968 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340b2070 con 0x7f03440adac0 2024-03-30T13:09:05.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f033bfff640 1 -- 172.21.15.83:0/817075968 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03340ad640 con 0x7f03440adac0 2024-03-30T13:09:05.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.179+0000 7f033bfff640 1 -- 172.21.15.83:0/817075968 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340ada10 con 0x7f03440adac0 2024-03-30T13:09:05.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 -- 172.21.15.83:0/817075968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03440adac0 msgr2=0x7f034415ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 --2- 172.21.15.83:0/817075968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03440adac0 0x7f034415ccc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f03440b4ee0 tx=0x7f033401c480 comp rx=0 tx=0).stop 2024-03-30T13:09:05.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 -- 172.21.15.83:0/817075968 shutdown_connections 2024-03-30T13:09:05.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 --2- 172.21.15.83:0/817075968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03440adac0 0x7f034415ccc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 --2- 172.21.15.83:0/817075968 >> v2:172.21.15.153:3300/0 conn(0x7f034415c8e0 0x7f03440ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 -- 172.21.15.83:0/817075968 >> 172.21.15.83:0/817075968 conn(0x7f034406b660 msgr2=0x7f034406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:05.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 -- 172.21.15.83:0/817075968 shutdown_connections 2024-03-30T13:09:05.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 -- 172.21.15.83:0/817075968 wait complete. 2024-03-30T13:09:05.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 Processor -- start 2024-03-30T13:09:05.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 -- start start 2024-03-30T13:09:05.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03440adac0 0x7f0344099000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f034415c8e0 0x7f034414cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f034415d200 0x7f0344149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f03440b4710 con 0x7f034415c8e0 2024-03-30T13:09:05.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f03440b4590 con 0x7f034415d200 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f03440b4890 con 0x7f03440adac0 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0348b07640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f034415c8e0 0x7f034414cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0348b07640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f034415c8e0 0x7f034414cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58938/0 (socket says 172.21.15.83:58938) 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0348b07640 1 -- 172.21.15.83:0/554073900 learned_addr learned my addr 172.21.15.83:0/554073900 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0349308640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03440adac0 0x7f0344099000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0348b07640 1 -- 172.21.15.83:0/554073900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03440adac0 msgr2=0x7f0344099000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0348b07640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03440adac0 0x7f0344099000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0348b07640 1 -- 172.21.15.83:0/554073900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f034415d200 msgr2=0x7f0344149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0349b09640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f034415d200 0x7f0344149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0348b07640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f034415d200 0x7f0344149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0348b07640 1 -- 172.21.15.83:0/554073900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0344099880 con 0x7f034415c8e0 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0348b07640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f034415c8e0 0x7f034414cb50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f03340b0040 tx=0x7f0334019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0339ffb640 1 -- 172.21.15.83:0/554073900 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340ba020 con 0x7f034415c8e0 2024-03-30T13:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0339ffb640 1 -- 172.21.15.83:0/554073900 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03340b6410 con 0x7f034415c8e0 2024-03-30T13:09:05.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f0339ffb640 1 -- 172.21.15.83:0/554073900 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340b2040 con 0x7f034415c8e0 2024-03-30T13:09:05.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 -- 172.21.15.83:0/554073900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034414d250 con 0x7f034415c8e0 2024-03-30T13:09:05.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.183+0000 7f034b56c640 1 -- 172.21.15.83:0/554073900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03441495c0 con 0x7f034415c8e0 2024-03-30T13:09:05.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.187+0000 7f034b56c640 1 -- 172.21.15.83:0/554073900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f034404f9e0 con 0x7f034415c8e0 2024-03-30T13:09:05.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.187+0000 7f0339ffb640 1 -- 172.21.15.83:0/554073900 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f03340bd020 con 0x7f034415c8e0 2024-03-30T13:09:05.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.187+0000 7f0339ffb640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0328067fc0 0x7f032806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.187+0000 7f0339ffb640 1 -- 172.21.15.83:0/554073900 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f03341203e0 con 0x7f034415c8e0 2024-03-30T13:09:05.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.187+0000 7f0349308640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0328067fc0 0x7f032806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.187+0000 7f0349308640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0328067fc0 0x7f032806a480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f03400096f0 tx=0x7f0340008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:05.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.191+0000 7f0339ffb640 1 -- 172.21.15.83:0/554073900 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f03340c4030 con 0x7f034415c8e0 2024-03-30T13:09:05.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.343+0000 7f034b56c640 1 -- 172.21.15.83:0/554073900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0344156350 con 0x7f034415c8e0 2024-03-30T13:09:05.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.343+0000 7f0339ffb640 1 -- 172.21.15.83:0/554073900 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f0344099880 con 0x7f034415c8e0 2024-03-30T13:09:05.349 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:09:05.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.347+0000 7f034b56c640 1 -- 172.21.15.83:0/554073900 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0328067fc0 msgr2=0x7f032806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.347+0000 7f034b56c640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0328067fc0 0x7f032806a480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f03400096f0 tx=0x7f0340008040 comp rx=0 tx=0).stop 2024-03-30T13:09:05.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.347+0000 7f034b56c640 1 -- 172.21.15.83:0/554073900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f034415c8e0 msgr2=0x7f034414cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.347+0000 7f034b56c640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f034415c8e0 0x7f034414cb50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f03340b0040 tx=0x7f0334019220 comp rx=0 tx=0).stop 2024-03-30T13:09:05.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.347+0000 7f034b56c640 1 -- 172.21.15.83:0/554073900 shutdown_connections 2024-03-30T13:09:05.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.347+0000 7f034b56c640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0328067fc0 0x7f032806a480 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.347+0000 7f034b56c640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f034415d200 0x7f0344149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.347+0000 7f034b56c640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f034415c8e0 0x7f034414cb50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.347+0000 7f034b56c640 1 --2- 172.21.15.83:0/554073900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03440adac0 0x7f0344099000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.347+0000 7f034b56c640 1 -- 172.21.15.83:0/554073900 >> 172.21.15.83:0/554073900 conn(0x7f034406b660 msgr2=0x7f034414afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:05.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.347+0000 7f034b56c640 1 -- 172.21.15.83:0/554073900 shutdown_connections 2024-03-30T13:09:05.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.347+0000 7f034b56c640 1 -- 172.21.15.83:0/554073900 wait complete. 2024-03-30T13:09:05.367 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:09:05.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f161b6ec640 1 Processor -- start 2024-03-30T13:09:05.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f161b6ec640 1 -- start start 2024-03-30T13:09:05.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f161b6ec640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f16140d31e0 0x7f16140d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f161b6ec640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f16140d1370 0x7f161406c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f161b6ec640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16140d51f0 con 0x7f161415e840 2024-03-30T13:09:05.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f161b6ec640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f16140d17e0 con 0x7f16140d1370 2024-03-30T13:09:05.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f161b6ec640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f161415ec20 con 0x7f16140d31e0 2024-03-30T13:09:05.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f1619c89640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f16140d1370 0x7f161406c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f1619488640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f161415e840 0x7f16140cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46252/0 (socket says 172.21.15.83:46252) 2024-03-30T13:09:05.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f1619488640 1 -- 172.21.15.83:0/1087758888 learned_addr learned my addr 172.21.15.83:0/1087758888 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:05.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f1618c87640 1 --2- 172.21.15.83:0/1087758888 >> v2:172.21.15.153:3300/0 conn(0x7f16140d31e0 0x7f16140d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f1619c89640 1 -- 172.21.15.83:0/1087758888 >> v2:172.21.15.153:3300/0 conn(0x7f16140d31e0 msgr2=0x7f16140d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:05.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f1619c89640 1 --2- 172.21.15.83:0/1087758888 >> v2:172.21.15.153:3300/0 conn(0x7f16140d31e0 0x7f16140d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f1619c89640 1 -- 172.21.15.83:0/1087758888 >> v1:172.21.15.83:6789/0 conn(0x7f161415e840 legacy=0x7f16140cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f1619c89640 1 -- 172.21.15.83:0/1087758888 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16140d2140 con 0x7f16140d1370 2024-03-30T13:09:05.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.475+0000 7f160bfff640 1 -- 172.21.15.83:0/1087758888 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3389954074 0 0) 0x7f1610001120 con 0x7f161415e840 2024-03-30T13:09:05.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f1619c89640 1 --2- 172.21.15.83:0/1087758888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16140d1370 0x7f161406c720 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16140d1c00 tx=0x7f160c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4db4d0cfffa65d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:05.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f160bfff640 1 -- 172.21.15.83:0/1087758888 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c0b2070 con 0x7f16140d1370 2024-03-30T13:09:05.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f160bfff640 1 -- 172.21.15.83:0/1087758888 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160c0a5760 con 0x7f16140d1370 2024-03-30T13:09:05.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f160bfff640 1 -- 172.21.15.83:0/1087758888 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c0a5b30 con 0x7f16140d1370 2024-03-30T13:09:05.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 -- 172.21.15.83:0/1087758888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16140d1370 msgr2=0x7f161406c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 --2- 172.21.15.83:0/1087758888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16140d1370 0x7f161406c720 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16140d1c00 tx=0x7f160c01c8a0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 -- 172.21.15.83:0/1087758888 shutdown_connections 2024-03-30T13:09:05.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 --2- 172.21.15.83:0/1087758888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16140d1370 0x7f161406c720 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 --2- 172.21.15.83:0/1087758888 >> v2:172.21.15.153:3300/0 conn(0x7f16140d31e0 0x7f16140d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 -- 172.21.15.83:0/1087758888 >> 172.21.15.83:0/1087758888 conn(0x7f161409d7f0 msgr2=0x7f16140d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:05.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 -- 172.21.15.83:0/1087758888 shutdown_connections 2024-03-30T13:09:05.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 -- 172.21.15.83:0/1087758888 wait complete. 2024-03-30T13:09:05.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 Processor -- start 2024-03-30T13:09:05.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 -- start start 2024-03-30T13:09:05.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16140d1370 0x7f16141587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16140d31e0 0x7f1614153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f161415e840 0x7f16140ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f16140d04a0 con 0x7f16140d1370 2024-03-30T13:09:05.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f16140d0320 con 0x7f161415e840 2024-03-30T13:09:05.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f161b6ec640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f161416b5f0 con 0x7f16140d31e0 2024-03-30T13:09:05.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f1619488640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16140d1370 0x7f16141587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f1619488640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16140d1370 0x7f16141587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58954/0 (socket says 172.21.15.83:58954) 2024-03-30T13:09:05.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f1619488640 1 -- 172.21.15.83:0/3575042119 learned_addr learned my addr 172.21.15.83:0/3575042119 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:05.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f1619c89640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f161415e840 0x7f16140ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f1618c87640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16140d31e0 0x7f1614153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f1619488640 1 -- 172.21.15.83:0/3575042119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16140d31e0 msgr2=0x7f1614153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f1619488640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16140d31e0 0x7f1614153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f1619488640 1 -- 172.21.15.83:0/3575042119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f161415e840 msgr2=0x7f16140ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f1619488640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f161415e840 0x7f16140ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.479+0000 7f1619488640 1 -- 172.21.15.83:0/3575042119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1614154250 con 0x7f16140d1370 2024-03-30T13:09:05.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.483+0000 7f1619488640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16140d1370 0x7f16141587c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f161000c480 tx=0x7f161000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:05.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.483+0000 7f1609ffb640 1 -- 172.21.15.83:0/3575042119 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610018070 con 0x7f16140d1370 2024-03-30T13:09:05.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.483+0000 7f1609ffb640 1 -- 172.21.15.83:0/3575042119 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1610007500 con 0x7f16140d1370 2024-03-30T13:09:05.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.483+0000 7f161b6ec640 1 -- 172.21.15.83:0/3575042119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1614154530 con 0x7f16140d1370 2024-03-30T13:09:05.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.483+0000 7f1609ffb640 1 -- 172.21.15.83:0/3575042119 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610004a30 con 0x7f16140d1370 2024-03-30T13:09:05.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.483+0000 7f161b6ec640 1 -- 172.21.15.83:0/3575042119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1614154af0 con 0x7f16140d1370 2024-03-30T13:09:05.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.483+0000 7f161b6ec640 1 -- 172.21.15.83:0/3575042119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16140a23d0 con 0x7f16140d1370 2024-03-30T13:09:05.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.483+0000 7f1609ffb640 1 -- 172.21.15.83:0/3575042119 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f161001b070 con 0x7f16140d1370 2024-03-30T13:09:05.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.483+0000 7f1609ffb640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f15f8067fc0 0x7f15f806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.483+0000 7f1609ffb640 1 -- 172.21.15.83:0/3575042119 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1610085810 con 0x7f16140d1370 2024-03-30T13:09:05.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.483+0000 7f1618c87640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f15f8067fc0 0x7f15f806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.483+0000 7f1618c87640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f15f8067fc0 0x7f15f806a480 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f16140b5490 tx=0x7f1604008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:05.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.487+0000 7f1609ffb640 1 -- 172.21.15.83:0/3575042119 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f16140d51f0 con 0x7f16140d1370 2024-03-30T13:09:05.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 -- 172.21.15.83:0/3575042119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f161415e070 con 0x7f16140d1370 2024-03-30T13:09:05.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f1609ffb640 1 -- 172.21.15.83:0/3575042119 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f1610056050 con 0x7f16140d1370 2024-03-30T13:09:05.654 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:09:05.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 -- 172.21.15.83:0/3575042119 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f15f8067fc0 msgr2=0x7f15f806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f15f8067fc0 0x7f15f806a480 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f16140b5490 tx=0x7f1604008040 comp rx=0 tx=0).stop 2024-03-30T13:09:05.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 -- 172.21.15.83:0/3575042119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16140d1370 msgr2=0x7f16141587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16140d1370 0x7f16141587c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f161000c480 tx=0x7f161000c940 comp rx=0 tx=0).stop 2024-03-30T13:09:05.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 -- 172.21.15.83:0/3575042119 shutdown_connections 2024-03-30T13:09:05.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f15f8067fc0 0x7f15f806a480 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f161415e840 0x7f16140ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16140d31e0 0x7f1614153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 --2- 172.21.15.83:0/3575042119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16140d1370 0x7f16141587c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 -- 172.21.15.83:0/3575042119 >> 172.21.15.83:0/3575042119 conn(0x7f161409d7f0 msgr2=0x7f16140b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:05.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 -- 172.21.15.83:0/3575042119 shutdown_connections 2024-03-30T13:09:05.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.651+0000 7f161b6ec640 1 -- 172.21.15.83:0/3575042119 wait complete. 2024-03-30T13:09:05.673 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:09:05.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea9a0ef640 1 Processor -- start 2024-03-30T13:09:05.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea9a0ef640 1 -- start start 2024-03-30T13:09:05.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea9a0ef640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea9415c8e0 0x7fea940ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea9a0ef640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fea940adac0 0x7fea9415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea9a0ef640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea940ae040 con 0x7fea9415d200 2024-03-30T13:09:05.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea9a0ef640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fea940b31e0 con 0x7fea940adac0 2024-03-30T13:09:05.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea9a0ef640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fea940ae320 con 0x7fea9415c8e0 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea93fff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fea9415d200 0x7fea940b3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:46254/0 (socket says 172.21.15.83:46254) 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea93fff640 1 -- 172.21.15.83:0/3621793387 learned_addr learned my addr 172.21.15.83:0/3621793387 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea937fe640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea9415c8e0 0x7fea940ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea92ffd640 1 --2- 172.21.15.83:0/3621793387 >> v2:172.21.15.153:3300/0 conn(0x7fea940adac0 0x7fea9415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556549874 0 0) 0x7fea940ae040 con 0x7fea9415d200 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea7c003530 con 0x7fea9415d200 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3531545086 0 0) 0x7fea7c003530 con 0x7fea9415d200 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea9415c8e0 msgr2=0x7fea940ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea9415c8e0 0x7fea940ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 >> v2:172.21.15.153:3300/0 conn(0x7fea940adac0 msgr2=0x7fea9415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 --2- 172.21.15.83:0/3621793387 >> v2:172.21.15.153:3300/0 conn(0x7fea940adac0 0x7fea9415ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea940ae600 con 0x7fea9415d200 2024-03-30T13:09:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fea8c001a00 con 0x7fea9415d200 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 >> v1:172.21.15.83:6789/0 conn(0x7fea9415d200 legacy=0x7fea940b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea7c0039c0 0x7fea7c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea7c004810 0x7fea7c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea9415c8e0 0x7fea7c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fea940b31e0 con 0x7fea7c004810 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fea940ae320 con 0x7fea7c0039c0 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fea7c00b9d0 con 0x7fea9415c8e0 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea92ffd640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea7c004810 0x7fea7c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea937fe640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea7c0039c0 0x7fea7c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea93fff640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea9415c8e0 0x7fea7c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea92ffd640 1 -- 172.21.15.83:0/3621793387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea9415c8e0 msgr2=0x7fea7c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea92ffd640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea9415c8e0 0x7fea7c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea92ffd640 1 -- 172.21.15.83:0/3621793387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea7c0039c0 msgr2=0x7fea7c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea92ffd640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea7c0039c0 0x7fea7c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea92ffd640 1 -- 172.21.15.83:0/3621793387 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c003530 con 0x7fea7c004810 2024-03-30T13:09:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.787+0000 7fea937fe640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea7c0039c0 0x7fea7c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea92ffd640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea7c004810 0x7fea7c004c90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fea88009ae0 tx=0x7fea8801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c544f2134e6cf8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea880b2070 con 0x7fea7c004810 2024-03-30T13:09:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8c0020c0 con 0x7fea7c004810 2024-03-30T13:09:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea927fc640 1 -- 172.21.15.83:0/3621793387 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea880096b0 con 0x7fea7c004810 2024-03-30T13:09:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3621793387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea7c004810 msgr2=0x7fea7c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea9a0ef640 1 --2- 172.21.15.83:0/3621793387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea7c004810 0x7fea7c004c90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fea88009ae0 tx=0x7fea8801cab0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea93fff640 1 -- 172.21.15.83:0/3621793387 reap_dead start 2024-03-30T13:09:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3621793387 shutdown_connections 2024-03-30T13:09:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3621793387 >> 172.21.15.83:0/3621793387 conn(0x7fea9406b660 msgr2=0x7fea9406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3621793387 shutdown_connections 2024-03-30T13:09:05.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3621793387 wait complete. 2024-03-30T13:09:05.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea9a0ef640 1 Processor -- start 2024-03-30T13:09:05.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.791+0000 7fea9a0ef640 1 -- start start 2024-03-30T13:09:05.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea9a0ef640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea7c004810 0x7fea9415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea9a0ef640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea94099bb0 0x7fea9415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea9a0ef640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea941f4990 0x7fea941f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea9a0ef640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fea9415d690 con 0x7fea7c004810 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea9a0ef640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fea9406f8e0 con 0x7fea941f4990 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea9a0ef640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fea940ad580 con 0x7fea94099bb0 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea937fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea7c004810 0x7fea9415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea937fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea7c004810 0x7fea9415a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58970/0 (socket says 172.21.15.83:58970) 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea937fe640 1 -- 172.21.15.83:0/3675204294 learned_addr learned my addr 172.21.15.83:0/3675204294 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea92ffd640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea94099bb0 0x7fea9415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea93fff640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea941f4990 0x7fea941f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea937fe640 1 -- 172.21.15.83:0/3675204294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea94099bb0 msgr2=0x7fea9415aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea937fe640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea94099bb0 0x7fea9415aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea937fe640 1 -- 172.21.15.83:0/3675204294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea941f4990 msgr2=0x7fea941f4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea937fe640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea941f4990 0x7fea941f4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea937fe640 1 -- 172.21.15.83:0/3675204294 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9406bf80 con 0x7fea7c004810 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea93fff640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea941f4990 0x7fea941f4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea937fe640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea7c004810 0x7fea9415a5b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fea840108c0 tx=0x7fea84010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea7bfff640 1 -- 172.21.15.83:0/3675204294 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8400f040 con 0x7fea7c004810 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea7bfff640 1 -- 172.21.15.83:0/3675204294 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea84004220 con 0x7fea7c004810 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea7bfff640 1 -- 172.21.15.83:0/3675204294 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8400e960 con 0x7fea7c004810 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3675204294 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea941f5750 con 0x7fea7c004810 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3675204294 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea94071a70 con 0x7fea7c004810 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3675204294 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9415cfe0 con 0x7fea7c004810 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea7bfff640 1 -- 172.21.15.83:0/3675204294 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fea8400eb00 con 0x7fea7c004810 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea7bfff640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fea80067fc0 0x7fea8006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea7bfff640 1 -- 172.21.15.83:0/3675204294 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fea84086690 con 0x7fea7c004810 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea92ffd640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fea80067fc0 0x7fea8006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:05.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.795+0000 7fea92ffd640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fea80067fc0 0x7fea8006a480 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea880af000 tx=0x7fea880046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:05.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.799+0000 7fea7bfff640 1 -- 172.21.15.83:0/3675204294 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fea84018030 con 0x7fea7c004810 2024-03-30T13:09:05.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.971+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3675204294 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fea9404f9e0 con 0x7fea7c004810 2024-03-30T13:09:05.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.971+0000 7fea7bfff640 1 -- 172.21.15.83:0/3675204294 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fea84056ed0 con 0x7fea7c004810 2024-03-30T13:09:05.976 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-03-30T13:09:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.975+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3675204294 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fea80067fc0 msgr2=0x7fea8006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.975+0000 7fea9a0ef640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fea80067fc0 0x7fea8006a480 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea880af000 tx=0x7fea880046d0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.975+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3675204294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea7c004810 msgr2=0x7fea9415a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.975+0000 7fea9a0ef640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea7c004810 0x7fea9415a5b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fea840108c0 tx=0x7fea84010d80 comp rx=0 tx=0).stop 2024-03-30T13:09:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.975+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3675204294 shutdown_connections 2024-03-30T13:09:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.975+0000 7fea9a0ef640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fea80067fc0 0x7fea8006a480 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.975+0000 7fea9a0ef640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea941f4990 0x7fea941f4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.975+0000 7fea9a0ef640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea94099bb0 0x7fea9415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.975+0000 7fea9a0ef640 1 --2- 172.21.15.83:0/3675204294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea7c004810 0x7fea9415a5b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.975+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3675204294 >> 172.21.15.83:0/3675204294 conn(0x7fea9406b660 msgr2=0x7fea9415b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.975+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3675204294 shutdown_connections 2024-03-30T13:09:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:05.975+0000 7fea9a0ef640 1 -- 172.21.15.83:0/3675204294 wait complete. 2024-03-30T13:09:05.995 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi083.front.sepia.ceph.com... 2024-03-30T13:09:05.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:05.996 DEBUG:teuthology.orchestra.run.smithi083:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-30T13:09:06.022 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:09:06.022 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:09:06.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:06.022 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-30T13:09:06.074 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:09:06.075 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:09:06.081 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:09:06.081 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:09:06.128 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:06.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c931d7640 1 Processor -- start 2024-03-30T13:09:06.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c931d7640 1 -- start start 2024-03-30T13:09:06.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c931d7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8c0730e0 0x7f1c8c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c931d7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1c8c06f140 0x7f1c8c06f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c91774640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1c8c06f140 0x7f1c8c06f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c91774640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1c8c06f140 0x7f1c8c06f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58976/0 (socket says 172.21.15.83:58976) 2024-03-30T13:09:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c91774640 1 -- 172.21.15.83:0/302320438 learned_addr learned my addr 172.21.15.83:0/302320438 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c931d7640 1 -- 172.21.15.83:0/302320438 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c8c0734c0 con 0x7f1c8c0b4bb0 2024-03-30T13:09:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c931d7640 1 -- 172.21.15.83:0/302320438 --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f1c8c06faf0 con 0x7f1c8c06f140 2024-03-30T13:09:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c931d7640 1 -- 172.21.15.83:0/302320438 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1c8c15fed0 con 0x7f1c8c0730e0 2024-03-30T13:09:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c90f73640 1 --2- 172.21.15.83:0/302320438 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8c0730e0 0x7f1c8c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c91774640 1 -- 172.21.15.83:0/302320438 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8c0730e0 msgr2=0x7f1c8c15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c91774640 1 --2- 172.21.15.83:0/302320438 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8c0730e0 0x7f1c8c15b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c91774640 1 -- 172.21.15.83:0/302320438 >> v1:172.21.15.153:6789/0 conn(0x7f1c8c0b4bb0 legacy=0x7f1c8c15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c91774640 1 -- 172.21.15.83:0/302320438 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8c15c2a0 con 0x7f1c8c06f140 2024-03-30T13:09:06.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c91774640 1 --2- 172.21.15.83:0/302320438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c8c06f140 0x7f1c8c06f5b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009e50 tx=0x7f1c8401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5609713fb3b2ef3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:06.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.247+0000 7f1c837fe640 1 -- 172.21.15.83:0/302320438 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c840a58d0 con 0x7f1c8c06f140 2024-03-30T13:09:06.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c837fe640 1 -- 172.21.15.83:0/302320438 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c840a5a70 con 0x7f1c8c06f140 2024-03-30T13:09:06.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c837fe640 1 -- 172.21.15.83:0/302320438 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c840a5e40 con 0x7f1c8c06f140 2024-03-30T13:09:06.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 -- 172.21.15.83:0/302320438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c8c06f140 msgr2=0x7f1c8c06f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 --2- 172.21.15.83:0/302320438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c8c06f140 0x7f1c8c06f5b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009e50 tx=0x7f1c8401ca00 comp rx=0 tx=0).stop 2024-03-30T13:09:06.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 -- 172.21.15.83:0/302320438 shutdown_connections 2024-03-30T13:09:06.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 --2- 172.21.15.83:0/302320438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c8c06f140 0x7f1c8c06f5b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 --2- 172.21.15.83:0/302320438 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8c0730e0 0x7f1c8c15b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 -- 172.21.15.83:0/302320438 >> 172.21.15.83:0/302320438 conn(0x7f1c8c0b1d60 msgr2=0x7f1c8c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:06.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 -- 172.21.15.83:0/302320438 shutdown_connections 2024-03-30T13:09:06.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 -- 172.21.15.83:0/302320438 wait complete. 2024-03-30T13:09:06.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 Processor -- start 2024-03-30T13:09:06.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 -- start start 2024-03-30T13:09:06.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c8c06f140 0x7f1c8c149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8c0730e0 0x7f1c8c0cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c8c0b4bb0 0x7f1c8c14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c15be90 con 0x7f1c8c06f140 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c15f2a0 con 0x7f1c8c0b4bb0 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1c8c15c010 con 0x7f1c8c0730e0 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c90f73640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c8c06f140 0x7f1c8c149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c90f73640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c8c06f140 0x7f1c8c149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58988/0 (socket says 172.21.15.83:58988) 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c90f73640 1 -- 172.21.15.83:0/3065536417 learned_addr learned my addr 172.21.15.83:0/3065536417 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c91774640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c8c0b4bb0 0x7f1c8c14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c83fff640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8c0730e0 0x7f1c8c0cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c90f73640 1 -- 172.21.15.83:0/3065536417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8c0730e0 msgr2=0x7f1c8c0cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c90f73640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8c0730e0 0x7f1c8c0cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c90f73640 1 -- 172.21.15.83:0/3065536417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c8c0b4bb0 msgr2=0x7f1c8c14e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c90f73640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c8c0b4bb0 0x7f1c8c14e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c90f73640 1 -- 172.21.15.83:0/3065536417 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8c164910 con 0x7f1c8c06f140 2024-03-30T13:09:06.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c90f73640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c8c06f140 0x7f1c8c149470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800d5f0 tx=0x7f1c8800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:06.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c817fa640 1 -- 172.21.15.83:0/3065536417 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c880125f0 con 0x7f1c8c06f140 2024-03-30T13:09:06.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c817fa640 1 -- 172.21.15.83:0/3065536417 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c88019070 con 0x7f1c8c06f140 2024-03-30T13:09:06.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c817fa640 1 -- 172.21.15.83:0/3065536417 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c880129b0 con 0x7f1c8c06f140 2024-03-30T13:09:06.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 -- 172.21.15.83:0/3065536417 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8c164bf0 con 0x7f1c8c06f140 2024-03-30T13:09:06.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.251+0000 7f1c931d7640 1 -- 172.21.15.83:0/3065536417 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8c1651b0 con 0x7f1c8c06f140 2024-03-30T13:09:06.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.255+0000 7f1c931d7640 1 -- 172.21.15.83:0/3065536417 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c8c0686c0 con 0x7f1c8c06f140 2024-03-30T13:09:06.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.255+0000 7f1c817fa640 1 -- 172.21.15.83:0/3065536417 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f1c88012b50 con 0x7f1c8c06f140 2024-03-30T13:09:06.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.255+0000 7f1c817fa640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1c78067fc0 0x7f1c7806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.255+0000 7f1c817fa640 1 -- 172.21.15.83:0/3065536417 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1c88086820 con 0x7f1c8c06f140 2024-03-30T13:09:06.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.255+0000 7f1c83fff640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1c78067fc0 0x7f1c7806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.255+0000 7f1c83fff640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1c78067fc0 0x7f1c7806a480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0b4760 tx=0x7f1c7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:06.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.259+0000 7f1c817fa640 1 -- 172.21.15.83:0/3065536417 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f1c88056fd0 con 0x7f1c8c06f140 2024-03-30T13:09:06.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.411+0000 7f1c931d7640 1 -- 172.21.15.83:0/3065536417 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c8c06da70 con 0x7f1c8c06f140 2024-03-30T13:09:06.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c817fa640 1 -- 172.21.15.83:0/3065536417 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f1c880568d0 con 0x7f1c8c06f140 2024-03-30T13:09:06.418 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:06.418 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:08:27.241091+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:06.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c931d7640 1 -- 172.21.15.83:0/3065536417 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1c78067fc0 msgr2=0x7f1c7806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c931d7640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1c78067fc0 0x7f1c7806a480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0b4760 tx=0x7f1c7c009040 comp rx=0 tx=0).stop 2024-03-30T13:09:06.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c931d7640 1 -- 172.21.15.83:0/3065536417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c8c06f140 msgr2=0x7f1c8c149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c931d7640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c8c06f140 0x7f1c8c149470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800d5f0 tx=0x7f1c8800dab0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c931d7640 1 -- 172.21.15.83:0/3065536417 shutdown_connections 2024-03-30T13:09:06.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c931d7640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1c78067fc0 0x7f1c7806a480 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c931d7640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c8c0b4bb0 0x7f1c8c14e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c931d7640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c8c0730e0 0x7f1c8c0cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c931d7640 1 --2- 172.21.15.83:0/3065536417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c8c06f140 0x7f1c8c149470 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c931d7640 1 -- 172.21.15.83:0/3065536417 >> 172.21.15.83:0/3065536417 conn(0x7f1c8c0b1d60 msgr2=0x7f1c8c0b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:06.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c931d7640 1 -- 172.21.15.83:0/3065536417 shutdown_connections 2024-03-30T13:09:06.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.415+0000 7f1c931d7640 1 -- 172.21.15.83:0/3065536417 wait complete. 2024-03-30T13:09:06.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:09:06.441 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:09:06.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdbadd37640 1 Processor -- start 2024-03-30T13:09:06.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdbadd37640 1 -- start start 2024-03-30T13:09:06.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdbadd37640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdba815b050 0x7fdba8073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdbadd37640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdba80b3ca0 0x7fdba806f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdbadd37640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba80b31e0 con 0x7fdba806f690 2024-03-30T13:09:06.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdbadd37640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdba806fad0 con 0x7fdba80b3ca0 2024-03-30T13:09:06.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdbadd37640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdba8073ab0 con 0x7fdba815b050 2024-03-30T13:09:06.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdb9ffff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdba80b3ca0 0x7fdba806f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdba77fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdba815b050 0x7fdba8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdba7fff640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdba806f690 0x7fdba8071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:38204/0 (socket says 172.21.15.83:38204) 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdba7fff640 1 -- 172.21.15.83:0/3824140419 learned_addr learned my addr 172.21.15.83:0/3824140419 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdb9ffff640 1 -- 172.21.15.83:0/3824140419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdba815b050 msgr2=0x7fdba8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdb9ffff640 1 --2- 172.21.15.83:0/3824140419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdba815b050 0x7fdba8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdb9ffff640 1 -- 172.21.15.83:0/3824140419 >> v1:172.21.15.153:6789/0 conn(0x7fdba806f690 legacy=0x7fdba8071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.547+0000 7fdb9ffff640 1 -- 172.21.15.83:0/3824140419 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba80ad4f0 con 0x7fdba80b3ca0 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdb9ffff640 1 --2- 172.21.15.83:0/3824140419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba80b3ca0 0x7fdba806f150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdb900097c0 tx=0x7fdb9001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39996219238a2641 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdba6ffd640 1 -- 172.21.15.83:0/3824140419 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb900b0070 con 0x7fdba80b3ca0 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdba6ffd640 1 -- 172.21.15.83:0/3824140419 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb900ab600 con 0x7fdba80b3ca0 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdba6ffd640 1 -- 172.21.15.83:0/3824140419 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb900ab9d0 con 0x7fdba80b3ca0 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 -- 172.21.15.83:0/3824140419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba80b3ca0 msgr2=0x7fdba806f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 --2- 172.21.15.83:0/3824140419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba80b3ca0 0x7fdba806f150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdb900097c0 tx=0x7fdb9001c4a0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 -- 172.21.15.83:0/3824140419 shutdown_connections 2024-03-30T13:09:06.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 --2- 172.21.15.83:0/3824140419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba80b3ca0 0x7fdba806f150 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 --2- 172.21.15.83:0/3824140419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdba815b050 0x7fdba8073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 -- 172.21.15.83:0/3824140419 >> 172.21.15.83:0/3824140419 conn(0x7fdba806b660 msgr2=0x7fdba806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:06.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 -- 172.21.15.83:0/3824140419 shutdown_connections 2024-03-30T13:09:06.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 -- 172.21.15.83:0/3824140419 wait complete. 2024-03-30T13:09:06.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 Processor -- start 2024-03-30T13:09:06.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 -- start start 2024-03-30T13:09:06.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba806f690 0x7fdba8151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdba80b3ca0 0x7fdba8151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdba815b050 0x7fdba81521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdba80b40e0 con 0x7fdba80b3ca0 2024-03-30T13:09:06.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdba80ad1c0 con 0x7fdba806f690 2024-03-30T13:09:06.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdbadd37640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdba80b4c10 con 0x7fdba815b050 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdb9ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdba80b3ca0 0x7fdba8151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdb9ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdba80b3ca0 0x7fdba8151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59004/0 (socket says 172.21.15.83:59004) 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdb9ffff640 1 -- 172.21.15.83:0/4045671144 learned_addr learned my addr 172.21.15.83:0/4045671144 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdba77fe640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba806f690 0x7fdba8151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdba7fff640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdba815b050 0x7fdba81521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdb9ffff640 1 -- 172.21.15.83:0/4045671144 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdba815b050 msgr2=0x7fdba81521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdb9ffff640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdba815b050 0x7fdba81521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdb9ffff640 1 -- 172.21.15.83:0/4045671144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba806f690 msgr2=0x7fdba8151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdb9ffff640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba806f690 0x7fdba8151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdb9ffff640 1 -- 172.21.15.83:0/4045671144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba8154ff0 con 0x7fdba80b3ca0 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.551+0000 7fdba7fff640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdba815b050 0x7fdba81521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.555+0000 7fdb9ffff640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdba80b3ca0 0x7fdba8151c80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdb9001a0d0 tx=0x7fdb90019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.555+0000 7fdba4ff9640 1 -- 172.21.15.83:0/4045671144 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb900ba070 con 0x7fdba80b3ca0 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.555+0000 7fdba4ff9640 1 -- 172.21.15.83:0/4045671144 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb900b43f0 con 0x7fdba80b3ca0 2024-03-30T13:09:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.555+0000 7fdbadd37640 1 -- 172.21.15.83:0/4045671144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba8144740 con 0x7fdba80b3ca0 2024-03-30T13:09:06.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.555+0000 7fdba4ff9640 1 -- 172.21.15.83:0/4045671144 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb900b0040 con 0x7fdba80b3ca0 2024-03-30T13:09:06.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.555+0000 7fdbadd37640 1 -- 172.21.15.83:0/4045671144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba8144d00 con 0x7fdba80b3ca0 2024-03-30T13:09:06.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.555+0000 7fdbadd37640 1 -- 172.21.15.83:0/4045671144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba809e540 con 0x7fdba80b3ca0 2024-03-30T13:09:06.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.555+0000 7fdba4ff9640 1 -- 172.21.15.83:0/4045671144 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fdb900bd070 con 0x7fdba80b3ca0 2024-03-30T13:09:06.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.555+0000 7fdba4ff9640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdb88067fc0 0x7fdb8806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.555+0000 7fdba4ff9640 1 -- 172.21.15.83:0/4045671144 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5833+0+0 (secure 0 0 0) 0x7fdb9011f3d0 con 0x7fdba80b3ca0 2024-03-30T13:09:06.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.555+0000 7fdba77fe640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdb88067fc0 0x7fdb8806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.555+0000 7fdba77fe640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdb88067fc0 0x7fdb8806a480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009af0 tx=0x7fdb98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:06.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.559+0000 7fdba4ff9640 1 -- 172.21.15.83:0/4045671144 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fdb90016090 con 0x7fdba80b3ca0 2024-03-30T13:09:06.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.723+0000 7fdbadd37640 1 -- 172.21.15.83:0/4045671144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdba804f9e0 con 0x7fdba80b3ca0 2024-03-30T13:09:06.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.723+0000 7fdba4ff9640 1 -- 172.21.15.83:0/4045671144 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fdb900efb90 con 0x7fdba80b3ca0 2024-03-30T13:09:06.729 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:09:06.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.727+0000 7fdbadd37640 1 -- 172.21.15.83:0/4045671144 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdb88067fc0 msgr2=0x7fdb8806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.727+0000 7fdbadd37640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdb88067fc0 0x7fdb8806a480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009af0 tx=0x7fdb98008040 comp rx=0 tx=0).stop 2024-03-30T13:09:06.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.727+0000 7fdbadd37640 1 -- 172.21.15.83:0/4045671144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdba80b3ca0 msgr2=0x7fdba8151c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.727+0000 7fdbadd37640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdba80b3ca0 0x7fdba8151c80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdb9001a0d0 tx=0x7fdb90019240 comp rx=0 tx=0).stop 2024-03-30T13:09:06.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.727+0000 7fdbadd37640 1 -- 172.21.15.83:0/4045671144 shutdown_connections 2024-03-30T13:09:06.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.727+0000 7fdbadd37640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdb88067fc0 0x7fdb8806a480 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.727+0000 7fdbadd37640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdba815b050 0x7fdba81521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.727+0000 7fdbadd37640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdba80b3ca0 0x7fdba8151c80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.727+0000 7fdbadd37640 1 --2- 172.21.15.83:0/4045671144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdba806f690 0x7fdba8151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.727+0000 7fdbadd37640 1 -- 172.21.15.83:0/4045671144 >> 172.21.15.83:0/4045671144 conn(0x7fdba806b660 msgr2=0x7fdba80b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:06.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.727+0000 7fdbadd37640 1 -- 172.21.15.83:0/4045671144 shutdown_connections 2024-03-30T13:09:06.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.727+0000 7fdbadd37640 1 -- 172.21.15.83:0/4045671144 wait complete. 2024-03-30T13:09:06.748 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:09:06.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.867+0000 7f35906ab640 1 Processor -- start 2024-03-30T13:09:06.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.867+0000 7f35906ab640 1 -- start start 2024-03-30T13:09:06.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f35906ab640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f358815d3d0 0x7f3588166ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f35906ab640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35880ae040 con 0x7f358815c8e0 2024-03-30T13:09:06.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f35906ab640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35880ae320 con 0x7f35880b4680 2024-03-30T13:09:06.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f35906ab640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f35880b31e0 con 0x7f358815d3d0 2024-03-30T13:09:06.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358e447640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f358815c8e0 0x7f35880ad580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59266/0 (socket says 172.21.15.83:59266) 2024-03-30T13:09:06.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358e447640 1 -- 172.21.15.83:0/1947044359 learned_addr learned my addr 172.21.15.83:0/1947044359 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:06.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358ec48640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f358815d3d0 0x7f3588166ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471064434 0 0) 0x7f35880ae040 con 0x7f358815c8e0 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3574003530 con 0x7f358815c8e0 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944286350 0 0) 0x7f35880ae320 con 0x7f35880b4680 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35880ae040 con 0x7f35880b4680 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 65173975 0 0) 0x7f3574003530 con 0x7f358815c8e0 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f358815d3d0 msgr2=0x7f3588166ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f358815d3d0 0x7f3588166ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 >> v1:172.21.15.153:6789/0 conn(0x7f35880b4680 legacy=0x7f358815ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35880ae600 con 0x7f358815c8e0 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f3578001680 con 0x7f358815c8e0 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 >> v1:172.21.15.83:6789/0 conn(0x7f358815c8e0 legacy=0x7f35880ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3574003b80 0x7f3574003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3574004810 0x7f3574004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f358815d3d0 0x7f35740051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f35880b31e0 con 0x7f3574003b80 2024-03-30T13:09:06.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f357400bb10 con 0x7f3574004810 2024-03-30T13:09:06.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f357400bd10 con 0x7f358815d3d0 2024-03-30T13:09:06.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358e447640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3574003b80 0x7f3574003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358ec48640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f358815d3d0 0x7f35740051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358dc46640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3574004810 0x7f3574004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358e447640 1 -- 172.21.15.83:0/1947044359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f358815d3d0 msgr2=0x7f35740051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:06.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358e447640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f358815d3d0 0x7f35740051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358e447640 1 -- 172.21.15.83:0/1947044359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3574004810 msgr2=0x7f3574004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:06.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358e447640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3574004810 0x7f3574004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358e447640 1 -- 172.21.15.83:0/1947044359 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3574003530 con 0x7f3574003b80 2024-03-30T13:09:06.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.871+0000 7f358dc46640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3574004810 0x7f3574004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:06.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358e447640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3574003b80 0x7f3574003f80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f357800c1c0 tx=0x7f357801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c001b9b2651705 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:06.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578007cf0 con 0x7f3574003b80 2024-03-30T13:09:06.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35780a9020 con 0x7f3574003b80 2024-03-30T13:09:06.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358d445640 1 -- 172.21.15.83:0/1947044359 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578005b20 con 0x7f3574003b80 2024-03-30T13:09:06.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 -- 172.21.15.83:0/1947044359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3574003b80 msgr2=0x7f3574003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 --2- 172.21.15.83:0/1947044359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3574003b80 0x7f3574003f80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f357800c1c0 tx=0x7f357801cc40 comp rx=0 tx=0).stop 2024-03-30T13:09:06.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358ec48640 1 -- 172.21.15.83:0/1947044359 reap_dead start 2024-03-30T13:09:06.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 -- 172.21.15.83:0/1947044359 shutdown_connections 2024-03-30T13:09:06.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 -- 172.21.15.83:0/1947044359 >> 172.21.15.83:0/1947044359 conn(0x7f358806b660 msgr2=0x7f358806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:06.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 -- 172.21.15.83:0/1947044359 shutdown_connections 2024-03-30T13:09:06.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 -- 172.21.15.83:0/1947044359 wait complete. 2024-03-30T13:09:06.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 Processor -- start 2024-03-30T13:09:06.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 -- start start 2024-03-30T13:09:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3574003b80 0x7f3588071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3588153e10 0x7f35880986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3588098c00 0x7f3588164200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3588167830 con 0x7f3574003b80 2024-03-30T13:09:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f35881676b0 con 0x7f3588098c00 2024-03-30T13:09:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f35906ab640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f35881679b0 con 0x7f3588153e10 2024-03-30T13:09:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358e447640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3574003b80 0x7f3588071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358e447640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3574003b80 0x7f3588071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38924/0 (socket says 172.21.15.83:38924) 2024-03-30T13:09:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358e447640 1 -- 172.21.15.83:0/1977788824 learned_addr learned my addr 172.21.15.83:0/1977788824 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358e447640 1 -- 172.21.15.83:0/1977788824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3588153e10 msgr2=0x7f35880986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358e447640 1 --2- 172.21.15.83:0/1977788824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3588153e10 0x7f35880986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358e447640 1 -- 172.21.15.83:0/1977788824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3588098c00 msgr2=0x7f3588164200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:06.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358e447640 1 --2- 172.21.15.83:0/1977788824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3588098c00 0x7f3588164200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:06.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358e447640 1 -- 172.21.15.83:0/1977788824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3588154f10 con 0x7f3574003b80 2024-03-30T13:09:06.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.875+0000 7f358e447640 1 --2- 172.21.15.83:0/1977788824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3574003b80 0x7f3588071790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f35780ab040 tx=0x7f3574005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:06.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.879+0000 7f357effd640 1 -- 172.21.15.83:0/1977788824 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578005b00 con 0x7f3574003b80 2024-03-30T13:09:06.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.879+0000 7f357effd640 1 -- 172.21.15.83:0/1977788824 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3578005ca0 con 0x7f3574003b80 2024-03-30T13:09:06.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.879+0000 7f357effd640 1 -- 172.21.15.83:0/1977788824 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35780a5a30 con 0x7f3574003b80 2024-03-30T13:09:06.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.879+0000 7f35906ab640 1 -- 172.21.15.83:0/1977788824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3588154290 con 0x7f3574003b80 2024-03-30T13:09:06.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.879+0000 7f35906ab640 1 -- 172.21.15.83:0/1977788824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35880af910 con 0x7f3574003b80 2024-03-30T13:09:06.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.879+0000 7f35906ab640 1 -- 172.21.15.83:0/1977788824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f358804f9e0 con 0x7f3574003b80 2024-03-30T13:09:06.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.879+0000 7f357effd640 1 -- 172.21.15.83:0/1977788824 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f35780a5bd0 con 0x7f3574003b80 2024-03-30T13:09:06.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.879+0000 7f357effd640 1 --2- 172.21.15.83:0/1977788824 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f356c067ff0 0x7f356c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:06.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.879+0000 7f357effd640 1 -- 172.21.15.83:0/1977788824 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5833+0+0 (secure 0 0 0) 0x7f357811f440 con 0x7f3574003b80 2024-03-30T13:09:06.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.879+0000 7f358dc46640 1 --2- 172.21.15.83:0/1977788824 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f356c067ff0 0x7f356c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:06.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.879+0000 7f358dc46640 1 --2- 172.21.15.83:0/1977788824 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f356c067ff0 0x7f356c06a4b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3584007fd0 tx=0x7f3584009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:06.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:06.883+0000 7f357effd640 1 -- 172.21.15.83:0/1977788824 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f35780bf070 con 0x7f3574003b80 2024-03-30T13:09:07.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.035+0000 7f35906ab640 1 -- 172.21.15.83:0/1977788824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3588153bd0 con 0x7f3574003b80 2024-03-30T13:09:07.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.035+0000 7f357effd640 1 -- 172.21.15.83:0/1977788824 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f3578016950 con 0x7f3574003b80 2024-03-30T13:09:07.040 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:09:07.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.039+0000 7f35906ab640 1 -- 172.21.15.83:0/1977788824 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f356c067ff0 msgr2=0x7f356c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.039+0000 7f35906ab640 1 --2- 172.21.15.83:0/1977788824 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f356c067ff0 0x7f356c06a4b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3584007fd0 tx=0x7f3584009040 comp rx=0 tx=0).stop 2024-03-30T13:09:07.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.039+0000 7f35906ab640 1 -- 172.21.15.83:0/1977788824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3574003b80 msgr2=0x7f3588071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.039+0000 7f35906ab640 1 --2- 172.21.15.83:0/1977788824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3574003b80 0x7f3588071790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f35780ab040 tx=0x7f3574005840 comp rx=0 tx=0).stop 2024-03-30T13:09:07.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.039+0000 7f35906ab640 1 -- 172.21.15.83:0/1977788824 shutdown_connections 2024-03-30T13:09:07.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.039+0000 7f35906ab640 1 --2- 172.21.15.83:0/1977788824 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f356c067ff0 0x7f356c06a4b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.039+0000 7f35906ab640 1 --2- 172.21.15.83:0/1977788824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3588098c00 0x7f3588164200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.039+0000 7f35906ab640 1 --2- 172.21.15.83:0/1977788824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3588153e10 0x7f35880986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.039+0000 7f35906ab640 1 --2- 172.21.15.83:0/1977788824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3574003b80 0x7f3588071790 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.039+0000 7f35906ab640 1 -- 172.21.15.83:0/1977788824 >> 172.21.15.83:0/1977788824 conn(0x7f358806b660 msgr2=0x7f358815b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:07.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.039+0000 7f35906ab640 1 -- 172.21.15.83:0/1977788824 shutdown_connections 2024-03-30T13:09:07.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.039+0000 7f35906ab640 1 -- 172.21.15.83:0/1977788824 wait complete. 2024-03-30T13:09:07.057 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:09:07.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3db1e48640 1 Processor -- start 2024-03-30T13:09:07.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3db1e48640 1 -- start start 2024-03-30T13:09:07.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3db1e48640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3dac15b050 0x7f3dac073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3db1e48640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3dac06f860 0x7f3dac15b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3db1e48640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dac0b31e0 con 0x7f3dac0b3ca0 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3db1e48640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f3dac073ab0 con 0x7f3dac06f860 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3db1e48640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3dac0ad4f0 con 0x7f3dac15b050 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3dabfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3dac06f860 0x7f3dac15b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3da2ffd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3dac0b3ca0 0x7f3dac06f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59280/0 (socket says 172.21.15.83:59280) 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3da2ffd640 1 -- 172.21.15.83:0/2475679585 learned_addr learned my addr 172.21.15.83:0/2475679585 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/2475679585 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3dac15b050 0x7f3dac073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3dabfff640 1 -- 172.21.15.83:0/2475679585 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3dac15b050 msgr2=0x7f3dac073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3dabfff640 1 --2- 172.21.15.83:0/2475679585 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3dac15b050 0x7f3dac073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3dabfff640 1 -- 172.21.15.83:0/2475679585 >> v1:172.21.15.83:6789/0 conn(0x7f3dac0b3ca0 legacy=0x7f3dac06f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3daaffd640 1 -- 172.21.15.83:0/2475679585 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011712900 0 0) 0x7f3dac0b31e0 con 0x7f3dac0b3ca0 2024-03-30T13:09:07.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.175+0000 7f3dabfff640 1 -- 172.21.15.83:0/2475679585 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac0ad7d0 con 0x7f3dac06f860 2024-03-30T13:09:07.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3dabfff640 1 --2- 172.21.15.83:0/2475679585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac06f860 0x7f3dac15b430 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3da4009d90 tx=0x7f3da401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118f2f6458a47437 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:07.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3daaffd640 1 -- 172.21.15.83:0/2475679585 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da40b2070 con 0x7f3dac06f860 2024-03-30T13:09:07.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3daaffd640 1 -- 172.21.15.83:0/2475679585 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da40a5a00 con 0x7f3dac06f860 2024-03-30T13:09:07.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3daaffd640 1 -- 172.21.15.83:0/2475679585 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da40a5dd0 con 0x7f3dac06f860 2024-03-30T13:09:07.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 -- 172.21.15.83:0/2475679585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac06f860 msgr2=0x7f3dac15b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 --2- 172.21.15.83:0/2475679585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac06f860 0x7f3dac15b430 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3da4009d90 tx=0x7f3da401c940 comp rx=0 tx=0).stop 2024-03-30T13:09:07.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 -- 172.21.15.83:0/2475679585 shutdown_connections 2024-03-30T13:09:07.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 --2- 172.21.15.83:0/2475679585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac06f860 0x7f3dac15b430 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 --2- 172.21.15.83:0/2475679585 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3dac15b050 0x7f3dac073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 -- 172.21.15.83:0/2475679585 >> 172.21.15.83:0/2475679585 conn(0x7f3dac06b660 msgr2=0x7f3dac06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:07.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 -- 172.21.15.83:0/2475679585 shutdown_connections 2024-03-30T13:09:07.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 -- 172.21.15.83:0/2475679585 wait complete. 2024-03-30T13:09:07.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 Processor -- start 2024-03-30T13:09:07.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 -- start start 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac06f860 0x7f3dac1f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3dac0b3ca0 0x7f3dac1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac15b050 0x7f3dac15deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac0b4220 con 0x7f3dac06f860 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac0b40a0 con 0x7f3dac15b050 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3dac0b4c10 con 0x7f3dac0b3ca0 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3dab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac06f860 0x7f3dac1f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3dab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac06f860 0x7f3dac1f4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38952/0 (socket says 172.21.15.83:38952) 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3dab7fe640 1 -- 172.21.15.83:0/2547675592 learned_addr learned my addr 172.21.15.83:0/2547675592 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3da2ffd640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3dac0b3ca0 0x7f3dac1552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3dab7fe640 1 -- 172.21.15.83:0/2547675592 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3dac0b3ca0 msgr2=0x7f3dac1552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3dac0b3ca0 0x7f3dac1552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3dab7fe640 1 -- 172.21.15.83:0/2547675592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac15b050 msgr2=0x7f3dac15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac15b050 0x7f3dac15deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3dab7fe640 1 -- 172.21.15.83:0/2547675592 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac14f770 con 0x7f3dac06f860 2024-03-30T13:09:07.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac06f860 0x7f3dac1f4c80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400d5f0 tx=0x7f3d9400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:07.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3da8ff9640 1 -- 172.21.15.83:0/2547675592 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d940125f0 con 0x7f3dac06f860 2024-03-30T13:09:07.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3da8ff9640 1 -- 172.21.15.83:0/2547675592 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d94019070 con 0x7f3dac06f860 2024-03-30T13:09:07.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 -- 172.21.15.83:0/2547675592 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac14fa50 con 0x7f3dac06f860 2024-03-30T13:09:07.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3da8ff9640 1 -- 172.21.15.83:0/2547675592 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d940129b0 con 0x7f3dac06f860 2024-03-30T13:09:07.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.179+0000 7f3db1e48640 1 -- 172.21.15.83:0/2547675592 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac155800 con 0x7f3dac06f860 2024-03-30T13:09:07.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.183+0000 7f3db1e48640 1 -- 172.21.15.83:0/2547675592 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dac09e540 con 0x7f3dac06f860 2024-03-30T13:09:07.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.183+0000 7f3da8ff9640 1 -- 172.21.15.83:0/2547675592 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f3d94012b50 con 0x7f3dac06f860 2024-03-30T13:09:07.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.183+0000 7f3da8ff9640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d90067fc0 0x7f3d9006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.183+0000 7f3da8ff9640 1 -- 172.21.15.83:0/2547675592 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5833+0+0 (secure 0 0 0) 0x7f3d940869c0 con 0x7f3dac06f860 2024-03-30T13:09:07.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.183+0000 7f3da2ffd640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d90067fc0 0x7f3d9006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.183+0000 7f3da2ffd640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d90067fc0 0x7f3d9006a480 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3dac06f120 tx=0x7f3d9c007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:07.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.187+0000 7f3da8ff9640 1 -- 172.21.15.83:0/2547675592 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3d94088e20 con 0x7f3dac06f860 2024-03-30T13:09:07.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3db1e48640 1 -- 172.21.15.83:0/2547675592 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3dac153700 con 0x7f3dac06f860 2024-03-30T13:09:07.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3da8ff9640 1 -- 172.21.15.83:0/2547675592 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f3d940570f0 con 0x7f3dac06f860 2024-03-30T13:09:07.352 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:09:07.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3db1e48640 1 -- 172.21.15.83:0/2547675592 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d90067fc0 msgr2=0x7f3d9006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3db1e48640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d90067fc0 0x7f3d9006a480 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3dac06f120 tx=0x7f3d9c007b60 comp rx=0 tx=0).stop 2024-03-30T13:09:07.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3db1e48640 1 -- 172.21.15.83:0/2547675592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac06f860 msgr2=0x7f3dac1f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3db1e48640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac06f860 0x7f3dac1f4c80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400d5f0 tx=0x7f3d9400dab0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3db1e48640 1 -- 172.21.15.83:0/2547675592 shutdown_connections 2024-03-30T13:09:07.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3db1e48640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d90067fc0 0x7f3d9006a480 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3db1e48640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac15b050 0x7f3dac15deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3db1e48640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3dac0b3ca0 0x7f3dac1552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3db1e48640 1 --2- 172.21.15.83:0/2547675592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac06f860 0x7f3dac1f4c80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3db1e48640 1 -- 172.21.15.83:0/2547675592 >> 172.21.15.83:0/2547675592 conn(0x7f3dac06b660 msgr2=0x7f3dac0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:07.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.347+0000 7f3db1e48640 1 -- 172.21.15.83:0/2547675592 shutdown_connections 2024-03-30T13:09:07.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.351+0000 7f3db1e48640 1 -- 172.21.15.83:0/2547675592 wait complete. 2024-03-30T13:09:07.370 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:09:07.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f8033f15640 1 Processor -- start 2024-03-30T13:09:07.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f8033f15640 1 -- start start 2024-03-30T13:09:07.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f8033f15640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f802c09acb0 0x7f802c09b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f8033f15640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f802c0b0b00 0x7f802c1661c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f8033f15640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f802c15ca20 con 0x7f802c0ce6e0 2024-03-30T13:09:07.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f8033f15640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f802c06fa80 con 0x7f802c0b0b00 2024-03-30T13:09:07.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f8033f15640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f802c0d3200 con 0x7f802c09acb0 2024-03-30T13:09:07.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f80324b2640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f802c0b0b00 0x7f802c1661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f80324b2640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f802c0b0b00 0x7f802c1661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38968/0 (socket says 172.21.15.83:38968) 2024-03-30T13:09:07.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f80324b2640 1 -- 172.21.15.83:0/1222460079 learned_addr learned my addr 172.21.15.83:0/1222460079 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:07.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f8031cb1640 1 --2- 172.21.15.83:0/1222460079 >> v2:172.21.15.153:3300/0 conn(0x7f802c09acb0 0x7f802c09b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f80324b2640 1 -- 172.21.15.83:0/1222460079 >> v2:172.21.15.153:3300/0 conn(0x7f802c09acb0 msgr2=0x7f802c09b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:07.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f80324b2640 1 --2- 172.21.15.83:0/1222460079 >> v2:172.21.15.153:3300/0 conn(0x7f802c09acb0 0x7f802c09b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f80324b2640 1 -- 172.21.15.83:0/1222460079 >> v1:172.21.15.153:6789/0 conn(0x7f802c0ce6e0 legacy=0x7f802c09b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:07.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f80324b2640 1 -- 172.21.15.83:0/1222460079 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802c06f750 con 0x7f802c0b0b00 2024-03-30T13:09:07.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.491+0000 7f8031cb1640 1 --2- 172.21.15.83:0/1222460079 >> v2:172.21.15.153:3300/0 conn(0x7f802c09acb0 0x7f802c09b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:07.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f80324b2640 1 --2- 172.21.15.83:0/1222460079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802c0b0b00 0x7f802c1661c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f802c072620 tx=0x7f802401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f71cca4b2cee4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:07.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8030caf640 1 -- 172.21.15.83:0/1222460079 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80240a5780 con 0x7f802c0b0b00 2024-03-30T13:09:07.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8030caf640 1 -- 172.21.15.83:0/1222460079 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80240a5920 con 0x7f802c0b0b00 2024-03-30T13:09:07.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8030caf640 1 -- 172.21.15.83:0/1222460079 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80240a5cf0 con 0x7f802c0b0b00 2024-03-30T13:09:07.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 -- 172.21.15.83:0/1222460079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802c0b0b00 msgr2=0x7f802c1661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 --2- 172.21.15.83:0/1222460079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802c0b0b00 0x7f802c1661c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f802c072620 tx=0x7f802401c9b0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 -- 172.21.15.83:0/1222460079 shutdown_connections 2024-03-30T13:09:07.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 --2- 172.21.15.83:0/1222460079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802c0b0b00 0x7f802c1661c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 --2- 172.21.15.83:0/1222460079 >> v2:172.21.15.153:3300/0 conn(0x7f802c09acb0 0x7f802c09b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 -- 172.21.15.83:0/1222460079 >> 172.21.15.83:0/1222460079 conn(0x7f802c0d2290 msgr2=0x7f802c0d26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:07.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 -- 172.21.15.83:0/1222460079 shutdown_connections 2024-03-30T13:09:07.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 -- 172.21.15.83:0/1222460079 wait complete. 2024-03-30T13:09:07.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 Processor -- start 2024-03-30T13:09:07.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 -- start start 2024-03-30T13:09:07.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c09acb0 0x7f802c158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802c0b0b00 0x7f802c159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802c0ce6e0 0x7f802c154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f802c168f20 con 0x7f802c0ce6e0 2024-03-30T13:09:07.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f802c0d2fc0 con 0x7f802c09acb0 2024-03-30T13:09:07.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f8033f15640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f802c1690a0 con 0x7f802c0b0b00 2024-03-30T13:09:07.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f80324b2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802c0ce6e0 0x7f802c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f80324b2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802c0ce6e0 0x7f802c154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38970/0 (socket says 172.21.15.83:38970) 2024-03-30T13:09:07.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.495+0000 7f80324b2640 1 -- 172.21.15.83:0/2234438671 learned_addr learned my addr 172.21.15.83:0/2234438671 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:07.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80314b0640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802c0b0b00 0x7f802c159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f8031cb1640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c09acb0 0x7f802c158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80324b2640 1 -- 172.21.15.83:0/2234438671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802c0b0b00 msgr2=0x7f802c159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80324b2640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802c0b0b00 0x7f802c159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80324b2640 1 -- 172.21.15.83:0/2234438671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c09acb0 msgr2=0x7f802c158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80324b2640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c09acb0 0x7f802c158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80324b2640 1 -- 172.21.15.83:0/2234438671 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802c158000 con 0x7f802c0ce6e0 2024-03-30T13:09:07.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80324b2640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802c0ce6e0 0x7f802c154720 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f802401a5e0 tx=0x7f8024019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:07.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80227fc640 1 -- 172.21.15.83:0/2234438671 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80240bc020 con 0x7f802c0ce6e0 2024-03-30T13:09:07.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80227fc640 1 -- 172.21.15.83:0/2234438671 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80240b8670 con 0x7f802c0ce6e0 2024-03-30T13:09:07.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f8033f15640 1 -- 172.21.15.83:0/2234438671 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802c157760 con 0x7f802c0ce6e0 2024-03-30T13:09:07.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80227fc640 1 -- 172.21.15.83:0/2234438671 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80240b8a60 con 0x7f802c0ce6e0 2024-03-30T13:09:07.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f8033f15640 1 -- 172.21.15.83:0/2234438671 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f802c157d20 con 0x7f802c0ce6e0 2024-03-30T13:09:07.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f8033f15640 1 -- 172.21.15.83:0/2234438671 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f802c0a0460 con 0x7f802c0ce6e0 2024-03-30T13:09:07.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80227fc640 1 -- 172.21.15.83:0/2234438671 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f80240bf020 con 0x7f802c0ce6e0 2024-03-30T13:09:07.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80227fc640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8010067fc0 0x7f801006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f80227fc640 1 -- 172.21.15.83:0/2234438671 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f80241216e0 con 0x7f802c0ce6e0 2024-03-30T13:09:07.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f8031cb1640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8010067fc0 0x7f801006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.499+0000 7f8031cb1640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8010067fc0 0x7f801006a480 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8028006fd0 tx=0x7f8028008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:07.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.503+0000 7f80227fc640 1 -- 172.21.15.83:0/2234438671 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f80240c6030 con 0x7f802c0ce6e0 2024-03-30T13:09:07.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.663+0000 7f8033f15640 1 -- 172.21.15.83:0/2234438671 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f802c0d0610 con 0x7f802c0ce6e0 2024-03-30T13:09:07.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.663+0000 7f80227fc640 1 -- 172.21.15.83:0/2234438671 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f80240165a0 con 0x7f802c0ce6e0 2024-03-30T13:09:07.669 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-03-30T13:09:07.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.667+0000 7f8033f15640 1 -- 172.21.15.83:0/2234438671 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8010067fc0 msgr2=0x7f801006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.667+0000 7f8033f15640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8010067fc0 0x7f801006a480 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8028006fd0 tx=0x7f8028008040 comp rx=0 tx=0).stop 2024-03-30T13:09:07.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.667+0000 7f8033f15640 1 -- 172.21.15.83:0/2234438671 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802c0ce6e0 msgr2=0x7f802c154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.667+0000 7f8033f15640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802c0ce6e0 0x7f802c154720 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f802401a5e0 tx=0x7f8024019750 comp rx=0 tx=0).stop 2024-03-30T13:09:07.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.667+0000 7f8033f15640 1 -- 172.21.15.83:0/2234438671 shutdown_connections 2024-03-30T13:09:07.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.667+0000 7f8033f15640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8010067fc0 0x7f801006a480 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.667+0000 7f8033f15640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f802c0ce6e0 0x7f802c154720 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.667+0000 7f8033f15640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f802c0b0b00 0x7f802c159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.667+0000 7f8033f15640 1 --2- 172.21.15.83:0/2234438671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c09acb0 0x7f802c158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.667+0000 7f8033f15640 1 -- 172.21.15.83:0/2234438671 >> 172.21.15.83:0/2234438671 conn(0x7f802c0d2290 msgr2=0x7f802c156020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:07.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.667+0000 7f8033f15640 1 -- 172.21.15.83:0/2234438671 shutdown_connections 2024-03-30T13:09:07.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.667+0000 7f8033f15640 1 -- 172.21.15.83:0/2234438671 wait complete. 2024-03-30T13:09:07.686 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:09:07.686 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:09:07.693 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:07.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5203acc640 1 Processor -- start 2024-03-30T13:09:07.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5203acc640 1 -- start start 2024-03-30T13:09:07.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5203acc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc06b660 0x7f51fc06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5203acc640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51fc0b4890 con 0x7f51fc09ac80 2024-03-30T13:09:07.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5203acc640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51fc06bf80 con 0x7f51fc160000 2024-03-30T13:09:07.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5203acc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc15ecf0 con 0x7f51fc06b660 2024-03-30T13:09:07.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5201067640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f51fc09ac80 0x7f51fc0b4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59282/0 (socket says 172.21.15.83:59282) 2024-03-30T13:09:07.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5201067640 1 -- 172.21.15.83:0/2055432817 learned_addr learned my addr 172.21.15.83:0/2055432817 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:07.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5201868640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc06b660 0x7f51fc06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150663546 0 0) 0x7f51fc0b4890 con 0x7f51fc09ac80 2024-03-30T13:09:07.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e8003530 con 0x7f51fc09ac80 2024-03-30T13:09:07.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1970920898 0 0) 0x7f51e8003530 con 0x7f51fc09ac80 2024-03-30T13:09:07.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc06b660 msgr2=0x7f51fc06ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:07.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc06b660 0x7f51fc06ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 >> v1:172.21.15.153:6789/0 conn(0x7f51fc160000 legacy=0x7f51fc1604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc15efd0 con 0x7f51fc09ac80 2024-03-30T13:09:07.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f51ec001680 con 0x7f51fc09ac80 2024-03-30T13:09:07.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 >> v1:172.21.15.83:6789/0 conn(0x7f51fc09ac80 legacy=0x7f51fc0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51e80039f0 0x7f51e8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc06b660 0x7f51e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e8004d50 0x7f51e80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc15ecf0 con 0x7f51e8004d50 2024-03-30T13:09:07.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51e800bb00 con 0x7f51e80039f0 2024-03-30T13:09:07.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f51e800bd00 con 0x7f51fc06b660 2024-03-30T13:09:07.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5202069640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e8004d50 0x7f51e80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5201868640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51e80039f0 0x7f51e8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5201067640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc06b660 0x7f51e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5202069640 1 -- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc06b660 msgr2=0x7f51e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:07.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5202069640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc06b660 0x7f51e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5202069640 1 -- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51e80039f0 msgr2=0x7f51e8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:07.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5202069640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51e80039f0 0x7f51e8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5202069640 1 -- 172.21.15.83:0/2055432817 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e8003530 con 0x7f51e8004d50 2024-03-30T13:09:07.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5201067640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc06b660 0x7f51e8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:07.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.799+0000 7f5201868640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51e80039f0 0x7f51e8003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5202069640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e8004d50 0x7f51e80051d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f51f4001e70 tx=0x7f51f401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac67c5a170238338 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f4001a90 con 0x7f51e8004d50 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f4003b80 con 0x7f51e8004d50 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5200866640 1 -- 172.21.15.83:0/2055432817 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f4005080 con 0x7f51e8004d50 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5203acc640 1 -- 172.21.15.83:0/2055432817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e8004d50 msgr2=0x7f51e80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5203acc640 1 --2- 172.21.15.83:0/2055432817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e8004d50 0x7f51e80051d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f51f4001e70 tx=0x7f51f401c780 comp rx=0 tx=0).stop 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5202069640 1 -- 172.21.15.83:0/2055432817 reap_dead start 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5203acc640 1 -- 172.21.15.83:0/2055432817 shutdown_connections 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5203acc640 1 -- 172.21.15.83:0/2055432817 >> 172.21.15.83:0/2055432817 conn(0x7f51fc0b68c0 msgr2=0x7f51fc0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5203acc640 1 -- 172.21.15.83:0/2055432817 shutdown_connections 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5203acc640 1 -- 172.21.15.83:0/2055432817 wait complete. 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5203acc640 1 Processor -- start 2024-03-30T13:09:07.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.803+0000 7f5203acc640 1 -- start start 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5203acc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc152c80 0x7f51fc0caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5203acc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51fc153060 0x7f51fc0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5203acc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51fc0cb8b0 0x7f51fc0af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5203acc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc15e960 con 0x7f51fc153060 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5203acc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc15f590 con 0x7f51fc0cb8b0 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5203acc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc06ba40 con 0x7f51fc152c80 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5201067640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51fc153060 0x7f51fc0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5201067640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51fc153060 0x7f51fc0af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38982/0 (socket says 172.21.15.83:38982) 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5201067640 1 -- 172.21.15.83:0/2398010348 learned_addr learned my addr 172.21.15.83:0/2398010348 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5201868640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc152c80 0x7f51fc0caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5201067640 1 -- 172.21.15.83:0/2398010348 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc152c80 msgr2=0x7f51fc0caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5201067640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc152c80 0x7f51fc0caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5202069640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51fc0cb8b0 0x7f51fc0af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5201067640 1 -- 172.21.15.83:0/2398010348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51fc0cb8b0 msgr2=0x7f51fc0af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5201067640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51fc0cb8b0 0x7f51fc0af820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5201067640 1 -- 172.21.15.83:0/2398010348 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc0cbe20 con 0x7f51fc153060 2024-03-30T13:09:07.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5201067640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51fc153060 0x7f51fc0af2e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f51ec011790 tx=0x7f51ec011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:07.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f51f27fc640 1 -- 172.21.15.83:0/2398010348 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec010040 con 0x7f51fc153060 2024-03-30T13:09:07.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f51f27fc640 1 -- 172.21.15.83:0/2398010348 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51ec01a070 con 0x7f51fc153060 2024-03-30T13:09:07.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f51f27fc640 1 -- 172.21.15.83:0/2398010348 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00fd80 con 0x7f51fc153060 2024-03-30T13:09:07.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5203acc640 1 -- 172.21.15.83:0/2398010348 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51fc0cc100 con 0x7f51fc153060 2024-03-30T13:09:07.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5203acc640 1 -- 172.21.15.83:0/2398010348 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51fc0cc6c0 con 0x7f51fc153060 2024-03-30T13:09:07.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5203acc640 1 -- 172.21.15.83:0/2398010348 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51fc068dd0 con 0x7f51fc153060 2024-03-30T13:09:07.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f51f27fc640 1 -- 172.21.15.83:0/2398010348 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f51ec01f460 con 0x7f51fc153060 2024-03-30T13:09:07.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f51f27fc640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f51e0067ff0 0x7f51e006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:07.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5201868640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f51e0067ff0 0x7f51e006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:07.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f51f27fc640 1 -- 172.21.15.83:0/2398010348 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f51ec089770 con 0x7f51fc153060 2024-03-30T13:09:07.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.807+0000 7f5201868640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f51e0067ff0 0x7f51e006a4b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0b6890 tx=0x7f51f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:07.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.811+0000 7f51f27fc640 1 -- 172.21.15.83:0/2398010348 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f51ec059e90 con 0x7f51fc153060 2024-03-30T13:09:07.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.971+0000 7f5203acc640 1 -- 172.21.15.83:0/2398010348 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51fc06e210 con 0x7f51fc153060 2024-03-30T13:09:07.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.971+0000 7f51f27fc640 1 -- 172.21.15.83:0/2398010348 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16848 (secure 0 0 0) 0x7f51ec059790 con 0x7f51fc153060 2024-03-30T13:09:07.977 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:07.977 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:09:07.416798+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:07.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.975+0000 7f5203acc640 1 -- 172.21.15.83:0/2398010348 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f51e0067ff0 msgr2=0x7f51e006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.975+0000 7f5203acc640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f51e0067ff0 0x7f51e006a4b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0b6890 tx=0x7f51f8008040 comp rx=0 tx=0).stop 2024-03-30T13:09:07.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.975+0000 7f5203acc640 1 -- 172.21.15.83:0/2398010348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51fc153060 msgr2=0x7f51fc0af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:07.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.975+0000 7f5203acc640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51fc153060 0x7f51fc0af2e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f51ec011790 tx=0x7f51ec011c50 comp rx=0 tx=0).stop 2024-03-30T13:09:07.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.975+0000 7f5203acc640 1 -- 172.21.15.83:0/2398010348 shutdown_connections 2024-03-30T13:09:07.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.975+0000 7f5203acc640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f51e0067ff0 0x7f51e006a4b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.975+0000 7f5203acc640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51fc0cb8b0 0x7f51fc0af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.975+0000 7f5203acc640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51fc153060 0x7f51fc0af2e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.975+0000 7f5203acc640 1 --2- 172.21.15.83:0/2398010348 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51fc152c80 0x7f51fc0caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:07.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.975+0000 7f5203acc640 1 -- 172.21.15.83:0/2398010348 >> 172.21.15.83:0/2398010348 conn(0x7f51fc0b68c0 msgr2=0x7f51fc0b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:07.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.975+0000 7f5203acc640 1 -- 172.21.15.83:0/2398010348 shutdown_connections 2024-03-30T13:09:07.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:07.975+0000 7f5203acc640 1 -- 172.21.15.83:0/2398010348 wait complete. 2024-03-30T13:09:07.995 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:09:07.995 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:09:08.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4aa82640 1 Processor -- start 2024-03-30T13:09:08.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4aa82640 1 -- start start 2024-03-30T13:09:08.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4aa82640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdd4415c8e0 0x7fdd440ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4aa82640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdd440b4680 0x7fdd44165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4aa82640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd440ae040 con 0x7fdd440adac0 2024-03-30T13:09:08.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4aa82640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fdd440b31e0 con 0x7fdd440b4680 2024-03-30T13:09:08.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4aa82640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdd440ae320 con 0x7fdd4415c8e0 2024-03-30T13:09:08.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4901f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdd440b4680 0x7fdd44165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4901f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdd440b4680 0x7fdd44165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38990/0 (socket says 172.21.15.83:38990) 2024-03-30T13:09:08.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4901f640 1 -- 172.21.15.83:0/2991752361 learned_addr learned my addr 172.21.15.83:0/2991752361 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:08.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4881e640 1 --2- 172.21.15.83:0/2991752361 >> v2:172.21.15.153:3300/0 conn(0x7fdd4415c8e0 0x7fdd440ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4901f640 1 -- 172.21.15.83:0/2991752361 >> v2:172.21.15.153:3300/0 conn(0x7fdd4415c8e0 msgr2=0x7fdd440ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:08.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4901f640 1 --2- 172.21.15.83:0/2991752361 >> v2:172.21.15.153:3300/0 conn(0x7fdd4415c8e0 0x7fdd440ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4901f640 1 -- 172.21.15.83:0/2991752361 >> v1:172.21.15.153:6789/0 conn(0x7fdd440adac0 legacy=0x7fdd4415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:08.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.115+0000 7fdd4901f640 1 -- 172.21.15.83:0/2991752361 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd440ae600 con 0x7fdd440b4680 2024-03-30T13:09:08.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4901f640 1 --2- 172.21.15.83:0/2991752361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd440b4680 0x7fdd44165e90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdd440b4ee0 tx=0x7fdd3c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f84966bb56b014 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:08.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd437fe640 1 -- 172.21.15.83:0/2991752361 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0a5670 con 0x7fdd440b4680 2024-03-30T13:09:08.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd437fe640 1 -- 172.21.15.83:0/2991752361 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0a5810 con 0x7fdd440b4680 2024-03-30T13:09:08.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd437fe640 1 -- 172.21.15.83:0/2991752361 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0a5be0 con 0x7fdd440b4680 2024-03-30T13:09:08.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 -- 172.21.15.83:0/2991752361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd440b4680 msgr2=0x7fdd44165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 --2- 172.21.15.83:0/2991752361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd440b4680 0x7fdd44165e90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdd440b4ee0 tx=0x7fdd3c01c9b0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 -- 172.21.15.83:0/2991752361 shutdown_connections 2024-03-30T13:09:08.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 --2- 172.21.15.83:0/2991752361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd440b4680 0x7fdd44165e90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 --2- 172.21.15.83:0/2991752361 >> v2:172.21.15.153:3300/0 conn(0x7fdd4415c8e0 0x7fdd440ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 -- 172.21.15.83:0/2991752361 >> 172.21.15.83:0/2991752361 conn(0x7fdd4406b660 msgr2=0x7fdd4406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:08.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 -- 172.21.15.83:0/2991752361 shutdown_connections 2024-03-30T13:09:08.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 -- 172.21.15.83:0/2991752361 wait complete. 2024-03-30T13:09:08.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 Processor -- start 2024-03-30T13:09:08.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 -- start start 2024-03-30T13:09:08.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd440adac0 0x7fdd440afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd440b4680 0x7fdd44099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd4415c8e0 0x7fdd4414c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdd44168f80 con 0x7fdd440b4680 2024-03-30T13:09:08.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdd44168e00 con 0x7fdd4415c8e0 2024-03-30T13:09:08.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4aa82640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdd44169100 con 0x7fdd440adac0 2024-03-30T13:09:08.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd43fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd440b4680 0x7fdd44099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd43fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd440b4680 0x7fdd44099a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39002/0 (socket says 172.21.15.83:39002) 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd43fff640 1 -- 172.21.15.83:0/702391495 learned_addr learned my addr 172.21.15.83:0/702391495 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4901f640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd4415c8e0 0x7fdd4414c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd4881e640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd440adac0 0x7fdd440afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd43fff640 1 -- 172.21.15.83:0/702391495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd440adac0 msgr2=0x7fdd440afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd43fff640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd440adac0 0x7fdd440afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd43fff640 1 -- 172.21.15.83:0/702391495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd4415c8e0 msgr2=0x7fdd4414c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd43fff640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd4415c8e0 0x7fdd4414c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.119+0000 7fdd43fff640 1 -- 172.21.15.83:0/702391495 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4414ce30 con 0x7fdd440b4680 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.123+0000 7fdd43fff640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd440b4680 0x7fdd44099a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800b440 tx=0x7fdd3800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.123+0000 7fdd417fa640 1 -- 172.21.15.83:0/702391495 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38015020 con 0x7fdd440b4680 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.123+0000 7fdd417fa640 1 -- 172.21.15.83:0/702391495 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd38011890 con 0x7fdd440b4680 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.123+0000 7fdd417fa640 1 -- 172.21.15.83:0/702391495 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38011c80 con 0x7fdd440b4680 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.123+0000 7fdd4aa82640 1 -- 172.21.15.83:0/702391495 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd44072040 con 0x7fdd440b4680 2024-03-30T13:09:08.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.123+0000 7fdd4aa82640 1 -- 172.21.15.83:0/702391495 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4414de30 con 0x7fdd440b4680 2024-03-30T13:09:08.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.123+0000 7fdd4aa82640 1 -- 172.21.15.83:0/702391495 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4404f9e0 con 0x7fdd440b4680 2024-03-30T13:09:08.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.123+0000 7fdd417fa640 1 -- 172.21.15.83:0/702391495 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fdd38018020 con 0x7fdd440b4680 2024-03-30T13:09:08.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.123+0000 7fdd417fa640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd30067ff0 0x7fdd3006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.123+0000 7fdd417fa640 1 -- 172.21.15.83:0/702391495 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7fdd38086390 con 0x7fdd440b4680 2024-03-30T13:09:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.123+0000 7fdd4881e640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd30067ff0 0x7fdd3006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.123+0000 7fdd4881e640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd30067ff0 0x7fdd3006a4b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009790 tx=0x7fdd34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:08.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.127+0000 7fdd417fa640 1 -- 172.21.15.83:0/702391495 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fdd3801f030 con 0x7fdd440b4680 2024-03-30T13:09:08.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.291+0000 7fdd4aa82640 1 -- 172.21.15.83:0/702391495 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd4409e4c0 con 0x7fdd440b4680 2024-03-30T13:09:08.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.291+0000 7fdd417fa640 1 -- 172.21.15.83:0/702391495 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fdd3800d040 con 0x7fdd440b4680 2024-03-30T13:09:08.296 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:09:08.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.295+0000 7fdd4aa82640 1 -- 172.21.15.83:0/702391495 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd30067ff0 msgr2=0x7fdd3006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.295+0000 7fdd4aa82640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd30067ff0 0x7fdd3006a4b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009790 tx=0x7fdd34008040 comp rx=0 tx=0).stop 2024-03-30T13:09:08.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.295+0000 7fdd4aa82640 1 -- 172.21.15.83:0/702391495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd440b4680 msgr2=0x7fdd44099a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.295+0000 7fdd4aa82640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd440b4680 0x7fdd44099a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800b440 tx=0x7fdd3800b900 comp rx=0 tx=0).stop 2024-03-30T13:09:08.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.295+0000 7fdd4aa82640 1 -- 172.21.15.83:0/702391495 shutdown_connections 2024-03-30T13:09:08.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.295+0000 7fdd4aa82640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd30067ff0 0x7fdd3006a4b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.295+0000 7fdd4aa82640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd4415c8e0 0x7fdd4414c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.295+0000 7fdd4aa82640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd440b4680 0x7fdd44099a00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.295+0000 7fdd4aa82640 1 --2- 172.21.15.83:0/702391495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd440adac0 0x7fdd440afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.295+0000 7fdd4aa82640 1 -- 172.21.15.83:0/702391495 >> 172.21.15.83:0/702391495 conn(0x7fdd4406b660 msgr2=0x7fdd4414d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:08.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.295+0000 7fdd4aa82640 1 -- 172.21.15.83:0/702391495 shutdown_connections 2024-03-30T13:09:08.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.295+0000 7fdd4aa82640 1 -- 172.21.15.83:0/702391495 wait complete. 2024-03-30T13:09:08.315 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:09:08.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.427+0000 7f791378f640 1 Processor -- start 2024-03-30T13:09:08.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f791378f640 1 -- start start 2024-03-30T13:09:08.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f791378f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f790c0d1a20 0x7f790c0cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f791378f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f790c0d4230 0x7f790c0d4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f791378f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790c0d3280 con 0x7f790c15e880 2024-03-30T13:09:08.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f791378f640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f790c0b4580 con 0x7f790c0d4230 2024-03-30T13:09:08.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f791378f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f790c0d3560 con 0x7f790c0d1a20 2024-03-30T13:09:08.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f7911d2c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f790c0d4230 0x7f790c0d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f791152b640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f790c15e880 0x7f790c0d2a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59284/0 (socket says 172.21.15.83:59284) 2024-03-30T13:09:08.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f791152b640 1 -- 172.21.15.83:0/2987280743 learned_addr learned my addr 172.21.15.83:0/2987280743 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:08.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f7910d2a640 1 --2- 172.21.15.83:0/2987280743 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f790c0d1a20 0x7f790c0cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f7911d2c640 1 -- 172.21.15.83:0/2987280743 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f790c0d1a20 msgr2=0x7f790c0cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:08.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f7911d2c640 1 --2- 172.21.15.83:0/2987280743 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f790c0d1a20 0x7f790c0cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f7911d2c640 1 -- 172.21.15.83:0/2987280743 >> v1:172.21.15.83:6789/0 conn(0x7f790c15e880 legacy=0x7f790c0d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f7903fff640 1 -- 172.21.15.83:0/2987280743 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314541822 0 0) 0x7f790c0d3280 con 0x7f790c15e880 2024-03-30T13:09:08.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.431+0000 7f7911d2c640 1 -- 172.21.15.83:0/2987280743 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c0b3f30 con 0x7f790c0d4230 2024-03-30T13:09:08.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f7911d2c640 1 --2- 172.21.15.83:0/2987280743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f790c0d4230 0x7f790c0d4680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7904009d90 tx=0x7f790401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22cdf4f773e3db65 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:08.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f7903fff640 1 -- 172.21.15.83:0/2987280743 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79040b2070 con 0x7f790c0d4230 2024-03-30T13:09:08.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f7903fff640 1 -- 172.21.15.83:0/2987280743 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79040a57a0 con 0x7f790c0d4230 2024-03-30T13:09:08.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f7903fff640 1 -- 172.21.15.83:0/2987280743 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79040a5b70 con 0x7f790c0d4230 2024-03-30T13:09:08.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f791378f640 1 -- 172.21.15.83:0/2987280743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f790c0d4230 msgr2=0x7f790c0d4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f791378f640 1 --2- 172.21.15.83:0/2987280743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f790c0d4230 0x7f790c0d4680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7904009d90 tx=0x7f790401c8e0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f791378f640 1 -- 172.21.15.83:0/2987280743 shutdown_connections 2024-03-30T13:09:08.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f791378f640 1 --2- 172.21.15.83:0/2987280743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f790c0d4230 0x7f790c0d4680 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f791378f640 1 --2- 172.21.15.83:0/2987280743 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f790c0d1a20 0x7f790c0cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f791378f640 1 -- 172.21.15.83:0/2987280743 >> 172.21.15.83:0/2987280743 conn(0x7f790c09d7c0 msgr2=0x7f790c08bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:08.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f791378f640 1 -- 172.21.15.83:0/2987280743 shutdown_connections 2024-03-30T13:09:08.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f791378f640 1 -- 172.21.15.83:0/2987280743 wait complete. 2024-03-30T13:09:08.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f791378f640 1 Processor -- start 2024-03-30T13:09:08.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.435+0000 7f791378f640 1 -- start start 2024-03-30T13:09:08.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791378f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f790c0d1a20 0x7f790c0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791378f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f790c0d4230 0x7f790c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791378f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f790c15e880 0x7f790c14fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791378f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f790c0b53a0 con 0x7f790c0d1a20 2024-03-30T13:09:08.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791378f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f790c0b5220 con 0x7f790c15e880 2024-03-30T13:09:08.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791378f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f790c0b5520 con 0x7f790c0d4230 2024-03-30T13:09:08.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791152b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f790c0d1a20 0x7f790c0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791152b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f790c0d1a20 0x7f790c0cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39014/0 (socket says 172.21.15.83:39014) 2024-03-30T13:09:08.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791152b640 1 -- 172.21.15.83:0/3844688529 learned_addr learned my addr 172.21.15.83:0/3844688529 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:08.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f7911d2c640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f790c15e880 0x7f790c14fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f7910d2a640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f790c0d4230 0x7f790c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791152b640 1 -- 172.21.15.83:0/3844688529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f790c0d4230 msgr2=0x7f790c0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791152b640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f790c0d4230 0x7f790c0cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791152b640 1 -- 172.21.15.83:0/3844688529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f790c15e880 msgr2=0x7f790c14fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791152b640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f790c15e880 0x7f790c14fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791152b640 1 -- 172.21.15.83:0/3844688529 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c08c0e0 con 0x7f790c0d1a20 2024-03-30T13:09:08.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f7911d2c640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f790c15e880 0x7f790c14fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:08.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791152b640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f790c0d1a20 0x7f790c0cc120 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00c480 tx=0x7f78fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:08.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f7901ffb640 1 -- 172.21.15.83:0/3844688529 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc018070 con 0x7f790c0d1a20 2024-03-30T13:09:08.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f7901ffb640 1 -- 172.21.15.83:0/3844688529 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78fc007500 con 0x7f790c0d1a20 2024-03-30T13:09:08.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791378f640 1 -- 172.21.15.83:0/3844688529 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790c0b2640 con 0x7f790c0d1a20 2024-03-30T13:09:08.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f7901ffb640 1 -- 172.21.15.83:0/3844688529 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc004a30 con 0x7f790c0d1a20 2024-03-30T13:09:08.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791378f640 1 -- 172.21.15.83:0/3844688529 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790c0b2c00 con 0x7f790c0d1a20 2024-03-30T13:09:08.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f791378f640 1 -- 172.21.15.83:0/3844688529 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790c0a23a0 con 0x7f790c0d1a20 2024-03-30T13:09:08.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f7901ffb640 1 -- 172.21.15.83:0/3844688529 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f78fc01b070 con 0x7f790c0d1a20 2024-03-30T13:09:08.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f7901ffb640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f78f0067ff0 0x7f78f006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f7901ffb640 1 -- 172.21.15.83:0/3844688529 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f78fc0857f0 con 0x7f790c0d1a20 2024-03-30T13:09:08.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f7910d2a640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f78f0067ff0 0x7f78f006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.439+0000 7f7910d2a640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f78f0067ff0 0x7f78f006a4b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7908006fd0 tx=0x7f7908008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:08.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.443+0000 7f7901ffb640 1 -- 172.21.15.83:0/3844688529 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f78fc055fb0 con 0x7f790c0d1a20 2024-03-30T13:09:08.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.591+0000 7f791378f640 1 -- 172.21.15.83:0/3844688529 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f790c0d49a0 con 0x7f790c0d1a20 2024-03-30T13:09:08.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.591+0000 7f7901ffb640 1 -- 172.21.15.83:0/3844688529 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f78fc0558b0 con 0x7f790c0d1a20 2024-03-30T13:09:08.597 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:09:08.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.595+0000 7f791378f640 1 -- 172.21.15.83:0/3844688529 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f78f0067ff0 msgr2=0x7f78f006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.595+0000 7f791378f640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f78f0067ff0 0x7f78f006a4b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7908006fd0 tx=0x7f7908008040 comp rx=0 tx=0).stop 2024-03-30T13:09:08.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.595+0000 7f791378f640 1 -- 172.21.15.83:0/3844688529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f790c0d1a20 msgr2=0x7f790c0cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.595+0000 7f791378f640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f790c0d1a20 0x7f790c0cc120 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00c480 tx=0x7f78fc00c940 comp rx=0 tx=0).stop 2024-03-30T13:09:08.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.595+0000 7f791378f640 1 -- 172.21.15.83:0/3844688529 shutdown_connections 2024-03-30T13:09:08.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.595+0000 7f791378f640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f78f0067ff0 0x7f78f006a4b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.595+0000 7f791378f640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f790c15e880 0x7f790c14fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.595+0000 7f791378f640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f790c0d4230 0x7f790c0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.595+0000 7f791378f640 1 --2- 172.21.15.83:0/3844688529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f790c0d1a20 0x7f790c0cc120 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.595+0000 7f791378f640 1 -- 172.21.15.83:0/3844688529 >> 172.21.15.83:0/3844688529 conn(0x7f790c09d7c0 msgr2=0x7f790c06dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:08.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.595+0000 7f791378f640 1 -- 172.21.15.83:0/3844688529 shutdown_connections 2024-03-30T13:09:08.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.595+0000 7f791378f640 1 -- 172.21.15.83:0/3844688529 wait complete. 2024-03-30T13:09:08.615 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:09:08.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f532110f640 1 Processor -- start 2024-03-30T13:09:08.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f532110f640 1 -- start start 2024-03-30T13:09:08.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f532110f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f531c15d3d0 0x7f531c166ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f532110f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531c0ae040 con 0x7f531c0b4680 2024-03-30T13:09:08.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f532110f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531c0ae320 con 0x7f531c15c8e0 2024-03-30T13:09:08.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f532110f640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f531c0b31e0 con 0x7f531c15d3d0 2024-03-30T13:09:08.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f531b59e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f531c15d3d0 0x7f531c166ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f531b59e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f531c15d3d0 0x7f531c166ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39024/0 (socket says 172.21.15.83:39024) 2024-03-30T13:09:08.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f531b59e640 1 -- 172.21.15.83:0/2095048131 learned_addr learned my addr 172.21.15.83:0/2095048131 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:08.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f531a59c640 1 --1- 172.21.15.83:0/2095048131 >> v1:172.21.15.83:6789/0 conn(0x7f531c0b4680 0x7f531c15ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59298/0 (socket says 172.21.15.83:59298) 2024-03-30T13:09:08.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f531b59e640 1 -- 172.21.15.83:0/2095048131 >> v1:172.21.15.153:6789/0 conn(0x7f531c15c8e0 legacy=0x7f531c0ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f531b59e640 1 -- 172.21.15.83:0/2095048131 >> v1:172.21.15.83:6789/0 conn(0x7f531c0b4680 legacy=0x7f531c15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f5319d9b640 1 -- 172.21.15.83:0/2095048131 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409776325 0 0) 0x7f531c0ae040 con 0x7f531c0b4680 2024-03-30T13:09:08.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f531b59e640 1 -- 172.21.15.83:0/2095048131 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c0ae600 con 0x7f531c15d3d0 2024-03-30T13:09:08.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.731+0000 7f531b59e640 1 --2- 172.21.15.83:0/2095048131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c15d3d0 0x7f531c166ea0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5314009e50 tx=0x7f531401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad7f385040c404a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:08.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f5319d9b640 1 -- 172.21.15.83:0/2095048131 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53140a5770 con 0x7f531c15d3d0 2024-03-30T13:09:08.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f5319d9b640 1 -- 172.21.15.83:0/2095048131 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53140a5910 con 0x7f531c15d3d0 2024-03-30T13:09:08.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f5319d9b640 1 -- 172.21.15.83:0/2095048131 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53140a5ce0 con 0x7f531c15d3d0 2024-03-30T13:09:08.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 -- 172.21.15.83:0/2095048131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c15d3d0 msgr2=0x7f531c166ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 --2- 172.21.15.83:0/2095048131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c15d3d0 0x7f531c166ea0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5314009e50 tx=0x7f531401c9a0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 -- 172.21.15.83:0/2095048131 shutdown_connections 2024-03-30T13:09:08.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 --2- 172.21.15.83:0/2095048131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c15d3d0 0x7f531c166ea0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 -- 172.21.15.83:0/2095048131 >> 172.21.15.83:0/2095048131 conn(0x7f531c06b660 msgr2=0x7f531c06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:08.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 -- 172.21.15.83:0/2095048131 shutdown_connections 2024-03-30T13:09:08.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 -- 172.21.15.83:0/2095048131 wait complete. 2024-03-30T13:09:08.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 Processor -- start 2024-03-30T13:09:08.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 -- start start 2024-03-30T13:09:08.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f531c0b4680 0x7f531c148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c15c8e0 0x7f531c0723b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f531c15d3d0 0x7f531c0b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f531c169d80 con 0x7f531c15c8e0 2024-03-30T13:09:08.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f531c169c00 con 0x7f531c15d3d0 2024-03-30T13:09:08.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f531c169f00 con 0x7f531c0b4680 2024-03-30T13:09:08.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f531a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c15c8e0 0x7f531c0723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f531a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c15c8e0 0x7f531c0723b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39038/0 (socket says 172.21.15.83:39038) 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f531a59c640 1 -- 172.21.15.83:0/3279522214 learned_addr learned my addr 172.21.15.83:0/3279522214 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f531ad9d640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f531c0b4680 0x7f531c148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f531b59e640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f531c15d3d0 0x7f531c0b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f531a59c640 1 -- 172.21.15.83:0/3279522214 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f531c0b4680 msgr2=0x7f531c148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f531a59c640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f531c0b4680 0x7f531c148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f531a59c640 1 -- 172.21.15.83:0/3279522214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f531c15d3d0 msgr2=0x7f531c0b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f531a59c640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f531c15d3d0 0x7f531c0b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f531a59c640 1 -- 172.21.15.83:0/3279522214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c0caff0 con 0x7f531c15c8e0 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f531a59c640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c15c8e0 0x7f531c0723b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f531000c410 tx=0x7f531000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f53037fe640 1 -- 172.21.15.83:0/3279522214 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53100074e0 con 0x7f531c15c8e0 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f53037fe640 1 -- 172.21.15.83:0/3279522214 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53100047f0 con 0x7f531c15c8e0 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 -- 172.21.15.83:0/3279522214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531c0cb2d0 con 0x7f531c15c8e0 2024-03-30T13:09:08.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f53037fe640 1 -- 172.21.15.83:0/3279522214 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5310007680 con 0x7f531c15c8e0 2024-03-30T13:09:08.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.735+0000 7f532110f640 1 -- 172.21.15.83:0/3279522214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531c0cb890 con 0x7f531c15c8e0 2024-03-30T13:09:08.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.739+0000 7f532110f640 1 -- 172.21.15.83:0/3279522214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531c04f9e0 con 0x7f531c15c8e0 2024-03-30T13:09:08.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.739+0000 7f53037fe640 1 -- 172.21.15.83:0/3279522214 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5310011070 con 0x7f531c15c8e0 2024-03-30T13:09:08.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.739+0000 7f53037fe640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5308067fc0 0x7f530806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:08.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.739+0000 7f53037fe640 1 -- 172.21.15.83:0/3279522214 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f53100861e0 con 0x7f531c15c8e0 2024-03-30T13:09:08.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.739+0000 7f531ad9d640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5308067fc0 0x7f530806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:08.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.739+0000 7f531ad9d640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5308067fc0 0x7f530806a480 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f530c000f70 tx=0x7f530c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:08.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.743+0000 7f53037fe640 1 -- 172.21.15.83:0/3279522214 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5310056910 con 0x7f531c15c8e0 2024-03-30T13:09:08.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.903+0000 7f532110f640 1 -- 172.21.15.83:0/3279522214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f531c06bc50 con 0x7f531c15c8e0 2024-03-30T13:09:08.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f53037fe640 1 -- 172.21.15.83:0/3279522214 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f5310056210 con 0x7f531c15c8e0 2024-03-30T13:09:08.910 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:09:08.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f532110f640 1 -- 172.21.15.83:0/3279522214 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5308067fc0 msgr2=0x7f530806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f532110f640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5308067fc0 0x7f530806a480 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f530c000f70 tx=0x7f530c009040 comp rx=0 tx=0).stop 2024-03-30T13:09:08.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f532110f640 1 -- 172.21.15.83:0/3279522214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c15c8e0 msgr2=0x7f531c0723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:08.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f532110f640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c15c8e0 0x7f531c0723b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f531000c410 tx=0x7f531000c8d0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f532110f640 1 -- 172.21.15.83:0/3279522214 shutdown_connections 2024-03-30T13:09:08.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f532110f640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5308067fc0 0x7f530806a480 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f532110f640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f531c15d3d0 0x7f531c0b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f532110f640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c15c8e0 0x7f531c0723b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f532110f640 1 --2- 172.21.15.83:0/3279522214 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f531c0b4680 0x7f531c148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:08.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f532110f640 1 -- 172.21.15.83:0/3279522214 >> 172.21.15.83:0/3279522214 conn(0x7f531c06b660 msgr2=0x7f531c15abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:08.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f532110f640 1 -- 172.21.15.83:0/3279522214 shutdown_connections 2024-03-30T13:09:08.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:08.907+0000 7f532110f640 1 -- 172.21.15.83:0/3279522214 wait complete. 2024-03-30T13:09:08.930 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:09:09.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd58e41640 1 Processor -- start 2024-03-30T13:09:09.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd58e41640 1 -- start start 2024-03-30T13:09:09.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd58e41640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdd540b4680 0x7fdd5415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd58e41640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415d200 0x7fdd54165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd58e41640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd540ae040 con 0x7fdd5415c8e0 2024-03-30T13:09:09.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd58e41640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdd540b31e0 con 0x7fdd540b4680 2024-03-30T13:09:09.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd58e41640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdd540ae320 con 0x7fdd5415d200 2024-03-30T13:09:09.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5259c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fdd5415c8e0 0x7fdd540ad580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59308/0 (socket says 172.21.15.83:59308) 2024-03-30T13:09:09.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5259c640 1 -- 172.21.15.83:0/3718090269 learned_addr learned my addr 172.21.15.83:0/3718090269 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:09.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd52d9d640 1 --2- 172.21.15.83:0/3718090269 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415d200 0x7fdd54165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd51d9b640 1 --2- 172.21.15.83:0/3718090269 >> v2:172.21.15.153:3300/0 conn(0x7fdd540b4680 0x7fdd5415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3954374848 0 0) 0x7fdd540ae040 con 0x7fdd5415c8e0 2024-03-30T13:09:09.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd3c003530 con 0x7fdd5415c8e0 2024-03-30T13:09:09.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3366239066 0 0) 0x7fdd3c003530 con 0x7fdd5415c8e0 2024-03-30T13:09:09.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415d200 msgr2=0x7fdd54165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:09.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 --2- 172.21.15.83:0/3718090269 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415d200 0x7fdd54165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 >> v2:172.21.15.153:3300/0 conn(0x7fdd540b4680 msgr2=0x7fdd5415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:09.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 --2- 172.21.15.83:0/3718090269 >> v2:172.21.15.153:3300/0 conn(0x7fdd540b4680 0x7fdd5415ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd540ae600 con 0x7fdd5415c8e0 2024-03-30T13:09:09.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fdd44001680 con 0x7fdd5415c8e0 2024-03-30T13:09:09.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 >> v1:172.21.15.83:6789/0 conn(0x7fdd5415c8e0 legacy=0x7fdd540ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 --2- 172.21.15.83:0/3718090269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd3c0039c0 0x7fdd3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 --2- 172.21.15.83:0/3718090269 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415d200 0x7fdd3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 --2- 172.21.15.83:0/3718090269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd3c004d50 0x7fdd3c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdd540b31e0 con 0x7fdd3c004d50 2024-03-30T13:09:09.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdd540ae320 con 0x7fdd3c0039c0 2024-03-30T13:09:09.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3c00b9d0 con 0x7fdd5415d200 2024-03-30T13:09:09.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd52d9d640 1 --2- 172.21.15.83:0/3718090269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd3c004d50 0x7fdd3c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd51d9b640 1 --2- 172.21.15.83:0/3718090269 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415d200 0x7fdd3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.043+0000 7fdd5259c640 1 --2- 172.21.15.83:0/3718090269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd3c0039c0 0x7fdd3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd52d9d640 1 -- 172.21.15.83:0/3718090269 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415d200 msgr2=0x7fdd3c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:09.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd52d9d640 1 --2- 172.21.15.83:0/3718090269 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415d200 0x7fdd3c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd52d9d640 1 -- 172.21.15.83:0/3718090269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd3c0039c0 msgr2=0x7fdd3c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:09.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd52d9d640 1 --2- 172.21.15.83:0/3718090269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd3c0039c0 0x7fdd3c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd52d9d640 1 -- 172.21.15.83:0/3718090269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3c003530 con 0x7fdd3c004d50 2024-03-30T13:09:09.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd52d9d640 1 --2- 172.21.15.83:0/3718090269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd3c004d50 0x7fdd3c0051d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00e170 tx=0x7fdd4c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b129962a7ddfeab3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0b2070 con 0x7fdd3c004d50 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4c0a5c70 con 0x7fdd3c004d50 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd5159a640 1 -- 172.21.15.83:0/3718090269 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c009c10 con 0x7fdd3c004d50 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd58e41640 1 -- 172.21.15.83:0/3718090269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd3c004d50 msgr2=0x7fdd3c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd58e41640 1 --2- 172.21.15.83:0/3718090269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd3c004d50 0x7fdd3c0051d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00e170 tx=0x7fdd4c01cc60 comp rx=0 tx=0).stop 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd52d9d640 1 -- 172.21.15.83:0/3718090269 reap_dead start 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd58e41640 1 -- 172.21.15.83:0/3718090269 shutdown_connections 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd58e41640 1 -- 172.21.15.83:0/3718090269 >> 172.21.15.83:0/3718090269 conn(0x7fdd5406b660 msgr2=0x7fdd5406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd58e41640 1 -- 172.21.15.83:0/3718090269 shutdown_connections 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.047+0000 7fdd58e41640 1 -- 172.21.15.83:0/3718090269 wait complete. 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd58e41640 1 Processor -- start 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd58e41640 1 -- start start 2024-03-30T13:09:09.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd58e41640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd541593e0 0x7fdd540cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd58e41640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415da10 0x7fdd54142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd58e41640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd54143110 0x7fdd540b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd58e41640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5415d690 con 0x7fdd541593e0 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd58e41640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5406f8e0 con 0x7fdd54143110 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd58e41640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdd540adc90 con 0x7fdd5415da10 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd5259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd541593e0 0x7fdd540cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd5259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd541593e0 0x7fdd540cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39056/0 (socket says 172.21.15.83:39056) 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd5259c640 1 -- 172.21.15.83:0/1364814932 learned_addr learned my addr 172.21.15.83:0/1364814932 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd51d9b640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415da10 0x7fdd54142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd52d9d640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd54143110 0x7fdd540b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd5259c640 1 -- 172.21.15.83:0/1364814932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415da10 msgr2=0x7fdd54142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd5259c640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415da10 0x7fdd54142bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd5259c640 1 -- 172.21.15.83:0/1364814932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd54143110 msgr2=0x7fdd540b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd5259c640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd54143110 0x7fdd540b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd5259c640 1 -- 172.21.15.83:0/1364814932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5415de90 con 0x7fdd541593e0 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd52d9d640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd54143110 0x7fdd540b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd5259c640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd541593e0 0x7fdd540cd8b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400eaf0 tx=0x7fdd44001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd42ffd640 1 -- 172.21.15.83:0/1364814932 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400c850 con 0x7fdd541593e0 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd42ffd640 1 -- 172.21.15.83:0/1364814932 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd44018070 con 0x7fdd541593e0 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd58e41640 1 -- 172.21.15.83:0/1364814932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5415e160 con 0x7fdd541593e0 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd42ffd640 1 -- 172.21.15.83:0/1364814932 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400cc50 con 0x7fdd541593e0 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd58e41640 1 -- 172.21.15.83:0/1364814932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd5415e720 con 0x7fdd541593e0 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd58e41640 1 -- 172.21.15.83:0/1364814932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd5404f9e0 con 0x7fdd541593e0 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd42ffd640 1 -- 172.21.15.83:0/1364814932 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fdd4401d460 con 0x7fdd541593e0 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd42ffd640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd34067fc0 0x7fdd3406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd42ffd640 1 -- 172.21.15.83:0/1364814932 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7fdd44086530 con 0x7fdd541593e0 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.051+0000 7fdd51d9b640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd34067fc0 0x7fdd3406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.055+0000 7fdd51d9b640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd34067fc0 0x7fdd3406a480 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdd540cf320 tx=0x7fdd48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:09.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.055+0000 7fdd42ffd640 1 -- 172.21.15.83:0/1364814932 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fdd44056cf0 con 0x7fdd541593e0 2024-03-30T13:09:09.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.215+0000 7fdd58e41640 1 -- 172.21.15.83:0/1364814932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdd54153b60 con 0x7fdd541593e0 2024-03-30T13:09:09.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.215+0000 7fdd42ffd640 1 -- 172.21.15.83:0/1364814932 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fdd440565f0 con 0x7fdd541593e0 2024-03-30T13:09:09.219 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-03-30T13:09:09.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.215+0000 7fdd58e41640 1 -- 172.21.15.83:0/1364814932 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd34067fc0 msgr2=0x7fdd3406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.215+0000 7fdd58e41640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd34067fc0 0x7fdd3406a480 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdd540cf320 tx=0x7fdd48008040 comp rx=0 tx=0).stop 2024-03-30T13:09:09.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.215+0000 7fdd58e41640 1 -- 172.21.15.83:0/1364814932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd541593e0 msgr2=0x7fdd540cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.215+0000 7fdd58e41640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd541593e0 0x7fdd540cd8b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400eaf0 tx=0x7fdd44001730 comp rx=0 tx=0).stop 2024-03-30T13:09:09.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.215+0000 7fdd58e41640 1 -- 172.21.15.83:0/1364814932 shutdown_connections 2024-03-30T13:09:09.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.215+0000 7fdd58e41640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd34067fc0 0x7fdd3406a480 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.215+0000 7fdd58e41640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd54143110 0x7fdd540b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.215+0000 7fdd58e41640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd5415da10 0x7fdd54142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.215+0000 7fdd58e41640 1 --2- 172.21.15.83:0/1364814932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd541593e0 0x7fdd540cd8b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.215+0000 7fdd58e41640 1 -- 172.21.15.83:0/1364814932 >> 172.21.15.83:0/1364814932 conn(0x7fdd5406b660 msgr2=0x7fdd540b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:09.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.219+0000 7fdd58e41640 1 -- 172.21.15.83:0/1364814932 shutdown_connections 2024-03-30T13:09:09.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.219+0000 7fdd58e41640 1 -- 172.21.15.83:0/1364814932 wait complete. 2024-03-30T13:09:09.237 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-03-30T13:09:09.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:09.238 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-30T13:09:09.268 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:09:09.269 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:09:09.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:09.269 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-30T13:09:09.326 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:09:09.326 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:09:09.332 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:09:09.332 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:09:09.379 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:09.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.539+0000 7f21d5c3a640 1 Processor -- start 2024-03-30T13:09:09.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.539+0000 7f21d5c3a640 1 -- start start 2024-03-30T13:09:09.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.539+0000 7f21d5c3a640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21d015e500 0x7f21d015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.539+0000 7f21d5c3a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00d4240 0x7f21d00d4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.539+0000 7f21d5c3a640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d006c6a0 con 0x7f21d00cee20 2024-03-30T13:09:09.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.539+0000 7f21d5c3a640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f21d00d2340 con 0x7f21d015e500 2024-03-30T13:09:09.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.539+0000 7f21d5c3a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f21d00cfb30 con 0x7f21d00d4240 2024-03-30T13:09:09.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21ceffd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00d4240 0x7f21d00d4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21ceffd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00d4240 0x7f21d00d4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:41270/0 (socket says 172.21.15.83:41270) 2024-03-30T13:09:09.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21ceffd640 1 -- 172.21.15.83:0/718066448 learned_addr learned my addr 172.21.15.83:0/718066448 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:09.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21cf7fe640 1 --2- 172.21.15.83:0/718066448 >> v2:172.21.15.153:3300/0 conn(0x7f21d015e500 0x7f21d015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21cf7fe640 1 -- 172.21.15.83:0/718066448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00d4240 msgr2=0x7f21d00d4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:09.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21cf7fe640 1 --2- 172.21.15.83:0/718066448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00d4240 0x7f21d00d4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21cf7fe640 1 -- 172.21.15.83:0/718066448 >> v1:172.21.15.153:6789/0 conn(0x7f21d00cee20 legacy=0x7f21d00cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21cf7fe640 1 -- 172.21.15.83:0/718066448 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d00cfe10 con 0x7f21d015e500 2024-03-30T13:09:09.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21cf7fe640 1 --2- 172.21.15.83:0/718066448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d015e500 0x7f21d015e8e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f21c40097c0 tx=0x7f21c401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49b90128fb13a312 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:09.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21ce7fc640 1 -- 172.21.15.83:0/718066448 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c40a7070 con 0x7f21d015e500 2024-03-30T13:09:09.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21ce7fc640 1 -- 172.21.15.83:0/718066448 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c40b0070 con 0x7f21d015e500 2024-03-30T13:09:09.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21ce7fc640 1 -- 172.21.15.83:0/718066448 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c40ab890 con 0x7f21d015e500 2024-03-30T13:09:09.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21d5c3a640 1 -- 172.21.15.83:0/718066448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d015e500 msgr2=0x7f21d015e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21d5c3a640 1 --2- 172.21.15.83:0/718066448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d015e500 0x7f21d015e8e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f21c40097c0 tx=0x7f21c401c470 comp rx=0 tx=0).stop 2024-03-30T13:09:09.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21d5c3a640 1 -- 172.21.15.83:0/718066448 shutdown_connections 2024-03-30T13:09:09.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21d5c3a640 1 --2- 172.21.15.83:0/718066448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00d4240 0x7f21d00d4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21d5c3a640 1 --2- 172.21.15.83:0/718066448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d015e500 0x7f21d015e8e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21d5c3a640 1 -- 172.21.15.83:0/718066448 >> 172.21.15.83:0/718066448 conn(0x7f21d008bfe0 msgr2=0x7f21d009d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:09.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21d5c3a640 1 -- 172.21.15.83:0/718066448 shutdown_connections 2024-03-30T13:09:09.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.543+0000 7f21d5c3a640 1 -- 172.21.15.83:0/718066448 wait complete. 2024-03-30T13:09:09.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21d5c3a640 1 Processor -- start 2024-03-30T13:09:09.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21d5c3a640 1 -- start start 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21d5c3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d00cee20 0x7f21d00b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21d5c3a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00d4240 0x7f21d015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21d5c3a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21d015e500 0x7f21d0151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21d5c3a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f21d006d810 con 0x7f21d015e500 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21d5c3a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f21d006d690 con 0x7f21d00cee20 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21d5c3a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f21d006d990 con 0x7f21d00d4240 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21cffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21d015e500 0x7f21d0151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21cffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21d015e500 0x7f21d0151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39070/0 (socket says 172.21.15.83:39070) 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21cffff640 1 -- 172.21.15.83:0/2191413579 learned_addr learned my addr 172.21.15.83:0/2191413579 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21ceffd640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00d4240 0x7f21d015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21cf7fe640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d00cee20 0x7f21d00b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21cffff640 1 -- 172.21.15.83:0/2191413579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00d4240 msgr2=0x7f21d015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21cffff640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00d4240 0x7f21d015cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21cffff640 1 -- 172.21.15.83:0/2191413579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d00cee20 msgr2=0x7f21d00b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21cffff640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d00cee20 0x7f21d00b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21cffff640 1 -- 172.21.15.83:0/2191413579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d0153c30 con 0x7f21d015e500 2024-03-30T13:09:09.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21cffff640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21d015e500 0x7f21d0151c70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c6c0 tx=0x7f21c800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:09.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21b7fff640 1 -- 172.21.15.83:0/2191413579 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8003b80 con 0x7f21d015e500 2024-03-30T13:09:09.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21b7fff640 1 -- 172.21.15.83:0/2191413579 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c8003d20 con 0x7f21d015e500 2024-03-30T13:09:09.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21d5c3a640 1 -- 172.21.15.83:0/2191413579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d01528b0 con 0x7f21d015e500 2024-03-30T13:09:09.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21b7fff640 1 -- 172.21.15.83:0/2191413579 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c80052f0 con 0x7f21d015e500 2024-03-30T13:09:09.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21d5c3a640 1 -- 172.21.15.83:0/2191413579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d0152e70 con 0x7f21d015e500 2024-03-30T13:09:09.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.547+0000 7f21d5c3a640 1 -- 172.21.15.83:0/2191413579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d00686c0 con 0x7f21d015e500 2024-03-30T13:09:09.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.551+0000 7f21b7fff640 1 -- 172.21.15.83:0/2191413579 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f21c8005490 con 0x7f21d015e500 2024-03-30T13:09:09.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.551+0000 7f21b7fff640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f21bc067fc0 0x7f21bc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.551+0000 7f21b7fff640 1 -- 172.21.15.83:0/2191413579 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f21c8086410 con 0x7f21d015e500 2024-03-30T13:09:09.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.551+0000 7f21cf7fe640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f21bc067fc0 0x7f21bc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.551+0000 7f21cf7fe640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f21bc067fc0 0x7f21bc06a480 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f21c40af000 tx=0x7f21c40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:09.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.555+0000 7f21b7fff640 1 -- 172.21.15.83:0/2191413579 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f21d0153c30 con 0x7f21d015e500 2024-03-30T13:09:09.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.715+0000 7f21d5c3a640 1 -- 172.21.15.83:0/2191413579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21d00d28f0 con 0x7f21d015e500 2024-03-30T13:09:09.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.715+0000 7f21b7fff640 1 -- 172.21.15.83:0/2191413579 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16848 (secure 0 0 0) 0x7f21c8056b40 con 0x7f21d015e500 2024-03-30T13:09:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:09.721 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:09:07.416798+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:09.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.719+0000 7f21d5c3a640 1 -- 172.21.15.83:0/2191413579 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f21bc067fc0 msgr2=0x7f21bc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.719+0000 7f21d5c3a640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f21bc067fc0 0x7f21bc06a480 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f21c40af000 tx=0x7f21c40a7000 comp rx=0 tx=0).stop 2024-03-30T13:09:09.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.719+0000 7f21d5c3a640 1 -- 172.21.15.83:0/2191413579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21d015e500 msgr2=0x7f21d0151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.719+0000 7f21d5c3a640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21d015e500 0x7f21d0151c70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c6c0 tx=0x7f21c800cb80 comp rx=0 tx=0).stop 2024-03-30T13:09:09.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.719+0000 7f21d5c3a640 1 -- 172.21.15.83:0/2191413579 shutdown_connections 2024-03-30T13:09:09.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.719+0000 7f21d5c3a640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f21bc067fc0 0x7f21bc06a480 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.719+0000 7f21d5c3a640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21d015e500 0x7f21d0151c70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.719+0000 7f21d5c3a640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00d4240 0x7f21d015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.719+0000 7f21d5c3a640 1 --2- 172.21.15.83:0/2191413579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d00cee20 0x7f21d00b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.719+0000 7f21d5c3a640 1 -- 172.21.15.83:0/2191413579 >> 172.21.15.83:0/2191413579 conn(0x7f21d008bfe0 msgr2=0x7f21d0157bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:09.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.719+0000 7f21d5c3a640 1 -- 172.21.15.83:0/2191413579 shutdown_connections 2024-03-30T13:09:09.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.719+0000 7f21d5c3a640 1 -- 172.21.15.83:0/2191413579 wait complete. 2024-03-30T13:09:09.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:09:09.740 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:09:09.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96ad3d7640 1 Processor -- start 2024-03-30T13:09:09.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96ad3d7640 1 -- start start 2024-03-30T13:09:09.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96ad3d7640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96a80d31e0 0x7f96a80d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96ad3d7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f96a80d1370 0x7f96a806c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96ad3d7640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a80d51f0 con 0x7f96a815e840 2024-03-30T13:09:09.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96ad3d7640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f96a80d17e0 con 0x7f96a80d1370 2024-03-30T13:09:09.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96ad3d7640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f96a815ec20 con 0x7f96a80d31e0 2024-03-30T13:09:09.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96a77fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f96a80d1370 0x7f96a806c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96a6ffd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f96a815e840 0x7f96a80cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59324/0 (socket says 172.21.15.83:59324) 2024-03-30T13:09:09.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96a77fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f96a80d1370 0x7f96a806c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39074/0 (socket says 172.21.15.83:39074) 2024-03-30T13:09:09.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96a6ffd640 1 -- 172.21.15.83:0/1252327955 learned_addr learned my addr 172.21.15.83:0/1252327955 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:09.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96a67fc640 1 --2- 172.21.15.83:0/1252327955 >> v2:172.21.15.153:3300/0 conn(0x7f96a80d31e0 0x7f96a80d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96a77fe640 1 -- 172.21.15.83:0/1252327955 >> v2:172.21.15.153:3300/0 conn(0x7f96a80d31e0 msgr2=0x7f96a80d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:09.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96a77fe640 1 --2- 172.21.15.83:0/1252327955 >> v2:172.21.15.153:3300/0 conn(0x7f96a80d31e0 0x7f96a80d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96a77fe640 1 -- 172.21.15.83:0/1252327955 >> v1:172.21.15.83:6789/0 conn(0x7f96a815e840 legacy=0x7f96a80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.855+0000 7f96a77fe640 1 -- 172.21.15.83:0/1252327955 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a80d2140 con 0x7f96a80d1370 2024-03-30T13:09:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96a77fe640 1 --2- 172.21.15.83:0/1252327955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96a80d1370 0x7f96a806c720 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f96a80d1c00 tx=0x7f969c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d9ac9f344638c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96a5ffb640 1 -- 172.21.15.83:0/1252327955 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0b0070 con 0x7f96a80d1370 2024-03-30T13:09:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96a5ffb640 1 -- 172.21.15.83:0/1252327955 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c0ab600 con 0x7f96a80d1370 2024-03-30T13:09:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96a5ffb640 1 -- 172.21.15.83:0/1252327955 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0ab9d0 con 0x7f96a80d1370 2024-03-30T13:09:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96ad3d7640 1 -- 172.21.15.83:0/1252327955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96a80d1370 msgr2=0x7f96a806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96ad3d7640 1 --2- 172.21.15.83:0/1252327955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96a80d1370 0x7f96a806c720 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f96a80d1c00 tx=0x7f969c01c3f0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96ad3d7640 1 -- 172.21.15.83:0/1252327955 shutdown_connections 2024-03-30T13:09:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96ad3d7640 1 --2- 172.21.15.83:0/1252327955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96a80d1370 0x7f96a806c720 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96ad3d7640 1 --2- 172.21.15.83:0/1252327955 >> v2:172.21.15.153:3300/0 conn(0x7f96a80d31e0 0x7f96a80d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96ad3d7640 1 -- 172.21.15.83:0/1252327955 >> 172.21.15.83:0/1252327955 conn(0x7f96a809d7f0 msgr2=0x7f96a80d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96ad3d7640 1 -- 172.21.15.83:0/1252327955 shutdown_connections 2024-03-30T13:09:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96ad3d7640 1 -- 172.21.15.83:0/1252327955 wait complete. 2024-03-30T13:09:09.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96ad3d7640 1 Processor -- start 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.859+0000 7f96ad3d7640 1 -- start start 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96ad3d7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a80d1370 0x7f96a80c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96ad3d7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a80d31e0 0x7f96a80b8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96ad3d7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96a815e840 0x7f96a815cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96ad3d7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f96a80d04a0 con 0x7f96a815e840 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96ad3d7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f96a80d0320 con 0x7f96a80d31e0 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96ad3d7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f96a816b5f0 con 0x7f96a80d1370 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96a815e840 0x7f96a815cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96a815e840 0x7f96a815cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39084/0 (socket says 172.21.15.83:39084) 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a77fe640 1 -- 172.21.15.83:0/3050310329 learned_addr learned my addr 172.21.15.83:0/3050310329 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a6ffd640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a80d1370 0x7f96a80c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a67fc640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a80d31e0 0x7f96a80b8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a77fe640 1 -- 172.21.15.83:0/3050310329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a80d1370 msgr2=0x7f96a80c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a77fe640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a80d1370 0x7f96a80c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a77fe640 1 -- 172.21.15.83:0/3050310329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a80d31e0 msgr2=0x7f96a80b8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a77fe640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a80d31e0 0x7f96a80b8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a77fe640 1 -- 172.21.15.83:0/3050310329 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a80b9970 con 0x7f96a815e840 2024-03-30T13:09:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a77fe640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96a815e840 0x7f96a815cbe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f969c0ae040 tx=0x7f969c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f968f7fe640 1 -- 172.21.15.83:0/3050310329 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0abe60 con 0x7f96a815e840 2024-03-30T13:09:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f968f7fe640 1 -- 172.21.15.83:0/3050310329 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c0b9070 con 0x7f96a815e840 2024-03-30T13:09:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96ad3d7640 1 -- 172.21.15.83:0/3050310329 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a80b9c50 con 0x7f96a815e840 2024-03-30T13:09:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f968f7fe640 1 -- 172.21.15.83:0/3050310329 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0b0040 con 0x7f96a815e840 2024-03-30T13:09:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96ad3d7640 1 -- 172.21.15.83:0/3050310329 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a80ba210 con 0x7f96a815e840 2024-03-30T13:09:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96ad3d7640 1 -- 172.21.15.83:0/3050310329 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a80a23d0 con 0x7f96a815e840 2024-03-30T13:09:09.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f968f7fe640 1 -- 172.21.15.83:0/3050310329 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f96a806d470 con 0x7f96a815e840 2024-03-30T13:09:09.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f968f7fe640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9694067fc0 0x7f969406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:09.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f968f7fe640 1 -- 172.21.15.83:0/3050310329 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f969c11ffa0 con 0x7f96a815e840 2024-03-30T13:09:09.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a6ffd640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9694067fc0 0x7f969406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:09.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.863+0000 7f96a6ffd640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9694067fc0 0x7f969406a480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f96a0000f70 tx=0x7f96a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:09.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:09.867+0000 7f968f7fe640 1 -- 172.21.15.83:0/3050310329 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f969c016070 con 0x7f96a815e840 2024-03-30T13:09:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.027+0000 7f96ad3d7640 1 -- 172.21.15.83:0/3050310329 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f96a80d1c30 con 0x7f96a815e840 2024-03-30T13:09:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.027+0000 7f968f7fe640 1 -- 172.21.15.83:0/3050310329 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f969c0f06d0 con 0x7f96a815e840 2024-03-30T13:09:10.034 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:09:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.031+0000 7f96ad3d7640 1 -- 172.21.15.83:0/3050310329 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9694067fc0 msgr2=0x7f969406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.031+0000 7f96ad3d7640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9694067fc0 0x7f969406a480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f96a0000f70 tx=0x7f96a0009040 comp rx=0 tx=0).stop 2024-03-30T13:09:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.031+0000 7f96ad3d7640 1 -- 172.21.15.83:0/3050310329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96a815e840 msgr2=0x7f96a815cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.031+0000 7f96ad3d7640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96a815e840 0x7f96a815cbe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f969c0ae040 tx=0x7f969c019190 comp rx=0 tx=0).stop 2024-03-30T13:09:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.031+0000 7f96ad3d7640 1 -- 172.21.15.83:0/3050310329 shutdown_connections 2024-03-30T13:09:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.031+0000 7f96ad3d7640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9694067fc0 0x7f969406a480 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.031+0000 7f96ad3d7640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96a815e840 0x7f96a815cbe0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.031+0000 7f96ad3d7640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96a80d31e0 0x7f96a80b8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.031+0000 7f96ad3d7640 1 --2- 172.21.15.83:0/3050310329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96a80d1370 0x7f96a80c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.031+0000 7f96ad3d7640 1 -- 172.21.15.83:0/3050310329 >> 172.21.15.83:0/3050310329 conn(0x7f96a809d7f0 msgr2=0x7f96a80b5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.031+0000 7f96ad3d7640 1 -- 172.21.15.83:0/3050310329 shutdown_connections 2024-03-30T13:09:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.031+0000 7f96ad3d7640 1 -- 172.21.15.83:0/3050310329 wait complete. 2024-03-30T13:09:10.052 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:09:10.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8259b02640 1 Processor -- start 2024-03-30T13:09:10.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8259b02640 1 -- start start 2024-03-30T13:09:10.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8259b02640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f82540b4680 0x7f825415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8259b02640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f825415d200 0x7f8254165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8259b02640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82540ae040 con 0x7f825415c8e0 2024-03-30T13:09:10.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8259b02640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f82540b31e0 con 0x7f82540b4680 2024-03-30T13:09:10.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8259b02640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f82540ae320 con 0x7f825415d200 2024-03-30T13:09:10.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82537fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f825415c8e0 0x7f82540ad580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59326/0 (socket says 172.21.15.83:59326) 2024-03-30T13:09:10.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82537fe640 1 -- 172.21.15.83:0/2566683960 learned_addr learned my addr 172.21.15.83:0/2566683960 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:10.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8252ffd640 1 --2- 172.21.15.83:0/2566683960 >> v2:172.21.15.153:3300/0 conn(0x7f82540b4680 0x7f825415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8253fff640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f825415d200 0x7f8254165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3809804875 0 0) 0x7f82540ae040 con 0x7f825415c8e0 2024-03-30T13:09:10.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f823c003530 con 0x7f825415c8e0 2024-03-30T13:09:10.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2501522222 0 0) 0x7f823c003530 con 0x7f825415c8e0 2024-03-30T13:09:10.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f825415d200 msgr2=0x7f8254165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:10.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f825415d200 0x7f8254165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 >> v2:172.21.15.153:3300/0 conn(0x7f82540b4680 msgr2=0x7f825415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:10.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 --2- 172.21.15.83:0/2566683960 >> v2:172.21.15.153:3300/0 conn(0x7f82540b4680 0x7f825415ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82540ae600 con 0x7f825415c8e0 2024-03-30T13:09:10.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f8248001680 con 0x7f825415c8e0 2024-03-30T13:09:10.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 >> v1:172.21.15.83:6789/0 conn(0x7f825415c8e0 legacy=0x7f82540ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f823c0039c0 0x7f823c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f825415d200 0x7f823c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f823c004d50 0x7f823c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f82540b31e0 con 0x7f823c004d50 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82540ae320 con 0x7f823c0039c0 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f823c00b9d0 con 0x7f825415d200 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8253fff640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f823c004d50 0x7f823c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82537fe640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f823c0039c0 0x7f823c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8252ffd640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f825415d200 0x7f823c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8253fff640 1 -- 172.21.15.83:0/2566683960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f825415d200 msgr2=0x7f823c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8253fff640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f825415d200 0x7f823c004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8253fff640 1 -- 172.21.15.83:0/2566683960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f823c0039c0 msgr2=0x7f823c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8253fff640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f823c0039c0 0x7f823c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f8253fff640 1 -- 172.21.15.83:0/2566683960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c003530 con 0x7f823c004d50 2024-03-30T13:09:10.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.163+0000 7f82537fe640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f823c0039c0 0x7f823c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:10.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8253fff640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f823c004d50 0x7f823c0051d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f824c00e170 tx=0x7f824c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf84409769743cf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:10.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c0b2070 con 0x7f823c004d50 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824c0a5c70 con 0x7f823c004d50 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f82527fc640 1 -- 172.21.15.83:0/2566683960 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c009c10 con 0x7f823c004d50 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 -- 172.21.15.83:0/2566683960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f823c004d50 msgr2=0x7f823c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 --2- 172.21.15.83:0/2566683960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f823c004d50 0x7f823c0051d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f824c00e170 tx=0x7f824c01cc60 comp rx=0 tx=0).stop 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8253fff640 1 -- 172.21.15.83:0/2566683960 reap_dead start 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 -- 172.21.15.83:0/2566683960 shutdown_connections 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 -- 172.21.15.83:0/2566683960 >> 172.21.15.83:0/2566683960 conn(0x7f825406b660 msgr2=0x7f825406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 -- 172.21.15.83:0/2566683960 shutdown_connections 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 -- 172.21.15.83:0/2566683960 wait complete. 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 Processor -- start 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 -- start start 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82540b37d0 0x7f8254151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82540b3bb0 0x7f82541f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82541f1f40 0x7f8254156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f825415d690 con 0x7f82540b3bb0 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f825406f8e0 con 0x7f82541f1f40 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8259b02640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f82540adc90 con 0x7f82540b37d0 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8252ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82540b3bb0 0x7f82541f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8252ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82540b3bb0 0x7f82541f1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39104/0 (socket says 172.21.15.83:39104) 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8252ffd640 1 -- 172.21.15.83:0/2651162931 learned_addr learned my addr 172.21.15.83:0/2651162931 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f82537fe640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82540b37d0 0x7f8254151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8253fff640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82541f1f40 0x7f8254156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8252ffd640 1 -- 172.21.15.83:0/2651162931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82540b37d0 msgr2=0x7f8254151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8252ffd640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82540b37d0 0x7f8254151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8252ffd640 1 -- 172.21.15.83:0/2651162931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82541f1f40 msgr2=0x7f8254156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8252ffd640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82541f1f40 0x7f8254156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.167+0000 7f8252ffd640 1 -- 172.21.15.83:0/2651162931 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8254157e90 con 0x7f82540b3bb0 2024-03-30T13:09:10.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.171+0000 7f8252ffd640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82540b3bb0 0x7f82541f1a00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8244010900 tx=0x7f8244010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:10.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.171+0000 7f823bfff640 1 -- 172.21.15.83:0/2651162931 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824400f040 con 0x7f82540b3bb0 2024-03-30T13:09:10.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.171+0000 7f823bfff640 1 -- 172.21.15.83:0/2651162931 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824400ec20 con 0x7f82540b3bb0 2024-03-30T13:09:10.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.171+0000 7f8259b02640 1 -- 172.21.15.83:0/2651162931 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82541f23c0 con 0x7f82540b3bb0 2024-03-30T13:09:10.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.171+0000 7f823bfff640 1 -- 172.21.15.83:0/2651162931 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824401c400 con 0x7f82540b3bb0 2024-03-30T13:09:10.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.171+0000 7f8259b02640 1 -- 172.21.15.83:0/2651162931 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82541587f0 con 0x7f82540b3bb0 2024-03-30T13:09:10.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.171+0000 7f8259b02640 1 -- 172.21.15.83:0/2651162931 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f825404f9e0 con 0x7f82540b3bb0 2024-03-30T13:09:10.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.171+0000 7f823bfff640 1 -- 172.21.15.83:0/2651162931 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f824401c5a0 con 0x7f82540b3bb0 2024-03-30T13:09:10.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.171+0000 7f823bfff640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8240067ff0 0x7f824006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.171+0000 7f823bfff640 1 -- 172.21.15.83:0/2651162931 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f8244086d10 con 0x7f82540b3bb0 2024-03-30T13:09:10.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.171+0000 7f82537fe640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8240067ff0 0x7f824006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.171+0000 7f82537fe640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8240067ff0 0x7f824006a4b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82480017f0 tx=0x7f8248009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:10.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.175+0000 7f823bfff640 1 -- 172.21.15.83:0/2651162931 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f82541f23c0 con 0x7f82540b3bb0 2024-03-30T13:09:10.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.323+0000 7f8259b02640 1 -- 172.21.15.83:0/2651162931 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8254151540 con 0x7f82540b3bb0 2024-03-30T13:09:10.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.323+0000 7f823bfff640 1 -- 172.21.15.83:0/2651162931 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f8244018030 con 0x7f82540b3bb0 2024-03-30T13:09:10.329 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:09:10.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.327+0000 7f8259b02640 1 -- 172.21.15.83:0/2651162931 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8240067ff0 msgr2=0x7f824006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.327+0000 7f8259b02640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8240067ff0 0x7f824006a4b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82480017f0 tx=0x7f8248009040 comp rx=0 tx=0).stop 2024-03-30T13:09:10.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.327+0000 7f8259b02640 1 -- 172.21.15.83:0/2651162931 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82540b3bb0 msgr2=0x7f82541f1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.327+0000 7f8259b02640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82540b3bb0 0x7f82541f1a00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8244010900 tx=0x7f8244010dc0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.327+0000 7f8259b02640 1 -- 172.21.15.83:0/2651162931 shutdown_connections 2024-03-30T13:09:10.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.327+0000 7f8259b02640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8240067ff0 0x7f824006a4b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.327+0000 7f8259b02640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82541f1f40 0x7f8254156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.327+0000 7f8259b02640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82540b3bb0 0x7f82541f1a00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.327+0000 7f8259b02640 1 --2- 172.21.15.83:0/2651162931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82540b37d0 0x7f8254151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.327+0000 7f8259b02640 1 -- 172.21.15.83:0/2651162931 >> 172.21.15.83:0/2651162931 conn(0x7f825406b660 msgr2=0x7f825415aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:10.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.327+0000 7f8259b02640 1 -- 172.21.15.83:0/2651162931 shutdown_connections 2024-03-30T13:09:10.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.327+0000 7f8259b02640 1 -- 172.21.15.83:0/2651162931 wait complete. 2024-03-30T13:09:10.346 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:09:10.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f6655173640 1 Processor -- start 2024-03-30T13:09:10.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f6655173640 1 -- start start 2024-03-30T13:09:10.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f6655173640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f665015b050 0x7f6650073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f6655173640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f66500b3ca0 0x7f665006f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f6655173640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f665006f690 0x7f6650071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f6655173640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f665006fad0 con 0x7f665006f690 2024-03-30T13:09:10.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f6655173640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6650073ab0 con 0x7f66500b3ca0 2024-03-30T13:09:10.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f6655173640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f66500b31e0 con 0x7f665015b050 2024-03-30T13:09:10.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f664f59e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f665006f690 0x7f6650071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f664f59e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f665006f690 0x7f6650071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39106/0 (socket says 172.21.15.83:39106) 2024-03-30T13:09:10.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f664f59e640 1 -- 172.21.15.83:0/2539460074 learned_addr learned my addr 172.21.15.83:0/2539460074 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:10.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f664e59c640 1 --2- 172.21.15.83:0/2539460074 >> v2:172.21.15.153:3300/0 conn(0x7f66500b3ca0 0x7f665006f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f664ed9d640 1 --2- 172.21.15.83:0/2539460074 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f665015b050 0x7f6650073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f664f59e640 1 -- 172.21.15.83:0/2539460074 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f665015b050 msgr2=0x7f6650073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:10.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f664f59e640 1 --2- 172.21.15.83:0/2539460074 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f665015b050 0x7f6650073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f664f59e640 1 -- 172.21.15.83:0/2539460074 >> v2:172.21.15.153:3300/0 conn(0x7f66500b3ca0 msgr2=0x7f665006f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:10.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f664f59e640 1 --2- 172.21.15.83:0/2539460074 >> v2:172.21.15.153:3300/0 conn(0x7f66500b3ca0 0x7f665006f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f664f59e640 1 -- 172.21.15.83:0/2539460074 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66500ad4f0 con 0x7f665006f690 2024-03-30T13:09:10.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.463+0000 7f664ed9d640 1 --2- 172.21.15.83:0/2539460074 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f665015b050 0x7f6650073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:10.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f664f59e640 1 --2- 172.21.15.83:0/2539460074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f665006f690 0x7f6650071790 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f665006d7e0 tx=0x7f664801e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5f6f467588a12d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:10.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f664dd9b640 1 -- 172.21.15.83:0/2539460074 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664800b2d0 con 0x7f665006f690 2024-03-30T13:09:10.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f664dd9b640 1 -- 172.21.15.83:0/2539460074 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664800b470 con 0x7f665006f690 2024-03-30T13:09:10.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f664dd9b640 1 -- 172.21.15.83:0/2539460074 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66480a79b0 con 0x7f665006f690 2024-03-30T13:09:10.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f6655173640 1 -- 172.21.15.83:0/2539460074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f665006f690 msgr2=0x7f6650071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f6655173640 1 --2- 172.21.15.83:0/2539460074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f665006f690 0x7f6650071790 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f665006d7e0 tx=0x7f664801e900 comp rx=0 tx=0).stop 2024-03-30T13:09:10.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f6655173640 1 -- 172.21.15.83:0/2539460074 shutdown_connections 2024-03-30T13:09:10.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f6655173640 1 --2- 172.21.15.83:0/2539460074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f665006f690 0x7f6650071790 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f6655173640 1 --2- 172.21.15.83:0/2539460074 >> v2:172.21.15.153:3300/0 conn(0x7f66500b3ca0 0x7f665006f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f6655173640 1 --2- 172.21.15.83:0/2539460074 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f665015b050 0x7f6650073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f6655173640 1 -- 172.21.15.83:0/2539460074 >> 172.21.15.83:0/2539460074 conn(0x7f665006b660 msgr2=0x7f665006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:10.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f6655173640 1 -- 172.21.15.83:0/2539460074 shutdown_connections 2024-03-30T13:09:10.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f6655173640 1 -- 172.21.15.83:0/2539460074 wait complete. 2024-03-30T13:09:10.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f6655173640 1 Processor -- start 2024-03-30T13:09:10.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.467+0000 7f6655173640 1 -- start start 2024-03-30T13:09:10.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f6655173640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f665006f690 0x7f66501f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f6655173640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66500b3ca0 0x7f665014b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f6655173640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f665015b050 0x7f66501630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f6655173640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f66500b4c10 con 0x7f665015b050 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f6655173640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66500ad1c0 con 0x7f665006f690 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f6655173640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f66500b4d90 con 0x7f66500b3ca0 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664f59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f665015b050 0x7f66501630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664f59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f665015b050 0x7f66501630f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39114/0 (socket says 172.21.15.83:39114) 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664f59e640 1 -- 172.21.15.83:0/176336517 learned_addr learned my addr 172.21.15.83:0/176336517 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664ed9d640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f665006f690 0x7f66501f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664e59c640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66500b3ca0 0x7f665014b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664f59e640 1 -- 172.21.15.83:0/176336517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66500b3ca0 msgr2=0x7f665014b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664f59e640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66500b3ca0 0x7f665014b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664f59e640 1 -- 172.21.15.83:0/176336517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f665006f690 msgr2=0x7f66501f7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664f59e640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f665006f690 0x7f66501f7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664f59e640 1 -- 172.21.15.83:0/176336517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665014b5b0 con 0x7f665015b050 2024-03-30T13:09:10.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664f59e640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f665015b050 0x7f66501630f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f66480b1040 tx=0x7f664801b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:10.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f66377fe640 1 -- 172.21.15.83:0/176336517 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664800b720 con 0x7f665015b050 2024-03-30T13:09:10.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f66377fe640 1 -- 172.21.15.83:0/176336517 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66480be070 con 0x7f665015b050 2024-03-30T13:09:10.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f6655173640 1 -- 172.21.15.83:0/176336517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6650163630 con 0x7f665015b050 2024-03-30T13:09:10.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f66377fe640 1 -- 172.21.15.83:0/176336517 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648009a40 con 0x7f665015b050 2024-03-30T13:09:10.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f6655173640 1 -- 172.21.15.83:0/176336517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6650163be0 con 0x7f665015b050 2024-03-30T13:09:10.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f6655173640 1 -- 172.21.15.83:0/176336517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f665009e540 con 0x7f665015b050 2024-03-30T13:09:10.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f66377fe640 1 -- 172.21.15.83:0/176336517 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f66480b6070 con 0x7f665015b050 2024-03-30T13:09:10.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f66377fe640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f663c067fc0 0x7f663c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f66377fe640 1 -- 172.21.15.83:0/176336517 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f6648121320 con 0x7f665015b050 2024-03-30T13:09:10.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664ed9d640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f663c067fc0 0x7f663c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.471+0000 7f664ed9d640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f663c067fc0 0x7f663c06a480 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6644006fd0 tx=0x7f6644008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:10.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.475+0000 7f66377fe640 1 -- 172.21.15.83:0/176336517 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f66480187e0 con 0x7f665015b050 2024-03-30T13:09:10.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.635+0000 7f6655173640 1 -- 172.21.15.83:0/176336517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f665004f9e0 con 0x7f665015b050 2024-03-30T13:09:10.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.635+0000 7f66377fe640 1 -- 172.21.15.83:0/176336517 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f66480f1cc0 con 0x7f665015b050 2024-03-30T13:09:10.641 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:09:10.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.639+0000 7f6655173640 1 -- 172.21.15.83:0/176336517 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f663c067fc0 msgr2=0x7f663c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.639+0000 7f6655173640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f663c067fc0 0x7f663c06a480 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6644006fd0 tx=0x7f6644008040 comp rx=0 tx=0).stop 2024-03-30T13:09:10.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.639+0000 7f6655173640 1 -- 172.21.15.83:0/176336517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f665015b050 msgr2=0x7f66501630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.639+0000 7f6655173640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f665015b050 0x7f66501630f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f66480b1040 tx=0x7f664801b6a0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.639+0000 7f6655173640 1 -- 172.21.15.83:0/176336517 shutdown_connections 2024-03-30T13:09:10.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.639+0000 7f6655173640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f663c067fc0 0x7f663c06a480 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.639+0000 7f6655173640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f665015b050 0x7f66501630f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.639+0000 7f6655173640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66500b3ca0 0x7f665014b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.639+0000 7f6655173640 1 --2- 172.21.15.83:0/176336517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f665006f690 0x7f66501f7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.639+0000 7f6655173640 1 -- 172.21.15.83:0/176336517 >> 172.21.15.83:0/176336517 conn(0x7f665006b660 msgr2=0x7f665015a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:10.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.639+0000 7f6655173640 1 -- 172.21.15.83:0/176336517 shutdown_connections 2024-03-30T13:09:10.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.639+0000 7f6655173640 1 -- 172.21.15.83:0/176336517 wait complete. 2024-03-30T13:09:10.660 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:09:10.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a9996d640 1 Processor -- start 2024-03-30T13:09:10.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a9996d640 1 -- start start 2024-03-30T13:09:10.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a9996d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5a9415c8e0 0x7f5a940ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a9996d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5a940b4680 0x7f5a94165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a9996d640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a940ae040 con 0x7f5a940adac0 2024-03-30T13:09:10.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a9996d640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f5a940b31e0 con 0x7f5a9415c8e0 2024-03-30T13:09:10.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a9996d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5a940ae320 con 0x7f5a940b4680 2024-03-30T13:09:10.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a92ffd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5a9415c8e0 0x7f5a940ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a927fc640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f5a940adac0 0x7f5a9415ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59338/0 (socket says 172.21.15.83:59338) 2024-03-30T13:09:10.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a927fc640 1 -- 172.21.15.83:0/1793741649 learned_addr learned my addr 172.21.15.83:0/1793741649 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:10.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a937fe640 1 --2- 172.21.15.83:0/1793741649 >> v2:172.21.15.153:3300/0 conn(0x7f5a940b4680 0x7f5a94165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a91ffb640 1 -- 172.21.15.83:0/1793741649 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2480087408 0 0) 0x7f5a940ae040 con 0x7f5a940adac0 2024-03-30T13:09:10.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a91ffb640 1 -- 172.21.15.83:0/1793741649 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a7c003530 con 0x7f5a940adac0 2024-03-30T13:09:10.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a92ffd640 1 -- 172.21.15.83:0/1793741649 >> v2:172.21.15.153:3300/0 conn(0x7f5a940b4680 msgr2=0x7f5a94165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:10.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a92ffd640 1 --2- 172.21.15.83:0/1793741649 >> v2:172.21.15.153:3300/0 conn(0x7f5a940b4680 0x7f5a94165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a91ffb640 1 -- 172.21.15.83:0/1793741649 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1044762711 0 0) 0x7f5a7c003530 con 0x7f5a940adac0 2024-03-30T13:09:10.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a92ffd640 1 -- 172.21.15.83:0/1793741649 >> v1:172.21.15.83:6789/0 conn(0x7f5a940adac0 legacy=0x7f5a9415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.775+0000 7f5a92ffd640 1 -- 172.21.15.83:0/1793741649 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a940ae600 con 0x7f5a9415c8e0 2024-03-30T13:09:10.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a92ffd640 1 --2- 172.21.15.83:0/1793741649 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a9415c8e0 0x7f5a940ad580 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5a94073a30 tx=0x7f5a8401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b26027b0c436f1e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:10.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a91ffb640 1 -- 172.21.15.83:0/1793741649 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a840b0070 con 0x7f5a9415c8e0 2024-03-30T13:09:10.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a91ffb640 1 -- 172.21.15.83:0/1793741649 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a840ab400 con 0x7f5a9415c8e0 2024-03-30T13:09:10.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a91ffb640 1 -- 172.21.15.83:0/1793741649 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a88001680 con 0x7f5a9415c8e0 2024-03-30T13:09:10.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a9996d640 1 -- 172.21.15.83:0/1793741649 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a9415c8e0 msgr2=0x7f5a940ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a9996d640 1 --2- 172.21.15.83:0/1793741649 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a9415c8e0 0x7f5a940ad580 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5a94073a30 tx=0x7f5a8401c3a0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a9996d640 1 -- 172.21.15.83:0/1793741649 shutdown_connections 2024-03-30T13:09:10.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a9996d640 1 --2- 172.21.15.83:0/1793741649 >> v2:172.21.15.153:3300/0 conn(0x7f5a940b4680 0x7f5a94165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a9996d640 1 --2- 172.21.15.83:0/1793741649 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a9415c8e0 0x7f5a940ad580 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a9996d640 1 -- 172.21.15.83:0/1793741649 >> 172.21.15.83:0/1793741649 conn(0x7f5a9406b660 msgr2=0x7f5a9406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:10.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a9996d640 1 -- 172.21.15.83:0/1793741649 shutdown_connections 2024-03-30T13:09:10.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a9996d640 1 -- 172.21.15.83:0/1793741649 wait complete. 2024-03-30T13:09:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a9996d640 1 Processor -- start 2024-03-30T13:09:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.779+0000 7f5a9996d640 1 -- start start 2024-03-30T13:09:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a9996d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a940adac0 0x7f5a94099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a9996d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a940b4680 0x7f5a941513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a9996d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a9415c8e0 0x7f5a940b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a9996d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5a94168f80 con 0x7f5a940adac0 2024-03-30T13:09:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a9996d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5a94168e00 con 0x7f5a940b4680 2024-03-30T13:09:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a9996d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5a94169100 con 0x7f5a9415c8e0 2024-03-30T13:09:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a92ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a940adac0 0x7f5a94099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a92ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a940adac0 0x7f5a94099a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39128/0 (socket says 172.21.15.83:39128) 2024-03-30T13:09:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a92ffd640 1 -- 172.21.15.83:0/2777158864 learned_addr learned my addr 172.21.15.83:0/2777158864 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a927fc640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a940b4680 0x7f5a941513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a937fe640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a9415c8e0 0x7f5a940b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a92ffd640 1 -- 172.21.15.83:0/2777158864 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a9415c8e0 msgr2=0x7f5a940b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a92ffd640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a9415c8e0 0x7f5a940b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a92ffd640 1 -- 172.21.15.83:0/2777158864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a940b4680 msgr2=0x7f5a941513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a92ffd640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a940b4680 0x7f5a941513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a92ffd640 1 -- 172.21.15.83:0/2777158864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a940b2b10 con 0x7f5a940adac0 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a927fc640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a940b4680 0x7f5a941513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a92ffd640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a940adac0 0x7f5a94099a20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5a840ae040 tx=0x7f5a8401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a7bfff640 1 -- 172.21.15.83:0/2777158864 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a840b0050 con 0x7f5a940adac0 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a7bfff640 1 -- 172.21.15.83:0/2777158864 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a840bc070 con 0x7f5a940adac0 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a9996d640 1 -- 172.21.15.83:0/2777158864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a94157ef0 con 0x7f5a940adac0 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a7bfff640 1 -- 172.21.15.83:0/2777158864 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a840b7870 con 0x7f5a940adac0 2024-03-30T13:09:10.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a9996d640 1 -- 172.21.15.83:0/2777158864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a941584b0 con 0x7f5a940adac0 2024-03-30T13:09:10.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a9996d640 1 -- 172.21.15.83:0/2777158864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a9415b1d0 con 0x7f5a940adac0 2024-03-30T13:09:10.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a7bfff640 1 -- 172.21.15.83:0/2777158864 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5a840b7a10 con 0x7f5a940adac0 2024-03-30T13:09:10.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a7bfff640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5a80067fc0 0x7f5a8006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:10.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a7bfff640 1 -- 172.21.15.83:0/2777158864 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f5a84120cf0 con 0x7f5a940adac0 2024-03-30T13:09:10.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a927fc640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5a80067fc0 0x7f5a8006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:10.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.783+0000 7f5a927fc640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5a80067fc0 0x7f5a8006a480 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a88001ec0 tx=0x7f5a88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.787+0000 7f5a7bfff640 1 -- 172.21.15.83:0/2777158864 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5a84125070 con 0x7f5a940adac0 2024-03-30T13:09:10.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 -- 172.21.15.83:0/2777158864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5a9404f9e0 con 0x7f5a940adac0 2024-03-30T13:09:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a7bfff640 1 -- 172.21.15.83:0/2777158864 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f5a84015f90 con 0x7f5a940adac0 2024-03-30T13:09:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-03-30T13:09:10.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 -- 172.21.15.83:0/2777158864 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5a80067fc0 msgr2=0x7f5a8006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5a80067fc0 0x7f5a8006a480 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a88001ec0 tx=0x7f5a88009040 comp rx=0 tx=0).stop 2024-03-30T13:09:10.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 -- 172.21.15.83:0/2777158864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a940adac0 msgr2=0x7f5a94099a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a940adac0 0x7f5a94099a20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5a840ae040 tx=0x7f5a8401abe0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 -- 172.21.15.83:0/2777158864 shutdown_connections 2024-03-30T13:09:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5a80067fc0 0x7f5a8006a480 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a9415c8e0 0x7f5a940b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a940b4680 0x7f5a941513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 --2- 172.21.15.83:0/2777158864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a940adac0 0x7f5a94099a20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 -- 172.21.15.83:0/2777158864 >> 172.21.15.83:0/2777158864 conn(0x7f5a9406b660 msgr2=0x7f5a94155ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 -- 172.21.15.83:0/2777158864 shutdown_connections 2024-03-30T13:09:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:10.947+0000 7f5a9996d640 1 -- 172.21.15.83:0/2777158864 wait complete. 2024-03-30T13:09:10.968 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:09:10.968 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:09:10.974 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61ae0c6640 1 Processor -- start 2024-03-30T13:09:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61ae0c6640 1 -- start start 2024-03-30T13:09:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61ae0c6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61a80730e0 0x7f61a815b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61ae0c6640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f61a80b4bb0 0x7f61a815f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61ae0c6640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a80734c0 con 0x7f61a806f140 2024-03-30T13:09:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61ae0c6640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f61a815c2a0 con 0x7f61a80b4bb0 2024-03-30T13:09:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61ae0c6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f61a815c580 con 0x7f61a80730e0 2024-03-30T13:09:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61a6ffd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f61a80b4bb0 0x7f61a815f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61a6ffd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f61a80b4bb0 0x7f61a815f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39138/0 (socket says 172.21.15.83:39138) 2024-03-30T13:09:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61a6ffd640 1 -- 172.21.15.83:0/316694729 learned_addr learned my addr 172.21.15.83:0/316694729 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61a77fe640 1 --2- 172.21.15.83:0/316694729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61a80730e0 0x7f61a815b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61a6ffd640 1 -- 172.21.15.83:0/316694729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61a80730e0 msgr2=0x7f61a815b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61a6ffd640 1 --2- 172.21.15.83:0/316694729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61a80730e0 0x7f61a815b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61a6ffd640 1 -- 172.21.15.83:0/316694729 >> v1:172.21.15.153:6789/0 conn(0x7f61a806f140 legacy=0x7f61a80b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.131+0000 7f61a6ffd640 1 -- 172.21.15.83:0/316694729 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a815c860 con 0x7f61a80b4bb0 2024-03-30T13:09:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61a6ffd640 1 --2- 172.21.15.83:0/316694729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61a80b4bb0 0x7f61a815f7c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f619c009870 tx=0x7f619c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edaf510ceb2adab3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61a67fc640 1 -- 172.21.15.83:0/316694729 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c0ab640 con 0x7f61a80b4bb0 2024-03-30T13:09:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61a67fc640 1 -- 172.21.15.83:0/316694729 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f619c0b0070 con 0x7f61a80b4bb0 2024-03-30T13:09:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61a67fc640 1 -- 172.21.15.83:0/316694729 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c0aba00 con 0x7f61a80b4bb0 2024-03-30T13:09:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61ae0c6640 1 -- 172.21.15.83:0/316694729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61a80b4bb0 msgr2=0x7f61a815f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61ae0c6640 1 --2- 172.21.15.83:0/316694729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61a80b4bb0 0x7f61a815f7c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f619c009870 tx=0x7f619c01c530 comp rx=0 tx=0).stop 2024-03-30T13:09:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61ae0c6640 1 -- 172.21.15.83:0/316694729 shutdown_connections 2024-03-30T13:09:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61ae0c6640 1 --2- 172.21.15.83:0/316694729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61a80b4bb0 0x7f61a815f7c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61ae0c6640 1 --2- 172.21.15.83:0/316694729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61a80730e0 0x7f61a815b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61ae0c6640 1 -- 172.21.15.83:0/316694729 >> 172.21.15.83:0/316694729 conn(0x7f61a80b1d60 msgr2=0x7f61a80b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61ae0c6640 1 -- 172.21.15.83:0/316694729 shutdown_connections 2024-03-30T13:09:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61ae0c6640 1 -- 172.21.15.83:0/316694729 wait complete. 2024-03-30T13:09:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61ae0c6640 1 Processor -- start 2024-03-30T13:09:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.135+0000 7f61ae0c6640 1 -- start start 2024-03-30T13:09:11.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61ae0c6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61a806f140 0x7f61a806e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61ae0c6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61a80730e0 0x7f61a814f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61ae0c6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61a80b4bb0 0x7f61a814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61ae0c6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f61a815c010 con 0x7f61a806f140 2024-03-30T13:09:11.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61ae0c6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f61a815be90 con 0x7f61a80730e0 2024-03-30T13:09:11.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61ae0c6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f61a815fd00 con 0x7f61a80b4bb0 2024-03-30T13:09:11.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61a806f140 0x7f61a806e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61a806f140 0x7f61a806e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39140/0 (socket says 172.21.15.83:39140) 2024-03-30T13:09:11.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a77fe640 1 -- 172.21.15.83:0/2646350745 learned_addr learned my addr 172.21.15.83:0/2646350745 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a6ffd640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61a80730e0 0x7f61a814f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a7fff640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61a80b4bb0 0x7f61a814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a77fe640 1 -- 172.21.15.83:0/2646350745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61a80b4bb0 msgr2=0x7f61a814f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a77fe640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61a80b4bb0 0x7f61a814f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a77fe640 1 -- 172.21.15.83:0/2646350745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61a80730e0 msgr2=0x7f61a814f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a77fe640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61a80730e0 0x7f61a814f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a77fe640 1 -- 172.21.15.83:0/2646350745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a81512f0 con 0x7f61a806f140 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a7fff640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61a80b4bb0 0x7f61a814f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a77fe640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61a806f140 0x7f61a806e290 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f619800e930 tx=0x7f619800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f618ffff640 1 -- 172.21.15.83:0/2646350745 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6198017070 con 0x7f61a806f140 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f618ffff640 1 -- 172.21.15.83:0/2646350745 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f619800ca00 con 0x7f61a806f140 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61ae0c6640 1 -- 172.21.15.83:0/2646350745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a81515d0 con 0x7f61a806f140 2024-03-30T13:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f618ffff640 1 -- 172.21.15.83:0/2646350745 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619800cdb0 con 0x7f61a806f140 2024-03-30T13:09:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61ae0c6640 1 -- 172.21.15.83:0/2646350745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a8151b90 con 0x7f61a806f140 2024-03-30T13:09:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61ae0c6640 1 -- 172.21.15.83:0/2646350745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a80686c0 con 0x7f61a806f140 2024-03-30T13:09:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f618ffff640 1 -- 172.21.15.83:0/2646350745 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f619801a070 con 0x7f61a806f140 2024-03-30T13:09:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f618ffff640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6194067fc0 0x7f619406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f618ffff640 1 -- 172.21.15.83:0/2646350745 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f6198086d40 con 0x7f61a806f140 2024-03-30T13:09:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a6ffd640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6194067fc0 0x7f619406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.139+0000 7f61a6ffd640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6194067fc0 0x7f619406a480 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f619c0af000 tx=0x7f619c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:11.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.143+0000 7f618ffff640 1 -- 172.21.15.83:0/2646350745 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6198057610 con 0x7f61a806f140 2024-03-30T13:09:11.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.303+0000 7f61ae0c6640 1 -- 172.21.15.83:0/2646350745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61a806da70 con 0x7f61a806f140 2024-03-30T13:09:11.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.307+0000 7f618ffff640 1 -- 172.21.15.83:0/2646350745 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16848 (secure 0 0 0) 0x7f6198056f10 con 0x7f61a806f140 2024-03-30T13:09:11.311 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:11.312 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:09:07.416798+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:11.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.307+0000 7f61ae0c6640 1 -- 172.21.15.83:0/2646350745 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6194067fc0 msgr2=0x7f619406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.307+0000 7f61ae0c6640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6194067fc0 0x7f619406a480 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f619c0af000 tx=0x7f619c0a7000 comp rx=0 tx=0).stop 2024-03-30T13:09:11.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.307+0000 7f61ae0c6640 1 -- 172.21.15.83:0/2646350745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61a806f140 msgr2=0x7f61a806e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.307+0000 7f61ae0c6640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61a806f140 0x7f61a806e290 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f619800e930 tx=0x7f619800edf0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.307+0000 7f61ae0c6640 1 -- 172.21.15.83:0/2646350745 shutdown_connections 2024-03-30T13:09:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.307+0000 7f61ae0c6640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6194067fc0 0x7f619406a480 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.307+0000 7f61ae0c6640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61a80b4bb0 0x7f61a814f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.307+0000 7f61ae0c6640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61a80730e0 0x7f61a814f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.307+0000 7f61ae0c6640 1 --2- 172.21.15.83:0/2646350745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61a806f140 0x7f61a806e290 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.311+0000 7f61ae0c6640 1 -- 172.21.15.83:0/2646350745 >> 172.21.15.83:0/2646350745 conn(0x7f61a80b1d60 msgr2=0x7f61a80b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.311+0000 7f61ae0c6640 1 -- 172.21.15.83:0/2646350745 shutdown_connections 2024-03-30T13:09:11.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.311+0000 7f61ae0c6640 1 -- 172.21.15.83:0/2646350745 wait complete. 2024-03-30T13:09:11.331 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:09:11.331 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:09:11.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facbdbe7640 1 Processor -- start 2024-03-30T13:09:11.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facbdbe7640 1 -- start start 2024-03-30T13:09:11.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facbdbe7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facb815b050 0x7facb8073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facbdbe7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7facb806f860 0x7facb815b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facbdbe7640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb80b31e0 con 0x7facb80b3ca0 2024-03-30T13:09:11.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facbdbe7640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7facb8073ab0 con 0x7facb806f860 2024-03-30T13:09:11.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facbdbe7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7facb80ad4f0 con 0x7facb815b050 2024-03-30T13:09:11.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facb7fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7facb806f860 0x7facb815b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facb7fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7facb806f860 0x7facb815b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39152/0 (socket says 172.21.15.83:39152) 2024-03-30T13:09:11.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facb7fff640 1 -- 172.21.15.83:0/568758802 learned_addr learned my addr 172.21.15.83:0/568758802 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:11.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facb77fe640 1 --2- 172.21.15.83:0/568758802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facb815b050 0x7facb8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facb7fff640 1 -- 172.21.15.83:0/568758802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facb815b050 msgr2=0x7facb8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:11.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facb7fff640 1 --2- 172.21.15.83:0/568758802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facb815b050 0x7facb8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facb7fff640 1 -- 172.21.15.83:0/568758802 >> v1:172.21.15.153:6789/0 conn(0x7facb80b3ca0 legacy=0x7facb806f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.451+0000 7facb7fff640 1 -- 172.21.15.83:0/568758802 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb80ad7d0 con 0x7facb806f860 2024-03-30T13:09:11.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb7fff640 1 --2- 172.21.15.83:0/568758802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb806f860 0x7facb815b430 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7facb0009e50 tx=0x7facb001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a54d687064d74af server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:11.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb67fc640 1 -- 172.21.15.83:0/568758802 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb00a58d0 con 0x7facb806f860 2024-03-30T13:09:11.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb67fc640 1 -- 172.21.15.83:0/568758802 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb00a5a70 con 0x7facb806f860 2024-03-30T13:09:11.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb67fc640 1 -- 172.21.15.83:0/568758802 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb00a5e40 con 0x7facb806f860 2024-03-30T13:09:11.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 -- 172.21.15.83:0/568758802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb806f860 msgr2=0x7facb815b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 --2- 172.21.15.83:0/568758802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb806f860 0x7facb815b430 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7facb0009e50 tx=0x7facb001ca00 comp rx=0 tx=0).stop 2024-03-30T13:09:11.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 -- 172.21.15.83:0/568758802 shutdown_connections 2024-03-30T13:09:11.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 --2- 172.21.15.83:0/568758802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb806f860 0x7facb815b430 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 --2- 172.21.15.83:0/568758802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facb815b050 0x7facb8073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 -- 172.21.15.83:0/568758802 >> 172.21.15.83:0/568758802 conn(0x7facb806b660 msgr2=0x7facb806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:11.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 -- 172.21.15.83:0/568758802 shutdown_connections 2024-03-30T13:09:11.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 -- 172.21.15.83:0/568758802 wait complete. 2024-03-30T13:09:11.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 Processor -- start 2024-03-30T13:09:11.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 -- start start 2024-03-30T13:09:11.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb806f860 0x7facb81503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb80b3ca0 0x7facb809b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facb815b050 0x7facb815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7facb80b4d90 con 0x7facb80b3ca0 2024-03-30T13:09:11.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7facb80b4c10 con 0x7facb806f860 2024-03-30T13:09:11.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7facb80b4080 con 0x7facb815b050 2024-03-30T13:09:11.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb80b3ca0 0x7facb809b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb80b3ca0 0x7facb809b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39158/0 (socket says 172.21.15.83:39158) 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb6ffd640 1 -- 172.21.15.83:0/2272992257 learned_addr learned my addr 172.21.15.83:0/2272992257 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb77fe640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb806f860 0x7facb81503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb7fff640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facb815b050 0x7facb815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb6ffd640 1 -- 172.21.15.83:0/2272992257 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facb815b050 msgr2=0x7facb815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb6ffd640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facb815b050 0x7facb815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb6ffd640 1 -- 172.21.15.83:0/2272992257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb806f860 msgr2=0x7facb81503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb6ffd640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb806f860 0x7facb81503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb6ffd640 1 -- 172.21.15.83:0/2272992257 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb8151bb0 con 0x7facb80b3ca0 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb77fe640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb806f860 0x7facb81503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facb6ffd640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb80b3ca0 0x7facb809b9b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7facac00c420 tx=0x7facac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7fac9ffff640 1 -- 172.21.15.83:0/2272992257 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac0052d0 con 0x7facb80b3ca0 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7fac9ffff640 1 -- 172.21.15.83:0/2272992257 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac005470 con 0x7facb80b3ca0 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.455+0000 7facbdbe7640 1 -- 172.21.15.83:0/2272992257 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb8151e90 con 0x7facb80b3ca0 2024-03-30T13:09:11.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.459+0000 7fac9ffff640 1 -- 172.21.15.83:0/2272992257 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac007260 con 0x7facb80b3ca0 2024-03-30T13:09:11.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.459+0000 7facbdbe7640 1 -- 172.21.15.83:0/2272992257 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb809bef0 con 0x7facb80b3ca0 2024-03-30T13:09:11.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.459+0000 7facbdbe7640 1 -- 172.21.15.83:0/2272992257 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb809e540 con 0x7facb80b3ca0 2024-03-30T13:09:11.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.459+0000 7fac9ffff640 1 -- 172.21.15.83:0/2272992257 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7facac007400 con 0x7facb80b3ca0 2024-03-30T13:09:11.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.459+0000 7fac9ffff640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faca4067ff0 0x7faca406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.459+0000 7fac9ffff640 1 -- 172.21.15.83:0/2272992257 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7facac085a70 con 0x7facb80b3ca0 2024-03-30T13:09:11.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.459+0000 7facb77fe640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faca4067ff0 0x7faca406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.459+0000 7facb77fe640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faca4067ff0 0x7faca406a4b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faca800b9f0 tx=0x7faca8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:11.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.463+0000 7fac9ffff640 1 -- 172.21.15.83:0/2272992257 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7facac0561a0 con 0x7facb80b3ca0 2024-03-30T13:09:11.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.623+0000 7facbdbe7640 1 -- 172.21.15.83:0/2272992257 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7facb80008e0 con 0x7facb80b3ca0 2024-03-30T13:09:11.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.623+0000 7fac9ffff640 1 -- 172.21.15.83:0/2272992257 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7facac055aa0 con 0x7facb80b3ca0 2024-03-30T13:09:11.628 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:09:11.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.627+0000 7facbdbe7640 1 -- 172.21.15.83:0/2272992257 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faca4067ff0 msgr2=0x7faca406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.627+0000 7facbdbe7640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faca4067ff0 0x7faca406a4b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faca800b9f0 tx=0x7faca8008040 comp rx=0 tx=0).stop 2024-03-30T13:09:11.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.627+0000 7facbdbe7640 1 -- 172.21.15.83:0/2272992257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb80b3ca0 msgr2=0x7facb809b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.627+0000 7facbdbe7640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb80b3ca0 0x7facb809b9b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7facac00c420 tx=0x7facac00c8e0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.627+0000 7facbdbe7640 1 -- 172.21.15.83:0/2272992257 shutdown_connections 2024-03-30T13:09:11.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.627+0000 7facbdbe7640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faca4067ff0 0x7faca406a4b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.627+0000 7facbdbe7640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7facb815b050 0x7facb815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.627+0000 7facbdbe7640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb80b3ca0 0x7facb809b9b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.627+0000 7facbdbe7640 1 --2- 172.21.15.83:0/2272992257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb806f860 0x7facb81503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.627+0000 7facbdbe7640 1 -- 172.21.15.83:0/2272992257 >> 172.21.15.83:0/2272992257 conn(0x7facb806b660 msgr2=0x7facb806ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:11.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.627+0000 7facbdbe7640 1 -- 172.21.15.83:0/2272992257 shutdown_connections 2024-03-30T13:09:11.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.627+0000 7facbdbe7640 1 -- 172.21.15.83:0/2272992257 wait complete. 2024-03-30T13:09:11.648 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:09:11.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb8e99640 1 Processor -- start 2024-03-30T13:09:11.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb8e99640 1 -- start start 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb8e99640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fccb40b4680 0x7fccb415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb8e99640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb415d200 0x7fccb4165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb8e99640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb40ae040 con 0x7fccb415c8e0 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb8e99640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fccb40b31e0 con 0x7fccb40b4680 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb8e99640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fccb40ae320 con 0x7fccb415d200 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb259c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fccb415c8e0 0x7fccb40ad580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59348/0 (socket says 172.21.15.83:59348) 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb259c640 1 -- 172.21.15.83:0/725523341 learned_addr learned my addr 172.21.15.83:0/725523341 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fcca9d9b640 1 --2- 172.21.15.83:0/725523341 >> v2:172.21.15.153:3300/0 conn(0x7fccb40b4680 0x7fccb415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb2d9d640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb415d200 0x7fccb4165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743619417 0 0) 0x7fccb40ae040 con 0x7fccb415c8e0 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcca0003530 con 0x7fccb415c8e0 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2227071266 0 0) 0x7fcca0003530 con 0x7fccb415c8e0 2024-03-30T13:09:11.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb415d200 msgr2=0x7fccb4165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb1d9b640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb415d200 0x7fccb4165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 >> v2:172.21.15.153:3300/0 conn(0x7fccb40b4680 msgr2=0x7fccb415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb1d9b640 1 --2- 172.21.15.83:0/725523341 >> v2:172.21.15.153:3300/0 conn(0x7fccb40b4680 0x7fccb415ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb40ae600 con 0x7fccb415c8e0 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fcca9d9b640 1 --2- 172.21.15.83:0/725523341 >> v2:172.21.15.153:3300/0 conn(0x7fccb40b4680 0x7fccb415ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fcc9c001680 con 0x7fccb415c8e0 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 >> v1:172.21.15.83:6789/0 conn(0x7fccb415c8e0 legacy=0x7fccb40ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.759+0000 7fccb1d9b640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb415d200 0x7fcca00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb1d9b640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcca0003f40 0x7fcca0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb1d9b640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca0004d50 0x7fcca00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fccb40b31e0 con 0x7fcca0003f40 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fccb40ae320 con 0x7fcca0004d50 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcca000b9d0 con 0x7fccb415d200 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fcca9d9b640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcca0003f40 0x7fcca0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb259c640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb415d200 0x7fcca00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb2d9d640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca0004d50 0x7fcca00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fcca9d9b640 1 -- 172.21.15.83:0/725523341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb415d200 msgr2=0x7fcca00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:11.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fcca9d9b640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fccb415d200 0x7fcca00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fcca9d9b640 1 -- 172.21.15.83:0/725523341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca0004d50 msgr2=0x7fcca00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:11.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fcca9d9b640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca0004d50 0x7fcca00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fcca9d9b640 1 -- 172.21.15.83:0/725523341 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca0003530 con 0x7fcca0003f40 2024-03-30T13:09:11.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb2d9d640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca0004d50 0x7fcca00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:11.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fcca9d9b640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcca0003f40 0x7fcca0004810 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009cb0 tx=0x7fcca401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30414d515d71c2db server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:11.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40b2070 con 0x7fcca0003f40 2024-03-30T13:09:11.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca40a5840 con 0x7fcca0003f40 2024-03-30T13:09:11.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb1d9b640 1 -- 172.21.15.83:0/725523341 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4009880 con 0x7fcca0003f40 2024-03-30T13:09:11.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb8e99640 1 -- 172.21.15.83:0/725523341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcca0003f40 msgr2=0x7fcca0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb8e99640 1 --2- 172.21.15.83:0/725523341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcca0003f40 0x7fcca0004810 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009cb0 tx=0x7fcca401cc30 comp rx=0 tx=0).stop 2024-03-30T13:09:11.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb2d9d640 1 -- 172.21.15.83:0/725523341 reap_dead start 2024-03-30T13:09:11.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb8e99640 1 -- 172.21.15.83:0/725523341 shutdown_connections 2024-03-30T13:09:11.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb8e99640 1 -- 172.21.15.83:0/725523341 >> 172.21.15.83:0/725523341 conn(0x7fccb406b660 msgr2=0x7fccb406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:11.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb8e99640 1 -- 172.21.15.83:0/725523341 shutdown_connections 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.763+0000 7fccb8e99640 1 -- 172.21.15.83:0/725523341 wait complete. 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb8e99640 1 Processor -- start 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb8e99640 1 -- start start 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb8e99640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcca0003f40 0x7fccb4159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb8e99640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb41499d0 0x7fccb409d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb8e99640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb41f5bd0 0x7fccb41f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb8e99640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fccb415d690 con 0x7fccb41499d0 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb8e99640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fccb406f8e0 con 0x7fccb41f5bd0 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb8e99640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fccb40adc90 con 0x7fcca0003f40 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fcca9d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb41499d0 0x7fccb409d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fcca9d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb41499d0 0x7fccb409d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39184/0 (socket says 172.21.15.83:39184) 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fcca9d9b640 1 -- 172.21.15.83:0/1296813587 learned_addr learned my addr 172.21.15.83:0/1296813587 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb259c640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcca0003f40 0x7fccb4159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb2d9d640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb41f5bd0 0x7fccb41f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fcca9d9b640 1 -- 172.21.15.83:0/1296813587 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcca0003f40 msgr2=0x7fccb4159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fcca9d9b640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcca0003f40 0x7fccb4159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fcca9d9b640 1 -- 172.21.15.83:0/1296813587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb41f5bd0 msgr2=0x7fccb41f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fcca9d9b640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb41f5bd0 0x7fccb41f6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fcca9d9b640 1 -- 172.21.15.83:0/1296813587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb415ccc0 con 0x7fccb41499d0 2024-03-30T13:09:11.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fcca9d9b640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb41499d0 0x7fccb409d8c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcca401ca60 tx=0x7fcca0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:11.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccab7fe640 1 -- 172.21.15.83:0/1296813587 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40b2040 con 0x7fccb41499d0 2024-03-30T13:09:11.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccab7fe640 1 -- 172.21.15.83:0/1296813587 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca4004020 con 0x7fccb41499d0 2024-03-30T13:09:11.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccab7fe640 1 -- 172.21.15.83:0/1296813587 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4009880 con 0x7fccb41499d0 2024-03-30T13:09:11.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb8e99640 1 -- 172.21.15.83:0/1296813587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb4159dd0 con 0x7fccb41499d0 2024-03-30T13:09:11.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb8e99640 1 -- 172.21.15.83:0/1296813587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb4147210 con 0x7fccb41499d0 2024-03-30T13:09:11.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccb8e99640 1 -- 172.21.15.83:0/1296813587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb415b470 con 0x7fccb41499d0 2024-03-30T13:09:11.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.767+0000 7fccab7fe640 1 -- 172.21.15.83:0/1296813587 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fcca40c0020 con 0x7fccb41499d0 2024-03-30T13:09:11.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.771+0000 7fccab7fe640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcc94067ff0 0x7fcc9406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:11.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.771+0000 7fccab7fe640 1 -- 172.21.15.83:0/1296813587 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7fcca41207b0 con 0x7fccb41499d0 2024-03-30T13:09:11.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.771+0000 7fccb259c640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcc94067ff0 0x7fcc9406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:11.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.771+0000 7fccb259c640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcc94067ff0 0x7fcc9406a4b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c001d10 tx=0x7fcc9c001ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:11.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.775+0000 7fccab7fe640 1 -- 172.21.15.83:0/1296813587 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fcca40169a0 con 0x7fccb41499d0 2024-03-30T13:09:11.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 -- 172.21.15.83:0/1296813587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fccb404f9e0 con 0x7fccb41499d0 2024-03-30T13:09:11.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccab7fe640 1 -- 172.21.15.83:0/1296813587 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fcca40f0ee0 con 0x7fccb41499d0 2024-03-30T13:09:11.939 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:09:11.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 -- 172.21.15.83:0/1296813587 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcc94067ff0 msgr2=0x7fcc9406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcc94067ff0 0x7fcc9406a4b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c001d10 tx=0x7fcc9c001ca0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 -- 172.21.15.83:0/1296813587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb41499d0 msgr2=0x7fccb409d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:11.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb41499d0 0x7fccb409d8c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcca401ca60 tx=0x7fcca0005840 comp rx=0 tx=0).stop 2024-03-30T13:09:11.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 -- 172.21.15.83:0/1296813587 shutdown_connections 2024-03-30T13:09:11.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcc94067ff0 0x7fcc9406a4b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccb41f5bd0 0x7fccb41f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb41499d0 0x7fccb409d8c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 --2- 172.21.15.83:0/1296813587 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcca0003f40 0x7fccb4159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:11.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 -- 172.21.15.83:0/1296813587 >> 172.21.15.83:0/1296813587 conn(0x7fccb406b660 msgr2=0x7fccb415a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:11.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 -- 172.21.15.83:0/1296813587 shutdown_connections 2024-03-30T13:09:11.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:11.935+0000 7fccb8e99640 1 -- 172.21.15.83:0/1296813587 wait complete. 2024-03-30T13:09:11.958 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:09:12.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.079+0000 7f48d0954640 1 Processor -- start 2024-03-30T13:09:12.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.079+0000 7f48d0954640 1 -- start start 2024-03-30T13:09:12.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48d0954640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc15d3d0 0x7f48cc166ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48d0954640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48cc0ae040 con 0x7f48cc15c8e0 2024-03-30T13:09:12.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48d0954640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48cc0ae320 con 0x7f48cc0b4680 2024-03-30T13:09:12.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48d0954640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f48cc0b31e0 con 0x7f48cc15d3d0 2024-03-30T13:09:12.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48ca59c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f48cc15c8e0 0x7f48cc0ad580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59356/0 (socket says 172.21.15.83:59356) 2024-03-30T13:09:12.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48ca59c640 1 -- 172.21.15.83:0/4294230800 learned_addr learned my addr 172.21.15.83:0/4294230800 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:12.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48cad9d640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc15d3d0 0x7f48cc166ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199356374 0 0) 0x7f48cc0ae040 con 0x7f48cc15c8e0 2024-03-30T13:09:12.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48b4003530 con 0x7f48cc15c8e0 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2736731012 0 0) 0x7f48b4003530 con 0x7f48cc15c8e0 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc15d3d0 msgr2=0x7f48cc166ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc15d3d0 0x7f48cc166ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 >> v1:172.21.15.153:6789/0 conn(0x7f48cc0b4680 legacy=0x7f48cc15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc0ae600 con 0x7f48cc15c8e0 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f48bc001680 con 0x7f48cc15c8e0 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 >> v1:172.21.15.83:6789/0 conn(0x7f48cc15c8e0 legacy=0x7f48cc0ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc15d3d0 0x7f48b40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48b4003f70 0x7f48b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4004d50 0x7f48b40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc0b31e0 con 0x7f48b4004d50 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f48b400bb60 con 0x7f48b4003f70 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f48b400bd60 con 0x7f48cc15d3d0 2024-03-30T13:09:12.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48cad9d640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4004d50 0x7f48b40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48ca59c640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc15d3d0 0x7f48b40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c9d9b640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48b4003f70 0x7f48b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48cad9d640 1 -- 172.21.15.83:0/4294230800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc15d3d0 msgr2=0x7f48b40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:12.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48cad9d640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc15d3d0 0x7f48b40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48cad9d640 1 -- 172.21.15.83:0/4294230800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48b4003f70 msgr2=0x7f48b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:12.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48cad9d640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48b4003f70 0x7f48b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48cad9d640 1 -- 172.21.15.83:0/4294230800 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b4003530 con 0x7f48b4004d50 2024-03-30T13:09:12.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.083+0000 7f48c9d9b640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48b4003f70 0x7f48b4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:12.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48cad9d640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4004d50 0x7f48b40051d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009fc0 tx=0x7f48c401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=961c21c4c96bf777 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:12.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c40b2070 con 0x7f48b4004d50 2024-03-30T13:09:12.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c40a5b80 con 0x7f48b4004d50 2024-03-30T13:09:12.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48c959a640 1 -- 172.21.15.83:0/4294230800 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4009c10 con 0x7f48b4004d50 2024-03-30T13:09:12.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 -- 172.21.15.83:0/4294230800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4004d50 msgr2=0x7f48b40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 --2- 172.21.15.83:0/4294230800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4004d50 0x7f48b40051d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009fc0 tx=0x7f48c401cc80 comp rx=0 tx=0).stop 2024-03-30T13:09:12.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48cad9d640 1 -- 172.21.15.83:0/4294230800 reap_dead start 2024-03-30T13:09:12.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 -- 172.21.15.83:0/4294230800 shutdown_connections 2024-03-30T13:09:12.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 -- 172.21.15.83:0/4294230800 >> 172.21.15.83:0/4294230800 conn(0x7f48cc06b660 msgr2=0x7f48cc06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:12.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 -- 172.21.15.83:0/4294230800 shutdown_connections 2024-03-30T13:09:12.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 -- 172.21.15.83:0/4294230800 wait complete. 2024-03-30T13:09:12.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 Processor -- start 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 -- start start 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4004d50 0x7f48cc156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48cc157900 0x7f48cc145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc145c00 0x7f48cc0cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc0adc90 con 0x7f48b4004d50 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc06f8e0 con 0x7f48cc157900 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f48cc159500 con 0x7f48cc145c00 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48ca59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4004d50 0x7f48cc156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48ca59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4004d50 0x7f48cc156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39212/0 (socket says 172.21.15.83:39212) 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48ca59c640 1 -- 172.21.15.83:0/3721680472 learned_addr learned my addr 172.21.15.83:0/3721680472 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48c9d9b640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48cc157900 0x7f48cc145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48cad9d640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc145c00 0x7f48cc0cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48ca59c640 1 -- 172.21.15.83:0/3721680472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc145c00 msgr2=0x7f48cc0cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48ca59c640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc145c00 0x7f48cc0cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48ca59c640 1 -- 172.21.15.83:0/3721680472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48cc157900 msgr2=0x7f48cc145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48ca59c640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48cc157900 0x7f48cc145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48ca59c640 1 -- 172.21.15.83:0/3721680472 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc158050 con 0x7f48b4004d50 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48c9d9b640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48cc157900 0x7f48cc145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48ca59c640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4004d50 0x7f48cc156ef0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f48bc011980 tx=0x7f48bc011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48baffd640 1 -- 172.21.15.83:0/3721680472 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc010040 con 0x7f48b4004d50 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48baffd640 1 -- 172.21.15.83:0/3721680472 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48bc01a070 con 0x7f48b4004d50 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 -- 172.21.15.83:0/3721680472 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48cc157d80 con 0x7f48b4004d50 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48baffd640 1 -- 172.21.15.83:0/3721680472 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc015410 con 0x7f48b4004d50 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.087+0000 7f48d0954640 1 -- 172.21.15.83:0/3721680472 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48cc159a80 con 0x7f48b4004d50 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.091+0000 7f48d0954640 1 -- 172.21.15.83:0/3721680472 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48cc0cc920 con 0x7f48b4004d50 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.091+0000 7f48baffd640 1 -- 172.21.15.83:0/3721680472 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f48bc0155b0 con 0x7f48b4004d50 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.091+0000 7f48baffd640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f48ac067ff0 0x7f48ac06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.091+0000 7f48c9d9b640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f48ac067ff0 0x7f48ac06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.091+0000 7f48baffd640 1 -- 172.21.15.83:0/3721680472 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f48bc089910 con 0x7f48b4004d50 2024-03-30T13:09:12.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.091+0000 7f48c9d9b640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f48ac067ff0 0x7f48ac06a4b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f48cc156940 tx=0x7f48c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:12.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.095+0000 7f48baffd640 1 -- 172.21.15.83:0/3721680472 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f48bc05a040 con 0x7f48b4004d50 2024-03-30T13:09:12.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.255+0000 7f48d0954640 1 -- 172.21.15.83:0/3721680472 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f48cc04f9e0 con 0x7f48b4004d50 2024-03-30T13:09:12.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48baffd640 1 -- 172.21.15.83:0/3721680472 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f48bc059940 con 0x7f48b4004d50 2024-03-30T13:09:12.262 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:09:12.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48d0954640 1 -- 172.21.15.83:0/3721680472 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f48ac067ff0 msgr2=0x7f48ac06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48d0954640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f48ac067ff0 0x7f48ac06a4b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f48cc156940 tx=0x7f48c0009040 comp rx=0 tx=0).stop 2024-03-30T13:09:12.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48d0954640 1 -- 172.21.15.83:0/3721680472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4004d50 msgr2=0x7f48cc156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48d0954640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4004d50 0x7f48cc156ef0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f48bc011980 tx=0x7f48bc011e40 comp rx=0 tx=0).stop 2024-03-30T13:09:12.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48d0954640 1 -- 172.21.15.83:0/3721680472 shutdown_connections 2024-03-30T13:09:12.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48d0954640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f48ac067ff0 0x7f48ac06a4b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48d0954640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48cc145c00 0x7f48cc0cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48d0954640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48cc157900 0x7f48cc145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48d0954640 1 --2- 172.21.15.83:0/3721680472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48b4004d50 0x7f48cc156ef0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48d0954640 1 -- 172.21.15.83:0/3721680472 >> 172.21.15.83:0/3721680472 conn(0x7f48cc06b660 msgr2=0x7f48cc152430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:12.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48d0954640 1 -- 172.21.15.83:0/3721680472 shutdown_connections 2024-03-30T13:09:12.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.259+0000 7f48d0954640 1 -- 172.21.15.83:0/3721680472 wait complete. 2024-03-30T13:09:12.281 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:09:12.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.395+0000 7f8ab75bf640 1 Processor -- start 2024-03-30T13:09:12.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.395+0000 7f8ab75bf640 1 -- start start 2024-03-30T13:09:12.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.395+0000 7f8ab75bf640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00d1540 0x7f8ab01695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.395+0000 7f8ab75bf640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab00d51f0 con 0x7f8ab015e840 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.395+0000 7f8ab75bf640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab00d2140 con 0x7f8ab00d31e0 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.395+0000 7f8ab75bf640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab015ec20 con 0x7f8ab00d1540 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab535b640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f8ab015e840 0x7f8ab00cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59370/0 (socket says 172.21.15.83:59370) 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab535b640 1 -- 172.21.15.83:0/4170424153 learned_addr learned my addr 172.21.15.83:0/4170424153 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab5b5c640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00d1540 0x7f8ab01695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3079623294 0 0) 0x7f8aac001120 con 0x7f8ab015e840 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a9c003530 con 0x7f8ab015e840 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3271773142 0 0) 0x7f8a9c003530 con 0x7f8ab015e840 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00d1540 msgr2=0x7f8ab01695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00d1540 0x7f8ab01695e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 >> v1:172.21.15.153:6789/0 conn(0x7f8ab00d31e0 legacy=0x7f8ab00d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab00d2420 con 0x7f8ab015e840 2024-03-30T13:09:12.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f8aac001850 con 0x7f8ab015e840 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 >> v1:172.21.15.83:6789/0 conn(0x7f8ab015e840 legacy=0x7f8ab00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00d1540 0x7f8a9c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c003f70 0x7f8a9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a9c004d50 0x7f8a9c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c00bb60 con 0x7f8a9c004d50 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c00bce0 con 0x7f8a9c003f70 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8a9c00bee0 con 0x7f8ab00d1540 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab5b5c640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a9c004d50 0x7f8a9c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab4b5a640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c003f70 0x7f8a9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab535b640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00d1540 0x7f8a9c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab5b5c640 1 -- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00d1540 msgr2=0x7f8a9c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab5b5c640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00d1540 0x7f8a9c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab5b5c640 1 -- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c003f70 msgr2=0x7f8a9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:12.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab5b5c640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c003f70 0x7f8a9c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab5b5c640 1 -- 172.21.15.83:0/4170424153 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c003530 con 0x7f8a9c004d50 2024-03-30T13:09:12.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab4b5a640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9c003f70 0x7f8a9c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:12.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab535b640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00d1540 0x7f8a9c0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:12.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8ab5b5c640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a9c004d50 0x7f8a9c0051d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009fc0 tx=0x7f8aa801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e10ad9099a57a89 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:12.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80b2070 con 0x7f8a9c004d50 2024-03-30T13:09:12.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa80a5b80 con 0x7f8a9c004d50 2024-03-30T13:09:12.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.399+0000 7f8aa7fff640 1 -- 172.21.15.83:0/4170424153 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8009c10 con 0x7f8a9c004d50 2024-03-30T13:09:12.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 -- 172.21.15.83:0/4170424153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a9c004d50 msgr2=0x7f8a9c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 --2- 172.21.15.83:0/4170424153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a9c004d50 0x7f8a9c0051d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009fc0 tx=0x7f8aa801cc80 comp rx=0 tx=0).stop 2024-03-30T13:09:12.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab5b5c640 1 -- 172.21.15.83:0/4170424153 reap_dead start 2024-03-30T13:09:12.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 -- 172.21.15.83:0/4170424153 shutdown_connections 2024-03-30T13:09:12.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 -- 172.21.15.83:0/4170424153 >> 172.21.15.83:0/4170424153 conn(0x7f8ab009d7f0 msgr2=0x7f8ab00d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:12.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 -- 172.21.15.83:0/4170424153 shutdown_connections 2024-03-30T13:09:12.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 -- 172.21.15.83:0/4170424153 wait complete. 2024-03-30T13:09:12.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 Processor -- start 2024-03-30T13:09:12.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 -- start start 2024-03-30T13:09:12.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a9c004d50 0x7f8ab00b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab0158980 0x7f8ab00a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00b3010 0x7f8ab00b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab00d29e0 con 0x7f8a9c004d50 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab00d2d50 con 0x7f8ab0158980 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab00d0320 con 0x7f8ab00b3010 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab535b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a9c004d50 0x7f8ab00b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab535b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a9c004d50 0x7f8ab00b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39226/0 (socket says 172.21.15.83:39226) 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab535b640 1 -- 172.21.15.83:0/3710483233 learned_addr learned my addr 172.21.15.83:0/3710483233 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab5b5c640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00b3010 0x7f8ab00b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab4b5a640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab0158980 0x7f8ab00a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab535b640 1 -- 172.21.15.83:0/3710483233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00b3010 msgr2=0x7f8ab00b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab535b640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00b3010 0x7f8ab00b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab535b640 1 -- 172.21.15.83:0/3710483233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab0158980 msgr2=0x7f8ab00a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab535b640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab0158980 0x7f8ab00a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab535b640 1 -- 172.21.15.83:0/3710483233 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab00b43e0 con 0x7f8a9c004d50 2024-03-30T13:09:12.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab535b640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a9c004d50 0x7f8ab00b3ea0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8aac000fc0 tx=0x7f8aac005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:12.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8aa5ffb640 1 -- 172.21.15.83:0/3710483233 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00e920 con 0x7f8a9c004d50 2024-03-30T13:09:12.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8aa5ffb640 1 -- 172.21.15.83:0/3710483233 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aac011040 con 0x7f8a9c004d50 2024-03-30T13:09:12.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8aa5ffb640 1 -- 172.21.15.83:0/3710483233 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00ece0 con 0x7f8a9c004d50 2024-03-30T13:09:12.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 -- 172.21.15.83:0/3710483233 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab00a0850 con 0x7f8a9c004d50 2024-03-30T13:09:12.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.403+0000 7f8ab75bf640 1 -- 172.21.15.83:0/3710483233 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab00a0e10 con 0x7f8a9c004d50 2024-03-30T13:09:12.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.407+0000 7f8ab75bf640 1 -- 172.21.15.83:0/3710483233 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab00a23d0 con 0x7f8a9c004d50 2024-03-30T13:09:12.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.407+0000 7f8aa5ffb640 1 -- 172.21.15.83:0/3710483233 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f8aac01d020 con 0x7f8a9c004d50 2024-03-30T13:09:12.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.407+0000 7f8aa5ffb640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8a94067ff0 0x7f8a9406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.407+0000 7f8aa5ffb640 1 -- 172.21.15.83:0/3710483233 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f8aac0892d0 con 0x7f8a9c004d50 2024-03-30T13:09:12.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.407+0000 7f8ab4b5a640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8a94067ff0 0x7f8a9406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.407+0000 7f8ab4b5a640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8a94067ff0 0x7f8a9406a4b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00a03a0 tx=0x7f8aa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:12.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.411+0000 7f8aa5ffb640 1 -- 172.21.15.83:0/3710483233 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f8ab00d51f0 con 0x7f8a9c004d50 2024-03-30T13:09:12.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.583+0000 7f8ab75bf640 1 -- 172.21.15.83:0/3710483233 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8ab004f9e0 con 0x7f8a9c004d50 2024-03-30T13:09:12.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.583+0000 7f8aa5ffb640 1 -- 172.21.15.83:0/3710483233 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f8aac059a00 con 0x7f8a9c004d50 2024-03-30T13:09:12.588 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-03-30T13:09:12.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.587+0000 7f8ab75bf640 1 -- 172.21.15.83:0/3710483233 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8a94067ff0 msgr2=0x7f8a9406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.587+0000 7f8ab75bf640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8a94067ff0 0x7f8a9406a4b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00a03a0 tx=0x7f8aa0009040 comp rx=0 tx=0).stop 2024-03-30T13:09:12.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.587+0000 7f8ab75bf640 1 -- 172.21.15.83:0/3710483233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a9c004d50 msgr2=0x7f8ab00b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.587+0000 7f8ab75bf640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a9c004d50 0x7f8ab00b3ea0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8aac000fc0 tx=0x7f8aac005700 comp rx=0 tx=0).stop 2024-03-30T13:09:12.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.587+0000 7f8ab75bf640 1 -- 172.21.15.83:0/3710483233 shutdown_connections 2024-03-30T13:09:12.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.587+0000 7f8ab75bf640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8a94067ff0 0x7f8a9406a4b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.587+0000 7f8ab75bf640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab00b3010 0x7f8ab00b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.587+0000 7f8ab75bf640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab0158980 0x7f8ab00a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.587+0000 7f8ab75bf640 1 --2- 172.21.15.83:0/3710483233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a9c004d50 0x7f8ab00b3ea0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.587+0000 7f8ab75bf640 1 -- 172.21.15.83:0/3710483233 >> 172.21.15.83:0/3710483233 conn(0x7f8ab009d7f0 msgr2=0x7f8ab00cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:12.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.587+0000 7f8ab75bf640 1 -- 172.21.15.83:0/3710483233 shutdown_connections 2024-03-30T13:09:12.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.587+0000 7f8ab75bf640 1 -- 172.21.15.83:0/3710483233 wait complete. 2024-03-30T13:09:12.605 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi083.front.sepia.ceph.com... 2024-03-30T13:09:12.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:12.606 DEBUG:teuthology.orchestra.run.smithi083:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-03-30T13:09:12.617 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:09:12.617 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:09:12.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:12.617 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-30T13:09:12.662 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:09:12.662 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:09:12.669 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:09:12.669 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:09:12.716 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:12.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.831+0000 7f1d5613e640 1 Processor -- start 2024-03-30T13:09:12.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.831+0000 7f1d5613e640 1 -- start start 2024-03-30T13:09:12.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d5613e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d500b4830 0x7f1d5015d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d5613e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1d5006dfe0 0x7f1d5006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d5613e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d5015d880 con 0x7f1d500aed20 2024-03-30T13:09:12.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d5613e640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f1d50156e00 con 0x7f1d5006dfe0 2024-03-30T13:09:12.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d5613e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1d500ad040 con 0x7f1d500b4830 2024-03-30T13:09:12.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d4ffff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1d5006dfe0 0x7f1d5006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d4ffff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1d5006dfe0 0x7f1d5006e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39242/0 (socket says 172.21.15.83:39242) 2024-03-30T13:09:12.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d4ffff640 1 -- 172.21.15.83:0/710494529 learned_addr learned my addr 172.21.15.83:0/710494529 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:12.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d4f7fe640 1 --2- 172.21.15.83:0/710494529 >> v2:172.21.15.153:3300/0 conn(0x7f1d500b4830 0x7f1d5015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d4ffff640 1 -- 172.21.15.83:0/710494529 >> v2:172.21.15.153:3300/0 conn(0x7f1d500b4830 msgr2=0x7f1d5015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:12.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d4ffff640 1 --2- 172.21.15.83:0/710494529 >> v2:172.21.15.153:3300/0 conn(0x7f1d500b4830 0x7f1d5015d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d4ffff640 1 -- 172.21.15.83:0/710494529 >> v1:172.21.15.153:6789/0 conn(0x7f1d500aed20 legacy=0x7f1d500af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d4ffff640 1 -- 172.21.15.83:0/710494529 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d500cfcb0 con 0x7f1d5006dfe0 2024-03-30T13:09:12.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d4ffff640 1 --2- 172.21.15.83:0/710494529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d5006dfe0 0x7f1d5006e3e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1d500b2a10 tx=0x7f1d4801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1790d8dc6ed7df10 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:12.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d4e7fc640 1 -- 172.21.15.83:0/710494529 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d480a5760 con 0x7f1d5006dfe0 2024-03-30T13:09:12.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d4e7fc640 1 -- 172.21.15.83:0/710494529 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d480a5900 con 0x7f1d5006dfe0 2024-03-30T13:09:12.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.835+0000 7f1d4e7fc640 1 -- 172.21.15.83:0/710494529 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d480a5cd0 con 0x7f1d5006dfe0 2024-03-30T13:09:12.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 -- 172.21.15.83:0/710494529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d5006dfe0 msgr2=0x7f1d5006e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 --2- 172.21.15.83:0/710494529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d5006dfe0 0x7f1d5006e3e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1d500b2a10 tx=0x7f1d4801c8a0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 -- 172.21.15.83:0/710494529 shutdown_connections 2024-03-30T13:09:12.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 --2- 172.21.15.83:0/710494529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d5006dfe0 0x7f1d5006e3e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 --2- 172.21.15.83:0/710494529 >> v2:172.21.15.153:3300/0 conn(0x7f1d500b4830 0x7f1d5015d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 -- 172.21.15.83:0/710494529 >> 172.21.15.83:0/710494529 conn(0x7f1d500b1d60 msgr2=0x7f1d500b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:12.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 -- 172.21.15.83:0/710494529 shutdown_connections 2024-03-30T13:09:12.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 -- 172.21.15.83:0/710494529 wait complete. 2024-03-30T13:09:12.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 Processor -- start 2024-03-30T13:09:12.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 -- start start 2024-03-30T13:09:12.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d5006dfe0 0x7f1d5014f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d500aed20 0x7f1d500cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d500b4830 0x7f1d500ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1d500cf860 con 0x7f1d5006dfe0 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5006fa90 con 0x7f1d500b4830 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1d500cf9e0 con 0x7f1d500aed20 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d4f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d5006dfe0 0x7f1d5014f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d4f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d5006dfe0 0x7f1d5014f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39254/0 (socket says 172.21.15.83:39254) 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d4f7fe640 1 -- 172.21.15.83:0/3704037289 learned_addr learned my addr 172.21.15.83:0/3704037289 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d4ffff640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d500b4830 0x7f1d500ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d4effd640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d500aed20 0x7f1d500cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d4f7fe640 1 -- 172.21.15.83:0/3704037289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d500aed20 msgr2=0x7f1d500cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d4f7fe640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d500aed20 0x7f1d500cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d4f7fe640 1 -- 172.21.15.83:0/3704037289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d500b4830 msgr2=0x7f1d500ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d4f7fe640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d500b4830 0x7f1d500ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d4f7fe640 1 -- 172.21.15.83:0/3704037289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d50072670 con 0x7f1d5006dfe0 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d4f7fe640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d5006dfe0 0x7f1d5014f600 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000d800 tx=0x7f1d4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d37fff640 1 -- 172.21.15.83:0/3704037289 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4000b6c0 con 0x7f1d5006dfe0 2024-03-30T13:09:12.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d37fff640 1 -- 172.21.15.83:0/3704037289 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d40019070 con 0x7f1d5006dfe0 2024-03-30T13:09:12.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 -- 172.21.15.83:0/3704037289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d50072950 con 0x7f1d5006dfe0 2024-03-30T13:09:12.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d37fff640 1 -- 172.21.15.83:0/3704037289 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4000ba60 con 0x7f1d5006dfe0 2024-03-30T13:09:12.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.839+0000 7f1d5613e640 1 -- 172.21.15.83:0/3704037289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d50072f10 con 0x7f1d5006dfe0 2024-03-30T13:09:12.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.843+0000 7f1d5613e640 1 -- 172.21.15.83:0/3704037289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d500686c0 con 0x7f1d5006dfe0 2024-03-30T13:09:12.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.843+0000 7f1d37fff640 1 -- 172.21.15.83:0/3704037289 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f1d4000bc00 con 0x7f1d5006dfe0 2024-03-30T13:09:12.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.843+0000 7f1d37fff640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1d3c067fc0 0x7f1d3c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:12.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.843+0000 7f1d37fff640 1 -- 172.21.15.83:0/3704037289 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f1d40086ab0 con 0x7f1d5006dfe0 2024-03-30T13:09:12.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.843+0000 7f1d4effd640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1d3c067fc0 0x7f1d3c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:12.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.843+0000 7f1d4effd640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1d3c067fc0 0x7f1d3c06a480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d440015b0 tx=0x7f1d44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:12.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:12.847+0000 7f1d37fff640 1 -- 172.21.15.83:0/3704037289 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f1d400571e0 con 0x7f1d5006dfe0 2024-03-30T13:09:13.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.003+0000 7f1d5613e640 1 -- 172.21.15.83:0/3704037289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d500b4ca0 con 0x7f1d5006dfe0 2024-03-30T13:09:13.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d37fff640 1 -- 172.21.15.83:0/3704037289 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16848 (secure 0 0 0) 0x7f1d40056ae0 con 0x7f1d5006dfe0 2024-03-30T13:09:13.011 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:13.011 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:09:07.416798+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:13.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d5613e640 1 -- 172.21.15.83:0/3704037289 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1d3c067fc0 msgr2=0x7f1d3c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d5613e640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1d3c067fc0 0x7f1d3c06a480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d440015b0 tx=0x7f1d44009040 comp rx=0 tx=0).stop 2024-03-30T13:09:13.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d5613e640 1 -- 172.21.15.83:0/3704037289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d5006dfe0 msgr2=0x7f1d5014f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d5613e640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d5006dfe0 0x7f1d5014f600 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000d800 tx=0x7f1d4000dcc0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d5613e640 1 -- 172.21.15.83:0/3704037289 shutdown_connections 2024-03-30T13:09:13.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d5613e640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1d3c067fc0 0x7f1d3c06a480 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d5613e640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d500b4830 0x7f1d500ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d5613e640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d500aed20 0x7f1d500cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d5613e640 1 --2- 172.21.15.83:0/3704037289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d5006dfe0 0x7f1d5014f600 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d5613e640 1 -- 172.21.15.83:0/3704037289 >> 172.21.15.83:0/3704037289 conn(0x7f1d500b1d60 msgr2=0x7f1d5014fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:13.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d5613e640 1 -- 172.21.15.83:0/3704037289 shutdown_connections 2024-03-30T13:09:13.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.007+0000 7f1d5613e640 1 -- 172.21.15.83:0/3704037289 wait complete. 2024-03-30T13:09:13.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:09:13.029 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:09:13.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6fd52640 1 Processor -- start 2024-03-30T13:09:13.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6fd52640 1 -- start start 2024-03-30T13:09:13.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6fd52640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a680b4680 0x7f7a6815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6fd52640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7a6815d200 0x7f7a68165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6fd52640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a680ae040 con 0x7f7a6815c8e0 2024-03-30T13:09:13.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6fd52640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f7a680b31e0 con 0x7f7a6815d200 2024-03-30T13:09:13.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6fd52640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7a680ae320 con 0x7f7a680b4680 2024-03-30T13:09:13.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6e2ef640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7a6815d200 0x7f7a68165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6e2ef640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7a6815d200 0x7f7a68165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39262/0 (socket says 172.21.15.83:39262) 2024-03-30T13:09:13.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6e2ef640 1 -- 172.21.15.83:0/4265325722 learned_addr learned my addr 172.21.15.83:0/4265325722 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:13.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6d2ed640 1 --2- 172.21.15.83:0/4265325722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a680b4680 0x7f7a6815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6e2ef640 1 -- 172.21.15.83:0/4265325722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a680b4680 msgr2=0x7f7a6815ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:13.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6e2ef640 1 --2- 172.21.15.83:0/4265325722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a680b4680 0x7f7a6815ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6e2ef640 1 -- 172.21.15.83:0/4265325722 >> v1:172.21.15.153:6789/0 conn(0x7f7a6815c8e0 legacy=0x7f7a680ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.147+0000 7f7a6e2ef640 1 -- 172.21.15.83:0/4265325722 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a680ae600 con 0x7f7a6815d200 2024-03-30T13:09:13.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6e2ef640 1 --2- 172.21.15.83:0/4265325722 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a6815d200 0x7f7a68165e90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009e50 tx=0x7f7a6001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec2a6039f3b8e8e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:13.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6caec640 1 -- 172.21.15.83:0/4265325722 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a600a5810 con 0x7f7a6815d200 2024-03-30T13:09:13.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6caec640 1 -- 172.21.15.83:0/4265325722 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a600a59b0 con 0x7f7a6815d200 2024-03-30T13:09:13.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6caec640 1 -- 172.21.15.83:0/4265325722 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a600a5d80 con 0x7f7a6815d200 2024-03-30T13:09:13.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 -- 172.21.15.83:0/4265325722 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a6815d200 msgr2=0x7f7a68165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 --2- 172.21.15.83:0/4265325722 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a6815d200 0x7f7a68165e90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009e50 tx=0x7f7a6001ca30 comp rx=0 tx=0).stop 2024-03-30T13:09:13.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 -- 172.21.15.83:0/4265325722 shutdown_connections 2024-03-30T13:09:13.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 --2- 172.21.15.83:0/4265325722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a680b4680 0x7f7a6815ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 --2- 172.21.15.83:0/4265325722 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a6815d200 0x7f7a68165e90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 -- 172.21.15.83:0/4265325722 >> 172.21.15.83:0/4265325722 conn(0x7f7a6806b660 msgr2=0x7f7a6806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:13.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 -- 172.21.15.83:0/4265325722 shutdown_connections 2024-03-30T13:09:13.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 -- 172.21.15.83:0/4265325722 wait complete. 2024-03-30T13:09:13.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 Processor -- start 2024-03-30T13:09:13.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 -- start start 2024-03-30T13:09:13.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a680b4680 0x7f7a680b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a6815c8e0 0x7f7a680cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a6815d200 0x7f7a68154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7a680adc90 con 0x7f7a6815d200 2024-03-30T13:09:13.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a68168bf0 con 0x7f7a6815c8e0 2024-03-30T13:09:13.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7a680b0480 con 0x7f7a680b4680 2024-03-30T13:09:13.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6e2ef640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a6815d200 0x7f7a68154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6e2ef640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a6815d200 0x7f7a68154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39272/0 (socket says 172.21.15.83:39272) 2024-03-30T13:09:13.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6e2ef640 1 -- 172.21.15.83:0/949052801 learned_addr learned my addr 172.21.15.83:0/949052801 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:13.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6e2ef640 1 -- 172.21.15.83:0/949052801 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a680b4680 msgr2=0x7f7a680b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6e2ef640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a680b4680 0x7f7a680b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6d2ed640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a6815c8e0 0x7f7a680cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6e2ef640 1 -- 172.21.15.83:0/949052801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a6815c8e0 msgr2=0x7f7a680cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6e2ef640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a6815c8e0 0x7f7a680cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6e2ef640 1 -- 172.21.15.83:0/949052801 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a680cfdf0 con 0x7f7a6815d200 2024-03-30T13:09:13.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6e2ef640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a6815d200 0x7f7a68154910 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7a6001a660 tx=0x7f7a600197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:13.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a5e7fc640 1 -- 172.21.15.83:0/949052801 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a600bc070 con 0x7f7a6815d200 2024-03-30T13:09:13.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a5e7fc640 1 -- 172.21.15.83:0/949052801 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a600b8660 con 0x7f7a6815d200 2024-03-30T13:09:13.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 -- 172.21.15.83:0/949052801 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a680afb50 con 0x7f7a6815d200 2024-03-30T13:09:13.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a5e7fc640 1 -- 172.21.15.83:0/949052801 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a600b8a50 con 0x7f7a6815d200 2024-03-30T13:09:13.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.151+0000 7f7a6fd52640 1 -- 172.21.15.83:0/949052801 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a680b0110 con 0x7f7a6815d200 2024-03-30T13:09:13.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.155+0000 7f7a6fd52640 1 -- 172.21.15.83:0/949052801 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a6804f9e0 con 0x7f7a6815d200 2024-03-30T13:09:13.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.155+0000 7f7a5e7fc640 1 -- 172.21.15.83:0/949052801 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f7a600bf070 con 0x7f7a6815d200 2024-03-30T13:09:13.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.155+0000 7f7a5e7fc640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7a4c067fc0 0x7f7a4c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.155+0000 7f7a6daee640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7a4c067fc0 0x7f7a4c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.155+0000 7f7a5e7fc640 1 -- 172.21.15.83:0/949052801 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f7a60121860 con 0x7f7a6815d200 2024-03-30T13:09:13.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.155+0000 7f7a6daee640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7a4c067fc0 0x7f7a4c06a480 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7a64000f70 tx=0x7f7a640079e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:13.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.159+0000 7f7a5e7fc640 1 -- 172.21.15.83:0/949052801 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f7a60016620 con 0x7f7a6815d200 2024-03-30T13:09:13.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.311+0000 7f7a6fd52640 1 -- 172.21.15.83:0/949052801 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7a6806ed80 con 0x7f7a6815d200 2024-03-30T13:09:13.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.311+0000 7f7a5e7fc640 1 -- 172.21.15.83:0/949052801 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f7a600f2220 con 0x7f7a6815d200 2024-03-30T13:09:13.317 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:09:13.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.315+0000 7f7a6fd52640 1 -- 172.21.15.83:0/949052801 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7a4c067fc0 msgr2=0x7f7a4c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.315+0000 7f7a6fd52640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7a4c067fc0 0x7f7a4c06a480 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7a64000f70 tx=0x7f7a640079e0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.315+0000 7f7a6fd52640 1 -- 172.21.15.83:0/949052801 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a6815d200 msgr2=0x7f7a68154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.315+0000 7f7a6fd52640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a6815d200 0x7f7a68154910 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7a6001a660 tx=0x7f7a600197d0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.315+0000 7f7a6fd52640 1 -- 172.21.15.83:0/949052801 shutdown_connections 2024-03-30T13:09:13.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.315+0000 7f7a6fd52640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7a4c067fc0 0x7f7a4c06a480 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.315+0000 7f7a6fd52640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a6815d200 0x7f7a68154910 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.315+0000 7f7a6fd52640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a6815c8e0 0x7f7a680cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.315+0000 7f7a6fd52640 1 --2- 172.21.15.83:0/949052801 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a680b4680 0x7f7a680b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.315+0000 7f7a6fd52640 1 -- 172.21.15.83:0/949052801 >> 172.21.15.83:0/949052801 conn(0x7f7a6806b660 msgr2=0x7f7a6814e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:13.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.315+0000 7f7a6fd52640 1 -- 172.21.15.83:0/949052801 shutdown_connections 2024-03-30T13:09:13.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.315+0000 7f7a6fd52640 1 -- 172.21.15.83:0/949052801 wait complete. 2024-03-30T13:09:13.335 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:09:13.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c9a4d640 1 Processor -- start 2024-03-30T13:09:13.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c9a4d640 1 -- start start 2024-03-30T13:09:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c9a4d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43c415b050 0x7f43c4073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c9a4d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43c40b3ca0 0x7f43c406f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c9a4d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43c40b31e0 con 0x7f43c406f690 2024-03-30T13:09:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c9a4d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f43c406fad0 con 0x7f43c415b050 2024-03-30T13:09:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c9a4d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f43c4073ab0 con 0x7f43c40b3ca0 2024-03-30T13:09:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c2ffd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43c415b050 0x7f43c4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c37fe640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f43c406f690 0x7f43c4071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:53616/0 (socket says 172.21.15.83:53616) 2024-03-30T13:09:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c37fe640 1 -- 172.21.15.83:0/832031516 learned_addr learned my addr 172.21.15.83:0/832031516 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43ba7fc640 1 --2- 172.21.15.83:0/832031516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43c40b3ca0 0x7f43c406f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c2ffd640 1 -- 172.21.15.83:0/832031516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43c40b3ca0 msgr2=0x7f43c406f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c2ffd640 1 --2- 172.21.15.83:0/832031516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43c40b3ca0 0x7f43c406f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c2ffd640 1 -- 172.21.15.83:0/832031516 >> v1:172.21.15.153:6789/0 conn(0x7f43c406f690 legacy=0x7f43c4071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.443+0000 7f43c2ffd640 1 -- 172.21.15.83:0/832031516 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c40ad4f0 con 0x7f43c415b050 2024-03-30T13:09:13.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c2ffd640 1 --2- 172.21.15.83:0/832031516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c415b050 0x7f43c4073570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0097c0 tx=0x7f43ac01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce37780cfe7abec6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c27fc640 1 -- 172.21.15.83:0/832031516 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac0b0070 con 0x7f43c415b050 2024-03-30T13:09:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c27fc640 1 -- 172.21.15.83:0/832031516 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ac0ab600 con 0x7f43c415b050 2024-03-30T13:09:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c27fc640 1 -- 172.21.15.83:0/832031516 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac0ab9d0 con 0x7f43c415b050 2024-03-30T13:09:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c9a4d640 1 -- 172.21.15.83:0/832031516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c415b050 msgr2=0x7f43c4073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c9a4d640 1 --2- 172.21.15.83:0/832031516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c415b050 0x7f43c4073570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0097c0 tx=0x7f43ac01c4a0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c9a4d640 1 -- 172.21.15.83:0/832031516 shutdown_connections 2024-03-30T13:09:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c9a4d640 1 --2- 172.21.15.83:0/832031516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43c40b3ca0 0x7f43c406f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c9a4d640 1 --2- 172.21.15.83:0/832031516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c415b050 0x7f43c4073570 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c9a4d640 1 -- 172.21.15.83:0/832031516 >> 172.21.15.83:0/832031516 conn(0x7f43c406b660 msgr2=0x7f43c406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c9a4d640 1 -- 172.21.15.83:0/832031516 shutdown_connections 2024-03-30T13:09:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c9a4d640 1 -- 172.21.15.83:0/832031516 wait complete. 2024-03-30T13:09:13.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c9a4d640 1 Processor -- start 2024-03-30T13:09:13.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.447+0000 7f43c9a4d640 1 -- start start 2024-03-30T13:09:13.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c9a4d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c406f690 0x7f43c4154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c9a4d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43c40b3ca0 0x7f43c414bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c9a4d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43c415b050 0x7f43c414c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c9a4d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f43c40b4c10 con 0x7f43c415b050 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c9a4d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f43c40ad1c0 con 0x7f43c406f690 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c9a4d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f43c40b4d90 con 0x7f43c40b3ca0 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43c415b050 0x7f43c414c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43c415b050 0x7f43c414c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39282/0 (socket says 172.21.15.83:39282) 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c37fe640 1 -- 172.21.15.83:0/1934308876 learned_addr learned my addr 172.21.15.83:0/1934308876 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c2ffd640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c406f690 0x7f43c4154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43ba7fc640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43c40b3ca0 0x7f43c414bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c37fe640 1 -- 172.21.15.83:0/1934308876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43c40b3ca0 msgr2=0x7f43c414bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c37fe640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43c40b3ca0 0x7f43c414bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c37fe640 1 -- 172.21.15.83:0/1934308876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c406f690 msgr2=0x7f43c4154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c37fe640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c406f690 0x7f43c4154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c37fe640 1 -- 172.21.15.83:0/1934308876 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c4154950 con 0x7f43c415b050 2024-03-30T13:09:13.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c37fe640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43c415b050 0x7f43c414c000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00cbc0 tx=0x7f43bc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:13.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c0ff9640 1 -- 172.21.15.83:0/1934308876 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc017070 con 0x7f43c415b050 2024-03-30T13:09:13.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c0ff9640 1 -- 172.21.15.83:0/1934308876 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc00ad40 con 0x7f43c415b050 2024-03-30T13:09:13.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c0ff9640 1 -- 172.21.15.83:0/1934308876 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc012600 con 0x7f43c415b050 2024-03-30T13:09:13.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c9a4d640 1 -- 172.21.15.83:0/1934308876 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c4156780 con 0x7f43c415b050 2024-03-30T13:09:13.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c9a4d640 1 -- 172.21.15.83:0/1934308876 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c414d010 con 0x7f43c415b050 2024-03-30T13:09:13.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c9a4d640 1 -- 172.21.15.83:0/1934308876 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c409e540 con 0x7f43c415b050 2024-03-30T13:09:13.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c0ff9640 1 -- 172.21.15.83:0/1934308876 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f43bc01a070 con 0x7f43c415b050 2024-03-30T13:09:13.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c0ff9640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f43a4067fc0 0x7f43a406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c0ff9640 1 -- 172.21.15.83:0/1934308876 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f43bc086270 con 0x7f43c415b050 2024-03-30T13:09:13.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c2ffd640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f43a4067fc0 0x7f43a406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.451+0000 7f43c2ffd640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f43a4067fc0 0x7f43a406a480 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0ad000 tx=0x7f43ac0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:13.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.455+0000 7f43c0ff9640 1 -- 172.21.15.83:0/1934308876 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f43bc0562c0 con 0x7f43c415b050 2024-03-30T13:09:13.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.603+0000 7f43c9a4d640 1 -- 172.21.15.83:0/1934308876 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f43c404f9e0 con 0x7f43c415b050 2024-03-30T13:09:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.603+0000 7f43c0ff9640 1 -- 172.21.15.83:0/1934308876 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f43bc05a5c0 con 0x7f43c415b050 2024-03-30T13:09:13.609 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:09:13.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.607+0000 7f43c9a4d640 1 -- 172.21.15.83:0/1934308876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f43a4067fc0 msgr2=0x7f43a406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.607+0000 7f43c9a4d640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f43a4067fc0 0x7f43a406a480 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0ad000 tx=0x7f43ac0a6000 comp rx=0 tx=0).stop 2024-03-30T13:09:13.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.607+0000 7f43c9a4d640 1 -- 172.21.15.83:0/1934308876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43c415b050 msgr2=0x7f43c414c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.607+0000 7f43c9a4d640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43c415b050 0x7f43c414c000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00cbc0 tx=0x7f43bc00a430 comp rx=0 tx=0).stop 2024-03-30T13:09:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.607+0000 7f43c9a4d640 1 -- 172.21.15.83:0/1934308876 shutdown_connections 2024-03-30T13:09:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.607+0000 7f43c9a4d640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f43a4067fc0 0x7f43a406a480 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.607+0000 7f43c9a4d640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43c415b050 0x7f43c414c000 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.607+0000 7f43c9a4d640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43c40b3ca0 0x7f43c414bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.607+0000 7f43c9a4d640 1 --2- 172.21.15.83:0/1934308876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c406f690 0x7f43c4154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.607+0000 7f43c9a4d640 1 -- 172.21.15.83:0/1934308876 >> 172.21.15.83:0/1934308876 conn(0x7f43c406b660 msgr2=0x7f43c40aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.607+0000 7f43c9a4d640 1 -- 172.21.15.83:0/1934308876 shutdown_connections 2024-03-30T13:09:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.607+0000 7f43c9a4d640 1 -- 172.21.15.83:0/1934308876 wait complete. 2024-03-30T13:09:13.626 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:09:13.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.743+0000 7f7c7d3e7640 1 Processor -- start 2024-03-30T13:09:13.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.743+0000 7f7c7d3e7640 1 -- start start 2024-03-30T13:09:13.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c7d3e7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7c7815e840 0x7f7c780d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c7d3e7640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7c780d1540 0x7f7c780d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c7d3e7640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c780d51f0 con 0x7f7c780cfc10 2024-03-30T13:09:13.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c7d3e7640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f7c7815ec20 con 0x7f7c7815e840 2024-03-30T13:09:13.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c7d3e7640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7c780d2d50 con 0x7f7c780d1540 2024-03-30T13:09:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c76ffd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7c7815e840 0x7f7c780d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c76ffd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7c7815e840 0x7f7c780d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39294/0 (socket says 172.21.15.83:39294) 2024-03-30T13:09:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c76ffd640 1 -- 172.21.15.83:0/3302583694 learned_addr learned my addr 172.21.15.83:0/3302583694 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c777fe640 1 --2- 172.21.15.83:0/3302583694 >> v2:172.21.15.153:3300/0 conn(0x7f7c780d1540 0x7f7c780d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c76ffd640 1 -- 172.21.15.83:0/3302583694 >> v2:172.21.15.153:3300/0 conn(0x7f7c780d1540 msgr2=0x7f7c780d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c76ffd640 1 --2- 172.21.15.83:0/3302583694 >> v2:172.21.15.153:3300/0 conn(0x7f7c780d1540 0x7f7c780d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c76ffd640 1 -- 172.21.15.83:0/3302583694 >> v1:172.21.15.153:6789/0 conn(0x7f7c780cfc10 legacy=0x7f7c780d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c76ffd640 1 -- 172.21.15.83:0/3302583694 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c780d2140 con 0x7f7c7815e840 2024-03-30T13:09:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c777fe640 1 --2- 172.21.15.83:0/3302583694 >> v2:172.21.15.153:3300/0 conn(0x7f7c780d1540 0x7f7c780d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:13.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c76ffd640 1 --2- 172.21.15.83:0/3302583694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c7815e840 0x7f7c780d31e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7c7808c800 tx=0x7f7c6801c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbea14fc5a701b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:13.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c75ffb640 1 -- 172.21.15.83:0/3302583694 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c680b0070 con 0x7f7c7815e840 2024-03-30T13:09:13.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c75ffb640 1 -- 172.21.15.83:0/3302583694 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c680ab600 con 0x7f7c7815e840 2024-03-30T13:09:13.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.747+0000 7f7c75ffb640 1 -- 172.21.15.83:0/3302583694 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c680ab9d0 con 0x7f7c7815e840 2024-03-30T13:09:13.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/3302583694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c7815e840 msgr2=0x7f7c780d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 --2- 172.21.15.83:0/3302583694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c7815e840 0x7f7c780d31e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7c7808c800 tx=0x7f7c6801c270 comp rx=0 tx=0).stop 2024-03-30T13:09:13.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/3302583694 shutdown_connections 2024-03-30T13:09:13.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 --2- 172.21.15.83:0/3302583694 >> v2:172.21.15.153:3300/0 conn(0x7f7c780d1540 0x7f7c780d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 --2- 172.21.15.83:0/3302583694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c7815e840 0x7f7c780d31e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/3302583694 >> 172.21.15.83:0/3302583694 conn(0x7f7c7809d7f0 msgr2=0x7f7c780d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:13.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/3302583694 shutdown_connections 2024-03-30T13:09:13.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/3302583694 wait complete. 2024-03-30T13:09:13.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 Processor -- start 2024-03-30T13:09:13.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 -- start start 2024-03-30T13:09:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c780cfc10 0x7f7c780c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c780d1540 0x7f7c78156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c7815e840 0x7f7c78156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7806d0b0 con 0x7f7c7815e840 2024-03-30T13:09:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7806cf30 con 0x7f7c780d1540 2024-03-30T13:09:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7c7806d230 con 0x7f7c780cfc10 2024-03-30T13:09:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c777fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c7815e840 0x7f7c78156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c777fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c7815e840 0x7f7c78156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39296/0 (socket says 172.21.15.83:39296) 2024-03-30T13:09:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c777fe640 1 -- 172.21.15.83:0/1390068517 learned_addr learned my addr 172.21.15.83:0/1390068517 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c767fc640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c780d1540 0x7f7c78156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c76ffd640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c780cfc10 0x7f7c780c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c777fe640 1 -- 172.21.15.83:0/1390068517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c780cfc10 msgr2=0x7f7c780c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c777fe640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c780cfc10 0x7f7c780c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c777fe640 1 -- 172.21.15.83:0/1390068517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c780d1540 msgr2=0x7f7c78156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c777fe640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c780d1540 0x7f7c78156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c777fe640 1 -- 172.21.15.83:0/1390068517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7815dbe0 con 0x7f7c7815e840 2024-03-30T13:09:13.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c777fe640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c7815e840 0x7f7c78156a40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000cdd0 tx=0x7f7c7000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:13.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c5f7fe640 1 -- 172.21.15.83:0/1390068517 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70003ba0 con 0x7f7c7815e840 2024-03-30T13:09:13.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c5f7fe640 1 -- 172.21.15.83:0/1390068517 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c70003d40 con 0x7f7c7815e840 2024-03-30T13:09:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/1390068517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c78155890 con 0x7f7c7815e840 2024-03-30T13:09:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c5f7fe640 1 -- 172.21.15.83:0/1390068517 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000d880 con 0x7f7c7815e840 2024-03-30T13:09:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.751+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/1390068517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c78155e50 con 0x7f7c7815e840 2024-03-30T13:09:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.755+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/1390068517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c780a23d0 con 0x7f7c7815e840 2024-03-30T13:09:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.755+0000 7f7c5f7fe640 1 -- 172.21.15.83:0/1390068517 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f7c7000da20 con 0x7f7c7815e840 2024-03-30T13:09:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.755+0000 7f7c5f7fe640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7c64067fc0 0x7f7c6406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.755+0000 7f7c5f7fe640 1 -- 172.21.15.83:0/1390068517 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f7c70086dd0 con 0x7f7c7815e840 2024-03-30T13:09:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.755+0000 7f7c76ffd640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7c64067fc0 0x7f7c6406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.755+0000 7f7c76ffd640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7c64067fc0 0x7f7c6406a480 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7c680ad000 tx=0x7f7c68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:13.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.759+0000 7f7c5f7fe640 1 -- 172.21.15.83:0/1390068517 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f7c7815dbe0 con 0x7f7c7815e840 2024-03-30T13:09:13.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.919+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/1390068517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7c7804f9e0 con 0x7f7c7815e840 2024-03-30T13:09:13.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.919+0000 7f7c5f7fe640 1 -- 172.21.15.83:0/1390068517 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f7c700880a0 con 0x7f7c7815e840 2024-03-30T13:09:13.923 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:09:13.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.919+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/1390068517 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7c64067fc0 msgr2=0x7f7c6406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.919+0000 7f7c7d3e7640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7c64067fc0 0x7f7c6406a480 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7c680ad000 tx=0x7f7c68008040 comp rx=0 tx=0).stop 2024-03-30T13:09:13.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.919+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/1390068517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c7815e840 msgr2=0x7f7c78156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:13.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.919+0000 7f7c7d3e7640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c7815e840 0x7f7c78156a40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000cdd0 tx=0x7f7c7000a710 comp rx=0 tx=0).stop 2024-03-30T13:09:13.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.919+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/1390068517 shutdown_connections 2024-03-30T13:09:13.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.919+0000 7f7c7d3e7640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7c64067fc0 0x7f7c6406a480 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.923+0000 7f7c7d3e7640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c7815e840 0x7f7c78156a40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.923+0000 7f7c7d3e7640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c780d1540 0x7f7c78156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.923+0000 7f7c7d3e7640 1 --2- 172.21.15.83:0/1390068517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7c780cfc10 0x7f7c780c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:13.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.923+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/1390068517 >> 172.21.15.83:0/1390068517 conn(0x7f7c7809d7f0 msgr2=0x7f7c780b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.923+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/1390068517 shutdown_connections 2024-03-30T13:09:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:13.923+0000 7f7c7d3e7640 1 -- 172.21.15.83:0/1390068517 wait complete. 2024-03-30T13:09:13.945 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:09:14.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.059+0000 7f270c9af640 1 Processor -- start 2024-03-30T13:09:14.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.059+0000 7f270c9af640 1 -- start start 2024-03-30T13:09:14.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.059+0000 7f270c9af640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f270806bd70 0x7f270815cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.059+0000 7f270c9af640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27080b5570 con 0x7f2708145eb0 2024-03-30T13:09:14.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.059+0000 7f270c9af640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27080b5850 con 0x7f27080b40e0 2024-03-30T13:09:14.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.059+0000 7f270c9af640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f27080b5b30 con 0x7f270806bd70 2024-03-30T13:09:14.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.059+0000 7f270659c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f2708145eb0 0x7f270806b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59378/0 (socket says 172.21.15.83:59378) 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.059+0000 7f270659c640 1 -- 172.21.15.83:0/894942270 learned_addr learned my addr 172.21.15.83:0/894942270 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f26fffff640 1 --2- 172.21.15.83:0/894942270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f270806bd70 0x7f270815cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3077590976 0 0) 0x7f27080b5570 con 0x7f2708145eb0 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26f4003530 con 0x7f2708145eb0 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786434718 0 0) 0x7f27080b5850 con 0x7f27080b40e0 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27080b5570 con 0x7f27080b40e0 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1059621662 0 0) 0x7f26f4003530 con 0x7f2708145eb0 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f270806bd70 msgr2=0x7f270815cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 --2- 172.21.15.83:0/894942270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f270806bd70 0x7f270815cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 >> v1:172.21.15.153:6789/0 conn(0x7f27080b40e0 legacy=0x7f270815d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27080b5e10 con 0x7f2708145eb0 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f26f8001680 con 0x7f2708145eb0 2024-03-30T13:09:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 >> v1:172.21.15.83:6789/0 conn(0x7f2708145eb0 legacy=0x7f270806b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 --2- 172.21.15.83:0/894942270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f270806bd70 0x7f26f4003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 --2- 172.21.15.83:0/894942270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f4004130 0x7f26f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 --2- 172.21.15.83:0/894942270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f4004d50 0x7f26f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f27080b5b30 con 0x7f26f4004130 2024-03-30T13:09:14.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f26f400bb10 con 0x7f26f4004d50 2024-03-30T13:09:14.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f26f400bd10 con 0x7f270806bd70 2024-03-30T13:09:14.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f26fffff640 1 --2- 172.21.15.83:0/894942270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f4004130 0x7f26f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2706d9d640 1 --2- 172.21.15.83:0/894942270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f4004d50 0x7f26f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f270659c640 1 --2- 172.21.15.83:0/894942270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f270806bd70 0x7f26f4003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f26fffff640 1 -- 172.21.15.83:0/894942270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f270806bd70 msgr2=0x7f26f4003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:14.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f26fffff640 1 --2- 172.21.15.83:0/894942270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f270806bd70 0x7f26f4003b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f26fffff640 1 -- 172.21.15.83:0/894942270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f4004d50 msgr2=0x7f26f40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:14.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f26fffff640 1 --2- 172.21.15.83:0/894942270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f4004d50 0x7f26f40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f26fffff640 1 -- 172.21.15.83:0/894942270 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f4003530 con 0x7f26f4004130 2024-03-30T13:09:14.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f26fffff640 1 --2- 172.21.15.83:0/894942270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f4004130 0x7f26f4004810 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009ae0 tx=0x7f26f001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38c1b7b9893f027 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:14.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f00b2070 con 0x7f26f4004130 2024-03-30T13:09:14.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f00a55a0 con 0x7f26f4004130 2024-03-30T13:09:14.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2705d9b640 1 -- 172.21.15.83:0/894942270 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f00096b0 con 0x7f26f4004130 2024-03-30T13:09:14.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f270c9af640 1 -- 172.21.15.83:0/894942270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f4004130 msgr2=0x7f26f4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f270c9af640 1 --2- 172.21.15.83:0/894942270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f4004130 0x7f26f4004810 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009ae0 tx=0x7f26f001c9b0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.063+0000 7f2706d9d640 1 -- 172.21.15.83:0/894942270 reap_dead start 2024-03-30T13:09:14.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 -- 172.21.15.83:0/894942270 shutdown_connections 2024-03-30T13:09:14.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 -- 172.21.15.83:0/894942270 >> 172.21.15.83:0/894942270 conn(0x7f27080b6600 msgr2=0x7f27080b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:14.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 -- 172.21.15.83:0/894942270 shutdown_connections 2024-03-30T13:09:14.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 -- 172.21.15.83:0/894942270 wait complete. 2024-03-30T13:09:14.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 Processor -- start 2024-03-30T13:09:14.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 -- start start 2024-03-30T13:09:14.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f4004130 0x7f270809e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f270809ede0 0x7f270813e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270809ccf0 0x7f270814d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f27080b5130 con 0x7f270809ede0 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f27080b4fb0 con 0x7f270809ccf0 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f27080b52b0 con 0x7f26f4004130 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f26fffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f270809ede0 0x7f270813e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f26fffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f270809ede0 0x7f270813e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39322/0 (socket says 172.21.15.83:39322) 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f26fffff640 1 -- 172.21.15.83:0/3106196019 learned_addr learned my addr 172.21.15.83:0/3106196019 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270659c640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f4004130 0x7f270809e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f2706d9d640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270809ccf0 0x7f270814d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f26fffff640 1 -- 172.21.15.83:0/3106196019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f4004130 msgr2=0x7f270809e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f26fffff640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f4004130 0x7f270809e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f26fffff640 1 -- 172.21.15.83:0/3106196019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270809ccf0 msgr2=0x7f270814d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f26fffff640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270809ccf0 0x7f270814d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f26fffff640 1 -- 172.21.15.83:0/3106196019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270809d660 con 0x7f270809ede0 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270659c640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f4004130 0x7f270809e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:14.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f26fffff640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f270809ede0 0x7f270813e740 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f26f001c7e0 tx=0x7f26f4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:14.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f26feffd640 1 -- 172.21.15.83:0/3106196019 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f00bc020 con 0x7f270809ede0 2024-03-30T13:09:14.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f26feffd640 1 -- 172.21.15.83:0/3106196019 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f0004020 con 0x7f270809ede0 2024-03-30T13:09:14.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 -- 172.21.15.83:0/3106196019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f270809d940 con 0x7f270809ede0 2024-03-30T13:09:14.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f26feffd640 1 -- 172.21.15.83:0/3106196019 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f00b2040 con 0x7f270809ede0 2024-03-30T13:09:14.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 -- 172.21.15.83:0/3106196019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f270809df00 con 0x7f270809ede0 2024-03-30T13:09:14.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.067+0000 7f270c9af640 1 -- 172.21.15.83:0/3106196019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f270809f440 con 0x7f270809ede0 2024-03-30T13:09:14.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.071+0000 7f26feffd640 1 -- 172.21.15.83:0/3106196019 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f26f0003620 con 0x7f270809ede0 2024-03-30T13:09:14.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.071+0000 7f26feffd640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f26e8067ff0 0x7f26e806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.071+0000 7f26feffd640 1 -- 172.21.15.83:0/3106196019 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f26f01209f0 con 0x7f270809ede0 2024-03-30T13:09:14.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.071+0000 7f270659c640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f26e8067ff0 0x7f26e806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.071+0000 7f270659c640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f26e8067ff0 0x7f26e806a4b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f26f8001ec0 tx=0x7f26f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:14.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.075+0000 7f26feffd640 1 -- 172.21.15.83:0/3106196019 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f26f00c6020 con 0x7f270809ede0 2024-03-30T13:09:14.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.235+0000 7f270c9af640 1 -- 172.21.15.83:0/3106196019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f270804f9e0 con 0x7f270809ede0 2024-03-30T13:09:14.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.235+0000 7f26feffd640 1 -- 172.21.15.83:0/3106196019 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f26f00166c0 con 0x7f270809ede0 2024-03-30T13:09:14.241 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-03-30T13:09:14.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.239+0000 7f270c9af640 1 -- 172.21.15.83:0/3106196019 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f26e8067ff0 msgr2=0x7f26e806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.239+0000 7f270c9af640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f26e8067ff0 0x7f26e806a4b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f26f8001ec0 tx=0x7f26f8009040 comp rx=0 tx=0).stop 2024-03-30T13:09:14.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.239+0000 7f270c9af640 1 -- 172.21.15.83:0/3106196019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f270809ede0 msgr2=0x7f270813e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.239+0000 7f270c9af640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f270809ede0 0x7f270813e740 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f26f001c7e0 tx=0x7f26f4005840 comp rx=0 tx=0).stop 2024-03-30T13:09:14.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.239+0000 7f270c9af640 1 -- 172.21.15.83:0/3106196019 shutdown_connections 2024-03-30T13:09:14.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.239+0000 7f270c9af640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f26e8067ff0 0x7f26e806a4b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.239+0000 7f270c9af640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270809ccf0 0x7f270814d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.239+0000 7f270c9af640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f270809ede0 0x7f270813e740 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.239+0000 7f270c9af640 1 --2- 172.21.15.83:0/3106196019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f4004130 0x7f270809e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.239+0000 7f270c9af640 1 -- 172.21.15.83:0/3106196019 >> 172.21.15.83:0/3106196019 conn(0x7f27080b6600 msgr2=0x7f27080b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:14.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.239+0000 7f270c9af640 1 -- 172.21.15.83:0/3106196019 shutdown_connections 2024-03-30T13:09:14.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.239+0000 7f270c9af640 1 -- 172.21.15.83:0/3106196019 wait complete. 2024-03-30T13:09:14.259 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:09:14.259 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:09:14.265 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:14.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f6bbc640 1 Processor -- start 2024-03-30T13:09:14.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f6bbc640 1 -- start start 2024-03-30T13:09:14.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f6bbc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7f015c490 0x7fb7f00cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f6bbc640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb7f009b160 0x7fb7f00c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f6bbc640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f00ce2b0 con 0x7fb7f00b49c0 2024-03-30T13:09:14.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f6bbc640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb7f00ce590 con 0x7fb7f009b160 2024-03-30T13:09:14.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f6bbc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f00c5f30 con 0x7fb7f015c490 2024-03-30T13:09:14.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7effff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fb7f00b49c0 0x7fb7f009aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59388/0 (socket says 172.21.15.83:59388) 2024-03-30T13:09:14.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7effff640 1 -- 172.21.15.83:0/1508947490 learned_addr learned my addr 172.21.15.83:0/1508947490 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:14.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f4958640 1 --2- 172.21.15.83:0/1508947490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7f015c490 0x7fb7f00cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f5159640 1 --2- 172.21.15.83:0/1508947490 >> v2:172.21.15.153:3300/0 conn(0x7fb7f009b160 0x7fb7f00c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767657034 0 0) 0x7fb7f00ce2b0 con 0x7fb7f00b49c0 2024-03-30T13:09:14.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7dc003530 con 0x7fb7f00b49c0 2024-03-30T13:09:14.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 428167195 0 0) 0x7fb7dc003530 con 0x7fb7f00b49c0 2024-03-30T13:09:14.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7f015c490 msgr2=0x7fb7f00cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 --2- 172.21.15.83:0/1508947490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7f015c490 0x7fb7f00cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 >> v2:172.21.15.153:3300/0 conn(0x7fb7f009b160 msgr2=0x7fb7f00c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 --2- 172.21.15.83:0/1508947490 >> v2:172.21.15.153:3300/0 conn(0x7fb7f009b160 0x7fb7f00c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f00c6210 con 0x7fb7f00b49c0 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fb7e0001680 con 0x7fb7f00b49c0 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 >> v1:172.21.15.83:6789/0 conn(0x7fb7f00b49c0 legacy=0x7fb7f009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 --2- 172.21.15.83:0/1508947490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7dc0039c0 0x7fb7dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 --2- 172.21.15.83:0/1508947490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7f015c490 0x7fb7dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 --2- 172.21.15.83:0/1508947490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7dc004d50 0x7fb7dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f00ce590 con 0x7fb7dc004d50 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f00c5f30 con 0x7fb7dc0039c0 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc00fde0 con 0x7fb7f015c490 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f5159640 1 --2- 172.21.15.83:0/1508947490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7dc004d50 0x7fb7dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f4958640 1 --2- 172.21.15.83:0/1508947490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7dc0039c0 0x7fb7dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f5159640 1 -- 172.21.15.83:0/1508947490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7f015c490 msgr2=0x7fb7dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:14.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f5159640 1 --2- 172.21.15.83:0/1508947490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7f015c490 0x7fb7dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f5159640 1 -- 172.21.15.83:0/1508947490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7dc0039c0 msgr2=0x7fb7dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:14.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f5159640 1 --2- 172.21.15.83:0/1508947490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7dc0039c0 0x7fb7dc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.379+0000 7fb7f5159640 1 -- 172.21.15.83:0/1508947490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc003530 con 0x7fb7dc004d50 2024-03-30T13:09:14.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7f5159640 1 --2- 172.21.15.83:0/1508947490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7dc004d50 0x7fb7dc0051d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb7f006c140 tx=0x7fb7e8025350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634eca630658d7ba server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80b9070 con 0x7fb7dc004d50 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e80b4600 con 0x7fb7dc004d50 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7ef7fe640 1 -- 172.21.15.83:0/1508947490 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8009d00 con 0x7fb7dc004d50 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/1508947490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7dc004d50 msgr2=0x7fb7dc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7f6bbc640 1 --2- 172.21.15.83:0/1508947490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7dc004d50 0x7fb7dc0051d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb7f006c140 tx=0x7fb7e8025350 comp rx=0 tx=0).stop 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7f5159640 1 -- 172.21.15.83:0/1508947490 reap_dead start 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/1508947490 shutdown_connections 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/1508947490 >> 172.21.15.83:0/1508947490 conn(0x7fb7f00b3da0 msgr2=0x7fb7f00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/1508947490 shutdown_connections 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/1508947490 wait complete. 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7f6bbc640 1 Processor -- start 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.383+0000 7fb7f6bbc640 1 -- start start 2024-03-30T13:09:14.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f6bbc640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7f0155b20 0x7fb7f015ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f6bbc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7f00c7ff0 0x7fb7f00c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f6bbc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7f00ca160 0x7fb7f00ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f6bbc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f00cda20 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f6bbc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f00cd8a0 con 0x7fb7f00ca160 2024-03-30T13:09:14.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f6bbc640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f00cdba0 con 0x7fb7f0155b20 2024-03-30T13:09:14.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7effff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7f00c7ff0 0x7fb7f00c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7effff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7f00c7ff0 0x7fb7f00c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39334/0 (socket says 172.21.15.83:39334) 2024-03-30T13:09:14.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7effff640 1 -- 172.21.15.83:0/97019310 learned_addr learned my addr 172.21.15.83:0/97019310 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:14.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f4958640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7f0155b20 0x7fb7f015ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f5159640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7f00ca160 0x7fb7f00ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7effff640 1 -- 172.21.15.83:0/97019310 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7f0155b20 msgr2=0x7fb7f015ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7effff640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7f0155b20 0x7fb7f015ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7effff640 1 -- 172.21.15.83:0/97019310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7f00ca160 msgr2=0x7fb7f00ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7effff640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7f00ca160 0x7fb7f00ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7effff640 1 -- 172.21.15.83:0/97019310 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f00cf610 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7effff640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7f00c7ff0 0x7fb7f00c8470 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000ca70 tx=0x7fb7e000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:14.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7ed7fa640 1 -- 172.21.15.83:0/97019310 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0018070 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7ed7fa640 1 -- 172.21.15.83:0/97019310 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0004ce0 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/97019310 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f0155f00 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7ed7fa640 1 -- 172.21.15.83:0/97019310 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0007310 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/97019310 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f00cfb90 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/97019310 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f0068dd0 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7ed7fa640 1 -- 172.21.15.83:0/97019310 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb7e001b070 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7ed7fa640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb7d0067ff0 0x7fb7d006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7ed7fa640 1 -- 172.21.15.83:0/97019310 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7fb7e0085b00 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f4958640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb7d0067ff0 0x7fb7d006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.387+0000 7fb7f4958640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb7d0067ff0 0x7fb7d006a4b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00d1910 tx=0x7fb7d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:14.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.391+0000 7fb7ed7fa640 1 -- 172.21.15.83:0/97019310 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb7e00562c0 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.555+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/97019310 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7f015cfc0 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.555+0000 7fb7ed7fa640 1 -- 172.21.15.83:0/97019310 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16848 (secure 0 0 0) 0x7fb7e0055bc0 con 0x7fb7f00c7ff0 2024-03-30T13:09:14.561 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:14.561 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:09:07.416798+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:14.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.559+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/97019310 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb7d0067ff0 msgr2=0x7fb7d006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.559+0000 7fb7f6bbc640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb7d0067ff0 0x7fb7d006a4b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00d1910 tx=0x7fb7d8008040 comp rx=0 tx=0).stop 2024-03-30T13:09:14.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.559+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/97019310 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7f00c7ff0 msgr2=0x7fb7f00c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.559+0000 7fb7f6bbc640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7f00c7ff0 0x7fb7f00c8470 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000ca70 tx=0x7fb7e000cf30 comp rx=0 tx=0).stop 2024-03-30T13:09:14.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.559+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/97019310 shutdown_connections 2024-03-30T13:09:14.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.559+0000 7fb7f6bbc640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb7d0067ff0 0x7fb7d006a4b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.559+0000 7fb7f6bbc640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7f00ca160 0x7fb7f00ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.559+0000 7fb7f6bbc640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7f00c7ff0 0x7fb7f00c8470 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.559+0000 7fb7f6bbc640 1 --2- 172.21.15.83:0/97019310 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7f0155b20 0x7fb7f015ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.559+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/97019310 >> 172.21.15.83:0/97019310 conn(0x7fb7f00b3da0 msgr2=0x7fb7f00745e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:14.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.559+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/97019310 shutdown_connections 2024-03-30T13:09:14.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.559+0000 7fb7f6bbc640 1 -- 172.21.15.83:0/97019310 wait complete. 2024-03-30T13:09:14.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:09:14.581 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:09:14.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2b0bd0640 1 Processor -- start 2024-03-30T13:09:14.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2b0bd0640 1 -- start start 2024-03-30T13:09:14.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2b0bd0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac15e5d0 0x7fd2ac0afe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2b0bd0640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd2ac0b4fd0 0x7fd2ac06f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2b0bd0640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ac15e9b0 con 0x7fd2ac0b5430 2024-03-30T13:09:14.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2b0bd0640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac0b0390 con 0x7fd2ac0b4fd0 2024-03-30T13:09:14.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2b0bd0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac0b05c0 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2a9d9b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd2ac0b4fd0 0x7fd2ac06f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2aa59c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac15e5d0 0x7fd2ac0afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2a9d9b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd2ac0b4fd0 0x7fd2ac06f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:50992/0 (socket says 172.21.15.83:50992) 2024-03-30T13:09:14.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2aa59c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac15e5d0 0x7fd2ac0afe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:41552/0 (socket says 172.21.15.83:41552) 2024-03-30T13:09:14.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2a9d9b640 1 -- 172.21.15.83:0/394291970 learned_addr learned my addr 172.21.15.83:0/394291970 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:14.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2aa59c640 1 -- 172.21.15.83:0/394291970 >> v2:172.21.15.153:3300/0 conn(0x7fd2ac0b4fd0 msgr2=0x7fd2ac06f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:14.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2aa59c640 1 --2- 172.21.15.83:0/394291970 >> v2:172.21.15.153:3300/0 conn(0x7fd2ac0b4fd0 0x7fd2ac06f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2aa59c640 1 -- 172.21.15.83:0/394291970 >> v1:172.21.15.153:6789/0 conn(0x7fd2ac0b5430 legacy=0x7fd2ac162140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.699+0000 7fd2aa59c640 1 -- 172.21.15.83:0/394291970 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac06e2e0 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2aa59c640 1 --2- 172.21.15.83:0/394291970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac15e5d0 0x7fd2ac0afe50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0097c0 tx=0x7fd29c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e92c65311ea8010 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2a959a640 1 -- 172.21.15.83:0/394291970 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0b1070 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2a959a640 1 -- 172.21.15.83:0/394291970 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c0ac410 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2a959a640 1 -- 172.21.15.83:0/394291970 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0ac7e0 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/394291970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac15e5d0 msgr2=0x7fd2ac0afe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 --2- 172.21.15.83:0/394291970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac15e5d0 0x7fd2ac0afe50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0097c0 tx=0x7fd29c01c4a0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/394291970 shutdown_connections 2024-03-30T13:09:14.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 --2- 172.21.15.83:0/394291970 >> v2:172.21.15.153:3300/0 conn(0x7fd2ac0b4fd0 0x7fd2ac06f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 --2- 172.21.15.83:0/394291970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac15e5d0 0x7fd2ac0afe50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/394291970 >> 172.21.15.83:0/394291970 conn(0x7fd2ac072ec0 msgr2=0x7fd2ac06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:14.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/394291970 shutdown_connections 2024-03-30T13:09:14.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/394291970 wait complete. 2024-03-30T13:09:14.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 Processor -- start 2024-03-30T13:09:14.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 -- start start 2024-03-30T13:09:14.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2ac0b4fd0 0x7fd2ac14a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac0b5430 0x7fd2ac1f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2ac15e5d0 0x7fd2ac1fae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac16b4e0 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac06ec10 con 0x7fd2ac0b4fd0 2024-03-30T13:09:14.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.703+0000 7fd2b0bd0640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac16b660 con 0x7fd2ac0b5430 2024-03-30T13:09:14.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2aad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2ac15e5d0 0x7fd2ac1fae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2aad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2ac15e5d0 0x7fd2ac1fae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39344/0 (socket says 172.21.15.83:39344) 2024-03-30T13:09:14.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2aad9d640 1 -- 172.21.15.83:0/1708960550 learned_addr learned my addr 172.21.15.83:0/1708960550 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2aa59c640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2ac0b4fd0 0x7fd2ac14a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2a9d9b640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac0b5430 0x7fd2ac1f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2aad9d640 1 -- 172.21.15.83:0/1708960550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac0b5430 msgr2=0x7fd2ac1f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2aad9d640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac0b5430 0x7fd2ac1f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2aad9d640 1 -- 172.21.15.83:0/1708960550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2ac0b4fd0 msgr2=0x7fd2ac14a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2aad9d640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2ac0b4fd0 0x7fd2ac14a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2aad9d640 1 -- 172.21.15.83:0/1708960550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac0cd210 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2a9d9b640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac0b5430 0x7fd2ac1f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2aad9d640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2ac15e5d0 0x7fd2ac1fae70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400c730 tx=0x7fd2a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd29affd640 1 -- 172.21.15.83:0/1708960550 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4003b80 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd29affd640 1 -- 172.21.15.83:0/1708960550 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a4003d20 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/1708960550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ac0cd4f0 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd29affd640 1 -- 172.21.15.83:0/1708960550 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a400aa30 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/1708960550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ac0cdab0 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/1708960550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ac073790 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd29affd640 1 -- 172.21.15.83:0/1708960550 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fd2a400abd0 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd29affd640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd28c067ff0 0x7fd28c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:14.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd29affd640 1 -- 172.21.15.83:0/1708960550 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7fd2a40863f0 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2aa59c640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd28c067ff0 0x7fd28c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:14.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.707+0000 7fd2aa59c640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd28c067ff0 0x7fd28c06a4b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0097c0 tx=0x7fd29c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:14.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.711+0000 7fd29affd640 1 -- 172.21.15.83:0/1708960550 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fd2a4056b20 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.859+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/1708960550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd2ac070460 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.859+0000 7fd29affd640 1 -- 172.21.15.83:0/1708960550 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fd2a4056420 con 0x7fd2ac15e5d0 2024-03-30T13:09:14.866 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:09:14.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.863+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/1708960550 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd28c067ff0 msgr2=0x7fd28c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.863+0000 7fd2b0bd0640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd28c067ff0 0x7fd28c06a4b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0097c0 tx=0x7fd29c008040 comp rx=0 tx=0).stop 2024-03-30T13:09:14.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.863+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/1708960550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2ac15e5d0 msgr2=0x7fd2ac1fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:14.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.863+0000 7fd2b0bd0640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2ac15e5d0 0x7fd2ac1fae70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400c730 tx=0x7fd2a400cbf0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.863+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/1708960550 shutdown_connections 2024-03-30T13:09:14.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.863+0000 7fd2b0bd0640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd28c067ff0 0x7fd28c06a4b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.863+0000 7fd2b0bd0640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2ac15e5d0 0x7fd2ac1fae70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.863+0000 7fd2b0bd0640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2ac0b5430 0x7fd2ac1f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.863+0000 7fd2b0bd0640 1 --2- 172.21.15.83:0/1708960550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2ac0b4fd0 0x7fd2ac14a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:14.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.863+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/1708960550 >> 172.21.15.83:0/1708960550 conn(0x7fd2ac072ec0 msgr2=0x7fd2ac157570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:14.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.863+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/1708960550 shutdown_connections 2024-03-30T13:09:14.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.863+0000 7fd2b0bd0640 1 -- 172.21.15.83:0/1708960550 wait complete. 2024-03-30T13:09:14.883 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:09:15.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.999+0000 7fed4aaff640 1 Processor -- start 2024-03-30T13:09:15.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:14.999+0000 7fed4aaff640 1 -- start start 2024-03-30T13:09:15.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4aaff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fed4415b050 0x7fed44073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4aaff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed4406f860 0x7fed4415b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4aaff640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed440b31e0 con 0x7fed440b3ca0 2024-03-30T13:09:15.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4aaff640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fed44073ab0 con 0x7fed4415b050 2024-03-30T13:09:15.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4aaff640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fed440ad4f0 con 0x7fed4406f860 2024-03-30T13:09:15.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4889b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fed4415b050 0x7fed44073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed43fff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fed440b3ca0 0x7fed4406f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59390/0 (socket says 172.21.15.83:59390) 2024-03-30T13:09:15.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed43fff640 1 -- 172.21.15.83:0/952980799 learned_addr learned my addr 172.21.15.83:0/952980799 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:15.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4889b640 1 --2- 172.21.15.83:0/952980799 >> v2:172.21.15.83:3300/0 conn(0x7fed4415b050 0x7fed44073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39348/0 (socket says 172.21.15.83:39348) 2024-03-30T13:09:15.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4909c640 1 --2- 172.21.15.83:0/952980799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed4406f860 0x7fed4415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4889b640 1 -- 172.21.15.83:0/952980799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed4406f860 msgr2=0x7fed4415b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:15.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4889b640 1 --2- 172.21.15.83:0/952980799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed4406f860 0x7fed4415b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4889b640 1 -- 172.21.15.83:0/952980799 >> v1:172.21.15.83:6789/0 conn(0x7fed440b3ca0 legacy=0x7fed4406f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4889b640 1 -- 172.21.15.83:0/952980799 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed440ad7d0 con 0x7fed4415b050 2024-03-30T13:09:15.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed437fe640 1 -- 172.21.15.83:0/952980799 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1665400836 0 0) 0x7fed440b31e0 con 0x7fed440b3ca0 2024-03-30T13:09:15.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.003+0000 7fed4889b640 1 --2- 172.21.15.83:0/952980799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4415b050 0x7fed44073570 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fed3400ba60 tx=0x7fed3401eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8fe7af3129df42 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:15.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed437fe640 1 -- 172.21.15.83:0/952980799 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed340b4070 con 0x7fed4415b050 2024-03-30T13:09:15.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed437fe640 1 -- 172.21.15.83:0/952980799 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed340a7c10 con 0x7fed4415b050 2024-03-30T13:09:15.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed437fe640 1 -- 172.21.15.83:0/952980799 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed340af440 con 0x7fed4415b050 2024-03-30T13:09:15.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 -- 172.21.15.83:0/952980799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4415b050 msgr2=0x7fed44073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 --2- 172.21.15.83:0/952980799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4415b050 0x7fed44073570 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fed3400ba60 tx=0x7fed3401eb40 comp rx=0 tx=0).stop 2024-03-30T13:09:15.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 -- 172.21.15.83:0/952980799 shutdown_connections 2024-03-30T13:09:15.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 --2- 172.21.15.83:0/952980799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed4406f860 0x7fed4415b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 --2- 172.21.15.83:0/952980799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4415b050 0x7fed44073570 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 -- 172.21.15.83:0/952980799 >> 172.21.15.83:0/952980799 conn(0x7fed4406b660 msgr2=0x7fed4406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:15.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 -- 172.21.15.83:0/952980799 shutdown_connections 2024-03-30T13:09:15.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 -- 172.21.15.83:0/952980799 wait complete. 2024-03-30T13:09:15.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 Processor -- start 2024-03-30T13:09:15.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 -- start start 2024-03-30T13:09:15.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed4406f860 0x7fed4415dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed440b3ca0 0x7fed4414b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4415b050 0x7fed4409a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fed440b4250 con 0x7fed4415b050 2024-03-30T13:09:15.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed440b40d0 con 0x7fed440b3ca0 2024-03-30T13:09:15.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fed440b4c10 con 0x7fed4406f860 2024-03-30T13:09:15.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4909c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4415b050 0x7fed4409a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4909c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4415b050 0x7fed4409a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39358/0 (socket says 172.21.15.83:39358) 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4909c640 1 -- 172.21.15.83:0/826433203 learned_addr learned my addr 172.21.15.83:0/826433203 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed43fff640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed440b3ca0 0x7fed4414b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4889b640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed4406f860 0x7fed4415dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4909c640 1 -- 172.21.15.83:0/826433203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed4406f860 msgr2=0x7fed4415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4909c640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed4406f860 0x7fed4415dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4909c640 1 -- 172.21.15.83:0/826433203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed440b3ca0 msgr2=0x7fed4414b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4909c640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed440b3ca0 0x7fed4414b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4909c640 1 -- 172.21.15.83:0/826433203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4415cff0 con 0x7fed4415b050 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed43fff640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed440b3ca0 0x7fed4414b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4909c640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4415b050 0x7fed4409a2d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fed3c007e40 tx=0x7fed3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed417fa640 1 -- 172.21.15.83:0/826433203 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c014620 con 0x7fed4415b050 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed417fa640 1 -- 172.21.15.83:0/826433203 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3c019070 con 0x7fed4415b050 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 -- 172.21.15.83:0/826433203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4415d2d0 con 0x7fed4415b050 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed417fa640 1 -- 172.21.15.83:0/826433203 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c014a20 con 0x7fed4415b050 2024-03-30T13:09:15.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.007+0000 7fed4aaff640 1 -- 172.21.15.83:0/826433203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed44152420 con 0x7fed4415b050 2024-03-30T13:09:15.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.011+0000 7fed4aaff640 1 -- 172.21.15.83:0/826433203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed4409e540 con 0x7fed4415b050 2024-03-30T13:09:15.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.011+0000 7fed417fa640 1 -- 172.21.15.83:0/826433203 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fed3c014bc0 con 0x7fed4415b050 2024-03-30T13:09:15.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.011+0000 7fed417fa640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fed30067fc0 0x7fed3006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.011+0000 7fed4889b640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fed30067fc0 0x7fed3006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.011+0000 7fed417fa640 1 -- 172.21.15.83:0/826433203 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7fed3c086fe0 con 0x7fed4415b050 2024-03-30T13:09:15.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.011+0000 7fed4889b640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fed30067fc0 0x7fed3006a480 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fed340b1000 tx=0x7fed340a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.015+0000 7fed417fa640 1 -- 172.21.15.83:0/826433203 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fed3c057670 con 0x7fed4415b050 2024-03-30T13:09:15.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 -- 172.21.15.83:0/826433203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fed4406bb70 con 0x7fed4415b050 2024-03-30T13:09:15.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed417fa640 1 -- 172.21.15.83:0/826433203 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fed3c056f70 con 0x7fed4415b050 2024-03-30T13:09:15.167 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:09:15.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 -- 172.21.15.83:0/826433203 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fed30067fc0 msgr2=0x7fed3006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fed30067fc0 0x7fed3006a480 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fed340b1000 tx=0x7fed340a9070 comp rx=0 tx=0).stop 2024-03-30T13:09:15.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 -- 172.21.15.83:0/826433203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4415b050 msgr2=0x7fed4409a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4415b050 0x7fed4409a2d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fed3c007e40 tx=0x7fed3c00e4b0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 -- 172.21.15.83:0/826433203 shutdown_connections 2024-03-30T13:09:15.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fed30067fc0 0x7fed3006a480 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4415b050 0x7fed4409a2d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed440b3ca0 0x7fed4414b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 --2- 172.21.15.83:0/826433203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed4406f860 0x7fed4415dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 -- 172.21.15.83:0/826433203 >> 172.21.15.83:0/826433203 conn(0x7fed4406b660 msgr2=0x7fed440b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:15.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 -- 172.21.15.83:0/826433203 shutdown_connections 2024-03-30T13:09:15.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.163+0000 7fed4aaff640 1 -- 172.21.15.83:0/826433203 wait complete. 2024-03-30T13:09:15.184 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:09:15.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.291+0000 7fa4e5ed6640 1 Processor -- start 2024-03-30T13:09:15.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.291+0000 7fa4e5ed6640 1 -- start start 2024-03-30T13:09:15.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4e5ed6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4e015c8e0 0x7fa4e00ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4e5ed6640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa4e00adac0 0x7fa4e015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4e5ed6640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4e00ae040 con 0x7fa4e015d200 2024-03-30T13:09:15.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4e5ed6640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fa4e00b31e0 con 0x7fa4e00adac0 2024-03-30T13:09:15.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4e5ed6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e00ae320 con 0x7fa4e015c8e0 2024-03-30T13:09:15.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4deffd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa4e00adac0 0x7fa4e015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4deffd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa4e00adac0 0x7fa4e015ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39364/0 (socket says 172.21.15.83:39364) 2024-03-30T13:09:15.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4dffff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fa4e015d200 0x7fa4e00b3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59398/0 (socket says 172.21.15.83:59398) 2024-03-30T13:09:15.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4deffd640 1 -- 172.21.15.83:0/3546808865 learned_addr learned my addr 172.21.15.83:0/3546808865 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:15.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4df7fe640 1 --2- 172.21.15.83:0/3546808865 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4e015c8e0 0x7fa4e00ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4deffd640 1 -- 172.21.15.83:0/3546808865 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4e015c8e0 msgr2=0x7fa4e00ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:15.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4deffd640 1 --2- 172.21.15.83:0/3546808865 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4e015c8e0 0x7fa4e00ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4deffd640 1 -- 172.21.15.83:0/3546808865 >> v1:172.21.15.83:6789/0 conn(0x7fa4e015d200 legacy=0x7fa4e00b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4deffd640 1 -- 172.21.15.83:0/3546808865 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e00ae600 con 0x7fa4e00adac0 2024-03-30T13:09:15.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4df7fe640 1 --2- 172.21.15.83:0/3546808865 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4e015c8e0 0x7fa4e00ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:15.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4deffd640 1 --2- 172.21.15.83:0/3546808865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4e00adac0 0x7fa4e015ccc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009870 tx=0x7fa4d401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d250b4b61b73a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:15.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4de7fc640 1 -- 172.21.15.83:0/3546808865 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40a7070 con 0x7fa4e00adac0 2024-03-30T13:09:15.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4de7fc640 1 -- 172.21.15.83:0/3546808865 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d40b0070 con 0x7fa4e00adac0 2024-03-30T13:09:15.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4de7fc640 1 -- 172.21.15.83:0/3546808865 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40ab890 con 0x7fa4e00adac0 2024-03-30T13:09:15.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/3546808865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4e00adac0 msgr2=0x7fa4e015ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.295+0000 7fa4e5ed6640 1 --2- 172.21.15.83:0/3546808865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4e00adac0 0x7fa4e015ccc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009870 tx=0x7fa4d401c560 comp rx=0 tx=0).stop 2024-03-30T13:09:15.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/3546808865 shutdown_connections 2024-03-30T13:09:15.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 --2- 172.21.15.83:0/3546808865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4e00adac0 0x7fa4e015ccc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 --2- 172.21.15.83:0/3546808865 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4e015c8e0 0x7fa4e00ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/3546808865 >> 172.21.15.83:0/3546808865 conn(0x7fa4e006b660 msgr2=0x7fa4e006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:15.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/3546808865 shutdown_connections 2024-03-30T13:09:15.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/3546808865 wait complete. 2024-03-30T13:09:15.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 Processor -- start 2024-03-30T13:09:15.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 -- start start 2024-03-30T13:09:15.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4e00adac0 0x7fa4e0152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4e015c8e0 0x7fa4e015de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4e015d200 0x7fa4e01473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00b4710 con 0x7fa4e00adac0 2024-03-30T13:09:15.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00b4590 con 0x7fa4e015c8e0 2024-03-30T13:09:15.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e00b4890 con 0x7fa4e015d200 2024-03-30T13:09:15.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4df7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4e00adac0 0x7fa4e0152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4df7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4e00adac0 0x7fa4e0152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39368/0 (socket says 172.21.15.83:39368) 2024-03-30T13:09:15.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4df7fe640 1 -- 172.21.15.83:0/288606543 learned_addr learned my addr 172.21.15.83:0/288606543 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4dffff640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4e015d200 0x7fa4e01473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4deffd640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4e015c8e0 0x7fa4e015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4df7fe640 1 -- 172.21.15.83:0/288606543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4e015d200 msgr2=0x7fa4e01473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4df7fe640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4e015d200 0x7fa4e01473e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4df7fe640 1 -- 172.21.15.83:0/288606543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4e015c8e0 msgr2=0x7fa4e015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4df7fe640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4e015c8e0 0x7fa4e015de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4df7fe640 1 -- 172.21.15.83:0/288606543 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e015e6f0 con 0x7fa4e00adac0 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4dffff640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4e015d200 0x7fa4e01473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4deffd640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4e015c8e0 0x7fa4e015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4df7fe640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4e00adac0 0x7fa4e0152290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009fd0 tx=0x7fa4d800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4c7fff640 1 -- 172.21.15.83:0/288606543 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d801a070 con 0x7fa4e00adac0 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4c7fff640 1 -- 172.21.15.83:0/288606543 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d8003bc0 con 0x7fa4e00adac0 2024-03-30T13:09:15.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/288606543 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e015e9d0 con 0x7fa4e00adac0 2024-03-30T13:09:15.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4c7fff640 1 -- 172.21.15.83:0/288606543 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8004030 con 0x7fa4e00adac0 2024-03-30T13:09:15.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/288606543 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e015ef90 con 0x7fa4e00adac0 2024-03-30T13:09:15.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.299+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/288606543 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e009e540 con 0x7fa4e00adac0 2024-03-30T13:09:15.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.303+0000 7fa4c7fff640 1 -- 172.21.15.83:0/288606543 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa4d801d070 con 0x7fa4e00adac0 2024-03-30T13:09:15.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.303+0000 7fa4c7fff640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa4cc067fc0 0x7fa4cc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.303+0000 7fa4deffd640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa4cc067fc0 0x7fa4cc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.303+0000 7fa4c7fff640 1 -- 172.21.15.83:0/288606543 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7fa4d80866b0 con 0x7fa4e00adac0 2024-03-30T13:09:15.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.303+0000 7fa4deffd640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa4cc067fc0 0x7fa4cc06a480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40af000 tx=0x7fa4d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:15.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.307+0000 7fa4c7fff640 1 -- 172.21.15.83:0/288606543 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fa4d8010070 con 0x7fa4e00adac0 2024-03-30T13:09:15.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.455+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/288606543 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa4e00ad6b0 con 0x7fa4e00adac0 2024-03-30T13:09:15.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.455+0000 7fa4c7fff640 1 -- 172.21.15.83:0/288606543 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fa4d8056820 con 0x7fa4e00adac0 2024-03-30T13:09:15.461 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:09:15.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.459+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/288606543 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa4cc067fc0 msgr2=0x7fa4cc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.459+0000 7fa4e5ed6640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa4cc067fc0 0x7fa4cc06a480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40af000 tx=0x7fa4d4008040 comp rx=0 tx=0).stop 2024-03-30T13:09:15.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.459+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/288606543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4e00adac0 msgr2=0x7fa4e0152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.459+0000 7fa4e5ed6640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4e00adac0 0x7fa4e0152290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009fd0 tx=0x7fa4d800d560 comp rx=0 tx=0).stop 2024-03-30T13:09:15.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.459+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/288606543 shutdown_connections 2024-03-30T13:09:15.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.459+0000 7fa4e5ed6640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa4cc067fc0 0x7fa4cc06a480 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.459+0000 7fa4e5ed6640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4e015d200 0x7fa4e01473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.459+0000 7fa4e5ed6640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4e015c8e0 0x7fa4e015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.459+0000 7fa4e5ed6640 1 --2- 172.21.15.83:0/288606543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4e00adac0 0x7fa4e0152290 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.459+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/288606543 >> 172.21.15.83:0/288606543 conn(0x7fa4e006b660 msgr2=0x7fa4e014ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.459+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/288606543 shutdown_connections 2024-03-30T13:09:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.459+0000 7fa4e5ed6640 1 -- 172.21.15.83:0/288606543 wait complete. 2024-03-30T13:09:15.480 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:09:15.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c782f640 1 Processor -- start 2024-03-30T13:09:15.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c782f640 1 -- start start 2024-03-30T13:09:15.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c782f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f56c015e840 0x7f56c00d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c782f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56c00cfc10 0x7f56c00d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c782f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56c00d51f0 con 0x7f56c00d0e30 2024-03-30T13:09:15.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c782f640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f56c015ec20 con 0x7f56c015e840 2024-03-30T13:09:15.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c782f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f56c00d2d50 con 0x7f56c00cfc10 2024-03-30T13:09:15.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c55cb640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f56c015e840 0x7f56c00d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c55cb640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f56c015e840 0x7f56c00d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39380/0 (socket says 172.21.15.83:39380) 2024-03-30T13:09:15.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c5dcc640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f56c00d0e30 0x7f56c01622b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:53654/0 (socket says 172.21.15.83:53654) 2024-03-30T13:09:15.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c55cb640 1 -- 172.21.15.83:0/115412844 learned_addr learned my addr 172.21.15.83:0/115412844 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:15.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c4dca640 1 --2- 172.21.15.83:0/115412844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56c00cfc10 0x7f56c00d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c55cb640 1 -- 172.21.15.83:0/115412844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56c00cfc10 msgr2=0x7f56c00d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:15.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c55cb640 1 --2- 172.21.15.83:0/115412844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56c00cfc10 0x7f56c00d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c55cb640 1 -- 172.21.15.83:0/115412844 >> v1:172.21.15.153:6789/0 conn(0x7f56c00d0e30 legacy=0x7f56c01622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.595+0000 7f56c55cb640 1 -- 172.21.15.83:0/115412844 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c00d2140 con 0x7f56c015e840 2024-03-30T13:09:15.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c55cb640 1 --2- 172.21.15.83:0/115412844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c015e840 0x7f56c00d31e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009870 tx=0x7f56bc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b117b5fe530793a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:15.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56b7fff640 1 -- 172.21.15.83:0/115412844 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0aa430 con 0x7f56c015e840 2024-03-30T13:09:15.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56b7fff640 1 -- 172.21.15.83:0/115412844 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56bc0af070 con 0x7f56c015e840 2024-03-30T13:09:15.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56b7fff640 1 -- 172.21.15.83:0/115412844 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0aa7f0 con 0x7f56c015e840 2024-03-30T13:09:15.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 -- 172.21.15.83:0/115412844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c015e840 msgr2=0x7f56c00d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 --2- 172.21.15.83:0/115412844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c015e840 0x7f56c00d31e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009870 tx=0x7f56bc01c4d0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 -- 172.21.15.83:0/115412844 shutdown_connections 2024-03-30T13:09:15.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 --2- 172.21.15.83:0/115412844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56c00cfc10 0x7f56c00d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 --2- 172.21.15.83:0/115412844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c015e840 0x7f56c00d31e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 -- 172.21.15.83:0/115412844 >> 172.21.15.83:0/115412844 conn(0x7f56c009d7f0 msgr2=0x7f56c00d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:15.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 -- 172.21.15.83:0/115412844 shutdown_connections 2024-03-30T13:09:15.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 -- 172.21.15.83:0/115412844 wait complete. 2024-03-30T13:09:15.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 Processor -- start 2024-03-30T13:09:15.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 -- start start 2024-03-30T13:09:15.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56c00cfc10 0x7f56c00c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56c00d0e30 0x7f56c00b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c015e840 0x7f56c01567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f56c00d1650 con 0x7f56c015e840 2024-03-30T13:09:15.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f56c016b5f0 con 0x7f56c00d0e30 2024-03-30T13:09:15.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f56c00b9300 con 0x7f56c00cfc10 2024-03-30T13:09:15.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c5dcc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c015e840 0x7f56c01567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c5dcc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c015e840 0x7f56c01567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39384/0 (socket says 172.21.15.83:39384) 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c5dcc640 1 -- 172.21.15.83:0/2954115460 learned_addr learned my addr 172.21.15.83:0/2954115460 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c4dca640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56c00d0e30 0x7f56c00b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c55cb640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56c00cfc10 0x7f56c00c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c5dcc640 1 -- 172.21.15.83:0/2954115460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56c00cfc10 msgr2=0x7f56c00c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c5dcc640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56c00cfc10 0x7f56c00c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c5dcc640 1 -- 172.21.15.83:0/2954115460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56c00d0e30 msgr2=0x7f56c00b89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c5dcc640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56c00d0e30 0x7f56c00b89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c5dcc640 1 -- 172.21.15.83:0/2954115460 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c00b95e0 con 0x7f56c015e840 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c55cb640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56c00cfc10 0x7f56c00c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c5dcc640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c015e840 0x7f56c01567a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f56b800c730 tx=0x7f56b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56b5ffb640 1 -- 172.21.15.83:0/2954115460 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b8017070 con 0x7f56c015e840 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56b5ffb640 1 -- 172.21.15.83:0/2954115460 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56b800ce40 con 0x7f56c015e840 2024-03-30T13:09:15.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 -- 172.21.15.83:0/2954115460 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c00b98c0 con 0x7f56c015e840 2024-03-30T13:09:15.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56b5ffb640 1 -- 172.21.15.83:0/2954115460 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b800a840 con 0x7f56c015e840 2024-03-30T13:09:15.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.599+0000 7f56c782f640 1 -- 172.21.15.83:0/2954115460 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c015edb0 con 0x7f56c015e840 2024-03-30T13:09:15.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.603+0000 7f56c782f640 1 -- 172.21.15.83:0/2954115460 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56c015bd60 con 0x7f56c015e840 2024-03-30T13:09:15.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.603+0000 7f56b5ffb640 1 -- 172.21.15.83:0/2954115460 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f56b801a070 con 0x7f56c015e840 2024-03-30T13:09:15.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.603+0000 7f56b5ffb640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f56a4067fc0 0x7f56a406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.603+0000 7f56b5ffb640 1 -- 172.21.15.83:0/2954115460 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f56b8085b30 con 0x7f56c015e840 2024-03-30T13:09:15.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.603+0000 7f56c55cb640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f56a4067fc0 0x7f56a406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.603+0000 7f56c55cb640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f56a4067fc0 0x7f56a406a480 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0ae000 tx=0x7f56bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:15.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.607+0000 7f56b5ffb640 1 -- 172.21.15.83:0/2954115460 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f56c00d51f0 con 0x7f56c015e840 2024-03-30T13:09:15.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.775+0000 7f56c782f640 1 -- 172.21.15.83:0/2954115460 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f56c00a23d0 con 0x7f56c015e840 2024-03-30T13:09:15.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56b5ffb640 1 -- 172.21.15.83:0/2954115460 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f56b8055b80 con 0x7f56c015e840 2024-03-30T13:09:15.782 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-03-30T13:09:15.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56c782f640 1 -- 172.21.15.83:0/2954115460 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f56a4067fc0 msgr2=0x7f56a406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56c782f640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f56a4067fc0 0x7f56a406a480 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0ae000 tx=0x7f56bc008040 comp rx=0 tx=0).stop 2024-03-30T13:09:15.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56c782f640 1 -- 172.21.15.83:0/2954115460 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c015e840 msgr2=0x7f56c01567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56c782f640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c015e840 0x7f56c01567a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f56b800c730 tx=0x7f56b800cbf0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56c782f640 1 -- 172.21.15.83:0/2954115460 shutdown_connections 2024-03-30T13:09:15.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56c782f640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f56a4067fc0 0x7f56a406a480 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56c782f640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c015e840 0x7f56c01567a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56c782f640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56c00d0e30 0x7f56c00b89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56c782f640 1 --2- 172.21.15.83:0/2954115460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56c00cfc10 0x7f56c00c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56c782f640 1 -- 172.21.15.83:0/2954115460 >> 172.21.15.83:0/2954115460 conn(0x7f56c009d7f0 msgr2=0x7f56c00b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:15.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56c782f640 1 -- 172.21.15.83:0/2954115460 shutdown_connections 2024-03-30T13:09:15.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.779+0000 7f56c782f640 1 -- 172.21.15.83:0/2954115460 wait complete. 2024-03-30T13:09:15.801 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-03-30T13:09:15.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:15.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-03-30T13:09:15.816 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:09:15.816 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:09:15.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:15.816 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-30T13:09:15.864 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-30T13:09:15.864 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:09:15.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.975+0000 7f70f635f640 1 Processor -- start 2024-03-30T13:09:15.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.975+0000 7f70f635f640 1 -- start start 2024-03-30T13:09:15.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70f635f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f70f006eff0 0x7f70f0167270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70f635f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70f00cfcb0 con 0x7f70f00aed20 2024-03-30T13:09:15.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70f635f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70f00ad290 con 0x7f70f00b4830 2024-03-30T13:09:15.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70f635f640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f70f0156e00 con 0x7f70f006eff0 2024-03-30T13:09:15.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70ef7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f70f00aed20 0x7f70f00af1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59406/0 (socket says 172.21.15.83:59406) 2024-03-30T13:09:15.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70ef7fe640 1 -- 172.21.15.83:0/1796189926 learned_addr learned my addr 172.21.15.83:0/1796189926 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70f48fc640 1 --2- 172.21.15.83:0/1796189926 >> v2:172.21.15.153:3300/0 conn(0x7f70f006eff0 0x7f70f0167270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 132126132 0 0) 0x7f70f00cfcb0 con 0x7f70f00aed20 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70d8003530 con 0x7f70f00aed20 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1372158530 0 0) 0x7f70d8003530 con 0x7f70f00aed20 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 >> v2:172.21.15.153:3300/0 conn(0x7f70f006eff0 msgr2=0x7f70f0167270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 --2- 172.21.15.83:0/1796189926 >> v2:172.21.15.153:3300/0 conn(0x7f70f006eff0 0x7f70f0167270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 >> v1:172.21.15.153:6789/0 conn(0x7f70f00b4830 legacy=0x7f70f015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f00ad570 con 0x7f70f00aed20 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f70e4001680 con 0x7f70f00aed20 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 >> v1:172.21.15.83:6789/0 conn(0x7f70f00aed20 legacy=0x7f70f00af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 --2- 172.21.15.83:0/1796189926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d80039c0 0x7f70d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 --2- 172.21.15.83:0/1796189926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d8004810 0x7f70d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 --2- 172.21.15.83:0/1796189926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d80052f0 0x7f70d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f70f0156e00 con 0x7f70d8004810 2024-03-30T13:09:15.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70d800c1c0 con 0x7f70d80052f0 2024-03-30T13:09:15.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f70d800c3c0 con 0x7f70d80039c0 2024-03-30T13:09:15.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70ef7fe640 1 --2- 172.21.15.83:0/1796189926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d8004810 0x7f70d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70f48fc640 1 --2- 172.21.15.83:0/1796189926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d80052f0 0x7f70d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70effff640 1 --2- 172.21.15.83:0/1796189926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d80039c0 0x7f70d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70ef7fe640 1 -- 172.21.15.83:0/1796189926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d80039c0 msgr2=0x7f70d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:15.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70ef7fe640 1 --2- 172.21.15.83:0/1796189926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d80039c0 0x7f70d8003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70ef7fe640 1 -- 172.21.15.83:0/1796189926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d80052f0 msgr2=0x7f70d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:15.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70ef7fe640 1 --2- 172.21.15.83:0/1796189926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d80052f0 0x7f70d800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70ef7fe640 1 -- 172.21.15.83:0/1796189926 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d8003530 con 0x7f70d8004810 2024-03-30T13:09:15.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.979+0000 7f70f48fc640 1 -- 172.21.15.83:0/1796189926 reap_dead start 2024-03-30T13:09:15.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70ef7fe640 1 --2- 172.21.15.83:0/1796189926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d8004810 0x7f70d8004c90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c190 tx=0x7f70e401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388c0c8182e29f3c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:15.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4007d00 con 0x7f70d8004810 2024-03-30T13:09:15.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e40a9020 con 0x7f70d8004810 2024-03-30T13:09:15.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70eeffd640 1 -- 172.21.15.83:0/1796189926 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4005ae0 con 0x7f70d8004810 2024-03-30T13:09:15.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 -- 172.21.15.83:0/1796189926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d8004810 msgr2=0x7f70d8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 --2- 172.21.15.83:0/1796189926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d8004810 0x7f70d8004c90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c190 tx=0x7f70e401cbc0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 -- 172.21.15.83:0/1796189926 shutdown_connections 2024-03-30T13:09:15.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 --2- 172.21.15.83:0/1796189926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d8004810 0x7f70d8004c90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 -- 172.21.15.83:0/1796189926 >> 172.21.15.83:0/1796189926 conn(0x7f70f00b1d60 msgr2=0x7f70f00b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:15.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 -- 172.21.15.83:0/1796189926 shutdown_connections 2024-03-30T13:09:15.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 -- 172.21.15.83:0/1796189926 wait complete. 2024-03-30T13:09:15.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 Processor -- start 2024-03-30T13:09:15.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 -- start start 2024-03-30T13:09:15.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d8004810 0x7f70f014e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70f014e930 0x7f70f0071800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70f01505a0 0x7f70f0150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f70f00af720 con 0x7f70f01505a0 2024-03-30T13:09:15.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70f00af5a0 con 0x7f70f014e930 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f70f00cf860 con 0x7f70d8004810 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f48fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70f01505a0 0x7f70f0150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f48fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70f01505a0 0x7f70f0150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39404/0 (socket says 172.21.15.83:39404) 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f48fc640 1 -- 172.21.15.83:0/1453962802 learned_addr learned my addr 172.21.15.83:0/1453962802 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70ef7fe640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70f014e930 0x7f70f0071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70effff640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d8004810 0x7f70f014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f48fc640 1 -- 172.21.15.83:0/1453962802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d8004810 msgr2=0x7f70f014e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f48fc640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d8004810 0x7f70f014e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f48fc640 1 -- 172.21.15.83:0/1453962802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70f014e930 msgr2=0x7f70f0071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f48fc640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70f014e930 0x7f70f0071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f48fc640 1 -- 172.21.15.83:0/1453962802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f00adb10 con 0x7f70f01505a0 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f48fc640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70f01505a0 0x7f70f0150a20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f70f00afca0 tx=0x7f70e800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:15.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70ecff9640 1 -- 172.21.15.83:0/1453962802 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e800fce0 con 0x7f70f01505a0 2024-03-30T13:09:15.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70ecff9640 1 -- 172.21.15.83:0/1453962802 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e800fe80 con 0x7f70f01505a0 2024-03-30T13:09:15.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 -- 172.21.15.83:0/1453962802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f0072150 con 0x7f70f01505a0 2024-03-30T13:09:15.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70ecff9640 1 -- 172.21.15.83:0/1453962802 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8015670 con 0x7f70f01505a0 2024-03-30T13:09:15.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.983+0000 7f70f635f640 1 -- 172.21.15.83:0/1453962802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f00ccb50 con 0x7f70f01505a0 2024-03-30T13:09:15.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.987+0000 7f70f635f640 1 -- 172.21.15.83:0/1453962802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f00686c0 con 0x7f70f01505a0 2024-03-30T13:09:15.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.987+0000 7f70ecff9640 1 -- 172.21.15.83:0/1453962802 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f70e8015810 con 0x7f70f01505a0 2024-03-30T13:09:15.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.987+0000 7f70ecff9640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f70dc067ff0 0x7f70dc06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:15.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.987+0000 7f70ecff9640 1 -- 172.21.15.83:0/1453962802 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f70e8087310 con 0x7f70f01505a0 2024-03-30T13:09:15.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.987+0000 7f70effff640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f70dc067ff0 0x7f70dc06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:15.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.987+0000 7f70effff640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f70dc067ff0 0x7f70dc06a4b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f70e0000c10 tx=0x7f70e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:15.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:15.991+0000 7f70ecff9640 1 -- 172.21.15.83:0/1453962802 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f70e8019030 con 0x7f70f01505a0 2024-03-30T13:09:16.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.167+0000 7f70f635f640 1 -- 172.21.15.83:0/1453962802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70f00b4ca0 con 0x7f70f01505a0 2024-03-30T13:09:16.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70ecff9640 1 -- 172.21.15.83:0/1453962802 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7f70e8010040 con 0x7f70f01505a0 2024-03-30T13:09:16.175 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:16.175 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2431286615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2431286615},{"type":"v1","addr":"172.21.15.153:6835","nonce":2431286615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1036905849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1036905849},{"type":"v1","addr":"172.21.15.83:6835","nonce":1036905849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2692566836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2692566836},{"type":"v1","addr":"172.21.15.83:6837","nonce":2692566836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:08:25.599943+0000","modified":"2024-03-30T13:08:27.589265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/53727078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":53727078},{"type":"v1","addr":"172.21.15.153:6833","nonce":53727078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-30T13:09:16.175 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 6 2024-03-30T13:09:16.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70f635f640 1 -- 172.21.15.83:0/1453962802 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f70dc067ff0 msgr2=0x7f70dc06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70f635f640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f70dc067ff0 0x7f70dc06a4b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f70e0000c10 tx=0x7f70e0009040 comp rx=0 tx=0).stop 2024-03-30T13:09:16.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70f635f640 1 -- 172.21.15.83:0/1453962802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70f01505a0 msgr2=0x7f70f0150a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70f635f640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70f01505a0 0x7f70f0150a20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f70f00afca0 tx=0x7f70e800f1b0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70f635f640 1 -- 172.21.15.83:0/1453962802 shutdown_connections 2024-03-30T13:09:16.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70f635f640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f70dc067ff0 0x7f70dc06a4b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70f635f640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70f01505a0 0x7f70f0150a20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70f635f640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70f014e930 0x7f70f0071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70f635f640 1 --2- 172.21.15.83:0/1453962802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d8004810 0x7f70f014e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70f635f640 1 -- 172.21.15.83:0/1453962802 >> 172.21.15.83:0/1453962802 conn(0x7f70f00b1d60 msgr2=0x7f70f00b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:16.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70f635f640 1 -- 172.21.15.83:0/1453962802 shutdown_connections 2024-03-30T13:09:16.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.171+0000 7f70f635f640 1 -- 172.21.15.83:0/1453962802 wait complete. 2024-03-30T13:09:16.193 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:16.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.295+0000 7f608938b640 1 Processor -- start 2024-03-30T13:09:16.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.295+0000 7f608938b640 1 -- start start 2024-03-30T13:09:16.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f608938b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f60840b4830 0x7f608415d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f608938b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840aed20 0x7f60840af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f608938b640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f608415d880 con 0x7f608415fee0 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f608938b640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6084156e00 con 0x7f60840b4830 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f608938b640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f60840ad040 con 0x7f60840aed20 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f60837fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f608415fee0 0x7f6084160310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59418/0 (socket says 172.21.15.83:59418) 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f60837fe640 1 -- 172.21.15.83:0/1981962550 learned_addr learned my addr 172.21.15.83:0/1981962550 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6082ffd640 1 --2- 172.21.15.83:0/1981962550 >> v2:172.21.15.153:3300/0 conn(0x7f60840b4830 0x7f608415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f60827fc640 1 --2- 172.21.15.83:0/1981962550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840aed20 0x7f60840af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656315537 0 0) 0x7f608415d880 con 0x7f608415fee0 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f606c003530 con 0x7f608415fee0 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 305480256 0 0) 0x7f606c003530 con 0x7f608415fee0 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840aed20 msgr2=0x7f60840af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 --2- 172.21.15.83:0/1981962550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840aed20 0x7f60840af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 >> v2:172.21.15.153:3300/0 conn(0x7f60840b4830 msgr2=0x7f608415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 --2- 172.21.15.83:0/1981962550 >> v2:172.21.15.153:3300/0 conn(0x7f60840b4830 0x7f608415d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60840cfcb0 con 0x7f608415fee0 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f607c001a00 con 0x7f608415fee0 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 >> v1:172.21.15.83:6789/0 conn(0x7f608415fee0 legacy=0x7f6084160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 --2- 172.21.15.83:0/1981962550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f606c0039c0 0x7f606c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 --2- 172.21.15.83:0/1981962550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840aed20 0x7f606c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 --2- 172.21.15.83:0/1981962550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f606c004d50 0x7f606c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6084156e00 con 0x7f606c004d50 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60840ad040 con 0x7f606c0039c0 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f606c00ba80 con 0x7f60840aed20 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f60837fe640 1 --2- 172.21.15.83:0/1981962550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f606c004d50 0x7f606c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f6082ffd640 1 --2- 172.21.15.83:0/1981962550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f606c0039c0 0x7f606c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f60827fc640 1 --2- 172.21.15.83:0/1981962550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840aed20 0x7f606c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f60837fe640 1 -- 172.21.15.83:0/1981962550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840aed20 msgr2=0x7f606c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f60837fe640 1 --2- 172.21.15.83:0/1981962550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840aed20 0x7f606c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f60837fe640 1 -- 172.21.15.83:0/1981962550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f606c0039c0 msgr2=0x7f606c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:16.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f60837fe640 1 --2- 172.21.15.83:0/1981962550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f606c0039c0 0x7f606c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.299+0000 7f60837fe640 1 -- 172.21.15.83:0/1981962550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606c003530 con 0x7f606c004d50 2024-03-30T13:09:16.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f60837fe640 1 --2- 172.21.15.83:0/1981962550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f606c004d50 0x7f606c0051d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f607c0013e0 tx=0x7f607c01d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc8a101d26340ca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:16.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c00a4e0 con 0x7f606c004d50 2024-03-30T13:09:16.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607c0ad650 con 0x7f606c004d50 2024-03-30T13:09:16.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f6081ffb640 1 -- 172.21.15.83:0/1981962550 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c0ada40 con 0x7f606c004d50 2024-03-30T13:09:16.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 -- 172.21.15.83:0/1981962550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f606c004d50 msgr2=0x7f606c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 --2- 172.21.15.83:0/1981962550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f606c004d50 0x7f606c0051d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f607c0013e0 tx=0x7f607c01d370 comp rx=0 tx=0).stop 2024-03-30T13:09:16.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f60837fe640 1 -- 172.21.15.83:0/1981962550 reap_dead start 2024-03-30T13:09:16.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 -- 172.21.15.83:0/1981962550 shutdown_connections 2024-03-30T13:09:16.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 -- 172.21.15.83:0/1981962550 >> 172.21.15.83:0/1981962550 conn(0x7f60840b1d60 msgr2=0x7f60840b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:16.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 -- 172.21.15.83:0/1981962550 shutdown_connections 2024-03-30T13:09:16.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 -- 172.21.15.83:0/1981962550 wait complete. 2024-03-30T13:09:16.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 Processor -- start 2024-03-30T13:09:16.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 -- start start 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6084161c40 0x7f60840b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1170 0x7f60841423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6084142900 0x7f6084144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f60840cf860 con 0x7f6084161c40 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f608406fa90 con 0x7f6084142900 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f608938b640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f60840cf9e0 con 0x7f60840b1170 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f6082ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6084161c40 0x7f60840b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f6082ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6084161c40 0x7f60840b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39424/0 (socket says 172.21.15.83:39424) 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.303+0000 7f6082ffd640 1 -- 172.21.15.83:0/3516735800 learned_addr learned my addr 172.21.15.83:0/3516735800 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f60837fe640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6084142900 0x7f6084144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f60827fc640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1170 0x7f60841423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f6082ffd640 1 -- 172.21.15.83:0/3516735800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1170 msgr2=0x7f60841423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f6082ffd640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1170 0x7f60841423c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f6082ffd640 1 -- 172.21.15.83:0/3516735800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6084142900 msgr2=0x7f6084144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f6082ffd640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6084142900 0x7f6084144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f6082ffd640 1 -- 172.21.15.83:0/3516735800 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6084143060 con 0x7f6084161c40 2024-03-30T13:09:16.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f60837fe640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6084142900 0x7f6084144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:16.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f6082ffd640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6084161c40 0x7f60840b0c30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6074011aa0 tx=0x7f6074011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:16.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f606b7fe640 1 -- 172.21.15.83:0/3516735800 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607400fb80 con 0x7f6084161c40 2024-03-30T13:09:16.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f606b7fe640 1 -- 172.21.15.83:0/3516735800 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607400fd20 con 0x7f6084161c40 2024-03-30T13:09:16.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f608938b640 1 -- 172.21.15.83:0/3516735800 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6084143340 con 0x7f6084161c40 2024-03-30T13:09:16.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f606b7fe640 1 -- 172.21.15.83:0/3516735800 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074014680 con 0x7f6084161c40 2024-03-30T13:09:16.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f608938b640 1 -- 172.21.15.83:0/3516735800 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6084143900 con 0x7f6084161c40 2024-03-30T13:09:16.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f608938b640 1 -- 172.21.15.83:0/3516735800 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60840686c0 con 0x7f6084161c40 2024-03-30T13:09:16.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f606b7fe640 1 -- 172.21.15.83:0/3516735800 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6074012040 con 0x7f6084161c40 2024-03-30T13:09:16.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f606b7fe640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6070067fc0 0x7f607006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f606b7fe640 1 -- 172.21.15.83:0/3516735800 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f6074086cd0 con 0x7f6084161c40 2024-03-30T13:09:16.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f60827fc640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6070067fc0 0x7f607006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.307+0000 7f60827fc640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6070067fc0 0x7f607006a480 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f60840b1820 tx=0x7f6078008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:16.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.311+0000 7f606b7fe640 1 -- 172.21.15.83:0/3516735800 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6074019030 con 0x7f6084161c40 2024-03-30T13:09:16.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.471+0000 7f608938b640 1 -- 172.21.15.83:0/3516735800 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60840b1550 con 0x7f6084161c40 2024-03-30T13:09:16.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.479+0000 7f606b7fe640 1 -- 172.21.15.83:0/3516735800 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16848 (secure 0 0 0) 0x7f6074056e40 con 0x7f6084161c40 2024-03-30T13:09:16.483 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:16.483 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:09:07.416798+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:16.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.479+0000 7f608938b640 1 -- 172.21.15.83:0/3516735800 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6070067fc0 msgr2=0x7f607006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.479+0000 7f608938b640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6070067fc0 0x7f607006a480 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f60840b1820 tx=0x7f6078008040 comp rx=0 tx=0).stop 2024-03-30T13:09:16.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.479+0000 7f608938b640 1 -- 172.21.15.83:0/3516735800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6084161c40 msgr2=0x7f60840b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.479+0000 7f608938b640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6084161c40 0x7f60840b0c30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6074011aa0 tx=0x7f6074011f60 comp rx=0 tx=0).stop 2024-03-30T13:09:16.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.479+0000 7f608938b640 1 -- 172.21.15.83:0/3516735800 shutdown_connections 2024-03-30T13:09:16.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.479+0000 7f608938b640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6070067fc0 0x7f607006a480 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.479+0000 7f608938b640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6084142900 0x7f6084144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.479+0000 7f608938b640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1170 0x7f60841423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.479+0000 7f608938b640 1 --2- 172.21.15.83:0/3516735800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6084161c40 0x7f60840b0c30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.479+0000 7f608938b640 1 -- 172.21.15.83:0/3516735800 >> 172.21.15.83:0/3516735800 conn(0x7f60840b1d60 msgr2=0x7f608415f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:16.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.479+0000 7f608938b640 1 -- 172.21.15.83:0/3516735800 shutdown_connections 2024-03-30T13:09:16.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.483+0000 7f608938b640 1 -- 172.21.15.83:0/3516735800 wait complete. 2024-03-30T13:09:16.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:08:23.821954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:08:24.549769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:09:16.503 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:09:16.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.615+0000 7f704312e640 1 Processor -- start 2024-03-30T13:09:16.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.615+0000 7f704312e640 1 -- start start 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.615+0000 7f704312e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f703c15c8e0 0x7f703c0ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.615+0000 7f704312e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f703c0adac0 0x7f703c15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.615+0000 7f704312e640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f703c0ae040 con 0x7f703c15d200 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.615+0000 7f704312e640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f703c0b31e0 con 0x7f703c0adac0 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.615+0000 7f704312e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f703c0ae320 con 0x7f703c15c8e0 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.615+0000 7f703bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f703c0adac0 0x7f703c15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.615+0000 7f70416cb640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f703c15d200 0x7f703c0b3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:59422/0 (socket says 172.21.15.83:59422) 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.615+0000 7f70416cb640 1 -- 172.21.15.83:0/626198386 learned_addr learned my addr 172.21.15.83:0/626198386 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.615+0000 7f7040eca640 1 --2- 172.21.15.83:0/626198386 >> v2:172.21.15.153:3300/0 conn(0x7f703c15c8e0 0x7f703c0ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f703bfff640 1 -- 172.21.15.83:0/626198386 >> v2:172.21.15.153:3300/0 conn(0x7f703c15c8e0 msgr2=0x7f703c0ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f703bfff640 1 --2- 172.21.15.83:0/626198386 >> v2:172.21.15.153:3300/0 conn(0x7f703c15c8e0 0x7f703c0ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f703bfff640 1 -- 172.21.15.83:0/626198386 >> v1:172.21.15.83:6789/0 conn(0x7f703c15d200 legacy=0x7f703c0b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f703bfff640 1 -- 172.21.15.83:0/626198386 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703c0ae600 con 0x7f703c0adac0 2024-03-30T13:09:16.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f703b7fe640 1 -- 172.21.15.83:0/626198386 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129231717 0 0) 0x7f703c0ae040 con 0x7f703c15d200 2024-03-30T13:09:16.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f703bfff640 1 --2- 172.21.15.83:0/626198386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f703c0adac0 0x7f703c15ccc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f703c0b4ee0 tx=0x7f703001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddd9ed7ca5a3bca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:16.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f703b7fe640 1 -- 172.21.15.83:0/626198386 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70300b2070 con 0x7f703c0adac0 2024-03-30T13:09:16.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f703b7fe640 1 -- 172.21.15.83:0/626198386 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70300ad640 con 0x7f703c0adac0 2024-03-30T13:09:16.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f703b7fe640 1 -- 172.21.15.83:0/626198386 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70300ada10 con 0x7f703c0adac0 2024-03-30T13:09:16.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f704312e640 1 -- 172.21.15.83:0/626198386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f703c0adac0 msgr2=0x7f703c15ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f704312e640 1 --2- 172.21.15.83:0/626198386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f703c0adac0 0x7f703c15ccc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f703c0b4ee0 tx=0x7f703001c480 comp rx=0 tx=0).stop 2024-03-30T13:09:16.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f704312e640 1 -- 172.21.15.83:0/626198386 shutdown_connections 2024-03-30T13:09:16.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f704312e640 1 --2- 172.21.15.83:0/626198386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f703c0adac0 0x7f703c15ccc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f704312e640 1 --2- 172.21.15.83:0/626198386 >> v2:172.21.15.153:3300/0 conn(0x7f703c15c8e0 0x7f703c0ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f704312e640 1 -- 172.21.15.83:0/626198386 >> 172.21.15.83:0/626198386 conn(0x7f703c06b660 msgr2=0x7f703c06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:16.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f704312e640 1 -- 172.21.15.83:0/626198386 shutdown_connections 2024-03-30T13:09:16.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.619+0000 7f704312e640 1 -- 172.21.15.83:0/626198386 wait complete. 2024-03-30T13:09:16.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f704312e640 1 Processor -- start 2024-03-30T13:09:16.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f704312e640 1 -- start start 2024-03-30T13:09:16.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f704312e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f703c0adac0 0x7f703c145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f704312e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f703c15c8e0 0x7f703c14b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f704312e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f703c15d200 0x7f703c150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f704312e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f703c0b4710 con 0x7f703c15c8e0 2024-03-30T13:09:16.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f704312e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f703c0b4590 con 0x7f703c15d200 2024-03-30T13:09:16.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f704312e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f703c0b4890 con 0x7f703c0adac0 2024-03-30T13:09:16.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f703bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f703c15c8e0 0x7f703c14b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f703bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f703c15c8e0 0x7f703c14b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39444/0 (socket says 172.21.15.83:39444) 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f703bfff640 1 -- 172.21.15.83:0/3506980983 learned_addr learned my addr 172.21.15.83:0/3506980983 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f7040eca640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f703c0adac0 0x7f703c145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f70416cb640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f703c15d200 0x7f703c150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f703bfff640 1 -- 172.21.15.83:0/3506980983 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f703c0adac0 msgr2=0x7f703c145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f703bfff640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f703c0adac0 0x7f703c145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f703bfff640 1 -- 172.21.15.83:0/3506980983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f703c15d200 msgr2=0x7f703c150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f703bfff640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f703c15d200 0x7f703c150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f703bfff640 1 -- 172.21.15.83:0/3506980983 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703c15db40 con 0x7f703c15c8e0 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f7040eca640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f703c0adac0 0x7f703c145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f70416cb640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f703c15d200 0x7f703c150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f703bfff640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f703c15c8e0 0x7f703c14b7c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f70300b0040 tx=0x7f7030019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f70397fa640 1 -- 172.21.15.83:0/3506980983 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70300ba020 con 0x7f703c15c8e0 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f70397fa640 1 -- 172.21.15.83:0/3506980983 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70300b6410 con 0x7f703c15c8e0 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f70397fa640 1 -- 172.21.15.83:0/3506980983 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70300b2040 con 0x7f703c15c8e0 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f704312e640 1 -- 172.21.15.83:0/3506980983 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703c15de20 con 0x7f703c15c8e0 2024-03-30T13:09:16.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f704312e640 1 -- 172.21.15.83:0/3506980983 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f703c15e3e0 con 0x7f703c15c8e0 2024-03-30T13:09:16.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f704312e640 1 -- 172.21.15.83:0/3506980983 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f703c04f9e0 con 0x7f703c15c8e0 2024-03-30T13:09:16.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f70397fa640 1 -- 172.21.15.83:0/3506980983 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f70300bd020 con 0x7f703c15c8e0 2024-03-30T13:09:16.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f70397fa640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7028067fc0 0x7f702806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f70397fa640 1 -- 172.21.15.83:0/3506980983 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f70301204d0 con 0x7f703c15c8e0 2024-03-30T13:09:16.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.623+0000 7f7040eca640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7028067fc0 0x7f702806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.627+0000 7f7040eca640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7028067fc0 0x7f702806a480 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f702c0097a0 tx=0x7f702c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:16.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.627+0000 7f70397fa640 1 -- 172.21.15.83:0/3506980983 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f70300c4030 con 0x7f703c15c8e0 2024-03-30T13:09:16.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.775+0000 7f704312e640 1 -- 172.21.15.83:0/3506980983 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f703c14e610 con 0x7f703c15c8e0 2024-03-30T13:09:16.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f70397fa640 1 -- 172.21.15.83:0/3506980983 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f7030016070 con 0x7f703c15c8e0 2024-03-30T13:09:16.783 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:09:16.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f704312e640 1 -- 172.21.15.83:0/3506980983 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7028067fc0 msgr2=0x7f702806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f704312e640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7028067fc0 0x7f702806a480 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f702c0097a0 tx=0x7f702c008040 comp rx=0 tx=0).stop 2024-03-30T13:09:16.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f704312e640 1 -- 172.21.15.83:0/3506980983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f703c15c8e0 msgr2=0x7f703c14b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f704312e640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f703c15c8e0 0x7f703c14b7c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f70300b0040 tx=0x7f7030019220 comp rx=0 tx=0).stop 2024-03-30T13:09:16.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f704312e640 1 -- 172.21.15.83:0/3506980983 shutdown_connections 2024-03-30T13:09:16.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f704312e640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7028067fc0 0x7f702806a480 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f704312e640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f703c15d200 0x7f703c150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f704312e640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f703c15c8e0 0x7f703c14b7c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f704312e640 1 --2- 172.21.15.83:0/3506980983 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f703c0adac0 0x7f703c145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f704312e640 1 -- 172.21.15.83:0/3506980983 >> 172.21.15.83:0/3506980983 conn(0x7f703c06b660 msgr2=0x7f703c15bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:16.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f704312e640 1 -- 172.21.15.83:0/3506980983 shutdown_connections 2024-03-30T13:09:16.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.779+0000 7f704312e640 1 -- 172.21.15.83:0/3506980983 wait complete. 2024-03-30T13:09:16.799 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:09:16.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.911+0000 7f68a9431640 1 Processor -- start 2024-03-30T13:09:16.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.911+0000 7f68a9431640 1 -- start start 2024-03-30T13:09:16.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a9431640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68a406f860 0x7f68a4165dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a9431640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a40b31e0 con 0x7f68a4073570 2024-03-30T13:09:16.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a9431640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a40ad4f0 con 0x7f68a415b050 2024-03-30T13:09:16.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a9431640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f68a40ad7d0 con 0x7f68a406f860 2024-03-30T13:09:16.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f689a7fc640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f68a4073570 0x7f68a406f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:52862/0 (socket says 172.21.15.83:52862) 2024-03-30T13:09:16.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f689a7fc640 1 -- 172.21.15.83:0/1804711340 learned_addr learned my addr 172.21.15.83:0/1804711340 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:16.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355229808 0 0) 0x7f68a40b31e0 con 0x7f68a4073570 2024-03-30T13:09:16.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6890003530 con 0x7f68a4073570 2024-03-30T13:09:16.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a37fe640 1 --2- 172.21.15.83:0/1804711340 >> v2:172.21.15.153:3300/0 conn(0x7f68a406f860 0x7f68a4165dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2166340930 0 0) 0x7f6890003530 con 0x7f68a4073570 2024-03-30T13:09:16.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 >> v2:172.21.15.153:3300/0 conn(0x7f68a406f860 msgr2=0x7f68a4165dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:16.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 --2- 172.21.15.83:0/1804711340 >> v2:172.21.15.153:3300/0 conn(0x7f68a406f860 0x7f68a4165dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 >> v1:172.21.15.153:6789/0 conn(0x7f68a415b050 legacy=0x7f68a40b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a40b34a0 con 0x7f68a4073570 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f688c0016a0 con 0x7f68a4073570 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 >> v1:172.21.15.83:6789/0 conn(0x7f68a4073570 legacy=0x7f68a406f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 --2- 172.21.15.83:0/1804711340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68900039c0 0x7f6890003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 --2- 172.21.15.83:0/1804711340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6890004810 0x7f6890004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 --2- 172.21.15.83:0/1804711340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68900052f0 0x7f689000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f68a40ad7d0 con 0x7f68900052f0 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f689000c1c0 con 0x7f68900039c0 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f689000c3c0 con 0x7f6890004810 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a37fe640 1 --2- 172.21.15.83:0/1804711340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68900052f0 0x7f689000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a2ffd640 1 --2- 172.21.15.83:0/1804711340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68900039c0 0x7f6890003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f689a7fc640 1 --2- 172.21.15.83:0/1804711340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6890004810 0x7f6890004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a37fe640 1 -- 172.21.15.83:0/1804711340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6890004810 msgr2=0x7f6890004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a37fe640 1 --2- 172.21.15.83:0/1804711340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6890004810 0x7f6890004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a37fe640 1 -- 172.21.15.83:0/1804711340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68900039c0 msgr2=0x7f6890003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a37fe640 1 --2- 172.21.15.83:0/1804711340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68900039c0 0x7f6890003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.915+0000 7f68a37fe640 1 -- 172.21.15.83:0/1804711340 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6890003530 con 0x7f68900052f0 2024-03-30T13:09:16.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a37fe640 1 -- 172.21.15.83:0/1804711340 reap_dead start 2024-03-30T13:09:16.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a37fe640 1 --2- 172.21.15.83:0/1804711340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68900052f0 0x7f689000b9d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f689c007330 tx=0x7f689c01ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3f910def9d7d1f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:16.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c009be0 con 0x7f68900052f0 2024-03-30T13:09:16.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c0a5d60 con 0x7f68900052f0 2024-03-30T13:09:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a27fc640 1 -- 172.21.15.83:0/1804711340 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c003be0 con 0x7f68900052f0 2024-03-30T13:09:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 -- 172.21.15.83:0/1804711340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68900052f0 msgr2=0x7f689000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 --2- 172.21.15.83:0/1804711340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68900052f0 0x7f689000b9d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f689c007330 tx=0x7f689c01ce60 comp rx=0 tx=0).stop 2024-03-30T13:09:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 -- 172.21.15.83:0/1804711340 shutdown_connections 2024-03-30T13:09:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 --2- 172.21.15.83:0/1804711340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68900052f0 0x7f689000b9d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 -- 172.21.15.83:0/1804711340 >> 172.21.15.83:0/1804711340 conn(0x7f68a406b660 msgr2=0x7f68a406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 -- 172.21.15.83:0/1804711340 shutdown_connections 2024-03-30T13:09:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 -- 172.21.15.83:0/1804711340 wait complete. 2024-03-30T13:09:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 Processor -- start 2024-03-30T13:09:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 -- start start 2024-03-30T13:09:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68900052f0 0x7f68a415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4152b40 0x7f68a4156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a414d030 0x7f68a414d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f68a40ad1c0 con 0x7f68a4152b40 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68a40739c0 con 0x7f68a414d030 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f68a40ad340 con 0x7f68900052f0 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f689a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4152b40 0x7f68a4156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f689a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4152b40 0x7f68a4156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51582/0 (socket says 172.21.15.83:51582) 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f689a7fc640 1 -- 172.21.15.83:0/468305229 learned_addr learned my addr 172.21.15.83:0/468305229 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a2ffd640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68900052f0 0x7f68a415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a37fe640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a414d030 0x7f68a414d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f689a7fc640 1 -- 172.21.15.83:0/468305229 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68900052f0 msgr2=0x7f68a415c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f689a7fc640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68900052f0 0x7f68a415c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f689a7fc640 1 -- 172.21.15.83:0/468305229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a414d030 msgr2=0x7f68a414d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f689a7fc640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a414d030 0x7f68a414d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f689a7fc640 1 -- 172.21.15.83:0/468305229 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a415ca30 con 0x7f68a4152b40 2024-03-30T13:09:16.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f689a7fc640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4152b40 0x7f68a4156610 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f688c010b80 tx=0x7f688c00e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:16.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f689bfff640 1 -- 172.21.15.83:0/468305229 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c01b070 con 0x7f68a4152b40 2024-03-30T13:09:16.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f689bfff640 1 -- 172.21.15.83:0/468305229 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688c011040 con 0x7f68a4152b40 2024-03-30T13:09:16.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 -- 172.21.15.83:0/468305229 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a41532a0 con 0x7f68a4152b40 2024-03-30T13:09:16.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f689bfff640 1 -- 172.21.15.83:0/468305229 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0143a0 con 0x7f68a4152b40 2024-03-30T13:09:16.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.919+0000 7f68a9431640 1 -- 172.21.15.83:0/468305229 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a415cd10 con 0x7f68a4152b40 2024-03-30T13:09:16.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.923+0000 7f68a9431640 1 -- 172.21.15.83:0/468305229 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a409e540 con 0x7f68a4152b40 2024-03-30T13:09:16.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.923+0000 7f689bfff640 1 -- 172.21.15.83:0/468305229 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f688c01e070 con 0x7f68a4152b40 2024-03-30T13:09:16.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.923+0000 7f689bfff640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6884067fc0 0x7f688406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:16.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.923+0000 7f689bfff640 1 -- 172.21.15.83:0/468305229 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f688c0891b0 con 0x7f68a4152b40 2024-03-30T13:09:16.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.923+0000 7f68a2ffd640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6884067fc0 0x7f688406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:16.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.923+0000 7f68a2ffd640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6884067fc0 0x7f688406a480 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6894000c10 tx=0x7f6894009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:16.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:16.927+0000 7f689bfff640 1 -- 172.21.15.83:0/468305229 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f688c0598e0 con 0x7f68a4152b40 2024-03-30T13:09:17.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.075+0000 7f68a9431640 1 -- 172.21.15.83:0/468305229 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f68a4151ba0 con 0x7f68a4152b40 2024-03-30T13:09:17.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.075+0000 7f689bfff640 1 -- 172.21.15.83:0/468305229 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f688c0591e0 con 0x7f68a4152b40 2024-03-30T13:09:17.081 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:09:17.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.079+0000 7f68a9431640 1 -- 172.21.15.83:0/468305229 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6884067fc0 msgr2=0x7f688406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.079+0000 7f68a9431640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6884067fc0 0x7f688406a480 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6894000c10 tx=0x7f6894009040 comp rx=0 tx=0).stop 2024-03-30T13:09:17.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.079+0000 7f68a9431640 1 -- 172.21.15.83:0/468305229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4152b40 msgr2=0x7f68a4156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.079+0000 7f68a9431640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4152b40 0x7f68a4156610 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f688c010b80 tx=0x7f688c00e4d0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.079+0000 7f68a9431640 1 -- 172.21.15.83:0/468305229 shutdown_connections 2024-03-30T13:09:17.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.079+0000 7f68a9431640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6884067fc0 0x7f688406a480 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.079+0000 7f68a9431640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a414d030 0x7f68a414d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.079+0000 7f68a9431640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4152b40 0x7f68a4156610 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.079+0000 7f68a9431640 1 --2- 172.21.15.83:0/468305229 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68900052f0 0x7f68a415c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.079+0000 7f68a9431640 1 -- 172.21.15.83:0/468305229 >> 172.21.15.83:0/468305229 conn(0x7f68a406b660 msgr2=0x7f68a406ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:17.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.079+0000 7f68a9431640 1 -- 172.21.15.83:0/468305229 shutdown_connections 2024-03-30T13:09:17.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.079+0000 7f68a9431640 1 -- 172.21.15.83:0/468305229 wait complete. 2024-03-30T13:09:17.099 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:09:17.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f9414eba640 1 Processor -- start 2024-03-30T13:09:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f9414eba640 1 -- start start 2024-03-30T13:09:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f9414eba640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94100b4680 0x7f941015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f9414eba640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94100ae040 con 0x7f941015d200 2024-03-30T13:09:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f9414eba640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94100ae320 con 0x7f941015c8e0 2024-03-30T13:09:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f9414eba640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f94100b31e0 con 0x7f94100b4680 2024-03-30T13:09:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940ed9d640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f941015d200 0x7f9410165e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:52864/0 (socket says 172.21.15.83:52864) 2024-03-30T13:09:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940ed9d640 1 -- 172.21.15.83:0/4047353367 learned_addr learned my addr 172.21.15.83:0/4047353367 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940dd9b640 1 --2- 172.21.15.83:0/4047353367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94100b4680 0x7f941015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494062790 0 0) 0x7f94100ae040 con 0x7f941015d200 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93f8003530 con 0x7f941015d200 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2476458289 0 0) 0x7f93f8003530 con 0x7f941015d200 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94100b4680 msgr2=0x7f941015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 --2- 172.21.15.83:0/4047353367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94100b4680 0x7f941015ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 >> v1:172.21.15.153:6789/0 conn(0x7f941015c8e0 legacy=0x7f94100ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94100ae600 con 0x7f941015d200 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f9408001a00 con 0x7f941015d200 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 >> v1:172.21.15.83:6789/0 conn(0x7f941015d200 legacy=0x7f9410165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 --2- 172.21.15.83:0/4047353367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94100b4680 0x7f93f80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 --2- 172.21.15.83:0/4047353367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93f8003f70 0x7f93f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 --2- 172.21.15.83:0/4047353367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93f8004d50 0x7f93f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f94100b31e0 con 0x7f93f8003f70 2024-03-30T13:09:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f93f800bab0 con 0x7f93f8004d50 2024-03-30T13:09:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f93f800bcb0 con 0x7f94100b4680 2024-03-30T13:09:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940dd9b640 1 --2- 172.21.15.83:0/4047353367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93f8003f70 0x7f93f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940e59c640 1 --2- 172.21.15.83:0/4047353367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94100b4680 0x7f93f80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940dd9b640 1 -- 172.21.15.83:0/4047353367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94100b4680 msgr2=0x7f93f80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940dd9b640 1 --2- 172.21.15.83:0/4047353367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94100b4680 0x7f93f80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940dd9b640 1 -- 172.21.15.83:0/4047353367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93f8004d50 msgr2=0x7f93f80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940dd9b640 1 --2- 172.21.15.83:0/4047353367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93f8004d50 0x7f93f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940dd9b640 1 -- 172.21.15.83:0/4047353367 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f8003530 con 0x7f93f8003f70 2024-03-30T13:09:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.207+0000 7f940e59c640 1 --2- 172.21.15.83:0/4047353367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94100b4680 0x7f93f80039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f940dd9b640 1 --2- 172.21.15.83:0/4047353367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93f8003f70 0x7f93f8004810 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9400009ac0 tx=0x7f940001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d72e5236e7f46e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94000b2070 con 0x7f93f8003f70 2024-03-30T13:09:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94000a5640 con 0x7f93f8003f70 2024-03-30T13:09:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f940d59a640 1 -- 172.21.15.83:0/4047353367 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400009690 con 0x7f93f8003f70 2024-03-30T13:09:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 -- 172.21.15.83:0/4047353367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93f8003f70 msgr2=0x7f93f8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 --2- 172.21.15.83:0/4047353367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93f8003f70 0x7f93f8004810 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9400009ac0 tx=0x7f940001ca50 comp rx=0 tx=0).stop 2024-03-30T13:09:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f940ed9d640 1 -- 172.21.15.83:0/4047353367 reap_dead start 2024-03-30T13:09:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 -- 172.21.15.83:0/4047353367 shutdown_connections 2024-03-30T13:09:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 -- 172.21.15.83:0/4047353367 >> 172.21.15.83:0/4047353367 conn(0x7f941006b660 msgr2=0x7f941006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 -- 172.21.15.83:0/4047353367 shutdown_connections 2024-03-30T13:09:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 -- 172.21.15.83:0/4047353367 wait complete. 2024-03-30T13:09:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 Processor -- start 2024-03-30T13:09:17.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 -- start start 2024-03-30T13:09:17.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f93f8003f70 0x7f9410150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94101f5550 0x7f94101f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94100b1ec0 0x7f94100b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f941015d690 con 0x7f94100b1ec0 2024-03-30T13:09:17.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f941006f8e0 con 0x7f94101f5550 2024-03-30T13:09:17.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f9414eba640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f94100adc90 con 0x7f93f8003f70 2024-03-30T13:09:17.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f940ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94100b1ec0 0x7f94100b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f940ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94100b1ec0 0x7f94100b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51610/0 (socket says 172.21.15.83:51610) 2024-03-30T13:09:17.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f940ed9d640 1 -- 172.21.15.83:0/1331333158 learned_addr learned my addr 172.21.15.83:0/1331333158 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.211+0000 7f940e59c640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f93f8003f70 0x7f9410150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f940dd9b640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94101f5550 0x7f94101f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f940ed9d640 1 -- 172.21.15.83:0/1331333158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f93f8003f70 msgr2=0x7f9410150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f940ed9d640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f93f8003f70 0x7f9410150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f940ed9d640 1 -- 172.21.15.83:0/1331333158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94101f5550 msgr2=0x7f94101f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f940ed9d640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94101f5550 0x7f94101f8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f940ed9d640 1 -- 172.21.15.83:0/1331333158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94101f4950 con 0x7f94100b1ec0 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f940ed9d640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94100b1ec0 0x7f94100b2340 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9410073a30 tx=0x7f940800fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f93feffd640 1 -- 172.21.15.83:0/1331333158 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940800d9c0 con 0x7f94100b1ec0 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f93feffd640 1 -- 172.21.15.83:0/1331333158 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f940800db80 con 0x7f94100b1ec0 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f9414eba640 1 -- 172.21.15.83:0/1331333158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9410072550 con 0x7f94100b1ec0 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f93feffd640 1 -- 172.21.15.83:0/1331333158 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9408017420 con 0x7f94100b1ec0 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f9414eba640 1 -- 172.21.15.83:0/1331333158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9410072b10 con 0x7f94100b1ec0 2024-03-30T13:09:17.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f9414eba640 1 -- 172.21.15.83:0/1331333158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9410072d50 con 0x7f94100b1ec0 2024-03-30T13:09:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f93feffd640 1 -- 172.21.15.83:0/1331333158 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9408014070 con 0x7f94100b1ec0 2024-03-30T13:09:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f93feffd640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f93f0067ff0 0x7f93f006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f93feffd640 1 -- 172.21.15.83:0/1331333158 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f94080892a0 con 0x7f94100b1ec0 2024-03-30T13:09:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f940e59c640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f93f0067ff0 0x7f93f006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.215+0000 7f940e59c640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f93f0067ff0 0x7f93f006a4b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9404001760 tx=0x7f9404009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:17.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.219+0000 7f93feffd640 1 -- 172.21.15.83:0/1331333158 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f940801d060 con 0x7f94100b1ec0 2024-03-30T13:09:17.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 -- 172.21.15.83:0/1331333158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f941004f9e0 con 0x7f94100b1ec0 2024-03-30T13:09:17.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f93feffd640 1 -- 172.21.15.83:0/1331333158 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f94080132c0 con 0x7f94100b1ec0 2024-03-30T13:09:17.383 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:09:17.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 -- 172.21.15.83:0/1331333158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f93f0067ff0 msgr2=0x7f93f006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f93f0067ff0 0x7f93f006a4b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9404001760 tx=0x7f9404009040 comp rx=0 tx=0).stop 2024-03-30T13:09:17.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 -- 172.21.15.83:0/1331333158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94100b1ec0 msgr2=0x7f94100b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94100b1ec0 0x7f94100b2340 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9410073a30 tx=0x7f940800fcd0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 -- 172.21.15.83:0/1331333158 shutdown_connections 2024-03-30T13:09:17.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f93f0067ff0 0x7f93f006a4b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94100b1ec0 0x7f94100b2340 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94101f5550 0x7f94101f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 --2- 172.21.15.83:0/1331333158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f93f8003f70 0x7f9410150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 -- 172.21.15.83:0/1331333158 >> 172.21.15.83:0/1331333158 conn(0x7f941006b660 msgr2=0x7f941015af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:17.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 -- 172.21.15.83:0/1331333158 shutdown_connections 2024-03-30T13:09:17.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.379+0000 7f9414eba640 1 -- 172.21.15.83:0/1331333158 wait complete. 2024-03-30T13:09:17.401 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:09:17.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.515+0000 7fdd27deb640 1 Processor -- start 2024-03-30T13:09:17.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.515+0000 7fdd27deb640 1 -- start start 2024-03-30T13:09:17.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd27deb640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdd200aed20 0x7fdd200af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd27deb640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd2006dfe0 0x7fdd2006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd27deb640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd200cfcb0 con 0x7fdd200b4830 2024-03-30T13:09:17.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd27deb640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdd20156e00 con 0x7fdd200aed20 2024-03-30T13:09:17.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd27deb640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdd200ad040 con 0x7fdd2006dfe0 2024-03-30T13:09:17.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd26388640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd2006dfe0 0x7fdd2006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd26388640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd2006dfe0 0x7fdd2006e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:59344/0 (socket says 172.21.15.83:59344) 2024-03-30T13:09:17.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd26388640 1 -- 172.21.15.83:0/877465012 learned_addr learned my addr 172.21.15.83:0/877465012 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:17.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd25386640 1 --2- 172.21.15.83:0/877465012 >> v2:172.21.15.153:3300/0 conn(0x7fdd200aed20 0x7fdd200af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd26388640 1 -- 172.21.15.83:0/877465012 >> v2:172.21.15.153:3300/0 conn(0x7fdd200aed20 msgr2=0x7fdd200af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:17.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd26388640 1 --2- 172.21.15.83:0/877465012 >> v2:172.21.15.153:3300/0 conn(0x7fdd200aed20 0x7fdd200af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd26388640 1 -- 172.21.15.83:0/877465012 >> v1:172.21.15.153:6789/0 conn(0x7fdd200b4830 legacy=0x7fdd2015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.519+0000 7fdd26388640 1 -- 172.21.15.83:0/877465012 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd200ad290 con 0x7fdd2006dfe0 2024-03-30T13:09:17.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd26388640 1 --2- 172.21.15.83:0/877465012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd2006dfe0 0x7fdd2006e410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009870 tx=0x7fdd1001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a6fab1d28d8a055 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:17.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd24b85640 1 -- 172.21.15.83:0/877465012 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd100ab610 con 0x7fdd2006dfe0 2024-03-30T13:09:17.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd24b85640 1 -- 172.21.15.83:0/877465012 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd100b0070 con 0x7fdd2006dfe0 2024-03-30T13:09:17.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd24b85640 1 -- 172.21.15.83:0/877465012 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd100ab9d0 con 0x7fdd2006dfe0 2024-03-30T13:09:17.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 -- 172.21.15.83:0/877465012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd2006dfe0 msgr2=0x7fdd2006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 --2- 172.21.15.83:0/877465012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd2006dfe0 0x7fdd2006e410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009870 tx=0x7fdd1001c410 comp rx=0 tx=0).stop 2024-03-30T13:09:17.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 -- 172.21.15.83:0/877465012 shutdown_connections 2024-03-30T13:09:17.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 --2- 172.21.15.83:0/877465012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd2006dfe0 0x7fdd2006e410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 --2- 172.21.15.83:0/877465012 >> v2:172.21.15.153:3300/0 conn(0x7fdd200aed20 0x7fdd200af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 -- 172.21.15.83:0/877465012 >> 172.21.15.83:0/877465012 conn(0x7fdd200b1d60 msgr2=0x7fdd200b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:17.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 -- 172.21.15.83:0/877465012 shutdown_connections 2024-03-30T13:09:17.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 -- 172.21.15.83:0/877465012 wait complete. 2024-03-30T13:09:17.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 Processor -- start 2024-03-30T13:09:17.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 -- start start 2024-03-30T13:09:17.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd2006dfe0 0x7fdd20145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd200aed20 0x7fdd200cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd200b4830 0x7fdd2014c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdd200cf860 con 0x7fdd200aed20 2024-03-30T13:09:17.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2006fa90 con 0x7fdd2006dfe0 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdd200cf9e0 con 0x7fdd200b4830 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd25386640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd200aed20 0x7fdd200cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd25386640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd200aed20 0x7fdd200cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51622/0 (socket says 172.21.15.83:51622) 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd25386640 1 -- 172.21.15.83:0/1183425581 learned_addr learned my addr 172.21.15.83:0/1183425581 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd25b87640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd2006dfe0 0x7fdd20145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd26388640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd200b4830 0x7fdd2014c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd25386640 1 -- 172.21.15.83:0/1183425581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd200b4830 msgr2=0x7fdd2014c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd25386640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd200b4830 0x7fdd2014c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd25386640 1 -- 172.21.15.83:0/1183425581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd2006dfe0 msgr2=0x7fdd20145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd25386640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd2006dfe0 0x7fdd20145310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd25386640 1 -- 172.21.15.83:0/1183425581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd201566a0 con 0x7fdd200aed20 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd25386640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd200aed20 0x7fdd200cca60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400e930 tx=0x7fdd1400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd1e7fc640 1 -- 172.21.15.83:0/1183425581 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14017070 con 0x7fdd200aed20 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd1e7fc640 1 -- 172.21.15.83:0/1183425581 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1400ca00 con 0x7fdd200aed20 2024-03-30T13:09:17.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd27deb640 1 -- 172.21.15.83:0/1183425581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2014bc00 con 0x7fdd200aed20 2024-03-30T13:09:17.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.523+0000 7fdd1e7fc640 1 -- 172.21.15.83:0/1183425581 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400cdb0 con 0x7fdd200aed20 2024-03-30T13:09:17.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.527+0000 7fdd27deb640 1 -- 172.21.15.83:0/1183425581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd20145850 con 0x7fdd200aed20 2024-03-30T13:09:17.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.527+0000 7fdd27deb640 1 -- 172.21.15.83:0/1183425581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd200686c0 con 0x7fdd200aed20 2024-03-30T13:09:17.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.527+0000 7fdd1e7fc640 1 -- 172.21.15.83:0/1183425581 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fdd1401a070 con 0x7fdd200aed20 2024-03-30T13:09:17.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.527+0000 7fdd1e7fc640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd0c067fc0 0x7fdd0c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.527+0000 7fdd1e7fc640 1 -- 172.21.15.83:0/1183425581 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7fdd14086e50 con 0x7fdd200aed20 2024-03-30T13:09:17.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.527+0000 7fdd25b87640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd0c067fc0 0x7fdd0c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.527+0000 7fdd25b87640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd0c067fc0 0x7fdd0c06a480 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdd180012f0 tx=0x7fdd18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:17.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.531+0000 7fdd1e7fc640 1 -- 172.21.15.83:0/1183425581 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fdd14056ec0 con 0x7fdd200aed20 2024-03-30T13:09:17.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.707+0000 7fdd27deb640 1 -- 172.21.15.83:0/1183425581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd200b3b90 con 0x7fdd200aed20 2024-03-30T13:09:17.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd1e7fc640 1 -- 172.21.15.83:0/1183425581 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7fdd1405b1c0 con 0x7fdd200aed20 2024-03-30T13:09:17.715 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:17.715 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2431286615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2431286615},{"type":"v1","addr":"172.21.15.153:6835","nonce":2431286615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1036905849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1036905849},{"type":"v1","addr":"172.21.15.83:6835","nonce":1036905849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2692566836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2692566836},{"type":"v1","addr":"172.21.15.83:6837","nonce":2692566836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:08:25.599943+0000","modified":"2024-03-30T13:08:27.589265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/53727078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":53727078},{"type":"v1","addr":"172.21.15.153:6833","nonce":53727078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-30T13:09:17.715 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 6 2024-03-30T13:09:17.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd27deb640 1 -- 172.21.15.83:0/1183425581 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd0c067fc0 msgr2=0x7fdd0c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd27deb640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd0c067fc0 0x7fdd0c06a480 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdd180012f0 tx=0x7fdd18009040 comp rx=0 tx=0).stop 2024-03-30T13:09:17.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd27deb640 1 -- 172.21.15.83:0/1183425581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd200aed20 msgr2=0x7fdd200cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd27deb640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd200aed20 0x7fdd200cca60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400e930 tx=0x7fdd1400edf0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd27deb640 1 -- 172.21.15.83:0/1183425581 shutdown_connections 2024-03-30T13:09:17.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd27deb640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdd0c067fc0 0x7fdd0c06a480 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd27deb640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd200b4830 0x7fdd2014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd27deb640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd200aed20 0x7fdd200cca60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd27deb640 1 --2- 172.21.15.83:0/1183425581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd2006dfe0 0x7fdd20145310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd27deb640 1 -- 172.21.15.83:0/1183425581 >> 172.21.15.83:0/1183425581 conn(0x7fdd200b1d60 msgr2=0x7fdd2015e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:17.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd27deb640 1 -- 172.21.15.83:0/1183425581 shutdown_connections 2024-03-30T13:09:17.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.711+0000 7fdd27deb640 1 -- 172.21.15.83:0/1183425581 wait complete. 2024-03-30T13:09:17.732 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:17.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.831+0000 7fb2ba2aa640 1 Processor -- start 2024-03-30T13:09:17.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.831+0000 7fb2ba2aa640 1 -- start start 2024-03-30T13:09:17.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.831+0000 7fb2ba2aa640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2b40d4950 0x7fb2b415e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.831+0000 7fb2ba2aa640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb2b40cee20 0x7fb2b40cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.831+0000 7fb2ba2aa640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b406c6a0 con 0x7fb2b415e500 2024-03-30T13:09:17.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.831+0000 7fb2ba2aa640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b40d2340 con 0x7fb2b40cee20 2024-03-30T13:09:17.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.831+0000 7fb2ba2aa640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b40cfb30 con 0x7fb2b40d4950 2024-03-30T13:09:17.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.831+0000 7fb2b8847640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb2b40cee20 0x7fb2b40cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.831+0000 7fb2b3fff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fb2b415e500 0x7fb2b40d4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:52874/0 (socket says 172.21.15.83:52874) 2024-03-30T13:09:17.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.831+0000 7fb2b3fff640 1 -- 172.21.15.83:0/3590513255 learned_addr learned my addr 172.21.15.83:0/3590513255 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:17.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2b37fe640 1 --2- 172.21.15.83:0/3590513255 >> v2:172.21.15.153:3300/0 conn(0x7fb2b40d4950 0x7fb2b415e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2b8847640 1 -- 172.21.15.83:0/3590513255 >> v2:172.21.15.153:3300/0 conn(0x7fb2b40d4950 msgr2=0x7fb2b415e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:17.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2b8847640 1 --2- 172.21.15.83:0/3590513255 >> v2:172.21.15.153:3300/0 conn(0x7fb2b40d4950 0x7fb2b415e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2b8847640 1 -- 172.21.15.83:0/3590513255 >> v1:172.21.15.83:6789/0 conn(0x7fb2b415e500 legacy=0x7fb2b40d4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2b8847640 1 -- 172.21.15.83:0/3590513255 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b40cfe10 con 0x7fb2b40cee20 2024-03-30T13:09:17.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2b2ffd640 1 -- 172.21.15.83:0/3590513255 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084287820 0 0) 0x7fb2b406c6a0 con 0x7fb2b415e500 2024-03-30T13:09:17.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2b37fe640 1 --2- 172.21.15.83:0/3590513255 >> v2:172.21.15.153:3300/0 conn(0x7fb2b40d4950 0x7fb2b415e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:17.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2b8847640 1 --2- 172.21.15.83:0/3590513255 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b40cee20 0x7fb2b40cf270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb2b406e730 tx=0x7fb2ac01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1011a4c5ac6b03b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:17.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2b2ffd640 1 -- 172.21.15.83:0/3590513255 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0b2070 con 0x7fb2b40cee20 2024-03-30T13:09:17.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2b2ffd640 1 -- 172.21.15.83:0/3590513255 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ac0a59c0 con 0x7fb2b40cee20 2024-03-30T13:09:17.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2b2ffd640 1 -- 172.21.15.83:0/3590513255 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0a5d90 con 0x7fb2b40cee20 2024-03-30T13:09:17.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/3590513255 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b40cee20 msgr2=0x7fb2b40cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2ba2aa640 1 --2- 172.21.15.83:0/3590513255 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b40cee20 0x7fb2b40cf270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb2b406e730 tx=0x7fb2ac01c900 comp rx=0 tx=0).stop 2024-03-30T13:09:17.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/3590513255 shutdown_connections 2024-03-30T13:09:17.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2ba2aa640 1 --2- 172.21.15.83:0/3590513255 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b40cee20 0x7fb2b40cf270 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2ba2aa640 1 --2- 172.21.15.83:0/3590513255 >> v2:172.21.15.153:3300/0 conn(0x7fb2b40d4950 0x7fb2b415e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/3590513255 >> 172.21.15.83:0/3590513255 conn(0x7fb2b408bfe0 msgr2=0x7fb2b409d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:17.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/3590513255 shutdown_connections 2024-03-30T13:09:17.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.835+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/3590513255 wait complete. 2024-03-30T13:09:17.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2ba2aa640 1 Processor -- start 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2ba2aa640 1 -- start start 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2ba2aa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b40cee20 0x7fb2b40cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2ba2aa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b40d4950 0x7fb2b4152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2ba2aa640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b415e500 0x7fb2b40cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2ba2aa640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b406d810 con 0x7fb2b40cee20 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2ba2aa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b406d690 con 0x7fb2b40d4950 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2ba2aa640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b406d990 con 0x7fb2b415e500 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b40cee20 0x7fb2b40cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b40cee20 0x7fb2b40cde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51628/0 (socket says 172.21.15.83:51628) 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b3fff640 1 -- 172.21.15.83:0/1814559091 learned_addr learned my addr 172.21.15.83:0/1814559091 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b8847640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b415e500 0x7fb2b40cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b37fe640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b40d4950 0x7fb2b4152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b3fff640 1 -- 172.21.15.83:0/1814559091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b415e500 msgr2=0x7fb2b40cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b3fff640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b415e500 0x7fb2b40cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b3fff640 1 -- 172.21.15.83:0/1814559091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b40d4950 msgr2=0x7fb2b4152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:17.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b3fff640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b40d4950 0x7fb2b4152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:17.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b3fff640 1 -- 172.21.15.83:0/1814559091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b40ccf20 con 0x7fb2b40cee20 2024-03-30T13:09:17.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b37fe640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b40d4950 0x7fb2b4152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:17.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b3fff640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b40cee20 0x7fb2b40cde40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c480 tx=0x7fb2a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:17.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b0ff9640 1 -- 172.21.15.83:0/1814559091 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4018070 con 0x7fb2b40cee20 2024-03-30T13:09:17.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b0ff9640 1 -- 172.21.15.83:0/1814559091 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a4007500 con 0x7fb2b40cee20 2024-03-30T13:09:17.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/1814559091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b40cd200 con 0x7fb2b40cee20 2024-03-30T13:09:17.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b0ff9640 1 -- 172.21.15.83:0/1814559091 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4004a30 con 0x7fb2b40cee20 2024-03-30T13:09:17.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/1814559091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b40cb5b0 con 0x7fb2b40cee20 2024-03-30T13:09:17.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/1814559091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b40686c0 con 0x7fb2b40cee20 2024-03-30T13:09:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.839+0000 7fb2b0ff9640 1 -- 172.21.15.83:0/1814559091 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb2a401b070 con 0x7fb2b40cee20 2024-03-30T13:09:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.843+0000 7fb2b0ff9640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb2a0067fc0 0x7fb2a006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.843+0000 7fb2b0ff9640 1 -- 172.21.15.83:0/1814559091 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7fb2a4085ae0 con 0x7fb2b40cee20 2024-03-30T13:09:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.843+0000 7fb2b37fe640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb2a0067fc0 0x7fb2a006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.843+0000 7fb2b37fe640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb2a0067fc0 0x7fb2a006a480 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8006fd0 tx=0x7fb2a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.843+0000 7fb2b0ff9640 1 -- 172.21.15.83:0/1814559091 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb2a4056380 con 0x7fb2b40cee20 2024-03-30T13:09:17.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.991+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/1814559091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2b40ce520 con 0x7fb2b40cee20 2024-03-30T13:09:17.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.995+0000 7fb2b0ff9640 1 -- 172.21.15.83:0/1814559091 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16848 (secure 0 0 0) 0x7fb2a4055c80 con 0x7fb2b40cee20 2024-03-30T13:09:18.000 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:18.000 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:09:07.416798+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.995+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/1814559091 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb2a0067fc0 msgr2=0x7fb2a006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.995+0000 7fb2ba2aa640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb2a0067fc0 0x7fb2a006a480 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8006fd0 tx=0x7fb2a8008040 comp rx=0 tx=0).stop 2024-03-30T13:09:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.995+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/1814559091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b40cee20 msgr2=0x7fb2b40cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.995+0000 7fb2ba2aa640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b40cee20 0x7fb2b40cde40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c480 tx=0x7fb2a400c940 comp rx=0 tx=0).stop 2024-03-30T13:09:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.995+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/1814559091 shutdown_connections 2024-03-30T13:09:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.995+0000 7fb2ba2aa640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb2a0067fc0 0x7fb2a006a480 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.995+0000 7fb2ba2aa640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2b415e500 0x7fb2b40cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.995+0000 7fb2ba2aa640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b40d4950 0x7fb2b4152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.995+0000 7fb2ba2aa640 1 --2- 172.21.15.83:0/1814559091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2b40cee20 0x7fb2b40cde40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.995+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/1814559091 >> 172.21.15.83:0/1814559091 conn(0x7fb2b408bfe0 msgr2=0x7fb2b40d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.999+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/1814559091 shutdown_connections 2024-03-30T13:09:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:17.999+0000 7fb2ba2aa640 1 -- 172.21.15.83:0/1814559091 wait complete. 2024-03-30T13:09:18.018 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T13:09:18.018 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:09:18.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fe2720640 1 Processor -- start 2024-03-30T13:09:18.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fe2720640 1 -- start start 2024-03-30T13:09:18.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fe2720640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc0b4830 0x7f3fdc15d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fe2720640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3fdc06dfe0 0x7f3fdc06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fe2720640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fdc15d880 con 0x7f3fdc0aed20 2024-03-30T13:09:18.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fe2720640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f3fdc156e00 con 0x7f3fdc06dfe0 2024-03-30T13:09:18.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fe2720640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3fdc0ad040 con 0x7f3fdc0b4830 2024-03-30T13:09:18.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdb7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3fdc0aed20 0x7f3fdc0af1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:52888/0 (socket says 172.21.15.83:52888) 2024-03-30T13:09:18.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdb7fe640 1 -- 172.21.15.83:0/1387350564 learned_addr learned my addr 172.21.15.83:0/1387350564 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:18.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fe0cbd640 1 --2- 172.21.15.83:0/1387350564 >> v2:172.21.15.153:3300/0 conn(0x7f3fdc06dfe0 0x7f3fdc06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdbfff640 1 --2- 172.21.15.83:0/1387350564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc0b4830 0x7f3fdc15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2717000535 0 0) 0x7f3fdc15d880 con 0x7f3fdc0aed20 2024-03-30T13:09:18.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fc4003530 con 0x7f3fdc0aed20 2024-03-30T13:09:18.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3531634667 0 0) 0x7f3fc4003530 con 0x7f3fdc0aed20 2024-03-30T13:09:18.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc0b4830 msgr2=0x7f3fdc15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:18.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 --2- 172.21.15.83:0/1387350564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc0b4830 0x7f3fdc15d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 >> v2:172.21.15.153:3300/0 conn(0x7f3fdc06dfe0 msgr2=0x7f3fdc06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:18.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 --2- 172.21.15.83:0/1387350564 >> v2:172.21.15.153:3300/0 conn(0x7f3fdc06dfe0 0x7f3fdc06e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc0cfcb0 con 0x7f3fdc0aed20 2024-03-30T13:09:18.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f3fd0001680 con 0x7f3fdc0aed20 2024-03-30T13:09:18.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 >> v1:172.21.15.83:6789/0 conn(0x7f3fdc0aed20 legacy=0x7f3fdc0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 --2- 172.21.15.83:0/1387350564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc40039c0 0x7f3fc4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 --2- 172.21.15.83:0/1387350564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fc4004810 0x7f3fc4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 --2- 172.21.15.83:0/1387350564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc0b4830 0x7f3fc40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc156e00 con 0x7f3fc4004810 2024-03-30T13:09:18.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc0ad040 con 0x7f3fc40039c0 2024-03-30T13:09:18.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.123+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc400ba50 con 0x7f3fdc0b4830 2024-03-30T13:09:18.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fdb7fe640 1 --2- 172.21.15.83:0/1387350564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fc4004810 0x7f3fc4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fe0cbd640 1 --2- 172.21.15.83:0/1387350564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc0b4830 0x7f3fc40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fdbfff640 1 --2- 172.21.15.83:0/1387350564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc40039c0 0x7f3fc4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fdb7fe640 1 -- 172.21.15.83:0/1387350564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc0b4830 msgr2=0x7f3fc40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:18.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fdb7fe640 1 --2- 172.21.15.83:0/1387350564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc0b4830 0x7f3fc40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fdb7fe640 1 -- 172.21.15.83:0/1387350564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc40039c0 msgr2=0x7f3fc4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:18.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fdb7fe640 1 --2- 172.21.15.83:0/1387350564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc40039c0 0x7f3fc4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fdb7fe640 1 -- 172.21.15.83:0/1387350564 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc4003530 con 0x7f3fc4004810 2024-03-30T13:09:18.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fdb7fe640 1 --2- 172.21.15.83:0/1387350564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fc4004810 0x7f3fc4004c90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0001060 tx=0x7f3fd001cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe28c0a0526f16e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:18.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0007d80 con 0x7f3fc4004810 2024-03-30T13:09:18.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd00a9020 con 0x7f3fc4004810 2024-03-30T13:09:18.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fdaffd640 1 -- 172.21.15.83:0/1387350564 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0005b00 con 0x7f3fc4004810 2024-03-30T13:09:18.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fe2720640 1 -- 172.21.15.83:0/1387350564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fc4004810 msgr2=0x7f3fc4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fe2720640 1 --2- 172.21.15.83:0/1387350564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fc4004810 0x7f3fc4004c90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0001060 tx=0x7f3fd001cc70 comp rx=0 tx=0).stop 2024-03-30T13:09:18.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fe0cbd640 1 -- 172.21.15.83:0/1387350564 reap_dead start 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fe2720640 1 -- 172.21.15.83:0/1387350564 shutdown_connections 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fe2720640 1 -- 172.21.15.83:0/1387350564 >> 172.21.15.83:0/1387350564 conn(0x7f3fdc0b1d60 msgr2=0x7f3fdc0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fe2720640 1 -- 172.21.15.83:0/1387350564 shutdown_connections 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.127+0000 7f3fe2720640 1 -- 172.21.15.83:0/1387350564 wait complete. 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe2720640 1 Processor -- start 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe2720640 1 -- start start 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe2720640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4004810 0x7f3fdc099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe2720640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc151c00 0x7f3fdc152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe2720640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fdc14faa0 0x7f3fdc14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe2720640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc0cf860 con 0x7f3fdc14faa0 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe2720640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc06fa90 con 0x7f3fc4004810 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe2720640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3fdc0cf9e0 con 0x7f3fdc151c00 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe0cbd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fdc14faa0 0x7f3fdc14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe0cbd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fdc14faa0 0x7f3fdc14ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51656/0 (socket says 172.21.15.83:51656) 2024-03-30T13:09:18.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe0cbd640 1 -- 172.21.15.83:0/757262535 learned_addr learned my addr 172.21.15.83:0/757262535 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fdbfff640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4004810 0x7f3fdc099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fdb7fe640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc151c00 0x7f3fdc152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe0cbd640 1 -- 172.21.15.83:0/757262535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc151c00 msgr2=0x7f3fdc152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe0cbd640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc151c00 0x7f3fdc152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe0cbd640 1 -- 172.21.15.83:0/757262535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4004810 msgr2=0x7f3fdc099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe0cbd640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4004810 0x7f3fdc099ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe0cbd640 1 -- 172.21.15.83:0/757262535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc154030 con 0x7f3fdc14faa0 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fdb7fe640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc151c00 0x7f3fdc152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe0cbd640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fdc14faa0 0x7f3fdc14ff50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc073aa0 tx=0x7f3fd40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fd8ff9640 1 -- 172.21.15.83:0/757262535 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40039a0 con 0x7f3fdc14faa0 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fd8ff9640 1 -- 172.21.15.83:0/757262535 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd401b070 con 0x7f3fdc14faa0 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe2720640 1 -- 172.21.15.83:0/757262535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fdc152750 con 0x7f3fdc14faa0 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fd8ff9640 1 -- 172.21.15.83:0/757262535 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4003b80 con 0x7f3fdc14faa0 2024-03-30T13:09:18.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe2720640 1 -- 172.21.15.83:0/757262535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fdc14dec0 con 0x7f3fdc14faa0 2024-03-30T13:09:18.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fe2720640 1 -- 172.21.15.83:0/757262535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fdc0686c0 con 0x7f3fdc14faa0 2024-03-30T13:09:18.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.131+0000 7f3fd8ff9640 1 -- 172.21.15.83:0/757262535 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f3fd4004030 con 0x7f3fdc14faa0 2024-03-30T13:09:18.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.135+0000 7f3fd8ff9640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3fc8067fc0 0x7f3fc806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.135+0000 7f3fdbfff640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3fc8067fc0 0x7f3fc806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.135+0000 7f3fd8ff9640 1 -- 172.21.15.83:0/757262535 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f3fd4087b90 con 0x7f3fdc14faa0 2024-03-30T13:09:18.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.135+0000 7f3fdbfff640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3fc8067fc0 0x7f3fc806a480 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009980 tx=0x7f3fcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:18.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.135+0000 7f3fd8ff9640 1 -- 172.21.15.83:0/757262535 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3fd4025020 con 0x7f3fdc14faa0 2024-03-30T13:09:18.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.319+0000 7f3fe2720640 1 -- 172.21.15.83:0/757262535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fdc0b1b40 con 0x7f3fdc14faa0 2024-03-30T13:09:18.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.319+0000 7f3fd8ff9640 1 -- 172.21.15.83:0/757262535 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7f3fd4087070 con 0x7f3fdc14faa0 2024-03-30T13:09:18.325 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:18.325 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2431286615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2431286615},{"type":"v1","addr":"172.21.15.153:6835","nonce":2431286615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1036905849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1036905849},{"type":"v1","addr":"172.21.15.83:6835","nonce":1036905849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2692566836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2692566836},{"type":"v1","addr":"172.21.15.83:6837","nonce":2692566836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:08:25.599943+0000","modified":"2024-03-30T13:08:27.589265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/53727078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":53727078},{"type":"v1","addr":"172.21.15.153:6833","nonce":53727078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-30T13:09:18.325 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 6 2024-03-30T13:09:18.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.323+0000 7f3fe2720640 1 -- 172.21.15.83:0/757262535 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3fc8067fc0 msgr2=0x7f3fc806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.323+0000 7f3fe2720640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3fc8067fc0 0x7f3fc806a480 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009980 tx=0x7f3fcc008040 comp rx=0 tx=0).stop 2024-03-30T13:09:18.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.323+0000 7f3fe2720640 1 -- 172.21.15.83:0/757262535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fdc14faa0 msgr2=0x7f3fdc14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.323+0000 7f3fe2720640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fdc14faa0 0x7f3fdc14ff50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc073aa0 tx=0x7f3fd40115a0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.323+0000 7f3fe2720640 1 -- 172.21.15.83:0/757262535 shutdown_connections 2024-03-30T13:09:18.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.323+0000 7f3fe2720640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3fc8067fc0 0x7f3fc806a480 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.323+0000 7f3fe2720640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fdc14faa0 0x7f3fdc14ff50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.323+0000 7f3fe2720640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3fdc151c00 0x7f3fdc152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.323+0000 7f3fe2720640 1 --2- 172.21.15.83:0/757262535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4004810 0x7f3fdc099ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.323+0000 7f3fe2720640 1 -- 172.21.15.83:0/757262535 >> 172.21.15.83:0/757262535 conn(0x7f3fdc0b1d60 msgr2=0x7f3fdc0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:18.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.323+0000 7f3fe2720640 1 -- 172.21.15.83:0/757262535 shutdown_connections 2024-03-30T13:09:18.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.323+0000 7f3fe2720640 1 -- 172.21.15.83:0/757262535 wait complete. 2024-03-30T13:09:18.343 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:09:18.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.443+0000 7f2ca4ccd640 1 Processor -- start 2024-03-30T13:09:18.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.443+0000 7f2ca4ccd640 1 -- start start 2024-03-30T13:09:18.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.443+0000 7f2ca4ccd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ca00aed20 0x7f2ca00af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.443+0000 7f2ca4ccd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2ca006dfe0 0x7f2ca006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.443+0000 7f2ca4ccd640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ca00cfcb0 con 0x7f2ca00b4830 2024-03-30T13:09:18.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.443+0000 7f2ca4ccd640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f2ca0156e00 con 0x7f2ca006dfe0 2024-03-30T13:09:18.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.443+0000 7f2ca4ccd640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2ca00ad040 con 0x7f2ca00aed20 2024-03-30T13:09:18.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2c9ed9d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2ca006dfe0 0x7f2ca006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2c9ed9d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2ca006dfe0 0x7f2ca006e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51658/0 (socket says 172.21.15.83:51658) 2024-03-30T13:09:18.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2c9ed9d640 1 -- 172.21.15.83:0/1792604289 learned_addr learned my addr 172.21.15.83:0/1792604289 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:18.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2c9dd9b640 1 --2- 172.21.15.83:0/1792604289 >> v2:172.21.15.153:3300/0 conn(0x7f2ca00aed20 0x7f2ca00af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2c9ed9d640 1 -- 172.21.15.83:0/1792604289 >> v2:172.21.15.153:3300/0 conn(0x7f2ca00aed20 msgr2=0x7f2ca00af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:18.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2c9ed9d640 1 --2- 172.21.15.83:0/1792604289 >> v2:172.21.15.153:3300/0 conn(0x7f2ca00aed20 0x7f2ca00af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2c9ed9d640 1 -- 172.21.15.83:0/1792604289 >> v1:172.21.15.153:6789/0 conn(0x7f2ca00b4830 legacy=0x7f2ca015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:18.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2c9ed9d640 1 -- 172.21.15.83:0/1792604289 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca00ad290 con 0x7f2ca006dfe0 2024-03-30T13:09:18.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2c9ed9d640 1 --2- 172.21.15.83:0/1792604289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca006dfe0 0x7f2ca006e410 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2ca006d0f0 tx=0x7f2c9801c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12eeb0999d87fc5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:18.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2c9d59a640 1 -- 172.21.15.83:0/1792604289 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c980a5720 con 0x7f2ca006dfe0 2024-03-30T13:09:18.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2c9d59a640 1 -- 172.21.15.83:0/1792604289 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c980a58c0 con 0x7f2ca006dfe0 2024-03-30T13:09:18.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2c9d59a640 1 -- 172.21.15.83:0/1792604289 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c980a5c90 con 0x7f2ca006dfe0 2024-03-30T13:09:18.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/1792604289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca006dfe0 msgr2=0x7f2ca006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2ca4ccd640 1 --2- 172.21.15.83:0/1792604289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca006dfe0 0x7f2ca006e410 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2ca006d0f0 tx=0x7f2c9801c860 comp rx=0 tx=0).stop 2024-03-30T13:09:18.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/1792604289 shutdown_connections 2024-03-30T13:09:18.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2ca4ccd640 1 --2- 172.21.15.83:0/1792604289 >> v2:172.21.15.153:3300/0 conn(0x7f2ca00aed20 0x7f2ca00af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2ca4ccd640 1 --2- 172.21.15.83:0/1792604289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca006dfe0 0x7f2ca006e410 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/1792604289 >> 172.21.15.83:0/1792604289 conn(0x7f2ca00b1d60 msgr2=0x7f2ca00b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:18.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/1792604289 shutdown_connections 2024-03-30T13:09:18.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.447+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/1792604289 wait complete. 2024-03-30T13:09:18.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2ca4ccd640 1 Processor -- start 2024-03-30T13:09:18.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2ca4ccd640 1 -- start start 2024-03-30T13:09:18.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2ca4ccd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ca006dfe0 0x7f2ca0157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2ca4ccd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca00aed20 0x7f2ca01595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2ca4ccd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00b4830 0x7f2ca0159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2ca4ccd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca00cf860 con 0x7f2ca00aed20 2024-03-30T13:09:18.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2ca4ccd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca006fa90 con 0x7f2ca006dfe0 2024-03-30T13:09:18.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2ca4ccd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca00cf9e0 con 0x7f2ca00b4830 2024-03-30T13:09:18.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c9dd9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca00aed20 0x7f2ca01595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c9dd9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca00aed20 0x7f2ca01595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51670/0 (socket says 172.21.15.83:51670) 2024-03-30T13:09:18.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c9ed9d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00b4830 0x7f2ca0159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c9dd9b640 1 -- 172.21.15.83:0/783819695 learned_addr learned my addr 172.21.15.83:0/783819695 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c9e59c640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ca006dfe0 0x7f2ca0157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c9dd9b640 1 -- 172.21.15.83:0/783819695 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00b4830 msgr2=0x7f2ca0159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c9dd9b640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00b4830 0x7f2ca0159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c9dd9b640 1 -- 172.21.15.83:0/783819695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ca006dfe0 msgr2=0x7f2ca0157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c9dd9b640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ca006dfe0 0x7f2ca0157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c9dd9b640 1 -- 172.21.15.83:0/783819695 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca01567b0 con 0x7f2ca00aed20 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c9dd9b640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca00aed20 0x7f2ca01595e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400c7f0 tx=0x7f2c9400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c8effd640 1 -- 172.21.15.83:0/783819695 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94015070 con 0x7f2ca00aed20 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c8effd640 1 -- 172.21.15.83:0/783819695 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c94004240 con 0x7f2ca00aed20 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/783819695 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca0158000 con 0x7f2ca00aed20 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c8effd640 1 -- 172.21.15.83:0/783819695 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94003620 con 0x7f2ca00aed20 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/783819695 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca01585c0 con 0x7f2ca00aed20 2024-03-30T13:09:18.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/783819695 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca00686c0 con 0x7f2ca00aed20 2024-03-30T13:09:18.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.451+0000 7f2c8effd640 1 -- 172.21.15.83:0/783819695 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2c940039d0 con 0x7f2ca00aed20 2024-03-30T13:09:18.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.455+0000 7f2c8effd640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2c80067fc0 0x7f2c8006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.455+0000 7f2c8effd640 1 -- 172.21.15.83:0/783819695 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7f2c94086580 con 0x7f2ca00aed20 2024-03-30T13:09:18.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.455+0000 7f2c9e59c640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2c80067fc0 0x7f2c8006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.455+0000 7f2c9e59c640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2c80067fc0 0x7f2c8006a480 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2ca015f7f0 tx=0x7f2c90007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:18.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.459+0000 7f2c8effd640 1 -- 172.21.15.83:0/783819695 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f2c94056660 con 0x7f2ca00aed20 2024-03-30T13:09:18.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/783819695 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ca00b4ca0 con 0x7f2ca00aed20 2024-03-30T13:09:18.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2c8effd640 1 -- 172.21.15.83:0/783819695 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7f2c9405a960 con 0x7f2ca00aed20 2024-03-30T13:09:18.647 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:18.647 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2431286615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2431286615},{"type":"v1","addr":"172.21.15.153:6835","nonce":2431286615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1036905849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1036905849},{"type":"v1","addr":"172.21.15.83:6835","nonce":1036905849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2692566836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2692566836},{"type":"v1","addr":"172.21.15.83:6837","nonce":2692566836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:08:25.599943+0000","modified":"2024-03-30T13:08:27.589265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/53727078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":53727078},{"type":"v1","addr":"172.21.15.153:6833","nonce":53727078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-03-30T13:09:18.648 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 6 2024-03-30T13:09:18.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/783819695 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2c80067fc0 msgr2=0x7f2c8006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2c80067fc0 0x7f2c8006a480 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2ca015f7f0 tx=0x7f2c90007e40 comp rx=0 tx=0).stop 2024-03-30T13:09:18.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/783819695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca00aed20 msgr2=0x7f2ca01595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca00aed20 0x7f2ca01595e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400c7f0 tx=0x7f2c9400ccb0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/783819695 shutdown_connections 2024-03-30T13:09:18.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2c80067fc0 0x7f2c8006a480 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ca00b4830 0x7f2ca0159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ca00aed20 0x7f2ca01595e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 --2- 172.21.15.83:0/783819695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ca006dfe0 0x7f2ca0157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/783819695 >> 172.21.15.83:0/783819695 conn(0x7f2ca00b1d60 msgr2=0x7f2ca015d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:18.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/783819695 shutdown_connections 2024-03-30T13:09:18.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.643+0000 7f2ca4ccd640 1 -- 172.21.15.83:0/783819695 wait complete. 2024-03-30T13:09:18.665 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:18.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4ff025640 1 Processor -- start 2024-03-30T13:09:18.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4ff025640 1 -- start start 2024-03-30T13:09:18.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4ff025640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4f80aed20 0x7fc4f80af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4ff025640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f80cfcb0 con 0x7fc4f806dfe0 2024-03-30T13:09:18.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4ff025640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f80ad290 con 0x7fc4f80b4830 2024-03-30T13:09:18.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4ff025640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc4f8156e00 con 0x7fc4f80aed20 2024-03-30T13:09:18.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4fd5c2640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc4f806dfe0 0x7fc4f806e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:52902/0 (socket says 172.21.15.83:52902) 2024-03-30T13:09:18.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4fd5c2640 1 -- 172.21.15.83:0/1633793288 learned_addr learned my addr 172.21.15.83:0/1633793288 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:18.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f7fff640 1 --2- 172.21.15.83:0/1633793288 >> v2:172.21.15.153:3300/0 conn(0x7fc4f80aed20 0x7fc4f80af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3057117758 0 0) 0x7fc4f80cfcb0 con 0x7fc4f806dfe0 2024-03-30T13:09:18.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4e0003530 con 0x7fc4f806dfe0 2024-03-30T13:09:18.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3489211302 0 0) 0x7fc4e0003530 con 0x7fc4f806dfe0 2024-03-30T13:09:18.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 >> v2:172.21.15.153:3300/0 conn(0x7fc4f80aed20 msgr2=0x7fc4f80af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 --2- 172.21.15.83:0/1633793288 >> v2:172.21.15.153:3300/0 conn(0x7fc4f80aed20 0x7fc4f80af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 >> v1:172.21.15.153:6789/0 conn(0x7fc4f80b4830 legacy=0x7fc4f815d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f80ad570 con 0x7fc4f806dfe0 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fc4f0001a00 con 0x7fc4f806dfe0 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 >> v1:172.21.15.83:6789/0 conn(0x7fc4f806dfe0 legacy=0x7fc4f806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e00039c0 0x7fc4e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4e0004810 0x7fc4e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e00052f0 0x7fc4e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f8156e00 con 0x7fc4e0004810 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e000c1c0 con 0x7fc4e00052f0 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e000c3c0 con 0x7fc4e00039c0 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f7fff640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4e0004810 0x7fc4e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4fcdc1640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e00039c0 0x7fc4e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f7fff640 1 -- 172.21.15.83:0/1633793288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e00039c0 msgr2=0x7fc4e0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:18.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f7fff640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e00039c0 0x7fc4e0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4fd5c2640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e00052f0 0x7fc4e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f7fff640 1 -- 172.21.15.83:0/1633793288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e00052f0 msgr2=0x7fc4e000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:18.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f7fff640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e00052f0 0x7fc4e000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4f7fff640 1 -- 172.21.15.83:0/1633793288 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e0003530 con 0x7fc4e0004810 2024-03-30T13:09:18.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4fcdc1640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e00039c0 0x7fc4e0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:18.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4fd5c2640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e00052f0 0x7fc4e000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:18.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.779+0000 7fc4fd5c2640 1 -- 172.21.15.83:0/1633793288 reap_dead start 2024-03-30T13:09:18.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4f7fff640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4e0004810 0x7fc4e0004c90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009ab0 tx=0x7fc4e801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461558282e49420c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:18.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80096b0 con 0x7fc4e0004810 2024-03-30T13:09:18.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e80a6500 con 0x7fc4e0004810 2024-03-30T13:09:18.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4f77fe640 1 -- 172.21.15.83:0/1633793288 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80a68f0 con 0x7fc4e0004810 2024-03-30T13:09:18.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 -- 172.21.15.83:0/1633793288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4e0004810 msgr2=0x7fc4e0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4e0004810 0x7fc4e0004c90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009ab0 tx=0x7fc4e801ca50 comp rx=0 tx=0).stop 2024-03-30T13:09:18.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 -- 172.21.15.83:0/1633793288 shutdown_connections 2024-03-30T13:09:18.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 --2- 172.21.15.83:0/1633793288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4e0004810 0x7fc4e0004c90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 -- 172.21.15.83:0/1633793288 >> 172.21.15.83:0/1633793288 conn(0x7fc4f80b1d60 msgr2=0x7fc4f80b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:18.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 -- 172.21.15.83:0/1633793288 shutdown_connections 2024-03-30T13:09:18.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 -- 172.21.15.83:0/1633793288 wait complete. 2024-03-30T13:09:18.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 Processor -- start 2024-03-30T13:09:18.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 -- start start 2024-03-30T13:09:18.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e0004810 0x7fc4f81f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4f8071fe0 0x7fc4f8150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f8073580 0x7fc4f815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f80cf9e0 con 0x7fc4f8073580 2024-03-30T13:09:18.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f80cf860 con 0x7fc4f8071fe0 2024-03-30T13:09:18.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4ff025640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f815fee0 con 0x7fc4e0004810 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4fd5c2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f8073580 0x7fc4f815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4fd5c2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f8073580 0x7fc4f815b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51676/0 (socket says 172.21.15.83:51676) 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4fd5c2640 1 -- 172.21.15.83:0/2626951231 learned_addr learned my addr 172.21.15.83:0/2626951231 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4f7fff640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4f8071fe0 0x7fc4f8150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.783+0000 7fc4fcdc1640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e0004810 0x7fc4f81f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4fd5c2640 1 -- 172.21.15.83:0/2626951231 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e0004810 msgr2=0x7fc4f81f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4fd5c2640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e0004810 0x7fc4f81f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4fd5c2640 1 -- 172.21.15.83:0/2626951231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4f8071fe0 msgr2=0x7fc4f8150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4fd5c2640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4f8071fe0 0x7fc4f8150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4fd5c2640 1 -- 172.21.15.83:0/2626951231 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f80724e0 con 0x7fc4f8073580 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4fd5c2640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f8073580 0x7fc4f815b3c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc4f809e390 tx=0x7fc4f000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4f57fa640 1 -- 172.21.15.83:0/2626951231 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0004d70 con 0x7fc4f8073580 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4f57fa640 1 -- 172.21.15.83:0/2626951231 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f000bb20 con 0x7fc4f8073580 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4ff025640 1 -- 172.21.15.83:0/2626951231 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f80727c0 con 0x7fc4f8073580 2024-03-30T13:09:18.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4f57fa640 1 -- 172.21.15.83:0/2626951231 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0007110 con 0x7fc4f8073580 2024-03-30T13:09:18.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4ff025640 1 -- 172.21.15.83:0/2626951231 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f8072d80 con 0x7fc4f8073580 2024-03-30T13:09:18.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4ff025640 1 -- 172.21.15.83:0/2626951231 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f80686c0 con 0x7fc4f8073580 2024-03-30T13:09:18.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4f57fa640 1 -- 172.21.15.83:0/2626951231 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc4f001b020 con 0x7fc4f8073580 2024-03-30T13:09:18.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4f57fa640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc4e4067fc0 0x7fc4e406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:18.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4fcdc1640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc4e4067fc0 0x7fc4e406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:18.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4f57fa640 1 -- 172.21.15.83:0/2626951231 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7fc4f00866f0 con 0x7fc4f8073580 2024-03-30T13:09:18.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.787+0000 7fc4fcdc1640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc4e4067fc0 0x7fc4e406a480 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80cc700 tx=0x7fc4ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:18.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.791+0000 7fc4f57fa640 1 -- 172.21.15.83:0/2626951231 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fc4f0056e20 con 0x7fc4f8073580 2024-03-30T13:09:18.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.955+0000 7fc4ff025640 1 -- 172.21.15.83:0/2626951231 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4f80b0f40 con 0x7fc4f8073580 2024-03-30T13:09:18.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.955+0000 7fc4f57fa640 1 -- 172.21.15.83:0/2626951231 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16848 (secure 0 0 0) 0x7fc4f0056720 con 0x7fc4f8073580 2024-03-30T13:09:18.960 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:18.960 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:09:07.416798+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:08:23.821954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:08:24.549769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:18.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.959+0000 7fc4ff025640 1 -- 172.21.15.83:0/2626951231 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc4e4067fc0 msgr2=0x7fc4e406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.959+0000 7fc4ff025640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc4e4067fc0 0x7fc4e406a480 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80cc700 tx=0x7fc4ec009040 comp rx=0 tx=0).stop 2024-03-30T13:09:18.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.959+0000 7fc4ff025640 1 -- 172.21.15.83:0/2626951231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f8073580 msgr2=0x7fc4f815b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:18.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.959+0000 7fc4ff025640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f8073580 0x7fc4f815b3c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc4f809e390 tx=0x7fc4f000b4a0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.959+0000 7fc4ff025640 1 -- 172.21.15.83:0/2626951231 shutdown_connections 2024-03-30T13:09:18.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.959+0000 7fc4ff025640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc4e4067fc0 0x7fc4e406a480 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.959+0000 7fc4ff025640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f8073580 0x7fc4f815b3c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.959+0000 7fc4ff025640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4f8071fe0 0x7fc4f8150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.959+0000 7fc4ff025640 1 --2- 172.21.15.83:0/2626951231 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e0004810 0x7fc4f81f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:18.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.959+0000 7fc4ff025640 1 -- 172.21.15.83:0/2626951231 >> 172.21.15.83:0/2626951231 conn(0x7fc4f80b1d60 msgr2=0x7fc4f81601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:18.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.959+0000 7fc4ff025640 1 -- 172.21.15.83:0/2626951231 shutdown_connections 2024-03-30T13:09:18.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:18.959+0000 7fc4ff025640 1 -- 172.21.15.83:0/2626951231 wait complete. 2024-03-30T13:09:18.980 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-30T13:09:19.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe18c01640 1 Processor -- start 2024-03-30T13:09:19.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe18c01640 1 -- start start 2024-03-30T13:09:19.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe18c01640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbe140d31e0 0x7fbe140d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:19.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe18c01640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe140d1370 0x7fbe1406c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:19.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe18c01640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe140d51f0 con 0x7fbe1415e840 2024-03-30T13:09:19.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe18c01640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fbe1415ec20 con 0x7fbe140d31e0 2024-03-30T13:09:19.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe18c01640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbe140d2d50 con 0x7fbe140d1370 2024-03-30T13:09:19.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe1259c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fbe1415e840 0x7fbe140cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:52918/0 (socket says 172.21.15.83:52918) 2024-03-30T13:09:19.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe1259c640 1 -- 172.21.15.83:0/2272027511 learned_addr learned my addr 172.21.15.83:0/2272027511 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:19.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe11d9b640 1 --2- 172.21.15.83:0/2272027511 >> v2:172.21.15.83:3300/0 conn(0x7fbe140d31e0 0x7fbe140d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:19.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe12d9d640 1 --2- 172.21.15.83:0/2272027511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe140d1370 0x7fbe1406c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:19.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe1159a640 1 -- 172.21.15.83:0/2272027511 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352733512 0 0) 0x7fbe08001120 con 0x7fbe1415e840 2024-03-30T13:09:19.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe1159a640 1 -- 172.21.15.83:0/2272027511 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdfc003530 con 0x7fbe1415e840 2024-03-30T13:09:19.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe11d9b640 1 -- 172.21.15.83:0/2272027511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe140d1370 msgr2=0x7fbe1406c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:19.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe11d9b640 1 --2- 172.21.15.83:0/2272027511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe140d1370 0x7fbe1406c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe11d9b640 1 -- 172.21.15.83:0/2272027511 >> v1:172.21.15.83:6789/0 conn(0x7fbe1415e840 legacy=0x7fbe140cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:19.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe11d9b640 1 -- 172.21.15.83:0/2272027511 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe140d2140 con 0x7fbe140d31e0 2024-03-30T13:09:19.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.091+0000 7fbe12d9d640 1 --2- 172.21.15.83:0/2272027511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe140d1370 0x7fbe1406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:19.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe11d9b640 1 --2- 172.21.15.83:0/2272027511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe140d31e0 0x7fbe140d0e30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbe040097c0 tx=0x7fbe0401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817b58990c003796 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:19.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe1159a640 1 -- 172.21.15.83:0/2272027511 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe040b0070 con 0x7fbe140d31e0 2024-03-30T13:09:19.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe1159a640 1 -- 172.21.15.83:0/2272027511 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe040ab600 con 0x7fbe140d31e0 2024-03-30T13:09:19.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe1159a640 1 -- 172.21.15.83:0/2272027511 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe040ab9d0 con 0x7fbe140d31e0 2024-03-30T13:09:19.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe18c01640 1 -- 172.21.15.83:0/2272027511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe140d31e0 msgr2=0x7fbe140d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:19.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe18c01640 1 --2- 172.21.15.83:0/2272027511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe140d31e0 0x7fbe140d0e30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbe040097c0 tx=0x7fbe0401c410 comp rx=0 tx=0).stop 2024-03-30T13:09:19.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe18c01640 1 -- 172.21.15.83:0/2272027511 shutdown_connections 2024-03-30T13:09:19.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe18c01640 1 --2- 172.21.15.83:0/2272027511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe140d1370 0x7fbe1406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe18c01640 1 --2- 172.21.15.83:0/2272027511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe140d31e0 0x7fbe140d0e30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe18c01640 1 -- 172.21.15.83:0/2272027511 >> 172.21.15.83:0/2272027511 conn(0x7fbe1409d7f0 msgr2=0x7fbe140d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:19.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe18c01640 1 -- 172.21.15.83:0/2272027511 shutdown_connections 2024-03-30T13:09:19.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe18c01640 1 -- 172.21.15.83:0/2272027511 wait complete. 2024-03-30T13:09:19.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe18c01640 1 Processor -- start 2024-03-30T13:09:19.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.095+0000 7fbe18c01640 1 -- start start 2024-03-30T13:09:19.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe18c01640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe140d1370 0x7fbe1415d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:19.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe18c01640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe140d31e0 0x7fbe14154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:19.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe18c01640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe1415e840 0x7fbe14154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:19.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe18c01640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbe140d04a0 con 0x7fbe140d1370 2024-03-30T13:09:19.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe18c01640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe140d0320 con 0x7fbe1415e840 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe18c01640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbe1416b5f0 con 0x7fbe140d31e0 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe1259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe140d1370 0x7fbe1415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe1259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe140d1370 0x7fbe1415d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51706/0 (socket says 172.21.15.83:51706) 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe1259c640 1 -- 172.21.15.83:0/4094520939 learned_addr learned my addr 172.21.15.83:0/4094520939 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe1259c640 1 -- 172.21.15.83:0/4094520939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe140d31e0 msgr2=0x7fbe14154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe1259c640 1 --2- 172.21.15.83:0/4094520939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe140d31e0 0x7fbe14154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe1259c640 1 -- 172.21.15.83:0/4094520939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe1415e840 msgr2=0x7fbe14154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe1259c640 1 --2- 172.21.15.83:0/4094520939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe1415e840 0x7fbe14154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe1259c640 1 -- 172.21.15.83:0/4094520939 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1415d970 con 0x7fbe140d1370 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe1259c640 1 --2- 172.21.15.83:0/4094520939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe140d1370 0x7fbe1415d120 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800c3c0 tx=0x7fbe0800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe02ffd640 1 -- 172.21.15.83:0/4094520939 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08017070 con 0x7fbe140d1370 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe02ffd640 1 -- 172.21.15.83:0/4094520939 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe08005cf0 con 0x7fbe140d1370 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe18c01640 1 -- 172.21.15.83:0/4094520939 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe141fb390 con 0x7fbe140d1370 2024-03-30T13:09:19.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe02ffd640 1 -- 172.21.15.83:0/4094520939 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08007310 con 0x7fbe140d1370 2024-03-30T13:09:19.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe18c01640 1 -- 172.21.15.83:0/4094520939 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe1415d660 con 0x7fbe140d1370 2024-03-30T13:09:19.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe18c01640 1 -- 172.21.15.83:0/4094520939 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe140a23d0 con 0x7fbe140d1370 2024-03-30T13:09:19.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe02ffd640 1 -- 172.21.15.83:0/4094520939 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fbe0801a070 con 0x7fbe140d1370 2024-03-30T13:09:19.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe02ffd640 1 --2- 172.21.15.83:0/4094520939 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbdf4067fc0 0x7fbdf406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:19.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe02ffd640 1 -- 172.21.15.83:0/4094520939 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5833+0+0 (secure 0 0 0) 0x7fbe08085970 con 0x7fbe140d1370 2024-03-30T13:09:19.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe11d9b640 1 --2- 172.21.15.83:0/4094520939 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbdf4067fc0 0x7fbdf406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:19.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.099+0000 7fbe11d9b640 1 --2- 172.21.15.83:0/4094520939 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbdf4067fc0 0x7fbdf406a480 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbe040ad000 tx=0x7fbe04004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:19.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.103+0000 7fbe02ffd640 1 -- 172.21.15.83:0/4094520939 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fbe140d51f0 con 0x7fbe140d1370 2024-03-30T13:09:19.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.291+0000 7fbe18c01640 1 -- 172.21.15.83:0/4094520939 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbe1415cf00 con 0x7fbe140d1370 2024-03-30T13:09:19.298 INFO:tasks.ceph.mon.a.smithi083.stderr:2024-03-30T13:09:19.295+0000 7f84d7d64640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T13:09:19.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.295+0000 7fbe02ffd640 1 -- 172.21.15.83:0/4094520939 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fbe080560a0 con 0x7fbe140d1370 2024-03-30T13:09:19.300 INFO:teuthology.orchestra.run.smithi083.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-30T13:09:19.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.299+0000 7fbe18c01640 1 -- 172.21.15.83:0/4094520939 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbdf4067fc0 msgr2=0x7fbdf406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:19.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.299+0000 7fbe18c01640 1 --2- 172.21.15.83:0/4094520939 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbdf4067fc0 0x7fbdf406a480 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbe040ad000 tx=0x7fbe04004740 comp rx=0 tx=0).stop 2024-03-30T13:09:19.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.299+0000 7fbe18c01640 1 -- 172.21.15.83:0/4094520939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe140d1370 msgr2=0x7fbe1415d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:19.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.299+0000 7fbe18c01640 1 --2- 172.21.15.83:0/4094520939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe140d1370 0x7fbe1415d120 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800c3c0 tx=0x7fbe0800c880 comp rx=0 tx=0).stop 2024-03-30T13:09:19.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.299+0000 7fbe18c01640 1 -- 172.21.15.83:0/4094520939 shutdown_connections 2024-03-30T13:09:19.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.299+0000 7fbe18c01640 1 --2- 172.21.15.83:0/4094520939 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbdf4067fc0 0x7fbdf406a480 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.299+0000 7fbe18c01640 1 --2- 172.21.15.83:0/4094520939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe1415e840 0x7fbe14154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.299+0000 7fbe18c01640 1 --2- 172.21.15.83:0/4094520939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe140d31e0 0x7fbe14154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.299+0000 7fbe18c01640 1 --2- 172.21.15.83:0/4094520939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe140d1370 0x7fbe1415d120 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.299+0000 7fbe18c01640 1 -- 172.21.15.83:0/4094520939 >> 172.21.15.83:0/4094520939 conn(0x7fbe1409d7f0 msgr2=0x7fbe1415b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:19.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.299+0000 7fbe18c01640 1 -- 172.21.15.83:0/4094520939 shutdown_connections 2024-03-30T13:09:19.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.299+0000 7fbe18c01640 1 -- 172.21.15.83:0/4094520939 wait complete. 2024-03-30T13:09:19.314 INFO:tasks.ceph.mds.d.smithi153.stderr: -3331> 2024-03-30T13:08:30.401+0000 7fc55eee6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T13:09:19.319 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-30T13:09:19.372 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-03-30T13:09:19.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f3363bb2640 1 Processor -- start 2024-03-30T13:09:19.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f3363bb2640 1 -- start start 2024-03-30T13:09:19.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f3363bb2640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f335c15b050 0x7f335c073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:19.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f3363bb2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f335c0b3ca0 0x7f335c06f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:19.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f3363bb2640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f335c0b31e0 con 0x7f335c06f690 2024-03-30T13:09:19.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f3363bb2640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f335c06fad0 con 0x7f335c15b050 2024-03-30T13:09:19.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f3363bb2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f335c073ab0 con 0x7f335c0b3ca0 2024-03-30T13:09:19.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f336194e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f335c15b050 0x7f335c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:19.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f336194e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f335c15b050 0x7f335c073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51714/0 (socket says 172.21.15.83:51714) 2024-03-30T13:09:19.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f336194e640 1 -- 172.21.15.83:0/3953631296 learned_addr learned my addr 172.21.15.83:0/3953631296 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:19.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f336114d640 1 --2- 172.21.15.83:0/3953631296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f335c0b3ca0 0x7f335c06f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:19.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f336194e640 1 -- 172.21.15.83:0/3953631296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f335c0b3ca0 msgr2=0x7f335c06f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:19.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f336194e640 1 --2- 172.21.15.83:0/3953631296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f335c0b3ca0 0x7f335c06f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f336194e640 1 -- 172.21.15.83:0/3953631296 >> v1:172.21.15.153:6789/0 conn(0x7f335c06f690 legacy=0x7f335c071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:19.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.431+0000 7f336194e640 1 -- 172.21.15.83:0/3953631296 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c0ad4f0 con 0x7f335c15b050 2024-03-30T13:09:19.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f336194e640 1 --2- 172.21.15.83:0/3953631296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c15b050 0x7f335c073570 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3358009870 tx=0x7f335801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f039b0b2f954ea server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:19.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f336094c640 1 -- 172.21.15.83:0/3953631296 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33580b0070 con 0x7f335c15b050 2024-03-30T13:09:19.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f336094c640 1 -- 172.21.15.83:0/3953631296 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33580ab600 con 0x7f335c15b050 2024-03-30T13:09:19.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f336094c640 1 -- 172.21.15.83:0/3953631296 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33580ab9d0 con 0x7f335c15b050 2024-03-30T13:09:19.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f3363bb2640 1 -- 172.21.15.83:0/3953631296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c15b050 msgr2=0x7f335c073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:19.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f3363bb2640 1 --2- 172.21.15.83:0/3953631296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c15b050 0x7f335c073570 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3358009870 tx=0x7f335801c520 comp rx=0 tx=0).stop 2024-03-30T13:09:19.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f3363bb2640 1 -- 172.21.15.83:0/3953631296 shutdown_connections 2024-03-30T13:09:19.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f3363bb2640 1 --2- 172.21.15.83:0/3953631296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f335c0b3ca0 0x7f335c06f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f3363bb2640 1 --2- 172.21.15.83:0/3953631296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c15b050 0x7f335c073570 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f3363bb2640 1 -- 172.21.15.83:0/3953631296 >> 172.21.15.83:0/3953631296 conn(0x7f335c06b660 msgr2=0x7f335c06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:19.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f3363bb2640 1 -- 172.21.15.83:0/3953631296 shutdown_connections 2024-03-30T13:09:19.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f3363bb2640 1 -- 172.21.15.83:0/3953631296 wait complete. 2024-03-30T13:09:19.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f3363bb2640 1 Processor -- start 2024-03-30T13:09:19.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.435+0000 7f3363bb2640 1 -- start start 2024-03-30T13:09:19.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f3363bb2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f335c06f690 0x7f335c147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:19.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f3363bb2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c0b3ca0 0x7f335c0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:19.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f3363bb2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f335c15b050 0x7f335c0af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:19.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f3363bb2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f335c0b4c10 con 0x7f335c0b3ca0 2024-03-30T13:09:19.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f3363bb2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f335c0ad1c0 con 0x7f335c06f690 2024-03-30T13:09:19.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f3363bb2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f335c0b4d90 con 0x7f335c15b050 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f336114d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c0b3ca0 0x7f335c0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f336114d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c0b3ca0 0x7f335c0aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51730/0 (socket says 172.21.15.83:51730) 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f336114d640 1 -- 172.21.15.83:0/1976472975 learned_addr learned my addr 172.21.15.83:0/1976472975 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f336114d640 1 -- 172.21.15.83:0/1976472975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f335c15b050 msgr2=0x7f335c0af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f336114d640 1 --2- 172.21.15.83:0/1976472975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f335c15b050 0x7f335c0af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f336114d640 1 -- 172.21.15.83:0/1976472975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f335c06f690 msgr2=0x7f335c147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f336114d640 1 --2- 172.21.15.83:0/1976472975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f335c06f690 0x7f335c147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f336114d640 1 -- 172.21.15.83:0/1976472975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c148680 con 0x7f335c0b3ca0 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f336114d640 1 --2- 172.21.15.83:0/1976472975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c0b3ca0 0x7f335c0aeed0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f334c00d800 tx=0x7f334c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f33527fc640 1 -- 172.21.15.83:0/1976472975 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c00b6c0 con 0x7f335c0b3ca0 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f33527fc640 1 -- 172.21.15.83:0/1976472975 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334c019070 con 0x7f335c0b3ca0 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f3363bb2640 1 -- 172.21.15.83:0/1976472975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335c148960 con 0x7f335c0b3ca0 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f33527fc640 1 -- 172.21.15.83:0/1976472975 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c00ba60 con 0x7f335c0b3ca0 2024-03-30T13:09:19.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f3363bb2640 1 -- 172.21.15.83:0/1976472975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f335c148f20 con 0x7f335c0b3ca0 2024-03-30T13:09:19.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f3363bb2640 1 -- 172.21.15.83:0/1976472975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335c09e540 con 0x7f335c0b3ca0 2024-03-30T13:09:19.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f33527fc640 1 -- 172.21.15.83:0/1976472975 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f334c00bc00 con 0x7f335c0b3ca0 2024-03-30T13:09:19.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f33527fc640 1 --2- 172.21.15.83:0/1976472975 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3340067fc0 0x7f334006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:19.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f33527fc640 1 -- 172.21.15.83:0/1976472975 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5919+0+0 (secure 0 0 0) 0x7f334c0869d0 con 0x7f335c0b3ca0 2024-03-30T13:09:19.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f336194e640 1 --2- 172.21.15.83:0/1976472975 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3340067fc0 0x7f334006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:19.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.439+0000 7f336194e640 1 --2- 172.21.15.83:0/1976472975 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3340067fc0 0x7f334006a480 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f33580ad000 tx=0x7f3358008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:19.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.443+0000 7f33527fc640 1 -- 172.21.15.83:0/1976472975 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f334c057140 con 0x7f335c0b3ca0 2024-03-30T13:09:19.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:19.627+0000 7f3363bb2640 1 -- 172.21.15.83:0/1976472975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f335c04f9e0 con 0x7f335c0b3ca0 2024-03-30T13:09:20.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.299+0000 7f33527fc640 1 -- 172.21.15.83:0/1976472975 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f334c056a40 con 0x7f335c0b3ca0 2024-03-30T13:09:20.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.303+0000 7f3363bb2640 1 -- 172.21.15.83:0/1976472975 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3340067fc0 msgr2=0x7f334006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:20.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.303+0000 7f3363bb2640 1 --2- 172.21.15.83:0/1976472975 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3340067fc0 0x7f334006a480 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f33580ad000 tx=0x7f3358008040 comp rx=0 tx=0).stop 2024-03-30T13:09:20.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.303+0000 7f3363bb2640 1 -- 172.21.15.83:0/1976472975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c0b3ca0 msgr2=0x7f335c0aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:20.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.303+0000 7f3363bb2640 1 --2- 172.21.15.83:0/1976472975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c0b3ca0 0x7f335c0aeed0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f334c00d800 tx=0x7f334c00dcc0 comp rx=0 tx=0).stop 2024-03-30T13:09:20.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.303+0000 7f3363bb2640 1 -- 172.21.15.83:0/1976472975 shutdown_connections 2024-03-30T13:09:20.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.303+0000 7f3363bb2640 1 --2- 172.21.15.83:0/1976472975 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3340067fc0 0x7f334006a480 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:20.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.303+0000 7f3363bb2640 1 --2- 172.21.15.83:0/1976472975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f335c15b050 0x7f335c0af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:20.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.303+0000 7f3363bb2640 1 --2- 172.21.15.83:0/1976472975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c0b3ca0 0x7f335c0aeed0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:20.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.303+0000 7f3363bb2640 1 --2- 172.21.15.83:0/1976472975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f335c06f690 0x7f335c147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:20.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.303+0000 7f3363bb2640 1 -- 172.21.15.83:0/1976472975 >> 172.21.15.83:0/1976472975 conn(0x7f335c06b660 msgr2=0x7f335c06e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:20.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.303+0000 7f3363bb2640 1 -- 172.21.15.83:0/1976472975 shutdown_connections 2024-03-30T13:09:20.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.303+0000 7f3363bb2640 1 -- 172.21.15.83:0/1976472975 wait complete. 2024-03-30T13:09:20.330 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-30T13:09:20.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.455+0000 7fb84d8dd640 1 Processor -- start 2024-03-30T13:09:20.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.455+0000 7fb84d8dd640 1 -- start start 2024-03-30T13:09:20.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.455+0000 7fb84d8dd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb848158b60 0x7fb8480b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:20.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.455+0000 7fb84d8dd640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb84815eff0 con 0x7fb848158f40 2024-03-30T13:09:20.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.455+0000 7fb84d8dd640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb84815f2d0 con 0x7fb8480b4a70 2024-03-30T13:09:20.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.455+0000 7fb84d8dd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb84815eda0 con 0x7fb848158b60 2024-03-30T13:09:20.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.455+0000 7fb8477fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fb848158f40 0x7fb8480cebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:52934/0 (socket says 172.21.15.83:52934) 2024-03-30T13:09:20.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.455+0000 7fb8477fe640 1 -- 172.21.15.83:0/1975211835 learned_addr learned my addr 172.21.15.83:0/1975211835 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:20.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.455+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242852698 0 0) 0x7fb84815eff0 con 0x7fb848158f40 2024-03-30T13:09:20.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.455+0000 7fb846ffd640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb848158b60 0x7fb8480b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:20.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.455+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb834003530 con 0x7fb848158f40 2024-03-30T13:09:20.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1710565007 0 0) 0x7fb834003530 con 0x7fb848158f40 2024-03-30T13:09:20.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb848158b60 msgr2=0x7fb8480b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:20.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb848158b60 0x7fb8480b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:20.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 >> v1:172.21.15.153:6789/0 conn(0x7fb8480b4a70 legacy=0x7fb8480d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:20.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84815f5b0 con 0x7fb848158f40 2024-03-30T13:09:20.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fb840001a00 con 0x7fb848158f40 2024-03-30T13:09:20.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 >> v1:172.21.15.83:6789/0 conn(0x7fb848158f40 legacy=0x7fb8480cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:20.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb848158b60 0x7fb8340039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:20.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb834004020 0x7fb834004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:20.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb834004d50 0x7fb8340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:20.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb84815eda0 con 0x7fb834004020 2024-03-30T13:09:20.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb83400bb90 con 0x7fb834004d50 2024-03-30T13:09:20.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb83400bd90 con 0x7fb848158b60 2024-03-30T13:09:20.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb83ffff640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb834004020 0x7fb834004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:20.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb846ffd640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb848158b60 0x7fb8340039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:20.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb83ffff640 1 -- 172.21.15.83:0/1975211835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb848158b60 msgr2=0x7fb8340039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:20.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb83ffff640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb848158b60 0x7fb8340039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:20.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8477fe640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb834004d50 0x7fb8340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:20.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb83ffff640 1 -- 172.21.15.83:0/1975211835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb834004d50 msgr2=0x7fb8340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:20.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb83ffff640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb834004d50 0x7fb8340051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:20.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb83ffff640 1 -- 172.21.15.83:0/1975211835 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb834003530 con 0x7fb834004020 2024-03-30T13:09:20.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb846ffd640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb848158b60 0x7fb8340039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:20.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb83ffff640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb834004020 0x7fb834004810 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb830001780 tx=0x7fb83001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8811c7e5ee70d19a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:20.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8300013a0 con 0x7fb834004020 2024-03-30T13:09:20.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8300a9070 con 0x7fb834004020 2024-03-30T13:09:20.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8467fc640 1 -- 172.21.15.83:0/1975211835 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8300052d0 con 0x7fb834004020 2024-03-30T13:09:20.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb84d8dd640 1 -- 172.21.15.83:0/1975211835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb834004020 msgr2=0x7fb834004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:20.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb84d8dd640 1 --2- 172.21.15.83:0/1975211835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb834004020 0x7fb834004810 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb830001780 tx=0x7fb83001c420 comp rx=0 tx=0).stop 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb8477fe640 1 -- 172.21.15.83:0/1975211835 reap_dead start 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb84d8dd640 1 -- 172.21.15.83:0/1975211835 shutdown_connections 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb84d8dd640 1 -- 172.21.15.83:0/1975211835 >> 172.21.15.83:0/1975211835 conn(0x7fb8480b3ee0 msgr2=0x7fb8480b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb84d8dd640 1 -- 172.21.15.83:0/1975211835 shutdown_connections 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.459+0000 7fb84d8dd640 1 -- 172.21.15.83:0/1975211835 wait complete. 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb84d8dd640 1 Processor -- start 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb84d8dd640 1 -- start start 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb84d8dd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb834004020 0x7fb8480cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb84d8dd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb84814a050 0x7fb8480b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb84d8dd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8480cc350 0x7fb8480cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb84d8dd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb8480cf2f0 con 0x7fb84814a050 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb84d8dd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb84815fb70 con 0x7fb834004020 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb84d8dd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb8480cf470 con 0x7fb8480cc350 2024-03-30T13:09:20.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb83ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb84814a050 0x7fb8480b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb83ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb84814a050 0x7fb8480b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51738/0 (socket says 172.21.15.83:51738) 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb83ffff640 1 -- 172.21.15.83:0/3697541315 learned_addr learned my addr 172.21.15.83:0/3697541315 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb846ffd640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb834004020 0x7fb8480cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb8477fe640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8480cc350 0x7fb8480cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb83ffff640 1 -- 172.21.15.83:0/3697541315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8480cc350 msgr2=0x7fb8480cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb83ffff640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8480cc350 0x7fb8480cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb83ffff640 1 -- 172.21.15.83:0/3697541315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb834004020 msgr2=0x7fb8480cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb83ffff640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb834004020 0x7fb8480cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb83ffff640 1 -- 172.21.15.83:0/3697541315 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8480b0e00 con 0x7fb84814a050 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb83ffff640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb84814a050 0x7fb8480b08c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb830005040 tx=0x7fb834005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb844ff9640 1 -- 172.21.15.83:0/3697541315 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb830007a40 con 0x7fb84814a050 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb844ff9640 1 -- 172.21.15.83:0/3697541315 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb830007040 con 0x7fb84814a050 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb84d8dd640 1 -- 172.21.15.83:0/3697541315 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8480b1080 con 0x7fb84814a050 2024-03-30T13:09:20.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb844ff9640 1 -- 172.21.15.83:0/3697541315 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8300071f0 con 0x7fb84814a050 2024-03-30T13:09:20.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb84d8dd640 1 -- 172.21.15.83:0/3697541315 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8480b1640 con 0x7fb84814a050 2024-03-30T13:09:20.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.463+0000 7fb84d8dd640 1 -- 172.21.15.83:0/3697541315 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8480686c0 con 0x7fb84814a050 2024-03-30T13:09:20.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.467+0000 7fb844ff9640 1 -- 172.21.15.83:0/3697541315 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb8300be020 con 0x7fb84814a050 2024-03-30T13:09:20.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.467+0000 7fb844ff9640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb828067fc0 0x7fb82806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:20.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.467+0000 7fb844ff9640 1 -- 172.21.15.83:0/3697541315 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5919+0+0 (secure 0 0 0) 0x7fb83011fa80 con 0x7fb84814a050 2024-03-30T13:09:20.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.467+0000 7fb846ffd640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb828067fc0 0x7fb82806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:20.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.467+0000 7fb846ffd640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb828067fc0 0x7fb82806a480 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c890 tx=0x7fb838008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:20.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.471+0000 7fb844ff9640 1 -- 172.21.15.83:0/3697541315 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb8300c6060 con 0x7fb84814a050 2024-03-30T13:09:20.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:20.623+0000 7fb84d8dd640 1 -- 172.21.15.83:0/3697541315 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb8480d03e0 con 0x7fb84814a050 2024-03-30T13:09:21.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.511+0000 7fb844ff9640 1 -- 172.21.15.83:0/3697541315 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7fb8480b0e00 con 0x7fb84814a050 2024-03-30T13:09:21.516 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' removed 2024-03-30T13:09:21.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.515+0000 7fb84d8dd640 1 -- 172.21.15.83:0/3697541315 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb828067fc0 msgr2=0x7fb82806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:21.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.515+0000 7fb84d8dd640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb828067fc0 0x7fb82806a480 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c890 tx=0x7fb838008040 comp rx=0 tx=0).stop 2024-03-30T13:09:21.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.515+0000 7fb84d8dd640 1 -- 172.21.15.83:0/3697541315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb84814a050 msgr2=0x7fb8480b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:21.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.515+0000 7fb84d8dd640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb84814a050 0x7fb8480b08c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb830005040 tx=0x7fb834005840 comp rx=0 tx=0).stop 2024-03-30T13:09:21.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.515+0000 7fb84d8dd640 1 -- 172.21.15.83:0/3697541315 shutdown_connections 2024-03-30T13:09:21.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.515+0000 7fb84d8dd640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb828067fc0 0x7fb82806a480 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:21.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.515+0000 7fb84d8dd640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8480cc350 0x7fb8480cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:21.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.515+0000 7fb84d8dd640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb84814a050 0x7fb8480b08c0 secure :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb830005040 tx=0x7fb834005840 comp rx=0 tx=0).stop 2024-03-30T13:09:21.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.515+0000 7fb84d8dd640 1 --2- 172.21.15.83:0/3697541315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb834004020 0x7fb8480cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:21.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.515+0000 7fb84d8dd640 1 -- 172.21.15.83:0/3697541315 >> 172.21.15.83:0/3697541315 conn(0x7fb8480b3ee0 msgr2=0x7fb8480b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:21.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.515+0000 7fb84d8dd640 1 -- 172.21.15.83:0/3697541315 shutdown_connections 2024-03-30T13:09:21.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.515+0000 7fb84d8dd640 1 -- 172.21.15.83:0/3697541315 wait complete. 2024-03-30T13:09:21.543 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-30T13:09:21.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f651cd28640 1 Processor -- start 2024-03-30T13:09:21.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f651cd28640 1 -- start start 2024-03-30T13:09:21.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f651cd28640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65180d2df0 0x7f651806c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:21.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f651cd28640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f65180d3250 0x7f651806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:21.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f651cd28640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65180d0410 con 0x7f651815e760 2024-03-30T13:09:21.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f651cd28640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f651806d1c0 con 0x7f65180d3250 2024-03-30T13:09:21.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f651cd28640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f65180d2960 con 0x7f65180d2df0 2024-03-30T13:09:21.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f6516d9d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f65180d3250 0x7f651806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:21.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f6516d9d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f65180d3250 0x7f651806cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51740/0 (socket says 172.21.15.83:51740) 2024-03-30T13:09:21.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f6516d9d640 1 -- 172.21.15.83:0/1324887108 learned_addr learned my addr 172.21.15.83:0/1324887108 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:21.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f6515d9b640 1 --2- 172.21.15.83:0/1324887108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65180d2df0 0x7f651806c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:21.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f6516d9d640 1 -- 172.21.15.83:0/1324887108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65180d2df0 msgr2=0x7f651806c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:21.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f6516d9d640 1 --2- 172.21.15.83:0/1324887108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65180d2df0 0x7f651806c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:21.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f6516d9d640 1 -- 172.21.15.83:0/1324887108 >> v1:172.21.15.153:6789/0 conn(0x7f651815e760 legacy=0x7f65180cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:21.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.663+0000 7f6516d9d640 1 -- 172.21.15.83:0/1324887108 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65180d2030 con 0x7f65180d3250 2024-03-30T13:09:21.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f6516d9d640 1 --2- 172.21.15.83:0/1324887108 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65180d3250 0x7f651806cc80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6510009e50 tx=0x7f651001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a0d5c503e8393 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:21.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651559a640 1 -- 172.21.15.83:0/1324887108 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65100a5830 con 0x7f65180d3250 2024-03-30T13:09:21.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651559a640 1 -- 172.21.15.83:0/1324887108 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65100a59d0 con 0x7f65180d3250 2024-03-30T13:09:21.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651559a640 1 -- 172.21.15.83:0/1324887108 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65100a5da0 con 0x7f65180d3250 2024-03-30T13:09:21.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 -- 172.21.15.83:0/1324887108 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65180d3250 msgr2=0x7f651806cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:21.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 --2- 172.21.15.83:0/1324887108 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65180d3250 0x7f651806cc80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6510009e50 tx=0x7f651001c970 comp rx=0 tx=0).stop 2024-03-30T13:09:21.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 -- 172.21.15.83:0/1324887108 shutdown_connections 2024-03-30T13:09:21.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 --2- 172.21.15.83:0/1324887108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65180d2df0 0x7f651806c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:21.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 --2- 172.21.15.83:0/1324887108 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65180d3250 0x7f651806cc80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:21.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 -- 172.21.15.83:0/1324887108 >> 172.21.15.83:0/1324887108 conn(0x7f65180d4460 msgr2=0x7f65180d4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:21.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 -- 172.21.15.83:0/1324887108 shutdown_connections 2024-03-30T13:09:21.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 -- 172.21.15.83:0/1324887108 wait complete. 2024-03-30T13:09:21.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 Processor -- start 2024-03-30T13:09:21.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 -- start start 2024-03-30T13:09:21.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65180d2df0 0x7f65181574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:21.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65180d3250 0x7f6518155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:21.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f651815e760 0x7f65181466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.667+0000 7f651cd28640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6518162d50 con 0x7f65180d2df0 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651cd28640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6518162bd0 con 0x7f651815e760 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651cd28640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6518162ed0 con 0x7f65180d3250 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65180d2df0 0x7f65181574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65180d2df0 0x7f65181574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51752/0 (socket says 172.21.15.83:51752) 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651659c640 1 -- 172.21.15.83:0/2817365159 learned_addr learned my addr 172.21.15.83:0/2817365159 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f6516d9d640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f651815e760 0x7f65181466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f6515d9b640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65180d3250 0x7f6518155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651659c640 1 -- 172.21.15.83:0/2817365159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65180d3250 msgr2=0x7f6518155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651659c640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65180d3250 0x7f6518155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651659c640 1 -- 172.21.15.83:0/2817365159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f651815e760 msgr2=0x7f65181466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651659c640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f651815e760 0x7f65181466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651659c640 1 -- 172.21.15.83:0/2817365159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651806e370 con 0x7f65180d2df0 2024-03-30T13:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651659c640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65180d2df0 0x7f65181574d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f650800c370 tx=0x7f650800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:21.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f6506ffd640 1 -- 172.21.15.83:0/2817365159 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65080052d0 con 0x7f65180d2df0 2024-03-30T13:09:21.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f6506ffd640 1 -- 172.21.15.83:0/2817365159 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6508005470 con 0x7f65180d2df0 2024-03-30T13:09:21.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651cd28640 1 -- 172.21.15.83:0/2817365159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65180cb530 con 0x7f65180d2df0 2024-03-30T13:09:21.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f6506ffd640 1 -- 172.21.15.83:0/2817365159 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508007260 con 0x7f65180d2df0 2024-03-30T13:09:21.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651cd28640 1 -- 172.21.15.83:0/2817365159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6518157e40 con 0x7f65180d2df0 2024-03-30T13:09:21.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f651cd28640 1 -- 172.21.15.83:0/2817365159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65180686c0 con 0x7f65180d2df0 2024-03-30T13:09:21.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f6506ffd640 1 -- 172.21.15.83:0/2817365159 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6508007400 con 0x7f65180d2df0 2024-03-30T13:09:21.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f6506ffd640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f64f8067fc0 0x7f64f806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:21.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f6506ffd640 1 -- 172.21.15.83:0/2817365159 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5481+0+0 (secure 0 0 0) 0x7f6508085860 con 0x7f65180d2df0 2024-03-30T13:09:21.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f6515d9b640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f64f8067fc0 0x7f64f806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:21.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.671+0000 7f6515d9b640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f64f8067fc0 0x7f64f806a480 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f65180cb490 tx=0x7f650c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:21.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.675+0000 7f6506ffd640 1 -- 172.21.15.83:0/2817365159 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6508056160 con 0x7f65180d2df0 2024-03-30T13:09:21.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:21.839+0000 7f651cd28640 1 -- 172.21.15.83:0/2817365159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f651806e760 con 0x7f65180d2df0 2024-03-30T13:09:22.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.527+0000 7f6506ffd640 1 -- 172.21.15.83:0/2817365159 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f6508055a60 con 0x7f65180d2df0 2024-03-30T13:09:22.531 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' removed 2024-03-30T13:09:22.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.531+0000 7f651cd28640 1 -- 172.21.15.83:0/2817365159 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f64f8067fc0 msgr2=0x7f64f806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:22.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.531+0000 7f651cd28640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f64f8067fc0 0x7f64f806a480 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f65180cb490 tx=0x7f650c008040 comp rx=0 tx=0).stop 2024-03-30T13:09:22.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.531+0000 7f651cd28640 1 -- 172.21.15.83:0/2817365159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65180d2df0 msgr2=0x7f65181574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:22.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.531+0000 7f651cd28640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65180d2df0 0x7f65181574d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f650800c370 tx=0x7f650800c830 comp rx=0 tx=0).stop 2024-03-30T13:09:22.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.531+0000 7f651cd28640 1 -- 172.21.15.83:0/2817365159 shutdown_connections 2024-03-30T13:09:22.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.531+0000 7f651cd28640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f64f8067fc0 0x7f64f806a480 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:22.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.531+0000 7f651cd28640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f651815e760 0x7f65181466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:22.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.531+0000 7f651cd28640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65180d3250 0x7f6518155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:22.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.531+0000 7f651cd28640 1 --2- 172.21.15.83:0/2817365159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65180d2df0 0x7f65181574d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:22.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.531+0000 7f651cd28640 1 -- 172.21.15.83:0/2817365159 >> 172.21.15.83:0/2817365159 conn(0x7f65180d4460 msgr2=0x7f65180cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:22.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.531+0000 7f651cd28640 1 -- 172.21.15.83:0/2817365159 shutdown_connections 2024-03-30T13:09:22.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.531+0000 7f651cd28640 1 -- 172.21.15.83:0/2817365159 wait complete. 2024-03-30T13:09:22.560 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-30T13:09:22.560 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-30T13:09:22.560 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-30T13:09:22.560 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:09:22.561 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-30T13:09:22.561 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-30T13:09:22.561 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-30T13:09:22.561 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:09:22.561 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-30T13:09:22.561 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-30T13:09:22.561 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-30T13:09:22.562 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:09:22.562 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-30T13:09:22.562 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-30T13:09:22.562 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-30T13:09:22.562 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:09:22.571 INFO:tasks.ceph.mds.c:Stopped 2024-03-30T13:09:22.572 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-30T13:09:22.573 INFO:tasks.ceph.mds.a:Stopped 2024-03-30T13:09:22.573 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-30T13:09:22.575 INFO:tasks.ceph.mds.b:Stopped 2024-03-30T13:09:22.575 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-30T13:09:22.577 INFO:tasks.ceph.mds.d:Stopped 2024-03-30T13:09:22.577 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-30T13:09:22.615 INFO:tasks.ceph.mds.c:Started 2024-03-30T13:09:22.615 DEBUG:teuthology.parallel:result is None 2024-03-30T13:09:22.616 INFO:tasks.ceph.mds.a:Started 2024-03-30T13:09:22.616 DEBUG:teuthology.parallel:result is None 2024-03-30T13:09:22.624 INFO:tasks.ceph.mds.b:Started 2024-03-30T13:09:22.624 DEBUG:teuthology.parallel:result is None 2024-03-30T13:09:22.625 INFO:tasks.ceph.mds.d:Started 2024-03-30T13:09:22.625 DEBUG:teuthology.parallel:result is None 2024-03-30T13:09:22.626 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-30T13:09:22.679 INFO:tasks.ceph.mds.c.smithi083.stdout:starting mds.c at 2024-03-30T13:09:22.680 INFO:tasks.ceph.mds.a.smithi083.stdout:starting mds.a at 2024-03-30T13:09:22.693 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-03-30T13:09:22.698 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-03-30T13:09:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f19432640 1 Processor -- start 2024-03-30T13:09:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f19432640 1 -- start start 2024-03-30T13:09:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f19432640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f140b4d90 0x7f2f14072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f19432640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f14071830 con 0x7f2f14073630 2024-03-30T13:09:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f19432640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f14071ad0 con 0x7f2f1415a8b0 2024-03-30T13:09:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f19432640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2f14071db0 con 0x7f2f140b4d90 2024-03-30T13:09:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f127fc640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f2f14073630 0x7f2f140b4680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:52956/0 (socket says 172.21.15.83:52956) 2024-03-30T13:09:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f127fc640 1 -- 172.21.15.83:0/310734860 learned_addr learned my addr 172.21.15.83:0/310734860 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:22.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f137fe640 1 --2- 172.21.15.83:0/310734860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f140b4d90 0x7f2f14072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2712229319 0 0) 0x7f2f14071830 con 0x7f2f14073630 2024-03-30T13:09:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2efc003530 con 0x7f2f14073630 2024-03-30T13:09:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4288654511 0 0) 0x7f2efc003530 con 0x7f2f14073630 2024-03-30T13:09:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f140b4d90 msgr2=0x7f2f14072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 --2- 172.21.15.83:0/310734860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f140b4d90 0x7f2f14072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 >> v1:172.21.15.153:6789/0 conn(0x7f2f1415a8b0 legacy=0x7f2f14072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f14072090 con 0x7f2f14073630 2024-03-30T13:09:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f2f08001680 con 0x7f2f14073630 2024-03-30T13:09:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 >> v1:172.21.15.83:6789/0 conn(0x7f2f14073630 legacy=0x7f2f140b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 --2- 172.21.15.83:0/310734860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2efc0039f0 0x7f2efc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 --2- 172.21.15.83:0/310734860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f140b4d90 0x7f2efc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 --2- 172.21.15.83:0/310734860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2efc004d50 0x7f2efc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2f14071db0 con 0x7f2efc0039f0 2024-03-30T13:09:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc00b9d0 con 0x7f2efc004d50 2024-03-30T13:09:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2efc00bbd0 con 0x7f2f140b4d90 2024-03-30T13:09:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f12ffd640 1 --2- 172.21.15.83:0/310734860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2efc0039f0 0x7f2efc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f127fc640 1 --2- 172.21.15.83:0/310734860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f140b4d90 0x7f2efc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f137fe640 1 --2- 172.21.15.83:0/310734860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2efc004d50 0x7f2efc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f12ffd640 1 -- 172.21.15.83:0/310734860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f140b4d90 msgr2=0x7f2efc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f12ffd640 1 --2- 172.21.15.83:0/310734860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f140b4d90 0x7f2efc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f12ffd640 1 -- 172.21.15.83:0/310734860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2efc004d50 msgr2=0x7f2efc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f12ffd640 1 --2- 172.21.15.83:0/310734860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2efc004d50 0x7f2efc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.743+0000 7f2f12ffd640 1 -- 172.21.15.83:0/310734860 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc003530 con 0x7f2efc0039f0 2024-03-30T13:09:22.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f12ffd640 1 --2- 172.21.15.83:0/310734860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2efc0039f0 0x7f2efc003dd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2f04001860 tx=0x7f2f0401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104e29d035fdd880 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:22.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f040b0070 con 0x7f2efc0039f0 2024-03-30T13:09:22.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f040ab600 con 0x7f2efc0039f0 2024-03-30T13:09:22.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f11ffb640 1 -- 172.21.15.83:0/310734860 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04001460 con 0x7f2efc0039f0 2024-03-30T13:09:22.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 -- 172.21.15.83:0/310734860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2efc0039f0 msgr2=0x7f2efc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:22.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 --2- 172.21.15.83:0/310734860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2efc0039f0 0x7f2efc003dd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2f04001860 tx=0x7f2f0401c430 comp rx=0 tx=0).stop 2024-03-30T13:09:22.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f137fe640 1 -- 172.21.15.83:0/310734860 reap_dead start 2024-03-30T13:09:22.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 -- 172.21.15.83:0/310734860 shutdown_connections 2024-03-30T13:09:22.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 -- 172.21.15.83:0/310734860 >> 172.21.15.83:0/310734860 conn(0x7f2f1406b660 msgr2=0x7f2f1406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:22.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 -- 172.21.15.83:0/310734860 shutdown_connections 2024-03-30T13:09:22.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 -- 172.21.15.83:0/310734860 wait complete. 2024-03-30T13:09:22.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 Processor -- start 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 -- start start 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2efc0039f0 0x7f2f1414aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f1414c000 0x7f2f140af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f140afb50 0x7f2f14145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2f14165c30 con 0x7f2efc0039f0 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f14165ab0 con 0x7f2f140afb50 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2f14165db0 con 0x7f2f1414c000 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f12ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2efc0039f0 0x7f2f1414aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f12ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2efc0039f0 0x7f2f1414aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51802/0 (socket says 172.21.15.83:51802) 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f12ffd640 1 -- 172.21.15.83:0/2688484653 learned_addr learned my addr 172.21.15.83:0/2688484653 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f127fc640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f1414c000 0x7f2f140af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f137fe640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f140afb50 0x7f2f14145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f12ffd640 1 -- 172.21.15.83:0/2688484653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f1414c000 msgr2=0x7f2f140af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f12ffd640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f1414c000 0x7f2f140af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f12ffd640 1 -- 172.21.15.83:0/2688484653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f140afb50 msgr2=0x7f2f14145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f12ffd640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f140afb50 0x7f2f14145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f12ffd640 1 -- 172.21.15.83:0/2688484653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f14149e30 con 0x7f2efc0039f0 2024-03-30T13:09:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f12ffd640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2efc0039f0 0x7f2f1414aed0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2f0401c260 tx=0x7f2efc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2efb7fe640 1 -- 172.21.15.83:0/2688484653 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f040b0040 con 0x7f2efc0039f0 2024-03-30T13:09:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2efb7fe640 1 -- 172.21.15.83:0/2688484653 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f040bb070 con 0x7f2efc0039f0 2024-03-30T13:09:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.747+0000 7f2f19432640 1 -- 172.21.15.83:0/2688484653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1414a110 con 0x7f2efc0039f0 2024-03-30T13:09:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.751+0000 7f2efb7fe640 1 -- 172.21.15.83:0/2688484653 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04001440 con 0x7f2efc0039f0 2024-03-30T13:09:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.751+0000 7f2f19432640 1 -- 172.21.15.83:0/2688484653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1414a6d0 con 0x7f2efc0039f0 2024-03-30T13:09:22.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.751+0000 7f2f19432640 1 -- 172.21.15.83:0/2688484653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1404f9e0 con 0x7f2efc0039f0 2024-03-30T13:09:22.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.751+0000 7f2efb7fe640 1 -- 172.21.15.83:0/2688484653 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2f04005070 con 0x7f2efc0039f0 2024-03-30T13:09:22.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.751+0000 7f2efb7fe640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2f00067fc0 0x7f2f0006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:22.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.751+0000 7f2efb7fe640 1 -- 172.21.15.83:0/2688484653 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7f2f0411ffd0 con 0x7f2efc0039f0 2024-03-30T13:09:22.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.751+0000 7f2f127fc640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2f00067fc0 0x7f2f0006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:22.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.751+0000 7f2f127fc640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2f00067fc0 0x7f2f0006a480 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f141fb190 tx=0x7f2f08007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:22.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.755+0000 7f2efb7fe640 1 -- 172.21.15.83:0/2688484653 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f2f04016170 con 0x7f2efc0039f0 2024-03-30T13:09:22.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:22.927+0000 7f2f19432640 1 -- 172.21.15.83:0/2688484653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2f140b4460 con 0x7f2efc0039f0 2024-03-30T13:09:23.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.563+0000 7f2efb7fe640 1 -- 172.21.15.83:0/2688484653 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7f2f040f0a80 con 0x7f2efc0039f0 2024-03-30T13:09:23.568 INFO:teuthology.orchestra.run.smithi083.stderr: removed all blocklist entries 2024-03-30T13:09:23.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.567+0000 7f2f19432640 1 -- 172.21.15.83:0/2688484653 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2f00067fc0 msgr2=0x7f2f0006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:23.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.567+0000 7f2f19432640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2f00067fc0 0x7f2f0006a480 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f141fb190 tx=0x7f2f08007900 comp rx=0 tx=0).stop 2024-03-30T13:09:23.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.567+0000 7f2f19432640 1 -- 172.21.15.83:0/2688484653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2efc0039f0 msgr2=0x7f2f1414aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:23.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.567+0000 7f2f19432640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2efc0039f0 0x7f2f1414aed0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2f0401c260 tx=0x7f2efc005840 comp rx=0 tx=0).stop 2024-03-30T13:09:23.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.567+0000 7f2f19432640 1 -- 172.21.15.83:0/2688484653 shutdown_connections 2024-03-30T13:09:23.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.567+0000 7f2f19432640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2f00067fc0 0x7f2f0006a480 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.567+0000 7f2f19432640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f140afb50 0x7f2f14145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.567+0000 7f2f19432640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f1414c000 0x7f2f140af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.567+0000 7f2f19432640 1 --2- 172.21.15.83:0/2688484653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2efc0039f0 0x7f2f1414aed0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.567+0000 7f2f19432640 1 -- 172.21.15.83:0/2688484653 >> 172.21.15.83:0/2688484653 conn(0x7f2f1406b660 msgr2=0x7f2f1406e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:23.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.567+0000 7f2f19432640 1 -- 172.21.15.83:0/2688484653 shutdown_connections 2024-03-30T13:09:23.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.567+0000 7f2f19432640 1 -- 172.21.15.83:0/2688484653 wait complete. 2024-03-30T13:09:23.601 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-30T13:09:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f32a021c640 1 Processor -- start 2024-03-30T13:09:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f32a021c640 1 -- start start 2024-03-30T13:09:23.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f32a021c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f32980739b0 0x7f32980b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:23.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f32a021c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f329806deb0 0x7f32980b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:23.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f32a021c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f329815edd0 con 0x7f32980735d0 2024-03-30T13:09:23.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f32a021c640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f32980b3c40 con 0x7f329806deb0 2024-03-30T13:09:23.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f32a021c640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f32980b3f20 con 0x7f32980739b0 2024-03-30T13:09:23.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f329e7b9640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f329806deb0 0x7f32980b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:23.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f329e7b9640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f329806deb0 0x7f32980b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51812/0 (socket says 172.21.15.83:51812) 2024-03-30T13:09:23.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f329e7b9640 1 -- 172.21.15.83:0/2122413760 learned_addr learned my addr 172.21.15.83:0/2122413760 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:23.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f329d7b7640 1 --2- 172.21.15.83:0/2122413760 >> v2:172.21.15.153:3300/0 conn(0x7f32980739b0 0x7f32980b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:23.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f329e7b9640 1 -- 172.21.15.83:0/2122413760 >> v2:172.21.15.153:3300/0 conn(0x7f32980739b0 msgr2=0x7f32980b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f329e7b9640 1 --2- 172.21.15.83:0/2122413760 >> v2:172.21.15.153:3300/0 conn(0x7f32980739b0 0x7f32980b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f329e7b9640 1 -- 172.21.15.83:0/2122413760 >> v1:172.21.15.153:6789/0 conn(0x7f32980735d0 legacy=0x7f329806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f329e7b9640 1 -- 172.21.15.83:0/2122413760 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32980b4200 con 0x7f329806deb0 2024-03-30T13:09:23.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.719+0000 7f329e7b9640 1 --2- 172.21.15.83:0/2122413760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329806deb0 0x7f32980b35a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f32980b2ac0 tx=0x7f329001c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccfc21fc46800a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:23.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329cfb6640 1 -- 172.21.15.83:0/2122413760 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32900a5660 con 0x7f329806deb0 2024-03-30T13:09:23.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329cfb6640 1 -- 172.21.15.83:0/2122413760 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32900a5800 con 0x7f329806deb0 2024-03-30T13:09:23.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329cfb6640 1 -- 172.21.15.83:0/2122413760 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32900a5bd0 con 0x7f329806deb0 2024-03-30T13:09:23.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 -- 172.21.15.83:0/2122413760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329806deb0 msgr2=0x7f32980b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:23.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 --2- 172.21.15.83:0/2122413760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329806deb0 0x7f32980b35a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f32980b2ac0 tx=0x7f329001c7a0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 -- 172.21.15.83:0/2122413760 shutdown_connections 2024-03-30T13:09:23.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 --2- 172.21.15.83:0/2122413760 >> v2:172.21.15.153:3300/0 conn(0x7f32980739b0 0x7f32980b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 --2- 172.21.15.83:0/2122413760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329806deb0 0x7f32980b35a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 -- 172.21.15.83:0/2122413760 >> 172.21.15.83:0/2122413760 conn(0x7f32980b1d60 msgr2=0x7f32980b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:23.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 -- 172.21.15.83:0/2122413760 shutdown_connections 2024-03-30T13:09:23.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 -- 172.21.15.83:0/2122413760 wait complete. 2024-03-30T13:09:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 Processor -- start 2024-03-30T13:09:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 -- start start 2024-03-30T13:09:23.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329806deb0 0x7f32981524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:23.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32980735d0 0x7f3298154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:23.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32980739b0 0x7f329815dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:23.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3298071d10 con 0x7f329806deb0 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32980afa80 con 0x7f32980739b0 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3298071e90 con 0x7f32980735d0 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329dfb8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329806deb0 0x7f32981524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329dfb8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329806deb0 0x7f32981524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51820/0 (socket says 172.21.15.83:51820) 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329dfb8640 1 -- 172.21.15.83:0/1503958249 learned_addr learned my addr 172.21.15.83:0/1503958249 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329e7b9640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32980739b0 0x7f329815dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329d7b7640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32980735d0 0x7f3298154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329dfb8640 1 -- 172.21.15.83:0/1503958249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32980735d0 msgr2=0x7f3298154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329dfb8640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32980735d0 0x7f3298154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329dfb8640 1 -- 172.21.15.83:0/1503958249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32980739b0 msgr2=0x7f329815dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329dfb8640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32980739b0 0x7f329815dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329dfb8640 1 -- 172.21.15.83:0/1503958249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3298153f00 con 0x7f329806deb0 2024-03-30T13:09:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329d7b7640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32980735d0 0x7f3298154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f329dfb8640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329806deb0 0x7f32981524e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f328800c480 tx=0x7f328800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f328e7fc640 1 -- 172.21.15.83:0/1503958249 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288012830 con 0x7f329806deb0 2024-03-30T13:09:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f328e7fc640 1 -- 172.21.15.83:0/1503958249 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3288017070 con 0x7f329806deb0 2024-03-30T13:09:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 -- 172.21.15.83:0/1503958249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32981541e0 con 0x7f329806deb0 2024-03-30T13:09:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f328e7fc640 1 -- 172.21.15.83:0/1503958249 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288012c30 con 0x7f329806deb0 2024-03-30T13:09:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.723+0000 7f32a021c640 1 -- 172.21.15.83:0/1503958249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32981547a0 con 0x7f329806deb0 2024-03-30T13:09:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.727+0000 7f32a021c640 1 -- 172.21.15.83:0/1503958249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32980686c0 con 0x7f329806deb0 2024-03-30T13:09:23.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.727+0000 7f328e7fc640 1 -- 172.21.15.83:0/1503958249 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f328801c460 con 0x7f329806deb0 2024-03-30T13:09:23.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.727+0000 7f328e7fc640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f327c067fc0 0x7f327c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:23.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.727+0000 7f328e7fc640 1 -- 172.21.15.83:0/1503958249 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f3288085fc0 con 0x7f329806deb0 2024-03-30T13:09:23.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.727+0000 7f329d7b7640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f327c067fc0 0x7f327c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:23.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.727+0000 7f329d7b7640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f327c067fc0 0x7f327c06a480 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f32980b0600 tx=0x7f3294008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.731+0000 7f328e7fc640 1 -- 172.21.15.83:0/1503958249 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3288056b50 con 0x7f329806deb0 2024-03-30T13:09:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.951+0000 7f32a021c640 1 -- 172.21.15.83:0/1503958249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f329816a1d0 con 0x7f329806deb0 2024-03-30T13:09:23.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.951+0000 7f328e7fc640 1 -- 172.21.15.83:0/1503958249 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f3288056450 con 0x7f329806deb0 2024-03-30T13:09:23.958 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:23.959 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:09:23.959 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_dump": [ 2024-03-30T13:09:23.959 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.959 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "mds.a", 2024-03-30T13:09:23.959 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCODghmHSTSNBAAhKj5kioNy0yLfO4IWMSfow==", 2024-03-30T13:09:23.959 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.959 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-03-30T13:09:23.960 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow *", 2024-03-30T13:09:23.960 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow *", 2024-03-30T13:09:23.960 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.960 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.960 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.960 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.960 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "mds.b", 2024-03-30T13:09:23.961 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCPDghmYWHSBxAAImo2q+219n+RM++M9aysiQ==", 2024-03-30T13:09:23.961 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.961 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-03-30T13:09:23.961 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow *", 2024-03-30T13:09:23.961 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow *", 2024-03-30T13:09:23.961 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.962 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.962 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.962 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.962 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "mds.c", 2024-03-30T13:09:23.962 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCPDghmEcevARAAlf+RR10P98cUbUd4VKZiaA==", 2024-03-30T13:09:23.962 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.962 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-03-30T13:09:23.963 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow *", 2024-03-30T13:09:23.963 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow *", 2024-03-30T13:09:23.963 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.963 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.963 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.963 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.964 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "mds.d", 2024-03-30T13:09:23.964 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCPDghmk1pcEBAA0ji2FeMmizTNjpWWSr8PGg==", 2024-03-30T13:09:23.964 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.964 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-03-30T13:09:23.964 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow *", 2024-03-30T13:09:23.964 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow *", 2024-03-30T13:09:23.965 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.965 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.965 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.965 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.965 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.0", 2024-03-30T13:09:23.965 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCSDghmauUkIBAA2tW3hxSGNe3a4L2eBKbU5g==", 2024-03-30T13:09:23.965 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.966 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-03-30T13:09:23.966 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-03-30T13:09:23.966 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.966 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.966 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.966 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.966 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.1", 2024-03-30T13:09:23.967 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCVDghmyD8lJhAAx3CpRry38qsgslzl/qw5eg==", 2024-03-30T13:09:23.967 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.967 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-03-30T13:09:23.967 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-03-30T13:09:23.967 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.967 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.968 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.968 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.968 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.2", 2024-03-30T13:09:23.968 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCYDghma94WLRAAYnscIJLG0U780LXtElksjw==", 2024-03-30T13:09:23.968 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.968 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-03-30T13:09:23.969 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-03-30T13:09:23.969 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.969 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.969 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.969 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.969 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.3", 2024-03-30T13:09:23.969 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCbDghmkzLyMxAAQKPntWgwDJBeKnXk3uK6GQ==", 2024-03-30T13:09:23.970 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.970 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-03-30T13:09:23.970 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-03-30T13:09:23.970 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.970 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.971 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.971 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.971 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.4", 2024-03-30T13:09:23.971 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQChDghmXQXINBAAfqY8CZ+nMOPd2WHxp6+xew==", 2024-03-30T13:09:23.971 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.971 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-03-30T13:09:23.971 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-03-30T13:09:23.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.972 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.972 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.972 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.972 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.5", 2024-03-30T13:09:23.973 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCkDghm/DduOhAAvs6Rk6F9+VFhC0yt6d7ccQ==", 2024-03-30T13:09:23.973 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.973 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-03-30T13:09:23.973 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-03-30T13:09:23.973 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.973 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.973 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.974 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.974 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.6", 2024-03-30T13:09:23.974 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCoDghmHYHABRAA2evRLfti5kky7GxUiTr73w==", 2024-03-30T13:09:23.974 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.974 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-03-30T13:09:23.974 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-03-30T13:09:23.975 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.975 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.975 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.975 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.975 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.7", 2024-03-30T13:09:23.975 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCrDghmcFHgChAA07TctKJbNHxywTu4OX635w==", 2024-03-30T13:09:23.976 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.976 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-03-30T13:09:23.976 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-03-30T13:09:23.976 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.976 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.976 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.977 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.977 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.0", 2024-03-30T13:09:23.977 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCPDghmyhIFFhAAN45m5XmwvXOH8BGl9v+GGw==", 2024-03-30T13:09:23.977 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.977 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-03-30T13:09:23.978 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow r", 2024-03-30T13:09:23.978 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow rw", 2024-03-30T13:09:23.978 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow rwx" 2024-03-30T13:09:23.978 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.978 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.978 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.979 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.1", 2024-03-30T13:09:23.979 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCPDghmR1BZHhAAD5WM5Vv/x0aoS3i1pRvDcw==", 2024-03-30T13:09:23.979 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.979 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-03-30T13:09:23.979 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow r", 2024-03-30T13:09:23.979 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow rw", 2024-03-30T13:09:23.980 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow rwx" 2024-03-30T13:09:23.980 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.980 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.980 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.980 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.2", 2024-03-30T13:09:23.980 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCPDghmm9CdGxAA05K8JRo/sntLYe7ZAq1Mmw==", 2024-03-30T13:09:23.981 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.981 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-03-30T13:09:23.981 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow r", 2024-03-30T13:09:23.981 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow rw", 2024-03-30T13:09:23.981 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow rwx" 2024-03-30T13:09:23.981 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.982 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.982 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.982 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.3", 2024-03-30T13:09:23.982 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCPDghmM6BgIxAAM9crxgoX+t6iUnshEHV/PQ==", 2024-03-30T13:09:23.982 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.982 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-03-30T13:09:23.982 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow r", 2024-03-30T13:09:23.983 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow rw", 2024-03-30T13:09:23.983 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow rwx" 2024-03-30T13:09:23.983 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.983 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.983 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.983 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.admin", 2024-03-30T13:09:23.983 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCODghmCH8yHhAA3H+M1+PK1zWTbxZoheCKvw==", 2024-03-30T13:09:23.983 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.984 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow *", 2024-03-30T13:09:23.984 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow *", 2024-03-30T13:09:23.984 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow *", 2024-03-30T13:09:23.984 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.984 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.984 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.985 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.985 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.bootstrap-mds", 2024-03-30T13:09:23.985 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCxDghmXJR2FxAA48zDCPXyPFHjdKiXlkMUhA==", 2024-03-30T13:09:23.985 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.985 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile bootstrap-mds" 2024-03-30T13:09:23.985 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.985 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.986 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.986 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.bootstrap-mgr", 2024-03-30T13:09:23.986 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCxDghmcK52FxAAoE41usfNe463rWOa2Xg95A==", 2024-03-30T13:09:23.986 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.986 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-30T13:09:23.986 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.986 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.987 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.987 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.bootstrap-osd", 2024-03-30T13:09:23.987 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCxDghmEMR2FxAAWHlWUScZFnIMNx9hRM5VOg==", 2024-03-30T13:09:23.987 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.987 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile bootstrap-osd" 2024-03-30T13:09:23.987 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.987 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.988 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.988 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.bootstrap-rbd", 2024-03-30T13:09:23.988 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCxDghmXdl2FxAAsZu8yxIEYRiSORPdhPhltw==", 2024-03-30T13:09:23.988 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.988 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-30T13:09:23.989 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.989 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.989 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.989 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-30T13:09:23.989 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCxDghmfO92FxAAiK3lvmAvhPnglfU+ZhzE4Q==", 2024-03-30T13:09:23.989 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.989 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-30T13:09:23.989 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.990 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.990 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.990 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.bootstrap-rgw", 2024-03-30T13:09:23.990 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCxDghmJAZ3FxAAl5OskemPicdWwgIQ4XvUfQ==", 2024-03-30T13:09:23.990 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.990 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-30T13:09:23.990 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.990 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.990 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.991 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "mgr.x", 2024-03-30T13:09:23.991 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCODghmbGW3MRAAxVOMst8eRfhO+U4eIYM+xw==", 2024-03-30T13:09:23.991 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.991 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow *", 2024-03-30T13:09:23.991 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile mgr", 2024-03-30T13:09:23.991 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.991 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.991 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:23.991 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:23.992 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "mgr.y", 2024-03-30T13:09:23.992 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCODghmMfkcLxAAovtfOXEsLKCy2XJ0Nxc9Dw==", 2024-03-30T13:09:23.992 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-03-30T13:09:23.992 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow *", 2024-03-30T13:09:23.992 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile mgr", 2024-03-30T13:09:23.992 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-03-30T13:09:23.992 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.992 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:23.992 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-03-30T13:09:23.992 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:09:23.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.955+0000 7f32a021c640 1 -- 172.21.15.83:0/1503958249 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f327c067fc0 msgr2=0x7f327c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:23.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.955+0000 7f32a021c640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f327c067fc0 0x7f327c06a480 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f32980b0600 tx=0x7f3294008040 comp rx=0 tx=0).stop 2024-03-30T13:09:23.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.955+0000 7f32a021c640 1 -- 172.21.15.83:0/1503958249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329806deb0 msgr2=0x7f32981524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:23.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.955+0000 7f32a021c640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329806deb0 0x7f32981524e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f328800c480 tx=0x7f328800c940 comp rx=0 tx=0).stop 2024-03-30T13:09:23.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.955+0000 7f32a021c640 1 -- 172.21.15.83:0/1503958249 shutdown_connections 2024-03-30T13:09:23.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.955+0000 7f32a021c640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f327c067fc0 0x7f327c06a480 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.955+0000 7f32a021c640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32980739b0 0x7f329815dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.955+0000 7f32a021c640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32980735d0 0x7f3298154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.955+0000 7f32a021c640 1 --2- 172.21.15.83:0/1503958249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f329806deb0 0x7f32981524e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:23.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.955+0000 7f32a021c640 1 -- 172.21.15.83:0/1503958249 >> 172.21.15.83:0/1503958249 conn(0x7f32980b1d60 msgr2=0x7f32981624d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:23.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.955+0000 7f32a021c640 1 -- 172.21.15.83:0/1503958249 shutdown_connections 2024-03-30T13:09:23.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:23.955+0000 7f32a021c640 1 -- 172.21.15.83:0/1503958249 wait complete. 2024-03-30T13:09:23.996 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-30T13:09:24.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.115+0000 7f691aa43640 1 Processor -- start 2024-03-30T13:09:24.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.115+0000 7f691aa43640 1 -- start start 2024-03-30T13:09:24.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.115+0000 7f691aa43640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f691406b660 0x7f691406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.115+0000 7f691aa43640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f691415cd90 con 0x7f691415d830 2024-03-30T13:09:24.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.115+0000 7f691aa43640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f691406bf80 con 0x7f6914160880 2024-03-30T13:09:24.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.115+0000 7f691aa43640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6914161140 con 0x7f691406b660 2024-03-30T13:09:24.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.115+0000 7f69137fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f691415d830 0x7f6914160170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:52968/0 (socket says 172.21.15.83:52968) 2024-03-30T13:09:24.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.115+0000 7f69137fe640 1 -- 172.21.15.83:0/1737173830 learned_addr learned my addr 172.21.15.83:0/1737173830 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:24.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.115+0000 7f6913fff640 1 --2- 172.21.15.83:0/1737173830 >> v2:172.21.15.153:3300/0 conn(0x7f691406b660 0x7f691406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.115+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3778388524 0 0) 0x7f691415cd90 con 0x7f691415d830 2024-03-30T13:09:24.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.115+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68fc003530 con 0x7f691415d830 2024-03-30T13:09:24.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 523303563 0 0) 0x7f68fc003530 con 0x7f691415d830 2024-03-30T13:09:24.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 >> v2:172.21.15.153:3300/0 conn(0x7f691406b660 msgr2=0x7f691406ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 --2- 172.21.15.83:0/1737173830 >> v2:172.21.15.153:3300/0 conn(0x7f691406b660 0x7f691406ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 >> v1:172.21.15.153:6789/0 conn(0x7f6914160880 legacy=0x7f691415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6914160e60 con 0x7f691415d830 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f6908001680 con 0x7f691415d830 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 >> v1:172.21.15.83:6789/0 conn(0x7f691415d830 legacy=0x7f6914160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 --2- 172.21.15.83:0/1737173830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc0039c0 0x7f68fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 --2- 172.21.15.83:0/1737173830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68fc004810 0x7f68fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 --2- 172.21.15.83:0/1737173830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68fc0051d0 0x7f68fc00fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6914161140 con 0x7f68fc0051d0 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc010580 con 0x7f68fc0039c0 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f68fc010780 con 0x7f68fc004810 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6918fe0640 1 --2- 172.21.15.83:0/1737173830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68fc0051d0 0x7f68fc00fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f69137fe640 1 --2- 172.21.15.83:0/1737173830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68fc004810 0x7f68fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6913fff640 1 --2- 172.21.15.83:0/1737173830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc0039c0 0x7f68fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6918fe0640 1 -- 172.21.15.83:0/1737173830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68fc004810 msgr2=0x7f68fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6918fe0640 1 --2- 172.21.15.83:0/1737173830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68fc004810 0x7f68fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6918fe0640 1 -- 172.21.15.83:0/1737173830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc0039c0 msgr2=0x7f68fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6918fe0640 1 --2- 172.21.15.83:0/1737173830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc0039c0 0x7f68fc003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6918fe0640 1 -- 172.21.15.83:0/1737173830 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68fc003530 con 0x7f68fc0051d0 2024-03-30T13:09:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f69137fe640 1 --2- 172.21.15.83:0/1737173830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68fc004810 0x7f68fc004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6918fe0640 1 -- 172.21.15.83:0/1737173830 reap_dead start 2024-03-30T13:09:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6918fe0640 1 --2- 172.21.15.83:0/1737173830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68fc0051d0 0x7f68fc00fde0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f690c001e70 tx=0x7f690c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ccf63be740e9ca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c001a90 con 0x7f68fc0051d0 2024-03-30T13:09:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690c003ba0 con 0x7f68fc0051d0 2024-03-30T13:09:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f6912ffd640 1 -- 172.21.15.83:0/1737173830 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908001d50 con 0x7f68fc0051d0 2024-03-30T13:09:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f691aa43640 1 -- 172.21.15.83:0/1737173830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68fc0051d0 msgr2=0x7f68fc00fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f691aa43640 1 --2- 172.21.15.83:0/1737173830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68fc0051d0 0x7f68fc00fde0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f690c001e70 tx=0x7f690c01c780 comp rx=0 tx=0).stop 2024-03-30T13:09:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f691aa43640 1 -- 172.21.15.83:0/1737173830 shutdown_connections 2024-03-30T13:09:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f691aa43640 1 --2- 172.21.15.83:0/1737173830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68fc0051d0 0x7f68fc00fde0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f691aa43640 1 -- 172.21.15.83:0/1737173830 >> 172.21.15.83:0/1737173830 conn(0x7f6914072d40 msgr2=0x7f69140b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f691aa43640 1 -- 172.21.15.83:0/1737173830 shutdown_connections 2024-03-30T13:09:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.119+0000 7f691aa43640 1 -- 172.21.15.83:0/1737173830 wait complete. 2024-03-30T13:09:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f691aa43640 1 Processor -- start 2024-03-30T13:09:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f691aa43640 1 -- start start 2024-03-30T13:09:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f691aa43640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc0051d0 0x7f691415b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f691aa43640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f691413e680 0x7f691415f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f691aa43640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f691415bfb0 0x7f691415f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f691aa43640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6914160cb0 con 0x7f691415bfb0 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f691aa43640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f691415d3a0 con 0x7f68fc0051d0 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f691aa43640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6914146350 con 0x7f691413e680 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6918fe0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f691415bfb0 0x7f691415f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6918fe0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f691415bfb0 0x7f691415f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51844/0 (socket says 172.21.15.83:51844) 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6918fe0640 1 -- 172.21.15.83:0/2034644911 learned_addr learned my addr 172.21.15.83:0/2034644911 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6913fff640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc0051d0 0x7f691415b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6918fe0640 1 -- 172.21.15.83:0/2034644911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f691413e680 msgr2=0x7f691415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6918fe0640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f691413e680 0x7f691415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6918fe0640 1 -- 172.21.15.83:0/2034644911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc0051d0 msgr2=0x7f691415b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6918fe0640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc0051d0 0x7f691415b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6918fe0640 1 -- 172.21.15.83:0/2034644911 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6914141f40 con 0x7f691415bfb0 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6918fe0640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f691415bfb0 0x7f691415f850 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f690c01d020 tx=0x7f68fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6910ff9640 1 -- 172.21.15.83:0/2034644911 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c001a90 con 0x7f691415bfb0 2024-03-30T13:09:24.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6910ff9640 1 -- 172.21.15.83:0/2034644911 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690c005620 con 0x7f691415bfb0 2024-03-30T13:09:24.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f6910ff9640 1 -- 172.21.15.83:0/2034644911 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c007dc0 con 0x7f691415bfb0 2024-03-30T13:09:24.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f691aa43640 1 -- 172.21.15.83:0/2034644911 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69140b1040 con 0x7f691415bfb0 2024-03-30T13:09:24.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f691aa43640 1 -- 172.21.15.83:0/2034644911 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69140b1600 con 0x7f691415bfb0 2024-03-30T13:09:24.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.123+0000 7f691aa43640 1 -- 172.21.15.83:0/2034644911 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691415ff30 con 0x7f691415bfb0 2024-03-30T13:09:24.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.127+0000 7f6910ff9640 1 -- 172.21.15.83:0/2034644911 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f690c0a6480 con 0x7f691415bfb0 2024-03-30T13:09:24.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.127+0000 7f6910ff9640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6900067ff0 0x7f690006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.127+0000 7f6910ff9640 1 -- 172.21.15.83:0/2034644911 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f690c11f350 con 0x7f691415bfb0 2024-03-30T13:09:24.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.127+0000 7f6913fff640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6900067ff0 0x7f690006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.127+0000 7f6913fff640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6900067ff0 0x7f690006a4b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6904009890 tx=0x7f6904008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:24.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.131+0000 7f6910ff9640 1 -- 172.21.15.83:0/2034644911 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f690c016490 con 0x7f691415bfb0 2024-03-30T13:09:24.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.351+0000 7f691aa43640 1 -- 172.21.15.83:0/2034644911 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f691404f9e0 con 0x7f691415bfb0 2024-03-30T13:09:24.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f6910ff9640 1 -- 172.21.15.83:0/2034644911 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f690c0efee0 con 0x7f691415bfb0 2024-03-30T13:09:24.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f691aa43640 1 -- 172.21.15.83:0/2034644911 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6900067ff0 msgr2=0x7f690006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f691aa43640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6900067ff0 0x7f690006a4b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6904009890 tx=0x7f6904008040 comp rx=0 tx=0).stop 2024-03-30T13:09:24.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f691aa43640 1 -- 172.21.15.83:0/2034644911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f691415bfb0 msgr2=0x7f691415f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f691aa43640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f691415bfb0 0x7f691415f850 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f690c01d020 tx=0x7f68fc005840 comp rx=0 tx=0).stop 2024-03-30T13:09:24.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f691aa43640 1 -- 172.21.15.83:0/2034644911 shutdown_connections 2024-03-30T13:09:24.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f691aa43640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6900067ff0 0x7f690006a4b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f691aa43640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f691415bfb0 0x7f691415f850 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f691aa43640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f691413e680 0x7f691415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f691aa43640 1 --2- 172.21.15.83:0/2034644911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc0051d0 0x7f691415b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f691aa43640 1 -- 172.21.15.83:0/2034644911 >> 172.21.15.83:0/2034644911 conn(0x7f6914072d40 msgr2=0x7f69140cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:24.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f691aa43640 1 -- 172.21.15.83:0/2034644911 shutdown_connections 2024-03-30T13:09:24.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.355+0000 7f691aa43640 1 -- 172.21.15.83:0/2034644911 wait complete. 2024-03-30T13:09:24.378 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-30T13:09:24.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b9901640 1 Processor -- start 2024-03-30T13:09:24.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b9901640 1 -- start start 2024-03-30T13:09:24.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b9901640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92b415b050 0x7f92b4073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b9901640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f92b40b3ca0 0x7f92b406f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b9901640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92b406f690 0x7f92b4071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b9901640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f92b406fb00 con 0x7f92b40b3ca0 2024-03-30T13:09:24.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b9901640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f92b4073ab0 con 0x7f92b415b050 2024-03-30T13:09:24.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b9901640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f92b40b31e0 con 0x7f92b406f690 2024-03-30T13:09:24.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b27fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f92b40b3ca0 0x7f92b406f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b27fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f92b40b3ca0 0x7f92b406f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51860/0 (socket says 172.21.15.83:51860) 2024-03-30T13:09:24.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b27fc640 1 -- 172.21.15.83:0/1101653495 learned_addr learned my addr 172.21.15.83:0/1101653495 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:24.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b37fe640 1 --2- 172.21.15.83:0/1101653495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92b406f690 0x7f92b4071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b2ffd640 1 --2- 172.21.15.83:0/1101653495 >> v2:172.21.15.153:3300/0 conn(0x7f92b415b050 0x7f92b4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b27fc640 1 -- 172.21.15.83:0/1101653495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92b406f690 msgr2=0x7f92b4071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:24.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b27fc640 1 --2- 172.21.15.83:0/1101653495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92b406f690 0x7f92b4071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b27fc640 1 -- 172.21.15.83:0/1101653495 >> v2:172.21.15.153:3300/0 conn(0x7f92b415b050 msgr2=0x7f92b4073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:24.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b27fc640 1 --2- 172.21.15.83:0/1101653495 >> v2:172.21.15.153:3300/0 conn(0x7f92b415b050 0x7f92b4073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b27fc640 1 -- 172.21.15.83:0/1101653495 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b40ad4f0 con 0x7f92b40b3ca0 2024-03-30T13:09:24.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.487+0000 7f92b37fe640 1 --2- 172.21.15.83:0/1101653495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92b406f690 0x7f92b4071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:24.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b27fc640 1 --2- 172.21.15.83:0/1101653495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92b40b3ca0 0x7f92b406f150 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f92b406d8d0 tx=0x7f92a801c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2b97cd7f4ac5a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:24.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b1ffb640 1 -- 172.21.15.83:0/1101653495 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a80b0070 con 0x7f92b40b3ca0 2024-03-30T13:09:24.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b1ffb640 1 -- 172.21.15.83:0/1101653495 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a80ab600 con 0x7f92b40b3ca0 2024-03-30T13:09:24.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b1ffb640 1 -- 172.21.15.83:0/1101653495 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a80ab9d0 con 0x7f92b40b3ca0 2024-03-30T13:09:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 -- 172.21.15.83:0/1101653495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92b40b3ca0 msgr2=0x7f92b406f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 --2- 172.21.15.83:0/1101653495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92b40b3ca0 0x7f92b406f150 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f92b406d8d0 tx=0x7f92a801c230 comp rx=0 tx=0).stop 2024-03-30T13:09:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 -- 172.21.15.83:0/1101653495 shutdown_connections 2024-03-30T13:09:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 --2- 172.21.15.83:0/1101653495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92b406f690 0x7f92b4071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 --2- 172.21.15.83:0/1101653495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92b40b3ca0 0x7f92b406f150 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 --2- 172.21.15.83:0/1101653495 >> v2:172.21.15.153:3300/0 conn(0x7f92b415b050 0x7f92b4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 -- 172.21.15.83:0/1101653495 >> 172.21.15.83:0/1101653495 conn(0x7f92b406b660 msgr2=0x7f92b406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 -- 172.21.15.83:0/1101653495 shutdown_connections 2024-03-30T13:09:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 -- 172.21.15.83:0/1101653495 wait complete. 2024-03-30T13:09:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 Processor -- start 2024-03-30T13:09:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 -- start start 2024-03-30T13:09:24.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92b406f690 0x7f92b4146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92b40b3ca0 0x7f92b4163590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b415b050 0x7f92b415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f92b40b4110 con 0x7f92b406f690 2024-03-30T13:09:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92b40ad1c0 con 0x7f92b415b050 2024-03-30T13:09:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b9901640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f92b40b4c10 con 0x7f92b40b3ca0 2024-03-30T13:09:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92b406f690 0x7f92b4146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92b406f690 0x7f92b4146010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51862/0 (socket says 172.21.15.83:51862) 2024-03-30T13:09:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b2ffd640 1 -- 172.21.15.83:0/109685967 learned_addr learned my addr 172.21.15.83:0/109685967 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b27fc640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92b40b3ca0 0x7f92b4163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b37fe640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b415b050 0x7f92b415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b2ffd640 1 -- 172.21.15.83:0/109685967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92b40b3ca0 msgr2=0x7f92b4163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b2ffd640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92b40b3ca0 0x7f92b4163590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b2ffd640 1 -- 172.21.15.83:0/109685967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b415b050 msgr2=0x7f92b415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.491+0000 7f92b2ffd640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b415b050 0x7f92b415d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f92b2ffd640 1 -- 172.21.15.83:0/109685967 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b4153970 con 0x7f92b406f690 2024-03-30T13:09:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f92b37fe640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b415b050 0x7f92b415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f92b2ffd640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92b406f690 0x7f92b4146010 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f92a400c7f0 tx=0x7f92a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f929bfff640 1 -- 172.21.15.83:0/109685967 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a4015070 con 0x7f92b406f690 2024-03-30T13:09:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f929bfff640 1 -- 172.21.15.83:0/109685967 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a4004240 con 0x7f92b406f690 2024-03-30T13:09:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f92b9901640 1 -- 172.21.15.83:0/109685967 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b4153c10 con 0x7f92b406f690 2024-03-30T13:09:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f929bfff640 1 -- 172.21.15.83:0/109685967 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a4003620 con 0x7f92b406f690 2024-03-30T13:09:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f92b9901640 1 -- 172.21.15.83:0/109685967 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b41541d0 con 0x7f92b406f690 2024-03-30T13:09:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f92b9901640 1 -- 172.21.15.83:0/109685967 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b409e540 con 0x7f92b406f690 2024-03-30T13:09:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f929bfff640 1 -- 172.21.15.83:0/109685967 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f92a40039d0 con 0x7f92b406f690 2024-03-30T13:09:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f929bfff640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f92a0067fc0 0x7f92a006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f929bfff640 1 -- 172.21.15.83:0/109685967 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f92a4086150 con 0x7f92b406f690 2024-03-30T13:09:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f92b27fc640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f92a0067fc0 0x7f92a006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.495+0000 7f92b27fc640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f92a0067fc0 0x7f92a006a480 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f92a80ad000 tx=0x7f92a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.499+0000 7f929bfff640 1 -- 172.21.15.83:0/109685967 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f92a4056ce0 con 0x7f92b406f690 2024-03-30T13:09:24.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.727+0000 7f92b9901640 1 -- 172.21.15.83:0/109685967 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f92b4073890 con 0x7f92b406f690 2024-03-30T13:09:24.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.727+0000 7f929bfff640 1 -- 172.21.15.83:0/109685967 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f92a40565e0 con 0x7f92b406f690 2024-03-30T13:09:24.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.731+0000 7f92b9901640 1 -- 172.21.15.83:0/109685967 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f92a0067fc0 msgr2=0x7f92a006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.731+0000 7f92b9901640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f92a0067fc0 0x7f92a006a480 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f92a80ad000 tx=0x7f92a8008040 comp rx=0 tx=0).stop 2024-03-30T13:09:24.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.731+0000 7f92b9901640 1 -- 172.21.15.83:0/109685967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92b406f690 msgr2=0x7f92b4146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.731+0000 7f92b9901640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92b406f690 0x7f92b4146010 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f92a400c7f0 tx=0x7f92a400ccb0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.731+0000 7f92b9901640 1 -- 172.21.15.83:0/109685967 shutdown_connections 2024-03-30T13:09:24.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.731+0000 7f92b9901640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f92a0067fc0 0x7f92a006a480 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.731+0000 7f92b9901640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92b415b050 0x7f92b415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.731+0000 7f92b9901640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92b40b3ca0 0x7f92b4163590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.731+0000 7f92b9901640 1 --2- 172.21.15.83:0/109685967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92b406f690 0x7f92b4146010 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.731+0000 7f92b9901640 1 -- 172.21.15.83:0/109685967 >> 172.21.15.83:0/109685967 conn(0x7f92b406b660 msgr2=0x7f92b40afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.731+0000 7f92b9901640 1 -- 172.21.15.83:0/109685967 shutdown_connections 2024-03-30T13:09:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.731+0000 7f92b9901640 1 -- 172.21.15.83:0/109685967 wait complete. 2024-03-30T13:09:24.751 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-30T13:09:24.793 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:09:24.799 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:09:24.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e9bd66640 1 Processor -- start 2024-03-30T13:09:24.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e9bd66640 1 -- start start 2024-03-30T13:09:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e9bd66640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0e9415e840 0x7f0e940d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e9bd66640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e940d51f0 con 0x7f0e940d1540 2024-03-30T13:09:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e9bd66640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e940d2140 con 0x7f0e940cfc10 2024-03-30T13:09:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e9bd66640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f0e9415ec20 con 0x7f0e9415e840 2024-03-30T13:09:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e99b02640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0e9415e840 0x7f0e940d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e9a303640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f0e940d1540 0x7f0e9406c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:52978/0 (socket says 172.21.15.83:52978) 2024-03-30T13:09:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e9a303640 1 -- 172.21.15.83:0/3128609393 learned_addr learned my addr 172.21.15.83:0/3128609393 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e99b02640 1 -- 172.21.15.83:0/3128609393 >> v1:172.21.15.153:6789/0 conn(0x7f0e940cfc10 legacy=0x7f0e940d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e99b02640 1 -- 172.21.15.83:0/3128609393 >> v1:172.21.15.83:6789/0 conn(0x7f0e940d1540 legacy=0x7f0e9406c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e99b02640 1 -- 172.21.15.83:0/3128609393 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e940d2420 con 0x7f0e9415e840 2024-03-30T13:09:24.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e99b02640 1 --2- 172.21.15.83:0/3128609393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e9415e840 0x7f0e940d31e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0e900097c0 tx=0x7f0e9001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571f9c4e5c20789 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e98b00640 1 -- 172.21.15.83:0/3128609393 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e900b0070 con 0x7f0e9415e840 2024-03-30T13:09:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e98b00640 1 -- 172.21.15.83:0/3128609393 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e900ab600 con 0x7f0e9415e840 2024-03-30T13:09:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.859+0000 7f0e98b00640 1 -- 172.21.15.83:0/3128609393 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e900ab9d0 con 0x7f0e9415e840 2024-03-30T13:09:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 -- 172.21.15.83:0/3128609393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e9415e840 msgr2=0x7f0e940d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 --2- 172.21.15.83:0/3128609393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e9415e840 0x7f0e940d31e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0e900097c0 tx=0x7f0e9001c3d0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 -- 172.21.15.83:0/3128609393 shutdown_connections 2024-03-30T13:09:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 --2- 172.21.15.83:0/3128609393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e9415e840 0x7f0e940d31e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 -- 172.21.15.83:0/3128609393 >> 172.21.15.83:0/3128609393 conn(0x7f0e9409d7f0 msgr2=0x7f0e940d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 -- 172.21.15.83:0/3128609393 shutdown_connections 2024-03-30T13:09:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 -- 172.21.15.83:0/3128609393 wait complete. 2024-03-30T13:09:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 Processor -- start 2024-03-30T13:09:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 -- start start 2024-03-30T13:09:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e940cfc10 0x7f0e94150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e940d1540 0x7f0e94155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e9415e840 0x7f0e941558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9416c780 con 0x7f0e940d1540 2024-03-30T13:09:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9416c600 con 0x7f0e940cfc10 2024-03-30T13:09:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9416c900 con 0x7f0e9415e840 2024-03-30T13:09:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e99301640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e940d1540 0x7f0e94155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e99301640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e940d1540 0x7f0e94155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51880/0 (socket says 172.21.15.83:51880) 2024-03-30T13:09:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e99301640 1 -- 172.21.15.83:0/1855681666 learned_addr learned my addr 172.21.15.83:0/1855681666 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9a303640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e9415e840 0x7f0e941558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e99b02640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e940cfc10 0x7f0e94150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e99301640 1 -- 172.21.15.83:0/1855681666 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e9415e840 msgr2=0x7f0e941558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e99301640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e9415e840 0x7f0e941558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e99301640 1 -- 172.21.15.83:0/1855681666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e940cfc10 msgr2=0x7f0e94150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e99301640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e940cfc10 0x7f0e94150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e99301640 1 -- 172.21.15.83:0/1855681666 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e940b9a90 con 0x7f0e940d1540 2024-03-30T13:09:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e99301640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e940d1540 0x7f0e94155360 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400c450 tx=0x7f0e8400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e8a7fc640 1 -- 172.21.15.83:0/1855681666 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84012830 con 0x7f0e940d1540 2024-03-30T13:09:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e8a7fc640 1 -- 172.21.15.83:0/1855681666 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e84017070 con 0x7f0e940d1540 2024-03-30T13:09:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 -- 172.21.15.83:0/1855681666 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e940b9d70 con 0x7f0e940d1540 2024-03-30T13:09:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e8a7fc640 1 -- 172.21.15.83:0/1855681666 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84012c30 con 0x7f0e940d1540 2024-03-30T13:09:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 -- 172.21.15.83:0/1855681666 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e940c8140 con 0x7f0e940d1540 2024-03-30T13:09:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.863+0000 7f0e9bd66640 1 -- 172.21.15.83:0/1855681666 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e940a23d0 con 0x7f0e940d1540 2024-03-30T13:09:24.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.867+0000 7f0e8a7fc640 1 -- 172.21.15.83:0/1855681666 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f0e8401c460 con 0x7f0e940d1540 2024-03-30T13:09:24.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.867+0000 7f0e8a7fc640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0e78067fc0 0x7f0e7806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:24.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.867+0000 7f0e8a7fc640 1 -- 172.21.15.83:0/1855681666 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f0e84085e60 con 0x7f0e940d1540 2024-03-30T13:09:24.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.867+0000 7f0e99b02640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0e78067fc0 0x7f0e7806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:24.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.867+0000 7f0e99b02640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0e78067fc0 0x7f0e7806a480 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e900ad000 tx=0x7f0e900a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:24.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:24.871+0000 7f0e8a7fc640 1 -- 172.21.15.83:0/1855681666 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f0e84056960 con 0x7f0e940d1540 2024-03-30T13:09:25.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.075+0000 7f0e9bd66640 1 -- 172.21.15.83:0/1855681666 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f0e9404f9e0 con 0x7f0e940d1540 2024-03-30T13:09:25.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.079+0000 7f0e8a7fc640 1 -- 172.21.15.83:0/1855681666 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f0e84056260 con 0x7f0e940d1540 2024-03-30T13:09:25.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.083+0000 7f0e9bd66640 1 -- 172.21.15.83:0/1855681666 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0e78067fc0 msgr2=0x7f0e7806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.083+0000 7f0e9bd66640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0e78067fc0 0x7f0e7806a480 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e900ad000 tx=0x7f0e900a6000 comp rx=0 tx=0).stop 2024-03-30T13:09:25.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.083+0000 7f0e9bd66640 1 -- 172.21.15.83:0/1855681666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e940d1540 msgr2=0x7f0e94155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.083+0000 7f0e9bd66640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e940d1540 0x7f0e94155360 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400c450 tx=0x7f0e8400c910 comp rx=0 tx=0).stop 2024-03-30T13:09:25.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.083+0000 7f0e9bd66640 1 -- 172.21.15.83:0/1855681666 shutdown_connections 2024-03-30T13:09:25.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.083+0000 7f0e9bd66640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0e78067fc0 0x7f0e7806a480 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.083+0000 7f0e9bd66640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e9415e840 0x7f0e941558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.083+0000 7f0e9bd66640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e940d1540 0x7f0e94155360 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.083+0000 7f0e9bd66640 1 --2- 172.21.15.83:0/1855681666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e940cfc10 0x7f0e94150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.083+0000 7f0e9bd66640 1 -- 172.21.15.83:0/1855681666 >> 172.21.15.83:0/1855681666 conn(0x7f0e9409d7f0 msgr2=0x7f0e940b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:25.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.083+0000 7f0e9bd66640 1 -- 172.21.15.83:0/1855681666 shutdown_connections 2024-03-30T13:09:25.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.083+0000 7f0e9bd66640 1 -- 172.21.15.83:0/1855681666 wait complete. 2024-03-30T13:09:25.102 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-30T13:09:25.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f8395ab5640 1 Processor -- start 2024-03-30T13:09:25.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f8395ab5640 1 -- start start 2024-03-30T13:09:25.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f8395ab5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f839015b050 0x7f8390073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f8395ab5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f839006f860 0x7f839015b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f8395ab5640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83900b31e0 con 0x7f83900b3ca0 2024-03-30T13:09:25.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f8395ab5640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f8390073ab0 con 0x7f839006f860 2024-03-30T13:09:25.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f8395ab5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f83900ad4f0 con 0x7f839015b050 2024-03-30T13:09:25.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f838ffff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f839006f860 0x7f839015b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f838ffff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f839006f860 0x7f839015b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51888/0 (socket says 172.21.15.83:51888) 2024-03-30T13:09:25.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f8387fff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f83900b3ca0 0x7f839006f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:52988/0 (socket says 172.21.15.83:52988) 2024-03-30T13:09:25.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f838ffff640 1 -- 172.21.15.83:0/1501851151 learned_addr learned my addr 172.21.15.83:0/1501851151 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:25.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f838f7fe640 1 --2- 172.21.15.83:0/1501851151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f839015b050 0x7f8390073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f838ffff640 1 -- 172.21.15.83:0/1501851151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f839015b050 msgr2=0x7f8390073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:25.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f838ffff640 1 --2- 172.21.15.83:0/1501851151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f839015b050 0x7f8390073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f838ffff640 1 -- 172.21.15.83:0/1501851151 >> v1:172.21.15.83:6789/0 conn(0x7f83900b3ca0 legacy=0x7f839006f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f838ffff640 1 -- 172.21.15.83:0/1501851151 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83900ad7d0 con 0x7f839006f860 2024-03-30T13:09:25.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f838ffff640 1 --2- 172.21.15.83:0/1501851151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f839006f860 0x7f839015b430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8388009e50 tx=0x7f838801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350513e0eca7af9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:25.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f838effd640 1 -- 172.21.15.83:0/1501851151 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880a58d0 con 0x7f839006f860 2024-03-30T13:09:25.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f838effd640 1 -- 172.21.15.83:0/1501851151 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83880a5a70 con 0x7f839006f860 2024-03-30T13:09:25.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.247+0000 7f838effd640 1 -- 172.21.15.83:0/1501851151 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880a5e40 con 0x7f839006f860 2024-03-30T13:09:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 -- 172.21.15.83:0/1501851151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f839006f860 msgr2=0x7f839015b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 --2- 172.21.15.83:0/1501851151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f839006f860 0x7f839015b430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8388009e50 tx=0x7f838801ca00 comp rx=0 tx=0).stop 2024-03-30T13:09:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 -- 172.21.15.83:0/1501851151 shutdown_connections 2024-03-30T13:09:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 --2- 172.21.15.83:0/1501851151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f839006f860 0x7f839015b430 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 --2- 172.21.15.83:0/1501851151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f839015b050 0x7f8390073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 -- 172.21.15.83:0/1501851151 >> 172.21.15.83:0/1501851151 conn(0x7f839006b660 msgr2=0x7f839006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 -- 172.21.15.83:0/1501851151 shutdown_connections 2024-03-30T13:09:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 -- 172.21.15.83:0/1501851151 wait complete. 2024-03-30T13:09:25.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 Processor -- start 2024-03-30T13:09:25.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 -- start start 2024-03-30T13:09:25.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f839006f860 0x7f839014af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83900b3ca0 0x7f839014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f839015b050 0x7f839014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f83900b4d90 con 0x7f839015b050 2024-03-30T13:09:25.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f83900b4c10 con 0x7f83900b3ca0 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f83900b4080 con 0x7f839006f860 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f838ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f839015b050 0x7f839014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f838ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f839015b050 0x7f839014fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51892/0 (socket says 172.21.15.83:51892) 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f838ffff640 1 -- 172.21.15.83:0/2854276040 learned_addr learned my addr 172.21.15.83:0/2854276040 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f838ffff640 1 -- 172.21.15.83:0/2854276040 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f839006f860 msgr2=0x7f839014af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f838ffff640 1 --2- 172.21.15.83:0/2854276040 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f839006f860 0x7f839014af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f838ffff640 1 -- 172.21.15.83:0/2854276040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83900b3ca0 msgr2=0x7f839014f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f838ffff640 1 --2- 172.21.15.83:0/2854276040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83900b3ca0 0x7f839014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f838ffff640 1 -- 172.21.15.83:0/2854276040 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839014da10 con 0x7f839015b050 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f838ffff640 1 --2- 172.21.15.83:0/2854276040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f839015b050 0x7f839014fa50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f838801a630 tx=0x7f83880197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f838cff9640 1 -- 172.21.15.83:0/2854276040 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880bc020 con 0x7f839015b050 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f838cff9640 1 -- 172.21.15.83:0/2854276040 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8388007e20 con 0x7f839015b050 2024-03-30T13:09:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 -- 172.21.15.83:0/2854276040 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839014c3e0 con 0x7f839015b050 2024-03-30T13:09:25.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f838cff9640 1 -- 172.21.15.83:0/2854276040 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880a58d0 con 0x7f839015b050 2024-03-30T13:09:25.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 -- 172.21.15.83:0/2854276040 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8390151ff0 con 0x7f839015b050 2024-03-30T13:09:25.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.251+0000 7f8395ab5640 1 -- 172.21.15.83:0/2854276040 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839009e540 con 0x7f839015b050 2024-03-30T13:09:25.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.255+0000 7f838cff9640 1 -- 172.21.15.83:0/2854276040 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f83880bf020 con 0x7f839015b050 2024-03-30T13:09:25.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.255+0000 7f838cff9640 1 --2- 172.21.15.83:0/2854276040 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8374067fc0 0x7f837406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.255+0000 7f838cff9640 1 -- 172.21.15.83:0/2854276040 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8388121840 con 0x7f839015b050 2024-03-30T13:09:25.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.255+0000 7f838f7fe640 1 --2- 172.21.15.83:0/2854276040 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8374067fc0 0x7f837406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.255+0000 7f838f7fe640 1 --2- 172.21.15.83:0/2854276040 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8374067fc0 0x7f837406a480 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83901f8130 tx=0x7f8380008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:25.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.259+0000 7f838cff9640 1 -- 172.21.15.83:0/2854276040 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f83880c6030 con 0x7f839015b050 2024-03-30T13:09:25.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.459+0000 7f8395ab5640 1 -- 172.21.15.83:0/2854276040 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f839004f9e0 con 0x7f839015b050 2024-03-30T13:09:25.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f838cff9640 1 -- 172.21.15.83:0/2854276040 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f8388016620 con 0x7f839015b050 2024-03-30T13:09:25.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f8395ab5640 1 -- 172.21.15.83:0/2854276040 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8374067fc0 msgr2=0x7f837406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f8395ab5640 1 --2- 172.21.15.83:0/2854276040 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8374067fc0 0x7f837406a480 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83901f8130 tx=0x7f8380008040 comp rx=0 tx=0).stop 2024-03-30T13:09:25.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f8395ab5640 1 -- 172.21.15.83:0/2854276040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f839015b050 msgr2=0x7f839014fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f8395ab5640 1 --2- 172.21.15.83:0/2854276040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f839015b050 0x7f839014fa50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f838801a630 tx=0x7f83880197a0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f8395ab5640 1 -- 172.21.15.83:0/2854276040 shutdown_connections 2024-03-30T13:09:25.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f8395ab5640 1 --2- 172.21.15.83:0/2854276040 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8374067fc0 0x7f837406a480 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f8395ab5640 1 --2- 172.21.15.83:0/2854276040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f839015b050 0x7f839014fa50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f8395ab5640 1 --2- 172.21.15.83:0/2854276040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83900b3ca0 0x7f839014f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f8395ab5640 1 --2- 172.21.15.83:0/2854276040 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f839006f860 0x7f839014af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f8395ab5640 1 -- 172.21.15.83:0/2854276040 >> 172.21.15.83:0/2854276040 conn(0x7f839006b660 msgr2=0x7f83900afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:25.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f8395ab5640 1 -- 172.21.15.83:0/2854276040 shutdown_connections 2024-03-30T13:09:25.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.463+0000 7f8395ab5640 1 -- 172.21.15.83:0/2854276040 wait complete. 2024-03-30T13:09:25.485 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-30T13:09:25.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fece2b2c640 1 Processor -- start 2024-03-30T13:09:25.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fece2b2c640 1 -- start start 2024-03-30T13:09:25.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fece2b2c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fecdc06e6d0 0x7fecdc06eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fece2b2c640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecdc163870 con 0x7fecdc15d100 2024-03-30T13:09:25.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fece2b2c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecdc163b50 con 0x7fecdc072390 2024-03-30T13:09:25.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fece2b2c640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fecdc15d4e0 con 0x7fecdc06e6d0 2024-03-30T13:09:25.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fece08c8640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fecdc15d100 0x7fecdc0b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:53000/0 (socket says 172.21.15.83:53000) 2024-03-30T13:09:25.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fece08c8640 1 -- 172.21.15.83:0/1373638935 learned_addr learned my addr 172.21.15.83:0/1373638935 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:25.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fece10c9640 1 --2- 172.21.15.83:0/1373638935 >> v2:172.21.15.153:3300/0 conn(0x7fecdc06e6d0 0x7fecdc06eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649811173 0 0) 0x7fecdc163870 con 0x7fecdc15d100 2024-03-30T13:09:25.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecc8003530 con 0x7fecdc15d100 2024-03-30T13:09:25.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 118688942 0 0) 0x7fecc8003530 con 0x7fecdc15d100 2024-03-30T13:09:25.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 >> v2:172.21.15.153:3300/0 conn(0x7fecdc06e6d0 msgr2=0x7fecdc06eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:25.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 --2- 172.21.15.83:0/1373638935 >> v2:172.21.15.153:3300/0 conn(0x7fecdc06e6d0 0x7fecdc06eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 >> v1:172.21.15.153:6789/0 conn(0x7fecdc072390 legacy=0x7fecdc162f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecdc163e30 con 0x7fecdc15d100 2024-03-30T13:09:25.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fece10c9640 1 --2- 172.21.15.83:0/1373638935 >> v2:172.21.15.153:3300/0 conn(0x7fecdc06e6d0 0x7fecdc06eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:25.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fecd4001a00 con 0x7fecdc15d100 2024-03-30T13:09:25.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 >> v1:172.21.15.83:6789/0 conn(0x7fecdc15d100 legacy=0x7fecdc0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 --2- 172.21.15.83:0/1373638935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecc8003a10 0x7fecc8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 --2- 172.21.15.83:0/1373638935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecc8004810 0x7fecc8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 --2- 172.21.15.83:0/1373638935 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fecc8005220 0x7fecc800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fecc800c140 con 0x7fecc8003a10 2024-03-30T13:09:25.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fecc800c2f0 con 0x7fecc8004810 2024-03-30T13:09:25.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fecc800c4f0 con 0x7fecc8005220 2024-03-30T13:09:25.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.599+0000 7fece08c8640 1 --2- 172.21.15.83:0/1373638935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecc8003a10 0x7fecc8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece10c9640 1 --2- 172.21.15.83:0/1373638935 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fecc8005220 0x7fecc800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fecdbfff640 1 --2- 172.21.15.83:0/1373638935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecc8004810 0x7fecc8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece08c8640 1 -- 172.21.15.83:0/1373638935 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fecc8005220 msgr2=0x7fecc800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:25.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece08c8640 1 --2- 172.21.15.83:0/1373638935 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fecc8005220 0x7fecc800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece08c8640 1 -- 172.21.15.83:0/1373638935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecc8004810 msgr2=0x7fecc8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:25.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece08c8640 1 --2- 172.21.15.83:0/1373638935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecc8004810 0x7fecc8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece08c8640 1 -- 172.21.15.83:0/1373638935 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc8003530 con 0x7fecc8003a10 2024-03-30T13:09:25.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece10c9640 1 -- 172.21.15.83:0/1373638935 reap_dead start 2024-03-30T13:09:25.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece08c8640 1 --2- 172.21.15.83:0/1373638935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecc8003a10 0x7fecc8003e30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fecd400a770 tx=0x7fecd401d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1095c1696d464b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:25.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd400a390 con 0x7fecc8003a10 2024-03-30T13:09:25.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd40ad650 con 0x7fecc8003a10 2024-03-30T13:09:25.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fecdb7fe640 1 -- 172.21.15.83:0/1373638935 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd40ada80 con 0x7fecc8003a10 2024-03-30T13:09:25.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece2b2c640 1 -- 172.21.15.83:0/1373638935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecc8003a10 msgr2=0x7fecc8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece2b2c640 1 --2- 172.21.15.83:0/1373638935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecc8003a10 0x7fecc8003e30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fecd400a770 tx=0x7fecd401d220 comp rx=0 tx=0).stop 2024-03-30T13:09:25.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece2b2c640 1 -- 172.21.15.83:0/1373638935 shutdown_connections 2024-03-30T13:09:25.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece2b2c640 1 --2- 172.21.15.83:0/1373638935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecc8003a10 0x7fecc8003e30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece2b2c640 1 -- 172.21.15.83:0/1373638935 >> 172.21.15.83:0/1373638935 conn(0x7fecdc06b660 msgr2=0x7fecdc06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:25.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece2b2c640 1 -- 172.21.15.83:0/1373638935 shutdown_connections 2024-03-30T13:09:25.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.603+0000 7fece2b2c640 1 -- 172.21.15.83:0/1373638935 wait complete. 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece2b2c640 1 Processor -- start 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece2b2c640 1 -- start start 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece2b2c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecc8003a10 0x7fecdc156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece2b2c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecdc1578f0 0x7fecdc159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece2b2c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fecdc09bd90 0x7fecdc09c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece2b2c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc0ae5e0 con 0x7fecdc1578f0 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece2b2c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc0ae170 con 0x7fecc8003a10 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece2b2c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fecdc0ae760 con 0x7fecdc09bd90 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecdbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecdc1578f0 0x7fecdc159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecdbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecdc1578f0 0x7fecdc159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51918/0 (socket says 172.21.15.83:51918) 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecdbfff640 1 -- 172.21.15.83:0/1655881811 learned_addr learned my addr 172.21.15.83:0/1655881811 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece08c8640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecc8003a10 0x7fecdc156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece10c9640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fecdc09bd90 0x7fecdc09c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecdbfff640 1 -- 172.21.15.83:0/1655881811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fecdc09bd90 msgr2=0x7fecdc09c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecdbfff640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fecdc09bd90 0x7fecdc09c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecdbfff640 1 -- 172.21.15.83:0/1655881811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecc8003a10 msgr2=0x7fecdc156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecdbfff640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecc8003a10 0x7fecdc156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecdbfff640 1 -- 172.21.15.83:0/1655881811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecdc157e40 con 0x7fecdc1578f0 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece10c9640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fecdc09bd90 0x7fecdc09c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecdbfff640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecdc1578f0 0x7fecdc159a30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fecc400e500 tx=0x7fecc400e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecd97fa640 1 -- 172.21.15.83:0/1655881811 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc40053a0 con 0x7fecdc1578f0 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecd97fa640 1 -- 172.21.15.83:0/1655881811 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc4018070 con 0x7fecdc1578f0 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece2b2c640 1 -- 172.21.15.83:0/1655881811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecdc158120 con 0x7fecdc1578f0 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecd97fa640 1 -- 172.21.15.83:0/1655881811 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4003820 con 0x7fecdc1578f0 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece2b2c640 1 -- 172.21.15.83:0/1655881811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecdc1586e0 con 0x7fecdc1578f0 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece2b2c640 1 -- 172.21.15.83:0/1655881811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecdc09e540 con 0x7fecdc1578f0 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecd97fa640 1 -- 172.21.15.83:0/1655881811 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fecc40039c0 con 0x7fecdc1578f0 2024-03-30T13:09:25.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecd97fa640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fecbc067ff0 0x7fecbc06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fece08c8640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fecbc067ff0 0x7fecbc06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.607+0000 7fecd97fa640 1 -- 172.21.15.83:0/1655881811 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fecc4085ad0 con 0x7fecdc1578f0 2024-03-30T13:09:25.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.611+0000 7fece08c8640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fecbc067ff0 0x7fecbc06a4b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fecd40ad000 tx=0x7fecd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:25.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.611+0000 7fecd97fa640 1 -- 172.21.15.83:0/1655881811 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fecc40565e0 con 0x7fecdc1578f0 2024-03-30T13:09:25.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.819+0000 7fece2b2c640 1 -- 172.21.15.83:0/1655881811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fecdc0afe50 con 0x7fecdc1578f0 2024-03-30T13:09:25.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fecd97fa640 1 -- 172.21.15.83:0/1655881811 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7fecc4055ee0 con 0x7fecdc1578f0 2024-03-30T13:09:25.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fece2b2c640 1 -- 172.21.15.83:0/1655881811 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fecbc067ff0 msgr2=0x7fecbc06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fece2b2c640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fecbc067ff0 0x7fecbc06a4b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fecd40ad000 tx=0x7fecd4009040 comp rx=0 tx=0).stop 2024-03-30T13:09:25.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fece2b2c640 1 -- 172.21.15.83:0/1655881811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecdc1578f0 msgr2=0x7fecdc159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fece2b2c640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecdc1578f0 0x7fecdc159a30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fecc400e500 tx=0x7fecc400e9c0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fece2b2c640 1 -- 172.21.15.83:0/1655881811 shutdown_connections 2024-03-30T13:09:25.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fece2b2c640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fecbc067ff0 0x7fecbc06a4b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fece2b2c640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fecdc09bd90 0x7fecdc09c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fece2b2c640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecdc1578f0 0x7fecdc159a30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fece2b2c640 1 --2- 172.21.15.83:0/1655881811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fecc8003a10 0x7fecdc156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fece2b2c640 1 -- 172.21.15.83:0/1655881811 >> 172.21.15.83:0/1655881811 conn(0x7fecdc06b660 msgr2=0x7fecdc0b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:25.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fece2b2c640 1 -- 172.21.15.83:0/1655881811 shutdown_connections 2024-03-30T13:09:25.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.823+0000 7fece2b2c640 1 -- 172.21.15.83:0/1655881811 wait complete. 2024-03-30T13:09:25.845 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-30T13:09:25.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.947+0000 7fd061dc6640 1 Processor -- start 2024-03-30T13:09:25.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.947+0000 7fd061dc6640 1 -- start start 2024-03-30T13:09:25.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.947+0000 7fd061dc6640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd05c155a60 0x7fd05c0ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd061dc6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd05c15c270 0x7fd05c0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd061dc6640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05c0cf9e0 con 0x7fd05c06c670 2024-03-30T13:09:25.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd061dc6640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd05c06e840 con 0x7fd05c155a60 2024-03-30T13:09:25.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd061dc6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd05c0cfc60 con 0x7fd05c15c270 2024-03-30T13:09:25.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05bfff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd05c06c670 0x7fd05c06ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:53014/0 (socket says 172.21.15.83:53014) 2024-03-30T13:09:25.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05bfff640 1 -- 172.21.15.83:0/3052336191 learned_addr learned my addr 172.21.15.83:0/3052336191 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:25.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05b7fe640 1 --2- 172.21.15.83:0/3052336191 >> v2:172.21.15.153:3300/0 conn(0x7fd05c155a60 0x7fd05c0ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4267613436 0 0) 0x7fd0540014a0 con 0x7fd05c06c670 2024-03-30T13:09:25.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05affd640 1 --2- 172.21.15.83:0/3052336191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd05c15c270 0x7fd05c0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd044003530 con 0x7fd05c06c670 2024-03-30T13:09:25.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 365209336 0 0) 0x7fd044003530 con 0x7fd05c06c670 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd05c15c270 msgr2=0x7fd05c0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 --2- 172.21.15.83:0/3052336191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd05c15c270 0x7fd05c0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 >> v2:172.21.15.153:3300/0 conn(0x7fd05c155a60 msgr2=0x7fd05c0ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 --2- 172.21.15.83:0/3052336191 >> v2:172.21.15.153:3300/0 conn(0x7fd05c155a60 0x7fd05c0ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c0cff40 con 0x7fd05c06c670 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fd054001bd0 con 0x7fd05c06c670 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 >> v1:172.21.15.83:6789/0 conn(0x7fd05c06c670 legacy=0x7fd05c06ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 --2- 172.21.15.83:0/3052336191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd05c15c270 0x7fd0440039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 --2- 172.21.15.83:0/3052336191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044003f40 0x7fd044004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 --2- 172.21.15.83:0/3052336191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd044004d50 0x7fd0440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c06e840 con 0x7fd044004d50 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c0cfc60 con 0x7fd044003f40 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd04400ba20 con 0x7fd05c15c270 2024-03-30T13:09:25.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05bfff640 1 --2- 172.21.15.83:0/3052336191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd044004d50 0x7fd0440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05affd640 1 --2- 172.21.15.83:0/3052336191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044003f40 0x7fd044004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05b7fe640 1 --2- 172.21.15.83:0/3052336191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd05c15c270 0x7fd0440039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05bfff640 1 -- 172.21.15.83:0/3052336191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd05c15c270 msgr2=0x7fd0440039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:25.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05bfff640 1 --2- 172.21.15.83:0/3052336191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd05c15c270 0x7fd0440039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05bfff640 1 -- 172.21.15.83:0/3052336191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044003f40 msgr2=0x7fd044004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:25.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05bfff640 1 --2- 172.21.15.83:0/3052336191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044003f40 0x7fd044004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05bfff640 1 -- 172.21.15.83:0/3052336191 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd044003530 con 0x7fd044004d50 2024-03-30T13:09:25.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05bfff640 1 --2- 172.21.15.83:0/3052336191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd044004d50 0x7fd0440051d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd05400aaa0 tx=0x7fd05401fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efa205eb2e3187 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:25.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05400a690 con 0x7fd044004d50 2024-03-30T13:09:25.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.951+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0540ad070 con 0x7fd044004d50 2024-03-30T13:09:25.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd05a7fc640 1 -- 172.21.15.83:0/3052336191 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0540a99e0 con 0x7fd044004d50 2024-03-30T13:09:25.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 -- 172.21.15.83:0/3052336191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd044004d50 msgr2=0x7fd0440051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 --2- 172.21.15.83:0/3052336191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd044004d50 0x7fd0440051d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd05400aaa0 tx=0x7fd05401fb00 comp rx=0 tx=0).stop 2024-03-30T13:09:25.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd05bfff640 1 -- 172.21.15.83:0/3052336191 reap_dead start 2024-03-30T13:09:25.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 -- 172.21.15.83:0/3052336191 shutdown_connections 2024-03-30T13:09:25.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 -- 172.21.15.83:0/3052336191 >> 172.21.15.83:0/3052336191 conn(0x7fd05c072150 msgr2=0x7fd05c072560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:25.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 -- 172.21.15.83:0/3052336191 shutdown_connections 2024-03-30T13:09:25.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 -- 172.21.15.83:0/3052336191 wait complete. 2024-03-30T13:09:25.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 Processor -- start 2024-03-30T13:09:25.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 -- start start 2024-03-30T13:09:25.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd044004d50 0x7fd05c14cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd05c158800 0x7fd05c153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd05c13cc10 0x7fd05c13d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c15c6f0 con 0x7fd05c13cc10 2024-03-30T13:09:25.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c0d0500 con 0x7fd05c158800 2024-03-30T13:09:25.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd05c0cf4a0 con 0x7fd044004d50 2024-03-30T13:09:25.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd05bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd05c13cc10 0x7fd05c13d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd05bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd05c13cc10 0x7fd05c13d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51942/0 (socket says 172.21.15.83:51942) 2024-03-30T13:09:25.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd05bfff640 1 -- 172.21.15.83:0/2154512158 learned_addr learned my addr 172.21.15.83:0/2154512158 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:25.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd05bfff640 1 -- 172.21.15.83:0/2154512158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd044004d50 msgr2=0x7fd05c14cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd05bfff640 1 --2- 172.21.15.83:0/2154512158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd044004d50 0x7fd05c14cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd05bfff640 1 -- 172.21.15.83:0/2154512158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd05c158800 msgr2=0x7fd05c153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:25.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd05bfff640 1 --2- 172.21.15.83:0/2154512158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd05c158800 0x7fd05c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:25.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd05bfff640 1 -- 172.21.15.83:0/2154512158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c13d5d0 con 0x7fd05c13cc10 2024-03-30T13:09:25.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd05bfff640 1 --2- 172.21.15.83:0/2154512158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd05c13cc10 0x7fd05c13d090 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd054007040 tx=0x7fd044005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:25.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd043fff640 1 -- 172.21.15.83:0/2154512158 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05400a690 con 0x7fd05c13cc10 2024-03-30T13:09:25.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd043fff640 1 -- 172.21.15.83:0/2154512158 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0540a9720 con 0x7fd05c13cc10 2024-03-30T13:09:25.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 -- 172.21.15.83:0/2154512158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05c154a00 con 0x7fd05c13cc10 2024-03-30T13:09:25.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd043fff640 1 -- 172.21.15.83:0/2154512158 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0540a9ad0 con 0x7fd05c13cc10 2024-03-30T13:09:25.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.955+0000 7fd061dc6640 1 -- 172.21.15.83:0/2154512158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05c154440 con 0x7fd05c13cc10 2024-03-30T13:09:25.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.959+0000 7fd061dc6640 1 -- 172.21.15.83:0/2154512158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05c0736e0 con 0x7fd05c13cc10 2024-03-30T13:09:25.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.959+0000 7fd043fff640 1 -- 172.21.15.83:0/2154512158 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fd0540a9c70 con 0x7fd05c13cc10 2024-03-30T13:09:25.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.959+0000 7fd043fff640 1 --2- 172.21.15.83:0/2154512158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd048067ff0 0x7fd04806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:25.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.959+0000 7fd043fff640 1 -- 172.21.15.83:0/2154512158 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fd054123990 con 0x7fd05c13cc10 2024-03-30T13:09:25.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.959+0000 7fd05b7fe640 1 --2- 172.21.15.83:0/2154512158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd048067ff0 0x7fd04806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:25.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.959+0000 7fd05b7fe640 1 --2- 172.21.15.83:0/2154512158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd048067ff0 0x7fd04806a4b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0099b0 tx=0x7fd04c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:25.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:25.963+0000 7fd043fff640 1 -- 172.21.15.83:0/2154512158 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fd05c0cf9e0 con 0x7fd05c13cc10 2024-03-30T13:09:26.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.163+0000 7fd061dc6640 1 -- 172.21.15.83:0/2154512158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fd05c0cdb40 con 0x7fd05c13cc10 2024-03-30T13:09:26.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.167+0000 7fd043fff640 1 -- 172.21.15.83:0/2154512158 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7fd0540f4460 con 0x7fd05c13cc10 2024-03-30T13:09:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.171+0000 7fd061dc6640 1 -- 172.21.15.83:0/2154512158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd048067ff0 msgr2=0x7fd04806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.171+0000 7fd061dc6640 1 --2- 172.21.15.83:0/2154512158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd048067ff0 0x7fd04806a4b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0099b0 tx=0x7fd04c008040 comp rx=0 tx=0).stop 2024-03-30T13:09:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.171+0000 7fd061dc6640 1 -- 172.21.15.83:0/2154512158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd05c13cc10 msgr2=0x7fd05c13d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.171+0000 7fd061dc6640 1 --2- 172.21.15.83:0/2154512158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd05c13cc10 0x7fd05c13d090 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd054007040 tx=0x7fd044005840 comp rx=0 tx=0).stop 2024-03-30T13:09:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.171+0000 7fd061dc6640 1 -- 172.21.15.83:0/2154512158 shutdown_connections 2024-03-30T13:09:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.171+0000 7fd061dc6640 1 --2- 172.21.15.83:0/2154512158 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd048067ff0 0x7fd04806a4b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.171+0000 7fd061dc6640 1 --2- 172.21.15.83:0/2154512158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd05c13cc10 0x7fd05c13d090 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.171+0000 7fd061dc6640 1 --2- 172.21.15.83:0/2154512158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd05c158800 0x7fd05c153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.171+0000 7fd061dc6640 1 --2- 172.21.15.83:0/2154512158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd044004d50 0x7fd05c14cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.171+0000 7fd061dc6640 1 -- 172.21.15.83:0/2154512158 >> 172.21.15.83:0/2154512158 conn(0x7fd05c072150 msgr2=0x7fd05c0b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.171+0000 7fd061dc6640 1 -- 172.21.15.83:0/2154512158 shutdown_connections 2024-03-30T13:09:26.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.171+0000 7fd061dc6640 1 -- 172.21.15.83:0/2154512158 wait complete. 2024-03-30T13:09:26.191 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.303+0000 7f4ad3c57640 1 Processor -- start 2024-03-30T13:09:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.303+0000 7f4ad3c57640 1 -- start start 2024-03-30T13:09:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad3c57640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4acc0b4830 0x7f4acc15d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad3c57640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4acc06dfe0 0x7f4acc06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad3c57640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4acc15d880 con 0x7f4acc0aed20 2024-03-30T13:09:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad3c57640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4acc156e00 con 0x7f4acc06dfe0 2024-03-30T13:09:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad3c57640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4acc0ad040 con 0x7f4acc0b4830 2024-03-30T13:09:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad19f3640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4acc0b4830 0x7f4acc15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad21f4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4acc06dfe0 0x7f4acc06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad21f4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4acc06dfe0 0x7f4acc06e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:36678/0 (socket says 172.21.15.83:36678) 2024-03-30T13:09:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad11f2640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4acc0aed20 0x7f4acc0af1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:34538/0 (socket says 172.21.15.83:34538) 2024-03-30T13:09:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad21f4640 1 -- 172.21.15.83:0/1311340413 learned_addr learned my addr 172.21.15.83:0/1311340413 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad19f3640 1 -- 172.21.15.83:0/1311340413 >> v2:172.21.15.153:3300/0 conn(0x7f4acc06dfe0 msgr2=0x7f4acc06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad19f3640 1 --2- 172.21.15.83:0/1311340413 >> v2:172.21.15.153:3300/0 conn(0x7f4acc06dfe0 0x7f4acc06e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad19f3640 1 -- 172.21.15.83:0/1311340413 >> v1:172.21.15.153:6789/0 conn(0x7f4acc0aed20 legacy=0x7f4acc0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad19f3640 1 -- 172.21.15.83:0/1311340413 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4acc0cfcb0 con 0x7f4acc0b4830 2024-03-30T13:09:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.307+0000 7f4ad21f4640 1 --2- 172.21.15.83:0/1311340413 >> v2:172.21.15.153:3300/0 conn(0x7f4acc06dfe0 0x7f4acc06e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:09:26.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad19f3640 1 --2- 172.21.15.83:0/1311340413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4acc0b4830 0x7f4acc15d340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80097c0 tx=0x7f4ac801c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e28fc14a8d7ab991 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:26.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad09f1640 1 -- 172.21.15.83:0/1311340413 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80b0070 con 0x7f4acc0b4830 2024-03-30T13:09:26.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad09f1640 1 -- 172.21.15.83:0/1311340413 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac8004230 con 0x7f4acc0b4830 2024-03-30T13:09:26.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad09f1640 1 -- 172.21.15.83:0/1311340413 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8003620 con 0x7f4acc0b4830 2024-03-30T13:09:26.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 -- 172.21.15.83:0/1311340413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4acc0b4830 msgr2=0x7f4acc15d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 --2- 172.21.15.83:0/1311340413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4acc0b4830 0x7f4acc15d340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80097c0 tx=0x7f4ac801c350 comp rx=0 tx=0).stop 2024-03-30T13:09:26.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 -- 172.21.15.83:0/1311340413 shutdown_connections 2024-03-30T13:09:26.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 --2- 172.21.15.83:0/1311340413 >> v2:172.21.15.153:3300/0 conn(0x7f4acc06dfe0 0x7f4acc06e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 --2- 172.21.15.83:0/1311340413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4acc0b4830 0x7f4acc15d340 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 -- 172.21.15.83:0/1311340413 >> 172.21.15.83:0/1311340413 conn(0x7f4acc0b1d60 msgr2=0x7f4acc0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:26.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 -- 172.21.15.83:0/1311340413 shutdown_connections 2024-03-30T13:09:26.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 -- 172.21.15.83:0/1311340413 wait complete. 2024-03-30T13:09:26.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 Processor -- start 2024-03-30T13:09:26.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 -- start start 2024-03-30T13:09:26.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4acc06dfe0 0x7f4acc09c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4acc0aed20 0x7f4acc1401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4acc0b4830 0x7f4acc1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4acc0cf860 con 0x7f4acc0b4830 2024-03-30T13:09:26.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4acc06fa90 con 0x7f4acc06dfe0 2024-03-30T13:09:26.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad3c57640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4acc0cf9e0 con 0x7f4acc0aed20 2024-03-30T13:09:26.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad21f4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4acc0b4830 0x7f4acc1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad21f4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4acc0b4830 0x7f4acc1509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51944/0 (socket says 172.21.15.83:51944) 2024-03-30T13:09:26.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad21f4640 1 -- 172.21.15.83:0/2062817806 learned_addr learned my addr 172.21.15.83:0/2062817806 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:26.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad19f3640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4acc06dfe0 0x7f4acc09c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.311+0000 7f4ad11f2640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4acc0aed20 0x7f4acc1401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ad21f4640 1 -- 172.21.15.83:0/2062817806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4acc0aed20 msgr2=0x7f4acc1401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ad21f4640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4acc0aed20 0x7f4acc1401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ad21f4640 1 -- 172.21.15.83:0/2062817806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4acc06dfe0 msgr2=0x7f4acc09c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ad21f4640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4acc06dfe0 0x7f4acc09c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ad21f4640 1 -- 172.21.15.83:0/2062817806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4acc09a3d0 con 0x7f4acc0b4830 2024-03-30T13:09:26.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ad21f4640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4acc0b4830 0x7f4acc1509b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400efc0 tx=0x7f4ac400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:26.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ac27fc640 1 -- 172.21.15.83:0/2062817806 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac400cb20 con 0x7f4acc0b4830 2024-03-30T13:09:26.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ac27fc640 1 -- 172.21.15.83:0/2062817806 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac400ccc0 con 0x7f4acc0b4830 2024-03-30T13:09:26.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ac27fc640 1 -- 172.21.15.83:0/2062817806 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4003bc0 con 0x7f4acc0b4830 2024-03-30T13:09:26.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ad3c57640 1 -- 172.21.15.83:0/2062817806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4acc09a6b0 con 0x7f4acc0b4830 2024-03-30T13:09:26.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ad3c57640 1 -- 172.21.15.83:0/2062817806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4acc1406f0 con 0x7f4acc0b4830 2024-03-30T13:09:26.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ad3c57640 1 -- 172.21.15.83:0/2062817806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4acc0686c0 con 0x7f4acc0b4830 2024-03-30T13:09:26.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ac27fc640 1 -- 172.21.15.83:0/2062817806 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f4ac401b030 con 0x7f4acc0b4830 2024-03-30T13:09:26.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ac27fc640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4ab0067fc0 0x7f4ab006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ad19f3640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4ab0067fc0 0x7f4ab006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ac27fc640 1 -- 172.21.15.83:0/2062817806 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f4ac4086300 con 0x7f4acc0b4830 2024-03-30T13:09:26.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.315+0000 7f4ad19f3640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4ab0067fc0 0x7f4ab006a480 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80ad000 tx=0x7f4ac80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:26.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.319+0000 7f4ac27fc640 1 -- 172.21.15.83:0/2062817806 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f4ac4022020 con 0x7f4acc0b4830 2024-03-30T13:09:26.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.467+0000 7f4ad3c57640 1 -- 172.21.15.83:0/2062817806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4acc0b4ca0 con 0x7f4acc0b4830 2024-03-30T13:09:26.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ac27fc640 1 -- 172.21.15.83:0/2062817806 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+12867 (secure 0 0 0) 0x7f4ac4010040 con 0x7f4acc0b4830 2024-03-30T13:09:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:26.475 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":30,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:09:23.582863+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ad3c57640 1 -- 172.21.15.83:0/2062817806 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4ab0067fc0 msgr2=0x7f4ab006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ad3c57640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4ab0067fc0 0x7f4ab006a480 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80ad000 tx=0x7f4ac80a6000 comp rx=0 tx=0).stop 2024-03-30T13:09:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ad3c57640 1 -- 172.21.15.83:0/2062817806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4acc0b4830 msgr2=0x7f4acc1509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ad3c57640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4acc0b4830 0x7f4acc1509b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400efc0 tx=0x7f4ac400c490 comp rx=0 tx=0).stop 2024-03-30T13:09:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ad3c57640 1 -- 172.21.15.83:0/2062817806 shutdown_connections 2024-03-30T13:09:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ad3c57640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4ab0067fc0 0x7f4ab006a480 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ad3c57640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4acc0b4830 0x7f4acc1509b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ad3c57640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4acc0aed20 0x7f4acc1401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ad3c57640 1 --2- 172.21.15.83:0/2062817806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4acc06dfe0 0x7f4acc09c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ad3c57640 1 -- 172.21.15.83:0/2062817806 >> 172.21.15.83:0/2062817806 conn(0x7f4acc0b1d60 msgr2=0x7f4acc0afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:26.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ad3c57640 1 -- 172.21.15.83:0/2062817806 shutdown_connections 2024-03-30T13:09:26.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.471+0000 7f4ad3c57640 1 -- 172.21.15.83:0/2062817806 wait complete. 2024-03-30T13:09:26.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:09:26.493 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:09:26.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.603+0000 7f514fe0a640 1 Processor -- start 2024-03-30T13:09:26.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514fe0a640 1 -- start start 2024-03-30T13:09:26.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514fe0a640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f514815c8e0 0x7f51480ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514fe0a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51480adac0 0x7f514815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514fe0a640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51480ae040 con 0x7f514815d200 2024-03-30T13:09:26.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514fe0a640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f51480b31e0 con 0x7f514815c8e0 2024-03-30T13:09:26.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514fe0a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f51480ae320 con 0x7f51480adac0 2024-03-30T13:09:26.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514dba6640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f514815c8e0 0x7f51480ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514dba6640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f514815c8e0 0x7f51480ad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51952/0 (socket says 172.21.15.83:51952) 2024-03-30T13:09:26.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514e3a7640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f514815d200 0x7f51480b3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:53020/0 (socket says 172.21.15.83:53020) 2024-03-30T13:09:26.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514dba6640 1 -- 172.21.15.83:0/3980677620 learned_addr learned my addr 172.21.15.83:0/3980677620 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:26.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514d3a5640 1 --2- 172.21.15.83:0/3980677620 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51480adac0 0x7f514815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514dba6640 1 -- 172.21.15.83:0/3980677620 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51480adac0 msgr2=0x7f514815ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:26.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514dba6640 1 --2- 172.21.15.83:0/3980677620 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51480adac0 0x7f514815ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514dba6640 1 -- 172.21.15.83:0/3980677620 >> v1:172.21.15.83:6789/0 conn(0x7f514815d200 legacy=0x7f51480b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514dba6640 1 -- 172.21.15.83:0/3980677620 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51480ae600 con 0x7f514815c8e0 2024-03-30T13:09:26.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514d3a5640 1 --2- 172.21.15.83:0/3980677620 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51480adac0 0x7f514815ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:26.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514dba6640 1 --2- 172.21.15.83:0/3980677620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f514815c8e0 0x7f51480ad580 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5140009870 tx=0x7f514001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbbfb0195c9a737 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:26.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514cba4640 1 -- 172.21.15.83:0/3980677620 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400a7070 con 0x7f514815c8e0 2024-03-30T13:09:26.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514cba4640 1 -- 172.21.15.83:0/3980677620 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51400b0070 con 0x7f514815c8e0 2024-03-30T13:09:26.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.607+0000 7f514cba4640 1 -- 172.21.15.83:0/3980677620 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400ab890 con 0x7f514815c8e0 2024-03-30T13:09:26.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 -- 172.21.15.83:0/3980677620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f514815c8e0 msgr2=0x7f51480ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 --2- 172.21.15.83:0/3980677620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f514815c8e0 0x7f51480ad580 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5140009870 tx=0x7f514001c560 comp rx=0 tx=0).stop 2024-03-30T13:09:26.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 -- 172.21.15.83:0/3980677620 shutdown_connections 2024-03-30T13:09:26.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 --2- 172.21.15.83:0/3980677620 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51480adac0 0x7f514815ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 --2- 172.21.15.83:0/3980677620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f514815c8e0 0x7f51480ad580 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 -- 172.21.15.83:0/3980677620 >> 172.21.15.83:0/3980677620 conn(0x7f514806b660 msgr2=0x7f514806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:26.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 -- 172.21.15.83:0/3980677620 shutdown_connections 2024-03-30T13:09:26.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 -- 172.21.15.83:0/3980677620 wait complete. 2024-03-30T13:09:26.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 Processor -- start 2024-03-30T13:09:26.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 -- start start 2024-03-30T13:09:26.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51480adac0 0x7f51480721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f514815c8e0 0x7f51480cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815d200 0x7f514814b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f51480b4710 con 0x7f51480adac0 2024-03-30T13:09:26.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51480b4590 con 0x7f514815d200 2024-03-30T13:09:26.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f51480b4890 con 0x7f514815c8e0 2024-03-30T13:09:26.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514dba6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51480adac0 0x7f51480721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514dba6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51480adac0 0x7f51480721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51954/0 (socket says 172.21.15.83:51954) 2024-03-30T13:09:26.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514dba6640 1 -- 172.21.15.83:0/3323003704 learned_addr learned my addr 172.21.15.83:0/3323003704 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:26.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514dba6640 1 -- 172.21.15.83:0/3323003704 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f514815c8e0 msgr2=0x7f51480cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514dba6640 1 --2- 172.21.15.83:0/3323003704 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f514815c8e0 0x7f51480cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514dba6640 1 -- 172.21.15.83:0/3323003704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815d200 msgr2=0x7f514814b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514dba6640 1 --2- 172.21.15.83:0/3323003704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815d200 0x7f514814b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514dba6640 1 -- 172.21.15.83:0/3323003704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51480ca780 con 0x7f51480adac0 2024-03-30T13:09:26.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514dba6640 1 --2- 172.21.15.83:0/3323003704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51480adac0 0x7f51480721a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f514001ac10 tx=0x7f514001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:26.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f513a7fc640 1 -- 172.21.15.83:0/3323003704 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400b4800 con 0x7f51480adac0 2024-03-30T13:09:26.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f513a7fc640 1 -- 172.21.15.83:0/3323003704 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51400b49c0 con 0x7f51480adac0 2024-03-30T13:09:26.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f513a7fc640 1 -- 172.21.15.83:0/3323003704 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400b4db0 con 0x7f51480adac0 2024-03-30T13:09:26.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 -- 172.21.15.83:0/3323003704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51480caa60 con 0x7f51480adac0 2024-03-30T13:09:26.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 -- 172.21.15.83:0/3323003704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51480cb020 con 0x7f51480adac0 2024-03-30T13:09:26.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.611+0000 7f514fe0a640 1 -- 172.21.15.83:0/3323003704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f514804f9e0 con 0x7f51480adac0 2024-03-30T13:09:26.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.615+0000 7f513a7fc640 1 -- 172.21.15.83:0/3323003704 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f51400b3380 con 0x7f51480adac0 2024-03-30T13:09:26.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.615+0000 7f513a7fc640 1 --2- 172.21.15.83:0/3323003704 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f512c067fc0 0x7f512c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.615+0000 7f513a7fc640 1 -- 172.21.15.83:0/3323003704 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f5140120020 con 0x7f51480adac0 2024-03-30T13:09:26.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.615+0000 7f514d3a5640 1 --2- 172.21.15.83:0/3323003704 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f512c067fc0 0x7f512c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.615+0000 7f514d3a5640 1 --2- 172.21.15.83:0/3323003704 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f512c067fc0 0x7f512c06a480 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5148072e90 tx=0x7f513c008330 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:26.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.619+0000 7f513a7fc640 1 -- 172.21.15.83:0/3323003704 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5140016150 con 0x7f51480adac0 2024-03-30T13:09:26.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.779+0000 7f514fe0a640 1 -- 172.21.15.83:0/3323003704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5148156590 con 0x7f51480adac0 2024-03-30T13:09:26.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.779+0000 7f513a7fc640 1 -- 172.21.15.83:0/3323003704 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) ==== 93+0+10 (secure 0 0 0) 0x7f51400abe20 con 0x7f51480adac0 2024-03-30T13:09:26.784 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:09:26.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.779+0000 7f514fe0a640 1 -- 172.21.15.83:0/3323003704 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f512c067fc0 msgr2=0x7f512c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.779+0000 7f514fe0a640 1 --2- 172.21.15.83:0/3323003704 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f512c067fc0 0x7f512c06a480 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5148072e90 tx=0x7f513c008330 comp rx=0 tx=0).stop 2024-03-30T13:09:26.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.779+0000 7f514fe0a640 1 -- 172.21.15.83:0/3323003704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51480adac0 msgr2=0x7f51480721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.779+0000 7f514fe0a640 1 --2- 172.21.15.83:0/3323003704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51480adac0 0x7f51480721a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f514001ac10 tx=0x7f514001ada0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.779+0000 7f514fe0a640 1 -- 172.21.15.83:0/3323003704 shutdown_connections 2024-03-30T13:09:26.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.779+0000 7f514fe0a640 1 --2- 172.21.15.83:0/3323003704 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f512c067fc0 0x7f512c06a480 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.779+0000 7f514fe0a640 1 --2- 172.21.15.83:0/3323003704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f514815d200 0x7f514814b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.779+0000 7f514fe0a640 1 --2- 172.21.15.83:0/3323003704 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f514815c8e0 0x7f51480cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.779+0000 7f514fe0a640 1 --2- 172.21.15.83:0/3323003704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51480adac0 0x7f51480721a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.779+0000 7f514fe0a640 1 -- 172.21.15.83:0/3323003704 >> 172.21.15.83:0/3323003704 conn(0x7f514806b660 msgr2=0x7f51481548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:26.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.783+0000 7f514fe0a640 1 -- 172.21.15.83:0/3323003704 shutdown_connections 2024-03-30T13:09:26.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.783+0000 7f514fe0a640 1 -- 172.21.15.83:0/3323003704 wait complete. 2024-03-30T13:09:26.802 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-30T13:09:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.915+0000 7ffaa566f640 1 Processor -- start 2024-03-30T13:09:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.915+0000 7ffaa566f640 1 -- start start 2024-03-30T13:09:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffaa566f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffaa00d4950 0x7ffaa015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffaa566f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaa006c6a0 con 0x7ffaa015e500 2024-03-30T13:09:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffaa566f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaa00cfb30 con 0x7ffaa00cee20 2024-03-30T13:09:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffaa566f640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa00d2340 con 0x7ffaa00d4950 2024-03-30T13:09:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9effd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ffaa015e500 0x7ffaa00d4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:39952/0 (socket says 172.21.15.83:39952) 2024-03-30T13:09:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9effd640 1 -- 172.21.15.83:0/355070836 learned_addr learned my addr 172.21.15.83:0/355070836 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9e7fc640 1 --2- 172.21.15.83:0/355070836 >> v2:172.21.15.153:3300/0 conn(0x7ffaa00d4950 0x7ffaa015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826923090 0 0) 0x7ffaa006c6a0 con 0x7ffaa015e500 2024-03-30T13:09:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa88003530 con 0x7ffaa015e500 2024-03-30T13:09:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3937410169 0 0) 0x7ffa88003530 con 0x7ffaa015e500 2024-03-30T13:09:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 >> v2:172.21.15.153:3300/0 conn(0x7ffaa00d4950 msgr2=0x7ffaa015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 --2- 172.21.15.83:0/355070836 >> v2:172.21.15.153:3300/0 conn(0x7ffaa00d4950 0x7ffaa015e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 >> v1:172.21.15.153:6789/0 conn(0x7ffaa00cee20 legacy=0x7ffaa00cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa00cfe10 con 0x7ffaa015e500 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7ffa90001680 con 0x7ffaa015e500 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 >> v1:172.21.15.83:6789/0 conn(0x7ffaa015e500 legacy=0x7ffaa00d4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 --2- 172.21.15.83:0/355070836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa880039c0 0x7ffa88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 --2- 172.21.15.83:0/355070836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa88004810 0x7ffa88004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 --2- 172.21.15.83:0/355070836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 0x7ffa8800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa00d2340 con 0x7ffa880051d0 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8800c070 con 0x7ffa88004810 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffa8800c270 con 0x7ffa880039c0 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9f7fe640 1 --2- 172.21.15.83:0/355070836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 0x7ffa8800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9e7fc640 1 --2- 172.21.15.83:0/355070836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa88004810 0x7ffa88004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9effd640 1 --2- 172.21.15.83:0/355070836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa880039c0 0x7ffa88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9f7fe640 1 -- 172.21.15.83:0/355070836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa880039c0 msgr2=0x7ffa88003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:26.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9f7fe640 1 --2- 172.21.15.83:0/355070836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa880039c0 0x7ffa88003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9f7fe640 1 -- 172.21.15.83:0/355070836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa88004810 msgr2=0x7ffa88004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:26.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9f7fe640 1 --2- 172.21.15.83:0/355070836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa88004810 0x7ffa88004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.919+0000 7ffa9f7fe640 1 -- 172.21.15.83:0/355070836 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa88003530 con 0x7ffa880051d0 2024-03-30T13:09:26.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9f7fe640 1 -- 172.21.15.83:0/355070836 reap_dead start 2024-03-30T13:09:26.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9f7fe640 1 --2- 172.21.15.83:0/355070836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 0x7ffa8800b9d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ffa98001e70 tx=0x7ffa9801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293c451242c4dacc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:26.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98001a90 con 0x7ffa880051d0 2024-03-30T13:09:26.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa98003bc0 con 0x7ffa880051d0 2024-03-30T13:09:26.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9dffb640 1 -- 172.21.15.83:0/355070836 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98005020 con 0x7ffa880051d0 2024-03-30T13:09:26.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 -- 172.21.15.83:0/355070836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 msgr2=0x7ffa8800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 --2- 172.21.15.83:0/355070836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 0x7ffa8800b9d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ffa98001e70 tx=0x7ffa9801c780 comp rx=0 tx=0).stop 2024-03-30T13:09:26.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 -- 172.21.15.83:0/355070836 shutdown_connections 2024-03-30T13:09:26.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 --2- 172.21.15.83:0/355070836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 0x7ffa8800b9d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 -- 172.21.15.83:0/355070836 >> 172.21.15.83:0/355070836 conn(0x7ffaa008bfe0 msgr2=0x7ffaa009d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:26.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 -- 172.21.15.83:0/355070836 shutdown_connections 2024-03-30T13:09:26.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 -- 172.21.15.83:0/355070836 wait complete. 2024-03-30T13:09:26.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 Processor -- start 2024-03-30T13:09:26.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 -- start start 2024-03-30T13:09:26.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 0x7ffaa015be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa01f4100 0x7ffaa01f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaa00cd840 0x7ffaa00cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa015e8e0 con 0x7ffa880051d0 2024-03-30T13:09:26.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa006c960 con 0x7ffaa01f4100 2024-03-30T13:09:26.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffaa566f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa015ea60 con 0x7ffaa00cd840 2024-03-30T13:09:26.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 0x7ffaa015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 0x7ffaa015be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45402/0 (socket says 172.21.15.83:45402) 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9effd640 1 -- 172.21.15.83:0/2825691052 learned_addr learned my addr 172.21.15.83:0/2825691052 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9f7fe640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaa00cd840 0x7ffaa00cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9e7fc640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa01f4100 0x7ffaa01f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9effd640 1 -- 172.21.15.83:0/2825691052 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaa00cd840 msgr2=0x7ffaa00cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9effd640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaa00cd840 0x7ffaa00cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9effd640 1 -- 172.21.15.83:0/2825691052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa01f4100 msgr2=0x7ffaa01f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9effd640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa01f4100 0x7ffaa01f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9effd640 1 -- 172.21.15.83:0/2825691052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa01f4c20 con 0x7ffa880051d0 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9e7fc640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa01f4100 0x7ffaa01f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.923+0000 7ffa9effd640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 0x7ffaa015be70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000e7f0 tx=0x7ffa9000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.927+0000 7ffa877fe640 1 -- 172.21.15.83:0/2825691052 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000c870 con 0x7ffa880051d0 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.927+0000 7ffa877fe640 1 -- 172.21.15.83:0/2825691052 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa90018070 con 0x7ffa880051d0 2024-03-30T13:09:26.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.927+0000 7ffaa566f640 1 -- 172.21.15.83:0/2825691052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa01f4f00 con 0x7ffa880051d0 2024-03-30T13:09:26.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.927+0000 7ffa877fe640 1 -- 172.21.15.83:0/2825691052 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000cc70 con 0x7ffa880051d0 2024-03-30T13:09:26.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.927+0000 7ffaa566f640 1 -- 172.21.15.83:0/2825691052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa00c9040 con 0x7ffa880051d0 2024-03-30T13:09:26.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.927+0000 7ffaa566f640 1 -- 172.21.15.83:0/2825691052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa00686c0 con 0x7ffa880051d0 2024-03-30T13:09:26.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.927+0000 7ffa877fe640 1 -- 172.21.15.83:0/2825691052 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ffa9001d460 con 0x7ffa880051d0 2024-03-30T13:09:26.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.927+0000 7ffa877fe640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ffa8c068010 0x7ffa8c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:26.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.927+0000 7ffa877fe640 1 -- 172.21.15.83:0/2825691052 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7ffa90085ff0 con 0x7ffa880051d0 2024-03-30T13:09:26.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.927+0000 7ffa9e7fc640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ffa8c068010 0x7ffa8c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:26.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.927+0000 7ffa9e7fc640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ffa8c068010 0x7ffa8c06a4d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffaa015da50 tx=0x7ffa94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:26.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:26.931+0000 7ffa877fe640 1 -- 172.21.15.83:0/2825691052 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ffa90056b40 con 0x7ffa880051d0 2024-03-30T13:09:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 -- 172.21.15.83:0/2825691052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ffaa00c9210 con 0x7ffa880051d0 2024-03-30T13:09:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffa877fe640 1 -- 172.21.15.83:0/2825691052 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7ffa90056440 con 0x7ffa880051d0 2024-03-30T13:09:27.099 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:27.099 INFO:teuthology.orchestra.run.smithi083.stdout:[ 2024-03-30T13:09:27.099 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:09:27.099 INFO:teuthology.orchestra.run.smithi083.stdout: "poolnum": 1, 2024-03-30T13:09:27.099 INFO:teuthology.orchestra.run.smithi083.stdout: "poolname": ".mgr" 2024-03-30T13:09:27.100 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:27.100 INFO:teuthology.orchestra.run.smithi083.stdout:] 2024-03-30T13:09:27.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 -- 172.21.15.83:0/2825691052 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ffa8c068010 msgr2=0x7ffa8c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ffa8c068010 0x7ffa8c06a4d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffaa015da50 tx=0x7ffa94008040 comp rx=0 tx=0).stop 2024-03-30T13:09:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 -- 172.21.15.83:0/2825691052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 msgr2=0x7ffaa015be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 0x7ffaa015be70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000e7f0 tx=0x7ffa9000ecb0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 -- 172.21.15.83:0/2825691052 shutdown_connections 2024-03-30T13:09:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ffa8c068010 0x7ffa8c06a4d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaa00cd840 0x7ffaa00cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa01f4100 0x7ffaa01f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 --2- 172.21.15.83:0/2825691052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa880051d0 0x7ffaa015be70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 -- 172.21.15.83:0/2825691052 >> 172.21.15.83:0/2825691052 conn(0x7ffaa008bfe0 msgr2=0x7ffaa006cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 -- 172.21.15.83:0/2825691052 shutdown_connections 2024-03-30T13:09:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.095+0000 7ffaa566f640 1 -- 172.21.15.83:0/2825691052 wait complete. 2024-03-30T13:09:27.118 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-30T13:09:27.118 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-30T13:09:27.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.235+0000 7f88f790a640 1 Processor -- start 2024-03-30T13:09:27.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.235+0000 7f88f790a640 1 -- start start 2024-03-30T13:09:27.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.235+0000 7f88f790a640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f88f00d1590 0x7f88f00cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:27.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.235+0000 7f88f790a640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f00d20e0 con 0x7f88f00d4ed0 2024-03-30T13:09:27.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.235+0000 7f88f790a640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f00cfbb0 con 0x7f88f015e770 2024-03-30T13:09:27.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.235+0000 7f88f790a640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f88f015eb50 con 0x7f88f00d1590 2024-03-30T13:09:27.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.235+0000 7f88f4ea5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f88f00d1590 0x7f88f00cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:27.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.235+0000 7f88f5ea7640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f88f00d4ed0 0x7f88f00d2ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:39968/0 (socket says 172.21.15.83:39968) 2024-03-30T13:09:27.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.235+0000 7f88f5ea7640 1 -- 172.21.15.83:0/2476820349 learned_addr learned my addr 172.21.15.83:0/2476820349 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:27.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.235+0000 7f88f4ea5640 1 -- 172.21.15.83:0/2476820349 >> v1:172.21.15.153:6789/0 conn(0x7f88f015e770 legacy=0x7f88f00d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:27.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.235+0000 7f88f4ea5640 1 -- 172.21.15.83:0/2476820349 >> v1:172.21.15.83:6789/0 conn(0x7f88f00d4ed0 legacy=0x7f88f00d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:27.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.235+0000 7f88f4ea5640 1 -- 172.21.15.83:0/2476820349 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f00d23a0 con 0x7f88f00d1590 2024-03-30T13:09:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88f4ea5640 1 --2- 172.21.15.83:0/2476820349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88f00d1590 0x7f88f00cf4a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f88e00097a0 tx=0x7f88e001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7c7037e967843f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88e7fff640 1 -- 172.21.15.83:0/2476820349 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e00b0070 con 0x7f88f00d1590 2024-03-30T13:09:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88e7fff640 1 -- 172.21.15.83:0/2476820349 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e0004230 con 0x7f88f00d1590 2024-03-30T13:09:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88e7fff640 1 -- 172.21.15.83:0/2476820349 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0003620 con 0x7f88f00d1590 2024-03-30T13:09:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88f790a640 1 -- 172.21.15.83:0/2476820349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88f00d1590 msgr2=0x7f88f00cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88f790a640 1 --2- 172.21.15.83:0/2476820349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88f00d1590 0x7f88f00cf4a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f88e00097a0 tx=0x7f88e001c440 comp rx=0 tx=0).stop 2024-03-30T13:09:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88f790a640 1 -- 172.21.15.83:0/2476820349 shutdown_connections 2024-03-30T13:09:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88f790a640 1 --2- 172.21.15.83:0/2476820349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88f00d1590 0x7f88f00cf4a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88f790a640 1 -- 172.21.15.83:0/2476820349 >> 172.21.15.83:0/2476820349 conn(0x7f88f008bfe0 msgr2=0x7f88f00d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88f790a640 1 -- 172.21.15.83:0/2476820349 shutdown_connections 2024-03-30T13:09:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88f790a640 1 -- 172.21.15.83:0/2476820349 wait complete. 2024-03-30T13:09:27.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88f790a640 1 Processor -- start 2024-03-30T13:09:27.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.239+0000 7f88f790a640 1 -- start start 2024-03-30T13:09:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f790a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88f00d1590 0x7f88f0152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f790a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88f00d4ed0 0x7f88f015ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f790a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88f015e770 0x7f88f01609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f790a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f88f00d3c40 con 0x7f88f00d1590 2024-03-30T13:09:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f790a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f88f00d3ac0 con 0x7f88f00d4ed0 2024-03-30T13:09:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f790a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f88f00d3dc0 con 0x7f88f015e770 2024-03-30T13:09:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f56a6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88f00d1590 0x7f88f0152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f56a6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88f00d1590 0x7f88f0152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45416/0 (socket says 172.21.15.83:45416) 2024-03-30T13:09:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f56a6640 1 -- 172.21.15.83:0/1199463419 learned_addr learned my addr 172.21.15.83:0/1199463419 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:27.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f56a6640 1 -- 172.21.15.83:0/1199463419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88f015e770 msgr2=0x7f88f01609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:27.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f56a6640 1 --2- 172.21.15.83:0/1199463419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88f015e770 0x7f88f01609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f56a6640 1 -- 172.21.15.83:0/1199463419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88f00d4ed0 msgr2=0x7f88f015ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:27.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f56a6640 1 --2- 172.21.15.83:0/1199463419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88f00d4ed0 0x7f88f015ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f56a6640 1 -- 172.21.15.83:0/1199463419 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f00c86e0 con 0x7f88f00d1590 2024-03-30T13:09:27.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f56a6640 1 --2- 172.21.15.83:0/1199463419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88f00d1590 0x7f88f0152950 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00b410 tx=0x7f88ec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:27.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88e5ffb640 1 -- 172.21.15.83:0/1199463419 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec015030 con 0x7f88f00d1590 2024-03-30T13:09:27.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88e5ffb640 1 -- 172.21.15.83:0/1199463419 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ec004020 con 0x7f88f00d1590 2024-03-30T13:09:27.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f790a640 1 -- 172.21.15.83:0/1199463419 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f00c89c0 con 0x7f88f00d1590 2024-03-30T13:09:27.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88e5ffb640 1 -- 172.21.15.83:0/1199463419 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec004410 con 0x7f88f00d1590 2024-03-30T13:09:27.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f790a640 1 -- 172.21.15.83:0/1199463419 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f00c8f80 con 0x7f88f00d1590 2024-03-30T13:09:27.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f790a640 1 -- 172.21.15.83:0/1199463419 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f00686c0 con 0x7f88f00d1590 2024-03-30T13:09:27.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88e5ffb640 1 -- 172.21.15.83:0/1199463419 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f88ec018070 con 0x7f88f00d1590 2024-03-30T13:09:27.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88e5ffb640 1 --2- 172.21.15.83:0/1199463419 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f88d4067fc0 0x7f88d406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:27.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88e5ffb640 1 -- 172.21.15.83:0/1199463419 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f88ec085cc0 con 0x7f88f00d1590 2024-03-30T13:09:27.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f4ea5640 1 --2- 172.21.15.83:0/1199463419 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f88d4067fc0 0x7f88d406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:27.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.243+0000 7f88f4ea5640 1 --2- 172.21.15.83:0/1199463419 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f88d4067fc0 0x7f88d406a480 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f88e00ad000 tx=0x7f88e0004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:27.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.247+0000 7f88e5ffb640 1 -- 172.21.15.83:0/1199463419 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f88ec056850 con 0x7f88f00d1590 2024-03-30T13:09:27.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.395+0000 7f88f790a640 1 -- 172.21.15.83:0/1199463419 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f88f00b6920 con 0x7f88f00d1590 2024-03-30T13:09:27.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.827+0000 7f88e5ffb640 1 -- 172.21.15.83:0/1199463419 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7f88ec056150 con 0x7f88f00d1590 2024-03-30T13:09:27.835 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' created 2024-03-30T13:09:27.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.831+0000 7f88f790a640 1 -- 172.21.15.83:0/1199463419 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f88d4067fc0 msgr2=0x7f88d406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:27.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.831+0000 7f88f790a640 1 --2- 172.21.15.83:0/1199463419 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f88d4067fc0 0x7f88d406a480 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f88e00ad000 tx=0x7f88e0004740 comp rx=0 tx=0).stop 2024-03-30T13:09:27.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.831+0000 7f88f790a640 1 -- 172.21.15.83:0/1199463419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88f00d1590 msgr2=0x7f88f0152950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:27.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.831+0000 7f88f790a640 1 --2- 172.21.15.83:0/1199463419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88f00d1590 0x7f88f0152950 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00b410 tx=0x7f88ec00b8d0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.831+0000 7f88f790a640 1 -- 172.21.15.83:0/1199463419 shutdown_connections 2024-03-30T13:09:27.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.831+0000 7f88f790a640 1 --2- 172.21.15.83:0/1199463419 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f88d4067fc0 0x7f88d406a480 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.831+0000 7f88f790a640 1 --2- 172.21.15.83:0/1199463419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88f015e770 0x7f88f01609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.831+0000 7f88f790a640 1 --2- 172.21.15.83:0/1199463419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88f00d4ed0 0x7f88f015ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.831+0000 7f88f790a640 1 --2- 172.21.15.83:0/1199463419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88f00d1590 0x7f88f0152950 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.831+0000 7f88f790a640 1 -- 172.21.15.83:0/1199463419 >> 172.21.15.83:0/1199463419 conn(0x7f88f008bfe0 msgr2=0x7f88f00b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:27.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.831+0000 7f88f790a640 1 -- 172.21.15.83:0/1199463419 shutdown_connections 2024-03-30T13:09:27.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.831+0000 7f88f790a640 1 -- 172.21.15.83:0/1199463419 wait complete. 2024-03-30T13:09:27.863 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-30T13:09:27.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff9152fa640 1 Processor -- start 2024-03-30T13:09:27.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff9152fa640 1 -- start start 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff9152fa640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff91015c8e0 0x7ff9100ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff9152fa640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff9100b4680 0x7ff910165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff9152fa640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9100ae040 con 0x7ff9100adac0 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff9152fa640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff9100b31e0 con 0x7ff9100b4680 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff9152fa640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff9100ae320 con 0x7ff91015c8e0 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff90f7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff9100b4680 0x7ff910165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff90f7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff9100b4680 0x7ff910165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45418/0 (socket says 172.21.15.83:45418) 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff90f7fe640 1 -- 172.21.15.83:0/3175739437 learned_addr learned my addr 172.21.15.83:0/3175739437 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff90effd640 1 --2- 172.21.15.83:0/3175739437 >> v2:172.21.15.153:3300/0 conn(0x7ff91015c8e0 0x7ff9100ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff90f7fe640 1 -- 172.21.15.83:0/3175739437 >> v2:172.21.15.153:3300/0 conn(0x7ff91015c8e0 msgr2=0x7ff9100ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff90f7fe640 1 --2- 172.21.15.83:0/3175739437 >> v2:172.21.15.153:3300/0 conn(0x7ff91015c8e0 0x7ff9100ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff90f7fe640 1 -- 172.21.15.83:0/3175739437 >> v1:172.21.15.153:6789/0 conn(0x7ff9100adac0 legacy=0x7ff91015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.991+0000 7ff90f7fe640 1 -- 172.21.15.83:0/3175739437 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9100ae600 con 0x7ff9100b4680 2024-03-30T13:09:27.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff90f7fe640 1 --2- 172.21.15.83:0/3175739437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9100b4680 0x7ff910165e90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff9100b4ee0 tx=0x7ff90801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20c96e428ddb1da server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:27.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff90dffb640 1 -- 172.21.15.83:0/3175739437 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9080a56c0 con 0x7ff9100b4680 2024-03-30T13:09:27.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff90dffb640 1 -- 172.21.15.83:0/3175739437 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9080a5860 con 0x7ff9100b4680 2024-03-30T13:09:27.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff90dffb640 1 -- 172.21.15.83:0/3175739437 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9080a5c30 con 0x7ff9100b4680 2024-03-30T13:09:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 -- 172.21.15.83:0/3175739437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9100b4680 msgr2=0x7ff910165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 --2- 172.21.15.83:0/3175739437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9100b4680 0x7ff910165e90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff9100b4ee0 tx=0x7ff90801c9f0 comp rx=0 tx=0).stop 2024-03-30T13:09:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 -- 172.21.15.83:0/3175739437 shutdown_connections 2024-03-30T13:09:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 --2- 172.21.15.83:0/3175739437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9100b4680 0x7ff910165e90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 --2- 172.21.15.83:0/3175739437 >> v2:172.21.15.153:3300/0 conn(0x7ff91015c8e0 0x7ff9100ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 -- 172.21.15.83:0/3175739437 >> 172.21.15.83:0/3175739437 conn(0x7ff91006b660 msgr2=0x7ff91006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 -- 172.21.15.83:0/3175739437 shutdown_connections 2024-03-30T13:09:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 -- 172.21.15.83:0/3175739437 wait complete. 2024-03-30T13:09:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 Processor -- start 2024-03-30T13:09:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 -- start start 2024-03-30T13:09:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9100adac0 0x7ff9101f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9100b4680 0x7ff910072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff91015c8e0 0x7ff910073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff910168f80 con 0x7ff91015c8e0 2024-03-30T13:09:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff910168e00 con 0x7ff9100b4680 2024-03-30T13:09:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.995+0000 7ff9152fa640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff910169100 con 0x7ff9100adac0 2024-03-30T13:09:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff91015c8e0 0x7ff910073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff91015c8e0 0x7ff910073210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45434/0 (socket says 172.21.15.83:45434) 2024-03-30T13:09:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90f7fe640 1 -- 172.21.15.83:0/3032619015 learned_addr learned my addr 172.21.15.83:0/3032619015 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90effd640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9100adac0 0x7ff9101f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90e7fc640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9100b4680 0x7ff910072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90f7fe640 1 -- 172.21.15.83:0/3032619015 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9100adac0 msgr2=0x7ff9101f7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90f7fe640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9100adac0 0x7ff9101f7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90f7fe640 1 -- 172.21.15.83:0/3032619015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9100b4680 msgr2=0x7ff910072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90f7fe640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9100b4680 0x7ff910072cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90f7fe640 1 -- 172.21.15.83:0/3032619015 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91014e7a0 con 0x7ff91015c8e0 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90e7fc640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9100b4680 0x7ff910072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90f7fe640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff91015c8e0 0x7ff910073210 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff9080af040 tx=0x7ff908019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff8f77fe640 1 -- 172.21.15.83:0/3032619015 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908009510 con 0x7ff91015c8e0 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff9152fa640 1 -- 172.21.15.83:0/3032619015 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9101f8920 con 0x7ff91015c8e0 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff8f77fe640 1 -- 172.21.15.83:0/3032619015 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9080be070 con 0x7ff91015c8e0 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff8f77fe640 1 -- 172.21.15.83:0/3032619015 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9080b88d0 con 0x7ff91015c8e0 2024-03-30T13:09:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff9152fa640 1 -- 172.21.15.83:0/3032619015 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff91014f070 con 0x7ff91015c8e0 2024-03-30T13:09:28.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff9152fa640 1 -- 172.21.15.83:0/3032619015 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff91014ee80 con 0x7ff91015c8e0 2024-03-30T13:09:28.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff8f77fe640 1 -- 172.21.15.83:0/3032619015 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff9080b8a70 con 0x7ff91015c8e0 2024-03-30T13:09:28.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff8f77fe640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff8fc067fc0 0x7ff8fc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:28.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff8f77fe640 1 -- 172.21.15.83:0/3032619015 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7ff908121aa0 con 0x7ff91015c8e0 2024-03-30T13:09:28.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90effd640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff8fc067fc0 0x7ff8fc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:28.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:27.999+0000 7ff90effd640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff8fc067fc0 0x7ff8fc06a480 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff90000b9d0 tx=0x7ff900008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:28.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.003+0000 7ff8f77fe640 1 -- 172.21.15.83:0/3032619015 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff9080165e0 con 0x7ff91015c8e0 2024-03-30T13:09:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.151+0000 7ff9152fa640 1 -- 172.21.15.83:0/3032619015 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff91015b530 con 0x7ff91015c8e0 2024-03-30T13:09:28.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.839+0000 7ff8f77fe640 1 -- 172.21.15.83:0/3032619015 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7ff9080f2430 con 0x7ff91015c8e0 2024-03-30T13:09:28.844 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' created 2024-03-30T13:09:28.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.843+0000 7ff9152fa640 1 -- 172.21.15.83:0/3032619015 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff8fc067fc0 msgr2=0x7ff8fc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:28.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.843+0000 7ff9152fa640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff8fc067fc0 0x7ff8fc06a480 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff90000b9d0 tx=0x7ff900008040 comp rx=0 tx=0).stop 2024-03-30T13:09:28.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.843+0000 7ff9152fa640 1 -- 172.21.15.83:0/3032619015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff91015c8e0 msgr2=0x7ff910073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:28.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.843+0000 7ff9152fa640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff91015c8e0 0x7ff910073210 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff9080af040 tx=0x7ff908019790 comp rx=0 tx=0).stop 2024-03-30T13:09:28.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.843+0000 7ff9152fa640 1 -- 172.21.15.83:0/3032619015 shutdown_connections 2024-03-30T13:09:28.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.843+0000 7ff9152fa640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff8fc067fc0 0x7ff8fc06a480 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:28.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.843+0000 7ff9152fa640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff91015c8e0 0x7ff910073210 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:28.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.843+0000 7ff9152fa640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9100b4680 0x7ff910072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:28.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.843+0000 7ff9152fa640 1 --2- 172.21.15.83:0/3032619015 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9100adac0 0x7ff9101f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:28.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.843+0000 7ff9152fa640 1 -- 172.21.15.83:0/3032619015 >> 172.21.15.83:0/3032619015 conn(0x7ff91006b660 msgr2=0x7ff91015a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:28.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.843+0000 7ff9152fa640 1 -- 172.21.15.83:0/3032619015 shutdown_connections 2024-03-30T13:09:28.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.843+0000 7ff9152fa640 1 -- 172.21.15.83:0/3032619015 wait complete. 2024-03-30T13:09:28.877 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-30T13:09:28.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f522cef9640 1 Processor -- start 2024-03-30T13:09:28.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f522cef9640 1 -- start start 2024-03-30T13:09:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f522cef9640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f522815e880 0x7f52280d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f522cef9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52280d2a30 0x7f52280cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f522cef9640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f52280d4230 0x7f52280d4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f522cef9640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f52280b4580 con 0x7f52280d4230 2024-03-30T13:09:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f522cef9640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f52280d3280 con 0x7f522815e880 2024-03-30T13:09:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f522cef9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f52280d3560 con 0x7f52280d2a30 2024-03-30T13:09:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f5226d9d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f52280d4230 0x7f52280d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f5226d9d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f52280d4230 0x7f52280d4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45450/0 (socket says 172.21.15.83:45450) 2024-03-30T13:09:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f5226d9d640 1 -- 172.21.15.83:0/3845400150 learned_addr learned my addr 172.21.15.83:0/3845400150 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:29.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f522659c640 1 --2- 172.21.15.83:0/3845400150 >> v2:172.21.15.153:3300/0 conn(0x7f522815e880 0x7f52280d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:29.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f5225d9b640 1 --2- 172.21.15.83:0/3845400150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52280d2a30 0x7f52280cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:29.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f5226d9d640 1 -- 172.21.15.83:0/3845400150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52280d2a30 msgr2=0x7f52280cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:29.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f5226d9d640 1 --2- 172.21.15.83:0/3845400150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52280d2a30 0x7f52280cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:29.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f5226d9d640 1 -- 172.21.15.83:0/3845400150 >> v2:172.21.15.153:3300/0 conn(0x7f522815e880 msgr2=0x7f52280d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:29.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f5226d9d640 1 --2- 172.21.15.83:0/3845400150 >> v2:172.21.15.153:3300/0 conn(0x7f522815e880 0x7f52280d1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:29.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.995+0000 7f5226d9d640 1 -- 172.21.15.83:0/3845400150 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52280b3f30 con 0x7f52280d4230 2024-03-30T13:09:29.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5226d9d640 1 --2- 172.21.15.83:0/3845400150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52280d4230 0x7f52280d4680 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f52280b7040 tx=0x7f522001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338662bca95fb823 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:29.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522559a640 1 -- 172.21.15.83:0/3845400150 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52200a5670 con 0x7f52280d4230 2024-03-30T13:09:29.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522559a640 1 -- 172.21.15.83:0/3845400150 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52200a5810 con 0x7f52280d4230 2024-03-30T13:09:29.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522559a640 1 -- 172.21.15.83:0/3845400150 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52200a5be0 con 0x7f52280d4230 2024-03-30T13:09:29.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 -- 172.21.15.83:0/3845400150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52280d4230 msgr2=0x7f52280d4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:29.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 --2- 172.21.15.83:0/3845400150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52280d4230 0x7f52280d4680 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f52280b7040 tx=0x7f522001c960 comp rx=0 tx=0).stop 2024-03-30T13:09:29.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 -- 172.21.15.83:0/3845400150 shutdown_connections 2024-03-30T13:09:29.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 --2- 172.21.15.83:0/3845400150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52280d4230 0x7f52280d4680 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:29.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 --2- 172.21.15.83:0/3845400150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52280d2a30 0x7f52280cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:29.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 --2- 172.21.15.83:0/3845400150 >> v2:172.21.15.153:3300/0 conn(0x7f522815e880 0x7f52280d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:29.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 -- 172.21.15.83:0/3845400150 >> 172.21.15.83:0/3845400150 conn(0x7f522809d7c0 msgr2=0x7f522808bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 -- 172.21.15.83:0/3845400150 shutdown_connections 2024-03-30T13:09:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 -- 172.21.15.83:0/3845400150 wait complete. 2024-03-30T13:09:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 Processor -- start 2024-03-30T13:09:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 -- start start 2024-03-30T13:09:29.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52280d2a30 0x7f5228155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:29.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52280d4230 0x7f5228154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:29.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f522815e880 0x7f52280c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:29.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f52280d2fc0 con 0x7f52280d4230 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52280d2e40 con 0x7f522815e880 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f52280b5200 con 0x7f52280d2a30 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5225d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52280d4230 0x7f5228154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5225d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52280d4230 0x7f5228154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45460/0 (socket says 172.21.15.83:45460) 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5225d9b640 1 -- 172.21.15.83:0/1871575919 learned_addr learned my addr 172.21.15.83:0/1871575919 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5226d9d640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f522815e880 0x7f52280c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5225d9b640 1 -- 172.21.15.83:0/1871575919 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52280d2a30 msgr2=0x7f5228155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522659c640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52280d2a30 0x7f5228155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5225d9b640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52280d2a30 0x7f5228155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5225d9b640 1 -- 172.21.15.83:0/1871575919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f522815e880 msgr2=0x7f52280c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5225d9b640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f522815e880 0x7f52280c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5225d9b640 1 -- 172.21.15.83:0/1871575919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52280d1650 con 0x7f52280d4230 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5226d9d640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f522815e880 0x7f52280c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5225d9b640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52280d4230 0x7f5228154240 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f521c00d800 tx=0x7f521c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:29.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5216ffd640 1 -- 172.21.15.83:0/1871575919 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c0096a0 con 0x7f52280d4230 2024-03-30T13:09:29.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5216ffd640 1 -- 172.21.15.83:0/1871575919 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521c019070 con 0x7f52280d4230 2024-03-30T13:09:29.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 -- 172.21.15.83:0/1871575919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5228155fd0 con 0x7f52280d4230 2024-03-30T13:09:29.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f5216ffd640 1 -- 172.21.15.83:0/1871575919 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c009aa0 con 0x7f52280d4230 2024-03-30T13:09:29.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:28.999+0000 7f522cef9640 1 -- 172.21.15.83:0/1871575919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52280cbf60 con 0x7f52280d4230 2024-03-30T13:09:29.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.003+0000 7f522cef9640 1 -- 172.21.15.83:0/1871575919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52280a23a0 con 0x7f52280d4230 2024-03-30T13:09:29.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.003+0000 7f5216ffd640 1 -- 172.21.15.83:0/1871575919 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f521c009c40 con 0x7f52280d4230 2024-03-30T13:09:29.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.003+0000 7f5216ffd640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5208067fc0 0x7f520806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:29.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.003+0000 7f5216ffd640 1 -- 172.21.15.83:0/1871575919 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7f521c086970 con 0x7f52280d4230 2024-03-30T13:09:29.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.003+0000 7f522659c640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5208067fc0 0x7f520806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:29.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.003+0000 7f522659c640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5208067fc0 0x7f520806a480 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f52180096f0 tx=0x7f5218008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:29.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.007+0000 7f5216ffd640 1 -- 172.21.15.83:0/1871575919 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5228155fd0 con 0x7f52280d4230 2024-03-30T13:09:29.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.203+0000 7f522cef9640 1 -- 172.21.15.83:0/1871575919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f522815c770 con 0x7f52280d4230 2024-03-30T13:09:29.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.863+0000 7f5216ffd640 1 -- 172.21.15.83:0/1871575919 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7f521c0570f0 con 0x7f52280d4230 2024-03-30T13:09:29.886 INFO:teuthology.orchestra.run.smithi083.stderr:new fs with metadata pool 4 and data pool 5 2024-03-30T13:09:29.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.891+0000 7f522cef9640 1 -- 172.21.15.83:0/1871575919 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5208067fc0 msgr2=0x7f520806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:29.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.891+0000 7f522cef9640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5208067fc0 0x7f520806a480 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f52180096f0 tx=0x7f5218008040 comp rx=0 tx=0).stop 2024-03-30T13:09:29.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.891+0000 7f522cef9640 1 -- 172.21.15.83:0/1871575919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52280d4230 msgr2=0x7f5228154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:29.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.891+0000 7f522cef9640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52280d4230 0x7f5228154240 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f521c00d800 tx=0x7f521c00dcc0 comp rx=0 tx=0).stop 2024-03-30T13:09:29.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.891+0000 7f522cef9640 1 -- 172.21.15.83:0/1871575919 shutdown_connections 2024-03-30T13:09:29.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.891+0000 7f522cef9640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5208067fc0 0x7f520806a480 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:29.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.891+0000 7f522cef9640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f522815e880 0x7f52280c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:29.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.891+0000 7f522cef9640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52280d4230 0x7f5228154240 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:29.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.891+0000 7f522cef9640 1 --2- 172.21.15.83:0/1871575919 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52280d2a30 0x7f5228155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:29.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.891+0000 7f522cef9640 1 -- 172.21.15.83:0/1871575919 >> 172.21.15.83:0/1871575919 conn(0x7f522809d7c0 msgr2=0x7f522806c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:29.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.891+0000 7f522cef9640 1 -- 172.21.15.83:0/1871575919 shutdown_connections 2024-03-30T13:09:29.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:29.891+0000 7f522cef9640 1 -- 172.21.15.83:0/1871575919 wait complete. 2024-03-30T13:09:29.918 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:30.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.027+0000 7f928221c640 1 Processor -- start 2024-03-30T13:09:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.027+0000 7f928221c640 1 -- start start 2024-03-30T13:09:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.027+0000 7f928221c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0730e0 0x7f927c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.027+0000 7f928221c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f927c06f140 0x7f927c06f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.027+0000 7f928221c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c0734c0 con 0x7f927c0b4bb0 2024-03-30T13:09:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.027+0000 7f928221c640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f927c06faf0 con 0x7f927c06f140 2024-03-30T13:09:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.027+0000 7f928221c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f927c15fed0 con 0x7f927c0730e0 2024-03-30T13:09:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927b7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0730e0 0x7f927c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927bfff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f927c06f140 0x7f927c06f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927b7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0730e0 0x7f927c15b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:34416/0 (socket says 172.21.15.83:34416) 2024-03-30T13:09:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927affd640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f927c0b4bb0 0x7f927c15f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:47166/0 (socket says 172.21.15.83:47166) 2024-03-30T13:09:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927b7fe640 1 -- 172.21.15.83:0/2085670988 learned_addr learned my addr 172.21.15.83:0/2085670988 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:30.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927a7fc640 1 -- 172.21.15.83:0/2085670988 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3805523901 0 0) 0x7f927c0734c0 con 0x7f927c0b4bb0 2024-03-30T13:09:30.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927a7fc640 1 -- 172.21.15.83:0/2085670988 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9264003530 con 0x7f927c0b4bb0 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927b7fe640 1 -- 172.21.15.83:0/2085670988 >> v2:172.21.15.153:3300/0 conn(0x7f927c06f140 msgr2=0x7f927c06f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927b7fe640 1 --2- 172.21.15.83:0/2085670988 >> v2:172.21.15.153:3300/0 conn(0x7f927c06f140 0x7f927c06f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927b7fe640 1 -- 172.21.15.83:0/2085670988 >> v1:172.21.15.153:6789/0 conn(0x7f927c0b4bb0 legacy=0x7f927c15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927b7fe640 1 -- 172.21.15.83:0/2085670988 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c15c2a0 con 0x7f927c0730e0 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927bfff640 1 --2- 172.21.15.83:0/2085670988 >> v2:172.21.15.153:3300/0 conn(0x7f927c06f140 0x7f927c06f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927b7fe640 1 --2- 172.21.15.83:0/2085670988 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0730e0 0x7f927c15b950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f926c009870 tx=0x7f926c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b922014dea8b510 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927a7fc640 1 -- 172.21.15.83:0/2085670988 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0a95f0 con 0x7f927c0730e0 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927a7fc640 1 -- 172.21.15.83:0/2085670988 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c0a9790 con 0x7f927c0730e0 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.031+0000 7f927a7fc640 1 -- 172.21.15.83:0/2085670988 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0a9b40 con 0x7f927c0730e0 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 -- 172.21.15.83:0/2085670988 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0730e0 msgr2=0x7f927c15b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 --2- 172.21.15.83:0/2085670988 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0730e0 0x7f927c15b950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f926c009870 tx=0x7f926c01c530 comp rx=0 tx=0).stop 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 -- 172.21.15.83:0/2085670988 shutdown_connections 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 --2- 172.21.15.83:0/2085670988 >> v2:172.21.15.153:3300/0 conn(0x7f927c06f140 0x7f927c06f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 --2- 172.21.15.83:0/2085670988 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0730e0 0x7f927c15b950 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 -- 172.21.15.83:0/2085670988 >> 172.21.15.83:0/2085670988 conn(0x7f927c0b1d60 msgr2=0x7f927c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 -- 172.21.15.83:0/2085670988 shutdown_connections 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 -- 172.21.15.83:0/2085670988 wait complete. 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 Processor -- start 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 -- start start 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f927c06f140 0x7f927c146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f927c0730e0 0x7f927c1f7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0b4bb0 0x7f927c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f927c15be90 con 0x7f927c0730e0 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f927c15f2a0 con 0x7f927c06f140 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f927c15c010 con 0x7f927c0b4bb0 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f927affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f927c0730e0 0x7f927c1f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f927affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f927c0730e0 0x7f927c1f7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45474/0 (socket says 172.21.15.83:45474) 2024-03-30T13:09:30.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f927affd640 1 -- 172.21.15.83:0/1780624369 learned_addr learned my addr 172.21.15.83:0/1780624369 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f927bfff640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0b4bb0 0x7f927c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f927b7fe640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f927c06f140 0x7f927c146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f927affd640 1 -- 172.21.15.83:0/1780624369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0b4bb0 msgr2=0x7f927c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f927affd640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0b4bb0 0x7f927c0cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f927affd640 1 -- 172.21.15.83:0/1780624369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f927c06f140 msgr2=0x7f927c146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f927affd640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f927c06f140 0x7f927c146440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f927affd640 1 -- 172.21.15.83:0/1780624369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c15d010 con 0x7f927c0730e0 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f927bfff640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0b4bb0 0x7f927c0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f927affd640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f927c0730e0 0x7f927c1f7430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f927000c400 tx=0x7f927000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f9263fff640 1 -- 172.21.15.83:0/1780624369 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92700074e0 con 0x7f927c0730e0 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f9263fff640 1 -- 172.21.15.83:0/1780624369 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9270007680 con 0x7f927c0730e0 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 -- 172.21.15.83:0/1780624369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f927c15d2f0 con 0x7f927c0730e0 2024-03-30T13:09:30.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f9263fff640 1 -- 172.21.15.83:0/1780624369 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270004a30 con 0x7f927c0730e0 2024-03-30T13:09:30.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.035+0000 7f928221c640 1 -- 172.21.15.83:0/1780624369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f927c15d8b0 con 0x7f927c0730e0 2024-03-30T13:09:30.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.039+0000 7f928221c640 1 -- 172.21.15.83:0/1780624369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f927c0686c0 con 0x7f927c0730e0 2024-03-30T13:09:30.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.039+0000 7f9263fff640 1 -- 172.21.15.83:0/1780624369 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f927001a020 con 0x7f927c0730e0 2024-03-30T13:09:30.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.039+0000 7f9263fff640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9268067fc0 0x7f926806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.039+0000 7f927b7fe640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9268067fc0 0x7f926806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.039+0000 7f9263fff640 1 -- 172.21.15.83:0/1780624369 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9270085d90 con 0x7f927c0730e0 2024-03-30T13:09:30.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.039+0000 7f927b7fe640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9268067fc0 0x7f926806a480 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f926c0ae000 tx=0x7f926c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:30.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.043+0000 7f9263fff640 1 -- 172.21.15.83:0/1780624369 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9270056550 con 0x7f927c0730e0 2024-03-30T13:09:30.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.207+0000 7f928221c640 1 -- 172.21.15.83:0/1780624369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f927c06da70 con 0x7f927c0730e0 2024-03-30T13:09:30.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f9263fff640 1 -- 172.21.15.83:0/1780624369 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16658 (secure 0 0 0) 0x7f9270055e50 con 0x7f927c0730e0 2024-03-30T13:09:30.216 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:30.216 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":33,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:09:29.206243+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:09:27.405927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:09:28.161081+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:30.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f928221c640 1 -- 172.21.15.83:0/1780624369 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9268067fc0 msgr2=0x7f926806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f928221c640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9268067fc0 0x7f926806a480 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f926c0ae000 tx=0x7f926c0a7000 comp rx=0 tx=0).stop 2024-03-30T13:09:30.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f928221c640 1 -- 172.21.15.83:0/1780624369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f927c0730e0 msgr2=0x7f927c1f7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f928221c640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f927c0730e0 0x7f927c1f7430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f927000c400 tx=0x7f927000c8c0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f928221c640 1 -- 172.21.15.83:0/1780624369 shutdown_connections 2024-03-30T13:09:30.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f928221c640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9268067fc0 0x7f926806a480 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f928221c640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f927c0b4bb0 0x7f927c0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f928221c640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f927c0730e0 0x7f927c1f7430 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f928221c640 1 --2- 172.21.15.83:0/1780624369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f927c06f140 0x7f927c146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f928221c640 1 -- 172.21.15.83:0/1780624369 >> 172.21.15.83:0/1780624369 conn(0x7f927c0b1d60 msgr2=0x7f927c0add00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:30.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f928221c640 1 -- 172.21.15.83:0/1780624369 shutdown_connections 2024-03-30T13:09:30.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.211+0000 7f928221c640 1 -- 172.21.15.83:0/1780624369 wait complete. 2024-03-30T13:09:30.235 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:30.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.347+0000 7f76e7dad640 1 Processor -- start 2024-03-30T13:09:30.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.347+0000 7f76e7dad640 1 -- start start 2024-03-30T13:09:30.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e7dad640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f76e006f140 0x7f76e006f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e7dad640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e00734c0 con 0x7f76e00730e0 2024-03-30T13:09:30.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e7dad640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e015c2a0 con 0x7f76e00b4bb0 2024-03-30T13:09:30.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e7dad640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f76e015c060 con 0x7f76e006f140 2024-03-30T13:09:30.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e5b49640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f76e00730e0 0x7f76e015b950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:39976/0 (socket says 172.21.15.83:39976) 2024-03-30T13:09:30.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e5b49640 1 -- 172.21.15.83:0/2076262578 learned_addr learned my addr 172.21.15.83:0/2076262578 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:30.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e634a640 1 --2- 172.21.15.83:0/2076262578 >> v2:172.21.15.153:3300/0 conn(0x7f76e006f140 0x7f76e006f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746501740 0 0) 0x7f76e00734c0 con 0x7f76e00730e0 2024-03-30T13:09:30.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76cc003530 con 0x7f76e00730e0 2024-03-30T13:09:30.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2283419923 0 0) 0x7f76cc003530 con 0x7f76e00730e0 2024-03-30T13:09:30.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 >> v2:172.21.15.153:3300/0 conn(0x7f76e006f140 msgr2=0x7f76e006f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:30.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 --2- 172.21.15.83:0/2076262578 >> v2:172.21.15.153:3300/0 conn(0x7f76e006f140 0x7f76e006f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 >> v1:172.21.15.153:6789/0 conn(0x7f76e00b4bb0 legacy=0x7f76e015f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e015c580 con 0x7f76e00730e0 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f76dc001680 con 0x7f76e00730e0 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 >> v1:172.21.15.83:6789/0 conn(0x7f76e00730e0 legacy=0x7f76e015b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 --2- 172.21.15.83:0/2076262578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 0x7f76cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 --2- 172.21.15.83:0/2076262578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76cc004810 0x7f76cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 --2- 172.21.15.83:0/2076262578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76cc0051d0 0x7f76cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f76e015c060 con 0x7f76cc0039c0 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc00c070 con 0x7f76cc0051d0 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f76cc010680 con 0x7f76cc004810 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e5b49640 1 --2- 172.21.15.83:0/2076262578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 0x7f76cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e5348640 1 --2- 172.21.15.83:0/2076262578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76cc004810 0x7f76cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e5b49640 1 -- 172.21.15.83:0/2076262578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76cc004810 msgr2=0x7f76cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e5b49640 1 --2- 172.21.15.83:0/2076262578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76cc004810 0x7f76cc004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e634a640 1 --2- 172.21.15.83:0/2076262578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76cc0051d0 0x7f76cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e5b49640 1 -- 172.21.15.83:0/2076262578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76cc0051d0 msgr2=0x7f76cc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:30.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e5b49640 1 --2- 172.21.15.83:0/2076262578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76cc0051d0 0x7f76cc00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e5b49640 1 -- 172.21.15.83:0/2076262578 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc003530 con 0x7f76cc0039c0 2024-03-30T13:09:30.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.351+0000 7f76e634a640 1 -- 172.21.15.83:0/2076262578 reap_dead start 2024-03-30T13:09:30.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e5b49640 1 --2- 172.21.15.83:0/2076262578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 0x7f76cc003de0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00c210 tx=0x7f76dc01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff02e8ba3418812 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:30.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc007d40 con 0x7f76cc0039c0 2024-03-30T13:09:30.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76dc0a9070 con 0x7f76cc0039c0 2024-03-30T13:09:30.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e4b47640 1 -- 172.21.15.83:0/2076262578 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc005d80 con 0x7f76cc0039c0 2024-03-30T13:09:30.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 -- 172.21.15.83:0/2076262578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 msgr2=0x7f76cc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 --2- 172.21.15.83:0/2076262578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 0x7f76cc003de0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00c210 tx=0x7f76dc01cc30 comp rx=0 tx=0).stop 2024-03-30T13:09:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 -- 172.21.15.83:0/2076262578 shutdown_connections 2024-03-30T13:09:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 --2- 172.21.15.83:0/2076262578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 0x7f76cc003de0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 -- 172.21.15.83:0/2076262578 >> 172.21.15.83:0/2076262578 conn(0x7f76e00b1d60 msgr2=0x7f76e00b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 -- 172.21.15.83:0/2076262578 shutdown_connections 2024-03-30T13:09:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 -- 172.21.15.83:0/2076262578 wait complete. 2024-03-30T13:09:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 Processor -- start 2024-03-30T13:09:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 -- start start 2024-03-30T13:09:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 0x7f76e0150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76e013eb30 0x7f76e01f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76e01f35b0 0x7f76e01547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f76e015bee0 con 0x7f76cc0039c0 2024-03-30T13:09:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f76e015bd60 con 0x7f76e013eb30 2024-03-30T13:09:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e7dad640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f76e006f930 con 0x7f76e01f35b0 2024-03-30T13:09:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e5b49640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 0x7f76e0150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e5b49640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 0x7f76e0150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45492/0 (socket says 172.21.15.83:45492) 2024-03-30T13:09:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e5b49640 1 -- 172.21.15.83:0/4031042580 learned_addr learned my addr 172.21.15.83:0/4031042580 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e634a640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76e01f35b0 0x7f76e01547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e5348640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76e013eb30 0x7f76e01f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e5b49640 1 -- 172.21.15.83:0/4031042580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76e01f35b0 msgr2=0x7f76e01547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e5b49640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76e01f35b0 0x7f76e01547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e5b49640 1 -- 172.21.15.83:0/4031042580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76e013eb30 msgr2=0x7f76e01f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e5b49640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76e013eb30 0x7f76e01f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e5b49640 1 -- 172.21.15.83:0/4031042580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e0150f10 con 0x7f76cc0039c0 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e5348640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76e013eb30 0x7f76e01f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76e5b49640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 0x7f76e0150590 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f76dc000c10 tx=0x7f76cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76d67fc640 1 -- 172.21.15.83:0/4031042580 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc007180 con 0x7f76cc0039c0 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.355+0000 7f76d67fc640 1 -- 172.21.15.83:0/4031042580 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76dc007320 con 0x7f76cc0039c0 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.359+0000 7f76d67fc640 1 -- 172.21.15.83:0/4031042580 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc0076d0 con 0x7f76cc0039c0 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.359+0000 7f76e7dad640 1 -- 172.21.15.83:0/4031042580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e01511f0 con 0x7f76cc0039c0 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.359+0000 7f76e7dad640 1 -- 172.21.15.83:0/4031042580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e01e7180 con 0x7f76cc0039c0 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.359+0000 7f76e7dad640 1 -- 172.21.15.83:0/4031042580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e01e6fa0 con 0x7f76cc0039c0 2024-03-30T13:09:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.359+0000 7f76d67fc640 1 -- 172.21.15.83:0/4031042580 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f76dc0047f0 con 0x7f76cc0039c0 2024-03-30T13:09:30.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.359+0000 7f76d67fc640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f76c4067fc0 0x7f76c406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.359+0000 7f76d67fc640 1 -- 172.21.15.83:0/4031042580 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f76dc11fae0 con 0x7f76cc0039c0 2024-03-30T13:09:30.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.359+0000 7f76e5348640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f76c4067fc0 0x7f76c406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.359+0000 7f76e5348640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f76c4067fc0 0x7f76c406a480 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f76e013ef50 tx=0x7f76d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:30.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.363+0000 7f76d67fc640 1 -- 172.21.15.83:0/4031042580 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f76e01e6fa0 con 0x7f76cc0039c0 2024-03-30T13:09:30.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.523+0000 7f76e7dad640 1 -- 172.21.15.83:0/4031042580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76e00686c0 con 0x7f76cc0039c0 2024-03-30T13:09:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.527+0000 7f76d67fc640 1 -- 172.21.15.83:0/4031042580 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16658 (secure 0 0 0) 0x7f76dc0169b0 con 0x7f76cc0039c0 2024-03-30T13:09:30.574 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:30.574 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":33,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:09:29.206243+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:09:27.405927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:09:28.161081+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.531+0000 7f76e7dad640 1 -- 172.21.15.83:0/4031042580 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f76c4067fc0 msgr2=0x7f76c406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.531+0000 7f76e7dad640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f76c4067fc0 0x7f76c406a480 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f76e013ef50 tx=0x7f76d0009040 comp rx=0 tx=0).stop 2024-03-30T13:09:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.531+0000 7f76e7dad640 1 -- 172.21.15.83:0/4031042580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 msgr2=0x7f76e0150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.531+0000 7f76e7dad640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 0x7f76e0150590 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f76dc000c10 tx=0x7f76cc005840 comp rx=0 tx=0).stop 2024-03-30T13:09:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.531+0000 7f76e7dad640 1 -- 172.21.15.83:0/4031042580 shutdown_connections 2024-03-30T13:09:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.531+0000 7f76e7dad640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f76c4067fc0 0x7f76c406a480 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.531+0000 7f76e7dad640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76e01f35b0 0x7f76e01547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.531+0000 7f76e7dad640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76e013eb30 0x7f76e01f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.531+0000 7f76e7dad640 1 --2- 172.21.15.83:0/4031042580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76cc0039c0 0x7f76e0150590 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.531+0000 7f76e7dad640 1 -- 172.21.15.83:0/4031042580 >> 172.21.15.83:0/4031042580 conn(0x7f76e00b1d60 msgr2=0x7f76e00b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.531+0000 7f76e7dad640 1 -- 172.21.15.83:0/4031042580 shutdown_connections 2024-03-30T13:09:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.531+0000 7f76e7dad640 1 -- 172.21.15.83:0/4031042580 wait complete. 2024-03-30T13:09:30.577 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-30T13:09:30.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.691+0000 7f009d942640 1 Processor -- start 2024-03-30T13:09:30.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.691+0000 7f009d942640 1 -- start start 2024-03-30T13:09:30.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f009d942640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f009815b050 0x7f0098073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f009d942640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f00980b3ca0 0x7f009806f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f009d942640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00980b31e0 con 0x7f009806f690 2024-03-30T13:09:30.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f009d942640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f009806fad0 con 0x7f00980b3ca0 2024-03-30T13:09:30.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f009d942640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0098073ab0 con 0x7f009815b050 2024-03-30T13:09:30.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f008ffff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f00980b3ca0 0x7f009806f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f008ffff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f00980b3ca0 0x7f009806f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45500/0 (socket says 172.21.15.83:45500) 2024-03-30T13:09:30.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f00977fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f009806f690 0x7f0098071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:39986/0 (socket says 172.21.15.83:39986) 2024-03-30T13:09:30.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f008ffff640 1 -- 172.21.15.83:0/2277016939 learned_addr learned my addr 172.21.15.83:0/2277016939 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:30.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f0096ffd640 1 --2- 172.21.15.83:0/2277016939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f009815b050 0x7f0098073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f008ffff640 1 -- 172.21.15.83:0/2277016939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f009815b050 msgr2=0x7f0098073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:30.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f008ffff640 1 --2- 172.21.15.83:0/2277016939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f009815b050 0x7f0098073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f008ffff640 1 -- 172.21.15.83:0/2277016939 >> v1:172.21.15.83:6789/0 conn(0x7f009806f690 legacy=0x7f0098071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.695+0000 7f008ffff640 1 -- 172.21.15.83:0/2277016939 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00980ad4f0 con 0x7f00980b3ca0 2024-03-30T13:09:30.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f008ffff640 1 --2- 172.21.15.83:0/2277016939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00980b3ca0 0x7f009806f150 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0080009870 tx=0x7f008001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74f4ffd92dfa797 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:30.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f00967fc640 1 -- 172.21.15.83:0/2277016939 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00800b0070 con 0x7f00980b3ca0 2024-03-30T13:09:30.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f00967fc640 1 -- 172.21.15.83:0/2277016939 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00800ab600 con 0x7f00980b3ca0 2024-03-30T13:09:30.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f00967fc640 1 -- 172.21.15.83:0/2277016939 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00800ab9d0 con 0x7f00980b3ca0 2024-03-30T13:09:30.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 -- 172.21.15.83:0/2277016939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00980b3ca0 msgr2=0x7f009806f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 --2- 172.21.15.83:0/2277016939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00980b3ca0 0x7f009806f150 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0080009870 tx=0x7f008001c560 comp rx=0 tx=0).stop 2024-03-30T13:09:30.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 -- 172.21.15.83:0/2277016939 shutdown_connections 2024-03-30T13:09:30.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 --2- 172.21.15.83:0/2277016939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00980b3ca0 0x7f009806f150 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 --2- 172.21.15.83:0/2277016939 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f009815b050 0x7f0098073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 -- 172.21.15.83:0/2277016939 >> 172.21.15.83:0/2277016939 conn(0x7f009806b660 msgr2=0x7f009806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:30.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 -- 172.21.15.83:0/2277016939 shutdown_connections 2024-03-30T13:09:30.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 -- 172.21.15.83:0/2277016939 wait complete. 2024-03-30T13:09:30.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 Processor -- start 2024-03-30T13:09:30.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 -- start start 2024-03-30T13:09:30.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009806f690 0x7f00980b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00980b3ca0 0x7f0098152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f009815b050 0x7f009815e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f00980b40e0 con 0x7f009806f690 2024-03-30T13:09:30.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f00980ad1c0 con 0x7f00980b3ca0 2024-03-30T13:09:30.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f009d942640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f00980b4c10 con 0x7f009815b050 2024-03-30T13:09:30.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f0096ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009806f690 0x7f00980b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f0096ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009806f690 0x7f00980b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45508/0 (socket says 172.21.15.83:45508) 2024-03-30T13:09:30.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f0096ffd640 1 -- 172.21.15.83:0/3323029223 learned_addr learned my addr 172.21.15.83:0/3323029223 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:30.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f00977fe640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f009815b050 0x7f009815e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f0096ffd640 1 -- 172.21.15.83:0/3323029223 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f009815b050 msgr2=0x7f009815e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f0096ffd640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f009815b050 0x7f009815e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f0096ffd640 1 -- 172.21.15.83:0/3323029223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00980b3ca0 msgr2=0x7f0098152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:30.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f008ffff640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00980b3ca0 0x7f0098152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f0096ffd640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00980b3ca0 0x7f0098152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:30.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f0096ffd640 1 -- 172.21.15.83:0/3323029223 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0098153640 con 0x7f009806f690 2024-03-30T13:09:30.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.699+0000 7f0096ffd640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009806f690 0x7f00980b05e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f008800d830 tx=0x7f008800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:30.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.703+0000 7f0094ff9640 1 -- 172.21.15.83:0/3323029223 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008800b6c0 con 0x7f009806f690 2024-03-30T13:09:30.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.703+0000 7f0094ff9640 1 -- 172.21.15.83:0/3323029223 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0088019070 con 0x7f009806f690 2024-03-30T13:09:30.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.703+0000 7f009d942640 1 -- 172.21.15.83:0/3323029223 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0098153920 con 0x7f009806f690 2024-03-30T13:09:30.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.703+0000 7f0094ff9640 1 -- 172.21.15.83:0/3323029223 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008800ba60 con 0x7f009806f690 2024-03-30T13:09:30.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.703+0000 7f009d942640 1 -- 172.21.15.83:0/3323029223 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f009814a740 con 0x7f009806f690 2024-03-30T13:09:30.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.703+0000 7f009d942640 1 -- 172.21.15.83:0/3323029223 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f009809e540 con 0x7f009806f690 2024-03-30T13:09:30.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.703+0000 7f0094ff9640 1 -- 172.21.15.83:0/3323029223 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f008801e460 con 0x7f009806f690 2024-03-30T13:09:30.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.703+0000 7f0094ff9640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0078067fc0 0x7f007806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:30.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.703+0000 7f0094ff9640 1 -- 172.21.15.83:0/3323029223 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f0088086b80 con 0x7f009806f690 2024-03-30T13:09:30.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.703+0000 7f008ffff640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0078067fc0 0x7f007806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:30.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.703+0000 7f008ffff640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0078067fc0 0x7f007806a480 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f00800ad000 tx=0x7f0080008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:30.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.707+0000 7f0094ff9640 1 -- 172.21.15.83:0/3323029223 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f00880573c0 con 0x7f009806f690 2024-03-30T13:09:30.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:30.907+0000 7f009d942640 1 -- 172.21.15.83:0/3323029223 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f009804f9e0 con 0x7f009806f690 2024-03-30T13:09:31.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.866+0000 7f0094ff9640 1 -- 172.21.15.83:0/3323029223 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7f0088056cc0 con 0x7f009806f690 2024-03-30T13:09:31.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.870+0000 7f009d942640 1 -- 172.21.15.83:0/3323029223 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0078067fc0 msgr2=0x7f007806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:31.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.870+0000 7f009d942640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0078067fc0 0x7f007806a480 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f00800ad000 tx=0x7f0080008040 comp rx=0 tx=0).stop 2024-03-30T13:09:31.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.870+0000 7f009d942640 1 -- 172.21.15.83:0/3323029223 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009806f690 msgr2=0x7f00980b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:31.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.870+0000 7f009d942640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009806f690 0x7f00980b05e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f008800d830 tx=0x7f008800dcf0 comp rx=0 tx=0).stop 2024-03-30T13:09:31.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.870+0000 7f009d942640 1 -- 172.21.15.83:0/3323029223 shutdown_connections 2024-03-30T13:09:31.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.870+0000 7f009d942640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0078067fc0 0x7f007806a480 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:31.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.870+0000 7f009d942640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f009815b050 0x7f009815e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:31.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.870+0000 7f009d942640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00980b3ca0 0x7f0098152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:31.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.870+0000 7f009d942640 1 --2- 172.21.15.83:0/3323029223 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009806f690 0x7f00980b05e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:31.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.870+0000 7f009d942640 1 -- 172.21.15.83:0/3323029223 >> 172.21.15.83:0/3323029223 conn(0x7f009806b660 msgr2=0x7f0098159900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:31.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.870+0000 7f009d942640 1 -- 172.21.15.83:0/3323029223 shutdown_connections 2024-03-30T13:09:31.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:31.870+0000 7f009d942640 1 -- 172.21.15.83:0/3323029223 wait complete. 2024-03-30T13:09:31.895 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-30T13:09:31.895 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-30T13:09:32.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff470a0e640 1 Processor -- start 2024-03-30T13:09:32.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff470a0e640 1 -- start start 2024-03-30T13:09:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff470a0e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff46c15b570 0x7ff46c0ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff470a0e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff46c0aec70 0x7ff46c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff470a0e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff46c0b37a0 con 0x7ff46c0b1510 2024-03-30T13:09:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff470a0e640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff46c0b0af0 con 0x7ff46c0aec70 2024-03-30T13:09:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff470a0e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff46c15b950 con 0x7ff46c15b570 2024-03-30T13:09:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff469d9b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff46c0aec70 0x7ff46c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff469d9b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff46c0aec70 0x7ff46c0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45522/0 (socket says 172.21.15.83:45522) 2024-03-30T13:09:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff469d9b640 1 -- 172.21.15.83:0/1377152789 learned_addr learned my addr 172.21.15.83:0/1377152789 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff46a59c640 1 --2- 172.21.15.83:0/1377152789 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff46c15b570 0x7ff46c0ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff469d9b640 1 -- 172.21.15.83:0/1377152789 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff46c15b570 msgr2=0x7ff46c0ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff469d9b640 1 --2- 172.21.15.83:0/1377152789 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff46c15b570 0x7ff46c0ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff469d9b640 1 -- 172.21.15.83:0/1377152789 >> v1:172.21.15.153:6789/0 conn(0x7ff46c0b1510 legacy=0x7ff46c0b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.022+0000 7ff469d9b640 1 -- 172.21.15.83:0/1377152789 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46c0af490 con 0x7ff46c0aec70 2024-03-30T13:09:32.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff469d9b640 1 --2- 172.21.15.83:0/1377152789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff46c0aec70 0x7ff46c0b0fd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff460009870 tx=0x7ff46001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69137f1f59b14ffc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:32.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff46959a640 1 -- 172.21.15.83:0/1377152789 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4600aa610 con 0x7ff46c0aec70 2024-03-30T13:09:32.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff46959a640 1 -- 172.21.15.83:0/1377152789 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4600af070 con 0x7ff46c0aec70 2024-03-30T13:09:32.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff46959a640 1 -- 172.21.15.83:0/1377152789 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4600aa9d0 con 0x7ff46c0aec70 2024-03-30T13:09:32.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff470a0e640 1 -- 172.21.15.83:0/1377152789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff46c0aec70 msgr2=0x7ff46c0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:32.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff470a0e640 1 --2- 172.21.15.83:0/1377152789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff46c0aec70 0x7ff46c0b0fd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff460009870 tx=0x7ff46001c4f0 comp rx=0 tx=0).stop 2024-03-30T13:09:32.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff470a0e640 1 -- 172.21.15.83:0/1377152789 shutdown_connections 2024-03-30T13:09:32.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff470a0e640 1 --2- 172.21.15.83:0/1377152789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff46c0aec70 0x7ff46c0b0fd0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:32.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff470a0e640 1 --2- 172.21.15.83:0/1377152789 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff46c15b570 0x7ff46c0ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:32.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff470a0e640 1 -- 172.21.15.83:0/1377152789 >> 172.21.15.83:0/1377152789 conn(0x7ff46c072d30 msgr2=0x7ff46c0b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:32.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff470a0e640 1 -- 172.21.15.83:0/1377152789 shutdown_connections 2024-03-30T13:09:32.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff470a0e640 1 -- 172.21.15.83:0/1377152789 wait complete. 2024-03-30T13:09:32.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff470a0e640 1 Processor -- start 2024-03-30T13:09:32.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.026+0000 7ff470a0e640 1 -- start start 2024-03-30T13:09:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff470a0e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0aec70 0x7ff46c1459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff470a0e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff46c0b1510 0x7ff46c1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff470a0e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff46c15b570 0x7ff46c1568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff470a0e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c0af230 con 0x7ff46c0b1510 2024-03-30T13:09:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff470a0e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c0af0b0 con 0x7ff46c0aec70 2024-03-30T13:09:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff470a0e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff46c0b20b0 con 0x7ff46c15b570 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff469d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff46c0b1510 0x7ff46c1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff469d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff46c0b1510 0x7ff46c1563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45532/0 (socket says 172.21.15.83:45532) 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff469d9b640 1 -- 172.21.15.83:0/715380403 learned_addr learned my addr 172.21.15.83:0/715380403 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff46ad9d640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff46c15b570 0x7ff46c1568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff46a59c640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0aec70 0x7ff46c1459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff469d9b640 1 -- 172.21.15.83:0/715380403 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff46c15b570 msgr2=0x7ff46c1568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff469d9b640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff46c15b570 0x7ff46c1568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff469d9b640 1 -- 172.21.15.83:0/715380403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0aec70 msgr2=0x7ff46c1459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff469d9b640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0aec70 0x7ff46c1459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff469d9b640 1 -- 172.21.15.83:0/715380403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46c14e970 con 0x7ff46c0b1510 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff46a59c640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0aec70 0x7ff46c1459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff469d9b640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff46c0b1510 0x7ff46c1563b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff4600ac040 tx=0x7ff46001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff45affd640 1 -- 172.21.15.83:0/715380403 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4600bd5f0 con 0x7ff46c0b1510 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff45affd640 1 -- 172.21.15.83:0/715380403 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4600bd7b0 con 0x7ff46c0b1510 2024-03-30T13:09:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff470a0e640 1 -- 172.21.15.83:0/715380403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff46c149de0 con 0x7ff46c0b1510 2024-03-30T13:09:32.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff45affd640 1 -- 172.21.15.83:0/715380403 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4600bdba0 con 0x7ff46c0b1510 2024-03-30T13:09:32.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff470a0e640 1 -- 172.21.15.83:0/715380403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff46c14a3a0 con 0x7ff46c0b1510 2024-03-30T13:09:32.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff470a0e640 1 -- 172.21.15.83:0/715380403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff46c09f3d0 con 0x7ff46c0b1510 2024-03-30T13:09:32.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff45affd640 1 -- 172.21.15.83:0/715380403 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff4600b33f0 con 0x7ff46c0b1510 2024-03-30T13:09:32.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff45affd640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff44c067fc0 0x7ff44c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:32.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff45affd640 1 -- 172.21.15.83:0/715380403 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff4601211c0 con 0x7ff46c0b1510 2024-03-30T13:09:32.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.030+0000 7ff46a59c640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff44c067fc0 0x7ff44c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:32.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.034+0000 7ff46a59c640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff44c067fc0 0x7ff44c06a480 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff464009f50 tx=0x7ff46400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:32.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.034+0000 7ff45affd640 1 -- 172.21.15.83:0/715380403 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff4600c3060 con 0x7ff46c0b1510 2024-03-30T13:09:32.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.230+0000 7ff470a0e640 1 -- 172.21.15.83:0/715380403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff46c04f9e0 con 0x7ff46c0b1510 2024-03-30T13:09:32.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff45affd640 1 -- 172.21.15.83:0/715380403 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7ff4600a7070 con 0x7ff46c0b1510 2024-03-30T13:09:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff470a0e640 1 -- 172.21.15.83:0/715380403 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff44c067fc0 msgr2=0x7ff44c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff470a0e640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff44c067fc0 0x7ff44c06a480 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff464009f50 tx=0x7ff46400b040 comp rx=0 tx=0).stop 2024-03-30T13:09:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff470a0e640 1 -- 172.21.15.83:0/715380403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff46c0b1510 msgr2=0x7ff46c1563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff470a0e640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff46c0b1510 0x7ff46c1563b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff4600ac040 tx=0x7ff46001ad30 comp rx=0 tx=0).stop 2024-03-30T13:09:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff470a0e640 1 -- 172.21.15.83:0/715380403 shutdown_connections 2024-03-30T13:09:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff470a0e640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff44c067fc0 0x7ff44c06a480 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff470a0e640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff46c15b570 0x7ff46c1568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:32.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff470a0e640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff46c0b1510 0x7ff46c1563b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:32.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff470a0e640 1 --2- 172.21.15.83:0/715380403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff46c0aec70 0x7ff46c1459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:32.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff470a0e640 1 -- 172.21.15.83:0/715380403 >> 172.21.15.83:0/715380403 conn(0x7ff46c072d30 msgr2=0x7ff46c15bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:32.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff470a0e640 1 -- 172.21.15.83:0/715380403 shutdown_connections 2024-03-30T13:09:32.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:32.878+0000 7ff470a0e640 1 -- 172.21.15.83:0/715380403 wait complete. 2024-03-30T13:09:32.903 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-30T13:09:32.904 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:09:33.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d40bb1640 1 Processor -- start 2024-03-30T13:09:33.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d40bb1640 1 -- start start 2024-03-30T13:09:33.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d40bb1640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d3c0b0240 0x7f7d3c072e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d40bb1640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d3c15ebb0 con 0x7f7d3c06b660 2024-03-30T13:09:33.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d40bb1640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d3c09ae60 con 0x7f7d3c15e7d0 2024-03-30T13:09:33.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d40bb1640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d3c0b0a70 con 0x7f7d3c0b0240 2024-03-30T13:09:33.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d3ad9d640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f7d3c06b660 0x7f7d3c0aeb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:39992/0 (socket says 172.21.15.83:39992) 2024-03-30T13:09:33.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d3ad9d640 1 -- 172.21.15.83:0/2286426977 learned_addr learned my addr 172.21.15.83:0/2286426977 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:33.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d33fff640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d3c0b0240 0x7f7d3c072e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4247933371 0 0) 0x7f7d340014a0 con 0x7f7d3c06b660 2024-03-30T13:09:33.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d28003530 con 0x7f7d3c06b660 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2393391600 0 0) 0x7f7d28003530 con 0x7f7d3c06b660 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d3c0b0240 msgr2=0x7f7d3c072e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d3c0b0240 0x7f7d3c072e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 >> v1:172.21.15.153:6789/0 conn(0x7f7d3c15e7d0 legacy=0x7f7d3c0b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c0b60b0 con 0x7f7d3c06b660 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f7d34001bd0 con 0x7f7d3c06b660 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 >> v1:172.21.15.83:6789/0 conn(0x7f7d3c06b660 legacy=0x7f7d3c0aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d280039f0 0x7f7d28003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d28004810 0x7f7d28004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d3c0b0240 0x7f7d28005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c0b0a70 con 0x7f7d280039f0 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2800bb00 con 0x7f7d28004810 2024-03-30T13:09:33.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2800bd00 con 0x7f7d3c0b0240 2024-03-30T13:09:33.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d3a59c640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d280039f0 0x7f7d28003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d33fff640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d28004810 0x7f7d28004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d3ad9d640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d3c0b0240 0x7f7d28005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d3a59c640 1 -- 172.21.15.83:0/2286426977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d3c0b0240 msgr2=0x7f7d28005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:33.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d3a59c640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d3c0b0240 0x7f7d28005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d3a59c640 1 -- 172.21.15.83:0/2286426977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d28004810 msgr2=0x7f7d28004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:33.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d3a59c640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d28004810 0x7f7d28004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d3a59c640 1 -- 172.21.15.83:0/2286426977 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d28003530 con 0x7f7d280039f0 2024-03-30T13:09:33.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.014+0000 7f7d3ad9d640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d3c0b0240 0x7f7d28005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:33.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d3a59c640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d280039f0 0x7f7d28003e10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c001780 tx=0x7f7d2c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88ae0c3e92c0f24 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:33.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0013a0 con 0x7f7d280039f0 2024-03-30T13:09:33.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2c0052f0 con 0x7f7d280039f0 2024-03-30T13:09:33.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d39d9b640 1 -- 172.21.15.83:0/2286426977 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c003840 con 0x7f7d280039f0 2024-03-30T13:09:33.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 -- 172.21.15.83:0/2286426977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d280039f0 msgr2=0x7f7d28003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 --2- 172.21.15.83:0/2286426977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d280039f0 0x7f7d28003e10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c001780 tx=0x7f7d2c01c420 comp rx=0 tx=0).stop 2024-03-30T13:09:33.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d3ad9d640 1 -- 172.21.15.83:0/2286426977 reap_dead start 2024-03-30T13:09:33.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 -- 172.21.15.83:0/2286426977 shutdown_connections 2024-03-30T13:09:33.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 -- 172.21.15.83:0/2286426977 >> 172.21.15.83:0/2286426977 conn(0x7f7d3c0b68c0 msgr2=0x7f7d3c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:33.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 -- 172.21.15.83:0/2286426977 shutdown_connections 2024-03-30T13:09:33.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 -- 172.21.15.83:0/2286426977 wait complete. 2024-03-30T13:09:33.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 Processor -- start 2024-03-30T13:09:33.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 -- start start 2024-03-30T13:09:33.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d280039f0 0x7f7d3c15ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d3c15f790 0x7f7d3c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d3c1564f0 0x7f7d3c156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c0af660 con 0x7f7d3c15f790 2024-03-30T13:09:33.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c073210 con 0x7f7d3c1564f0 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d40bb1640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d3c06ba90 con 0x7f7d280039f0 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d33fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d3c15f790 0x7f7d3c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d33fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d3c15f790 0x7f7d3c168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45538/0 (socket says 172.21.15.83:45538) 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d33fff640 1 -- 172.21.15.83:0/162022497 learned_addr learned my addr 172.21.15.83:0/162022497 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d3a59c640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d280039f0 0x7f7d3c15ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d3ad9d640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d3c1564f0 0x7f7d3c156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d33fff640 1 -- 172.21.15.83:0/162022497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d280039f0 msgr2=0x7f7d3c15ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d33fff640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d280039f0 0x7f7d3c15ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d33fff640 1 -- 172.21.15.83:0/162022497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d3c1564f0 msgr2=0x7f7d3c156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d33fff640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d3c1564f0 0x7f7d3c156980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d33fff640 1 -- 172.21.15.83:0/162022497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c15f370 con 0x7f7d3c15f790 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.018+0000 7f7d3ad9d640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d3c1564f0 0x7f7d3c156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.022+0000 7f7d33fff640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d3c15f790 0x7f7d3c168d80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7d240115e0 tx=0x7f7d24011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.022+0000 7f7d32ffd640 1 -- 172.21.15.83:0/162022497 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2400f8f0 con 0x7f7d3c15f790 2024-03-30T13:09:33.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.022+0000 7f7d32ffd640 1 -- 172.21.15.83:0/162022497 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2400fa90 con 0x7f7d3c15f790 2024-03-30T13:09:33.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.022+0000 7f7d32ffd640 1 -- 172.21.15.83:0/162022497 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2400fe40 con 0x7f7d3c15f790 2024-03-30T13:09:33.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.022+0000 7f7d40bb1640 1 -- 172.21.15.83:0/162022497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3c161ff0 con 0x7f7d3c15f790 2024-03-30T13:09:33.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.022+0000 7f7d40bb1640 1 -- 172.21.15.83:0/162022497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d3c161ce0 con 0x7f7d3c15f790 2024-03-30T13:09:33.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.022+0000 7f7d40bb1640 1 -- 172.21.15.83:0/162022497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d3c068dd0 con 0x7f7d3c15f790 2024-03-30T13:09:33.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.022+0000 7f7d32ffd640 1 -- 172.21.15.83:0/162022497 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f7d24015460 con 0x7f7d3c15f790 2024-03-30T13:09:33.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.022+0000 7f7d32ffd640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d1c067fc0 0x7f7d1c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.022+0000 7f7d32ffd640 1 -- 172.21.15.83:0/162022497 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7d24086d00 con 0x7f7d3c15f790 2024-03-30T13:09:33.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.022+0000 7f7d3a59c640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d1c067fc0 0x7f7d1c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.022+0000 7f7d3a59c640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d1c067fc0 0x7f7d1c06a480 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c001750 tx=0x7f7d2c0011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:33.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.026+0000 7f7d32ffd640 1 -- 172.21.15.83:0/162022497 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f7d24019030 con 0x7f7d3c15f790 2024-03-30T13:09:33.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.330+0000 7f7d40bb1640 1 -- 172.21.15.83:0/162022497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d3c0b0020 con 0x7f7d3c15f790 2024-03-30T13:09:33.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.330+0000 7f7d32ffd640 1 -- 172.21.15.83:0/162022497 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5184 (secure 0 0 0) 0x7f7d24057620 con 0x7f7d3c15f790 2024-03-30T13:09:33.335 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:33.336 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2103427036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2103427036},{"type":"v1","addr":"172.21.15.153:6833","nonce":2103427036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/718325648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":718325648},{"type":"v1","addr":"172.21.15.153:6835","nonce":718325648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2547254149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2547254149},{"type":"v1","addr":"172.21.15.83:6836","nonce":2547254149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:09:29.206969+0000","modified":"2024-03-30T13:09:32.236603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1254317891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1254317891},{"type":"v1","addr":"172.21.15.83:6837","nonce":1254317891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":2}]} 2024-03-30T13:09:33.336 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 15 2024-03-30T13:09:33.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.334+0000 7f7d40bb1640 1 -- 172.21.15.83:0/162022497 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d1c067fc0 msgr2=0x7f7d1c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.334+0000 7f7d40bb1640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d1c067fc0 0x7f7d1c06a480 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c001750 tx=0x7f7d2c0011a0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.334+0000 7f7d40bb1640 1 -- 172.21.15.83:0/162022497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d3c15f790 msgr2=0x7f7d3c168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.334+0000 7f7d40bb1640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d3c15f790 0x7f7d3c168d80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7d240115e0 tx=0x7f7d24011aa0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.334+0000 7f7d40bb1640 1 -- 172.21.15.83:0/162022497 shutdown_connections 2024-03-30T13:09:33.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.334+0000 7f7d40bb1640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d1c067fc0 0x7f7d1c06a480 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.334+0000 7f7d40bb1640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d3c1564f0 0x7f7d3c156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.334+0000 7f7d40bb1640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d3c15f790 0x7f7d3c168d80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.334+0000 7f7d40bb1640 1 --2- 172.21.15.83:0/162022497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d280039f0 0x7f7d3c15ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.334+0000 7f7d40bb1640 1 -- 172.21.15.83:0/162022497 >> 172.21.15.83:0/162022497 conn(0x7f7d3c0b68c0 msgr2=0x7f7d3c157540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:33.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.334+0000 7f7d40bb1640 1 -- 172.21.15.83:0/162022497 shutdown_connections 2024-03-30T13:09:33.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.334+0000 7f7d40bb1640 1 -- 172.21.15.83:0/162022497 wait complete. 2024-03-30T13:09:33.362 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:09:33.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.474+0000 7f309d288640 1 Processor -- start 2024-03-30T13:09:33.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.474+0000 7f309d288640 1 -- start start 2024-03-30T13:09:33.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f309d288640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f30980b0240 0x7f3098072e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f309d288640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f309806b660 0x7f309806baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f309d288640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309815ebb0 con 0x7f309815e7d0 2024-03-30T13:09:33.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f309d288640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f309809ae60 con 0x7f30980b0240 2024-03-30T13:09:33.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f309d288640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f30980b0a70 con 0x7f309806b660 2024-03-30T13:09:33.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f3096ffd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f309815e7d0 0x7f30980b4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40006/0 (socket says 172.21.15.83:40006) 2024-03-30T13:09:33.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f3096ffd640 1 -- 172.21.15.83:0/1186564998 learned_addr learned my addr 172.21.15.83:0/1186564998 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:33.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f30977fe640 1 --2- 172.21.15.83:0/1186564998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f309806b660 0x7f309806baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f30967fc640 1 --2- 172.21.15.83:0/1186564998 >> v2:172.21.15.153:3300/0 conn(0x7f30980b0240 0x7f3098072e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f3095ffb640 1 -- 172.21.15.83:0/1186564998 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3047087180 0 0) 0x7f3080001120 con 0x7f309815e7d0 2024-03-30T13:09:33.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f3095ffb640 1 -- 172.21.15.83:0/1186564998 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3084003530 con 0x7f309815e7d0 2024-03-30T13:09:33.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f3095ffb640 1 -- 172.21.15.83:0/1186564998 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 889955882 0 0) 0x7f3084003530 con 0x7f309815e7d0 2024-03-30T13:09:33.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f30977fe640 1 -- 172.21.15.83:0/1186564998 >> v2:172.21.15.153:3300/0 conn(0x7f30980b0240 msgr2=0x7f3098072e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:33.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f30977fe640 1 --2- 172.21.15.83:0/1186564998 >> v2:172.21.15.153:3300/0 conn(0x7f30980b0240 0x7f3098072e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f30977fe640 1 -- 172.21.15.83:0/1186564998 >> v1:172.21.15.83:6789/0 conn(0x7f309815e7d0 legacy=0x7f30980b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f30977fe640 1 -- 172.21.15.83:0/1186564998 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30980b60b0 con 0x7f309806b660 2024-03-30T13:09:33.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.478+0000 7f30977fe640 1 --2- 172.21.15.83:0/1186564998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f309806b660 0x7f309806baf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3090009d90 tx=0x7f309001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7333f50c636bf987 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:33.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f3095ffb640 1 -- 172.21.15.83:0/1186564998 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30900ac070 con 0x7f309806b660 2024-03-30T13:09:33.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f3095ffb640 1 -- 172.21.15.83:0/1186564998 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30900a6410 con 0x7f309806b660 2024-03-30T13:09:33.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f3095ffb640 1 -- 172.21.15.83:0/1186564998 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3080001850 con 0x7f309806b660 2024-03-30T13:09:33.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f309d288640 1 -- 172.21.15.83:0/1186564998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f309806b660 msgr2=0x7f309806baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f309d288640 1 --2- 172.21.15.83:0/1186564998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f309806b660 0x7f309806baf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3090009d90 tx=0x7f309001c800 comp rx=0 tx=0).stop 2024-03-30T13:09:33.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f309d288640 1 -- 172.21.15.83:0/1186564998 shutdown_connections 2024-03-30T13:09:33.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f309d288640 1 --2- 172.21.15.83:0/1186564998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f309806b660 0x7f309806baf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f309d288640 1 --2- 172.21.15.83:0/1186564998 >> v2:172.21.15.153:3300/0 conn(0x7f30980b0240 0x7f3098072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f309d288640 1 -- 172.21.15.83:0/1186564998 >> 172.21.15.83:0/1186564998 conn(0x7f30980b68c0 msgr2=0x7f30980b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:33.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f309d288640 1 -- 172.21.15.83:0/1186564998 shutdown_connections 2024-03-30T13:09:33.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f309d288640 1 -- 172.21.15.83:0/1186564998 wait complete. 2024-03-30T13:09:33.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f309d288640 1 Processor -- start 2024-03-30T13:09:33.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.482+0000 7f309d288640 1 -- start start 2024-03-30T13:09:33.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f309d288640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f309806b660 0x7f3098153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f309d288640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30980b0240 0x7f30980b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f309d288640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f309815e7d0 0x7f30980b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f309d288640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f30980af4d0 con 0x7f309815e7d0 2024-03-30T13:09:33.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f309d288640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30980af350 con 0x7f309806b660 2024-03-30T13:09:33.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f309d288640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f30980af650 con 0x7f30980b0240 2024-03-30T13:09:33.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f30977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f309815e7d0 0x7f30980b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f30977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f309815e7d0 0x7f30980b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45548/0 (socket says 172.21.15.83:45548) 2024-03-30T13:09:33.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f30977fe640 1 -- 172.21.15.83:0/135475597 learned_addr learned my addr 172.21.15.83:0/135475597 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:33.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f3096ffd640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f309806b660 0x7f3098153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f30967fc640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30980b0240 0x7f30980b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f30977fe640 1 -- 172.21.15.83:0/135475597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30980b0240 msgr2=0x7f30980b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f30977fe640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30980b0240 0x7f30980b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f30977fe640 1 -- 172.21.15.83:0/135475597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f309806b660 msgr2=0x7f3098153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f30977fe640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f309806b660 0x7f3098153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f30977fe640 1 -- 172.21.15.83:0/135475597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3098158c30 con 0x7f309815e7d0 2024-03-30T13:09:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f30977fe640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f309815e7d0 0x7f30980b1310 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f309001aeb0 tx=0x7f30900195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f308f7fe640 1 -- 172.21.15.83:0/135475597 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30900c0070 con 0x7f309815e7d0 2024-03-30T13:09:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f308f7fe640 1 -- 172.21.15.83:0/135475597 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30900b1660 con 0x7f309815e7d0 2024-03-30T13:09:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f309d288640 1 -- 172.21.15.83:0/135475597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3098158f10 con 0x7f309815e7d0 2024-03-30T13:09:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f308f7fe640 1 -- 172.21.15.83:0/135475597 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30900ac050 con 0x7f309815e7d0 2024-03-30T13:09:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f309d288640 1 -- 172.21.15.83:0/135475597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30981594d0 con 0x7f309815e7d0 2024-03-30T13:09:33.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f309d288640 1 -- 172.21.15.83:0/135475597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3098068dd0 con 0x7f309815e7d0 2024-03-30T13:09:33.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f308f7fe640 1 -- 172.21.15.83:0/135475597 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f30900af070 con 0x7f309815e7d0 2024-03-30T13:09:33.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f308f7fe640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3078067fc0 0x7f307806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f308f7fe640 1 -- 172.21.15.83:0/135475597 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3090120b00 con 0x7f309815e7d0 2024-03-30T13:09:33.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.486+0000 7f3096ffd640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3078067fc0 0x7f307806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.490+0000 7f3096ffd640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3078067fc0 0x7f307806a480 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3098150c80 tx=0x7f3080009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:33.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.498+0000 7f308f7fe640 1 -- 172.21.15.83:0/135475597 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3090016480 con 0x7f309815e7d0 2024-03-30T13:09:33.544 INFO:tasks.ceph.mds.a.smithi083.stderr:2024-03-30T13:09:33.538+0000 7feb0103c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T13:09:33.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.674+0000 7f309d288640 1 -- 172.21.15.83:0/135475597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30980b0020 con 0x7f309815e7d0 2024-03-30T13:09:33.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f308f7fe640 1 -- 172.21.15.83:0/135475597 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16645 (secure 0 0 0) 0x7f30900f1230 con 0x7f309815e7d0 2024-03-30T13:09:33.683 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:33.684 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":34,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:09:30.859377+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:09:27.405927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:09:28.161081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:09:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f309d288640 1 -- 172.21.15.83:0/135475597 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3078067fc0 msgr2=0x7f307806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f309d288640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3078067fc0 0x7f307806a480 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3098150c80 tx=0x7f3080009040 comp rx=0 tx=0).stop 2024-03-30T13:09:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f309d288640 1 -- 172.21.15.83:0/135475597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f309815e7d0 msgr2=0x7f30980b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f309d288640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f309815e7d0 0x7f30980b1310 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f309001aeb0 tx=0x7f30900195a0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f309d288640 1 -- 172.21.15.83:0/135475597 shutdown_connections 2024-03-30T13:09:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f309d288640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3078067fc0 0x7f307806a480 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f309d288640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f309815e7d0 0x7f30980b1310 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f309d288640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30980b0240 0x7f30980b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f309d288640 1 --2- 172.21.15.83:0/135475597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f309806b660 0x7f3098153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f309d288640 1 -- 172.21.15.83:0/135475597 >> 172.21.15.83:0/135475597 conn(0x7f30980b68c0 msgr2=0x7f30980d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:33.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f309d288640 1 -- 172.21.15.83:0/135475597 shutdown_connections 2024-03-30T13:09:33.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.678+0000 7f309d288640 1 -- 172.21.15.83:0/135475597 wait complete. 2024-03-30T13:09:33.702 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-30T13:09:33.702 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:09:33.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.814+0000 7f6a528ff640 1 Processor -- start 2024-03-30T13:09:33.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.814+0000 7f6a528ff640 1 -- start start 2024-03-30T13:09:33.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.818+0000 7f6a528ff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6a4c0b1200 0x7f6a4c0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.818+0000 7f6a528ff640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a4c0cd130 con 0x7f6a4c0ccc50 2024-03-30T13:09:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.818+0000 7f6a528ff640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a4c0cd410 con 0x7f6a4c15fb60 2024-03-30T13:09:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.818+0000 7f6a528ff640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f6a4c0cd6f0 con 0x7f6a4c0b1200 2024-03-30T13:09:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.818+0000 7f6a4b7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6a4c0b1200 0x7f6a4c0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.818+0000 7f6a50e9c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f6a4c0ccc50 0x7f6a4c09aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40014/0 (socket says 172.21.15.83:40014) 2024-03-30T13:09:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.818+0000 7f6a50e9c640 1 -- 172.21.15.83:0/776285371 learned_addr learned my addr 172.21.15.83:0/776285371 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.818+0000 7f6a4b7fe640 1 -- 172.21.15.83:0/776285371 >> v1:172.21.15.153:6789/0 conn(0x7f6a4c15fb60 legacy=0x7f6a4c0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.818+0000 7f6a4b7fe640 1 -- 172.21.15.83:0/776285371 >> v1:172.21.15.83:6789/0 conn(0x7f6a4c0ccc50 legacy=0x7f6a4c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.818+0000 7f6a4affd640 1 -- 172.21.15.83:0/776285371 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884724868 0 0) 0x7f6a4c0cd130 con 0x7f6a4c0ccc50 2024-03-30T13:09:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.818+0000 7f6a4b7fe640 1 -- 172.21.15.83:0/776285371 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4c0cd9d0 con 0x7f6a4c0b1200 2024-03-30T13:09:33.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.818+0000 7f6a4b7fe640 1 --2- 172.21.15.83:0/776285371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a4c0b1200 0x7f6a4c0d0cf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6a400097c0 tx=0x7f6a4001c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f73c4c9d56620c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:33.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a4affd640 1 -- 172.21.15.83:0/776285371 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a400b0070 con 0x7f6a4c0b1200 2024-03-30T13:09:33.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a4affd640 1 -- 172.21.15.83:0/776285371 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a400ab600 con 0x7f6a4c0b1200 2024-03-30T13:09:33.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a4affd640 1 -- 172.21.15.83:0/776285371 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a400ab9d0 con 0x7f6a4c0b1200 2024-03-30T13:09:33.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 -- 172.21.15.83:0/776285371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a4c0b1200 msgr2=0x7f6a4c0d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 --2- 172.21.15.83:0/776285371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a4c0b1200 0x7f6a4c0d0cf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6a400097c0 tx=0x7f6a4001c350 comp rx=0 tx=0).stop 2024-03-30T13:09:33.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 -- 172.21.15.83:0/776285371 shutdown_connections 2024-03-30T13:09:33.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 --2- 172.21.15.83:0/776285371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a4c0b1200 0x7f6a4c0d0cf0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 -- 172.21.15.83:0/776285371 >> 172.21.15.83:0/776285371 conn(0x7f6a4c0b3dd0 msgr2=0x7f6a4c0b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:33.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 -- 172.21.15.83:0/776285371 shutdown_connections 2024-03-30T13:09:33.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 -- 172.21.15.83:0/776285371 wait complete. 2024-03-30T13:09:33.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 Processor -- start 2024-03-30T13:09:33.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 -- start start 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a4c0b1200 0x7f6a4c159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a4c0ccc50 0x7f6a4c151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a4c15fb60 0x7f6a4c1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c0ceb60 con 0x7f6a4c15fb60 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c0ce9e0 con 0x7f6a4c0b1200 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4c09b160 con 0x7f6a4c0ccc50 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a50e9c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a4c15fb60 0x7f6a4c1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a50e9c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a4c15fb60 0x7f6a4c1565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45562/0 (socket says 172.21.15.83:45562) 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a50e9c640 1 -- 172.21.15.83:0/2821133561 learned_addr learned my addr 172.21.15.83:0/2821133561 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a4b7fe640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a4c0ccc50 0x7f6a4c151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a4bfff640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a4c0b1200 0x7f6a4c159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a50e9c640 1 -- 172.21.15.83:0/2821133561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a4c0ccc50 msgr2=0x7f6a4c151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a50e9c640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a4c0ccc50 0x7f6a4c151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a50e9c640 1 -- 172.21.15.83:0/2821133561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a4c0b1200 msgr2=0x7f6a4c159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:33.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a50e9c640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a4c0b1200 0x7f6a4c159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:33.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a50e9c640 1 -- 172.21.15.83:0/2821133561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4c152a10 con 0x7f6a4c15fb60 2024-03-30T13:09:33.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a50e9c640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a4c15fb60 0x7f6a4c1565b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c450 tx=0x7f6a3c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:33.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a48ff9640 1 -- 172.21.15.83:0/2821133561 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0074e0 con 0x7f6a4c15fb60 2024-03-30T13:09:33.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a48ff9640 1 -- 172.21.15.83:0/2821133561 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3c0047f0 con 0x7f6a4c15fb60 2024-03-30T13:09:33.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 -- 172.21.15.83:0/2821133561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4c15a0b0 con 0x7f6a4c15fb60 2024-03-30T13:09:33.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a48ff9640 1 -- 172.21.15.83:0/2821133561 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c007680 con 0x7f6a4c15fb60 2024-03-30T13:09:33.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.822+0000 7f6a528ff640 1 -- 172.21.15.83:0/2821133561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4c15a650 con 0x7f6a4c15fb60 2024-03-30T13:09:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.826+0000 7f6a528ff640 1 -- 172.21.15.83:0/2821133561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a4c068dd0 con 0x7f6a4c15fb60 2024-03-30T13:09:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.826+0000 7f6a48ff9640 1 -- 172.21.15.83:0/2821133561 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6a3c011070 con 0x7f6a4c15fb60 2024-03-30T13:09:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.826+0000 7f6a48ff9640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6a38067fc0 0x7f6a3806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.826+0000 7f6a4bfff640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6a38067fc0 0x7f6a3806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.826+0000 7f6a48ff9640 1 -- 172.21.15.83:0/2821133561 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6a3c0860e0 con 0x7f6a4c15fb60 2024-03-30T13:09:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.826+0000 7f6a4bfff640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6a38067fc0 0x7f6a3806a480 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6a440012f0 tx=0x7f6a44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:33.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.830+0000 7f6a48ff9640 1 -- 172.21.15.83:0/2821133561 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6a4c152a10 con 0x7f6a4c15fb60 2024-03-30T13:09:33.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.990+0000 7f6a528ff640 1 -- 172.21.15.83:0/2821133561 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a4c0d1fa0 con 0x7f6a38067fc0 2024-03-30T13:09:34.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.994+0000 7f6a48ff9640 1 -- 172.21.15.83:0/2821133561 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242994 (secure 0 0 0) 0x7f6a4c0d1fa0 con 0x7f6a38067fc0 2024-03-30T13:09:34.004 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:34.006 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:09:34.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.998+0000 7f6a528ff640 1 -- 172.21.15.83:0/2821133561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6a38067fc0 msgr2=0x7f6a3806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.998+0000 7f6a528ff640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6a38067fc0 0x7f6a3806a480 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6a440012f0 tx=0x7f6a44009040 comp rx=0 tx=0).stop 2024-03-30T13:09:34.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.998+0000 7f6a528ff640 1 -- 172.21.15.83:0/2821133561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a4c15fb60 msgr2=0x7f6a4c1565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.998+0000 7f6a528ff640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a4c15fb60 0x7f6a4c1565b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c450 tx=0x7f6a3c00c910 comp rx=0 tx=0).stop 2024-03-30T13:09:34.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.998+0000 7f6a528ff640 1 -- 172.21.15.83:0/2821133561 shutdown_connections 2024-03-30T13:09:34.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.998+0000 7f6a528ff640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6a38067fc0 0x7f6a3806a480 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.998+0000 7f6a528ff640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a4c15fb60 0x7f6a4c1565b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.998+0000 7f6a528ff640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a4c0ccc50 0x7f6a4c151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.998+0000 7f6a528ff640 1 --2- 172.21.15.83:0/2821133561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a4c0b1200 0x7f6a4c159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.998+0000 7f6a528ff640 1 -- 172.21.15.83:0/2821133561 >> 172.21.15.83:0/2821133561 conn(0x7f6a4c0b3dd0 msgr2=0x7f6a4c0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:34.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.998+0000 7f6a528ff640 1 -- 172.21.15.83:0/2821133561 shutdown_connections 2024-03-30T13:09:34.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:33.998+0000 7f6a528ff640 1 -- 172.21.15.83:0/2821133561 wait complete. 2024-03-30T13:09:34.020 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-03-30T13:09:32.159769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590472,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224180,"kb_used_data":3840,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750540,"statfs":{"total":773094113280,"available":772864552960,"internally_reserved":0,"allocated":3932160,"data_stored":2226066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":104,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.327137"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946549+0000","last_change":"2024-03-30T13:09:29.885974+0000","last_active":"2024-03-30T13:09:30.946549+0000","last_peered":"2024-03-30T13:09:30.946549+0000","last_clean":"2024-03-30T13:09:30.946549+0000","last_became_active":"2024-03-30T13:09:29.885560+0000","last_became_peered":"2024-03-30T13:09:29.885560+0000","last_unstale":"2024-03-30T13:09:30.946549+0000","last_undegraded":"2024-03-30T13:09:30.946549+0000","last_fullsized":"2024-03-30T13:09:30.946549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:42.515844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.949865+0000","last_change":"2024-03-30T13:09:29.890662+0000","last_active":"2024-03-30T13:09:30.949865+0000","last_peered":"2024-03-30T13:09:30.949865+0000","last_clean":"2024-03-30T13:09:30.949865+0000","last_became_active":"2024-03-30T13:09:29.889856+0000","last_became_peered":"2024-03-30T13:09:29.889856+0000","last_unstale":"2024-03-30T13:09:30.949865+0000","last_undegraded":"2024-03-30T13:09:30.949865+0000","last_fullsized":"2024-03-30T13:09:30.949865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:21.172612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946716+0000","last_change":"2024-03-30T13:09:29.870580+0000","last_active":"2024-03-30T13:09:30.946716+0000","last_peered":"2024-03-30T13:09:30.946716+0000","last_clean":"2024-03-30T13:09:30.946716+0000","last_became_active":"2024-03-30T13:09:29.870220+0000","last_became_peered":"2024-03-30T13:09:29.870220+0000","last_unstale":"2024-03-30T13:09:30.946716+0000","last_undegraded":"2024-03-30T13:09:30.946716+0000","last_fullsized":"2024-03-30T13:09:30.946716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:33:50.145715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947833+0000","last_change":"2024-03-30T13:09:29.882486+0000","last_active":"2024-03-30T13:09:30.947833+0000","last_peered":"2024-03-30T13:09:30.947833+0000","last_clean":"2024-03-30T13:09:30.947833+0000","last_became_active":"2024-03-30T13:09:29.881938+0000","last_became_peered":"2024-03-30T13:09:29.881938+0000","last_unstale":"2024-03-30T13:09:30.947833+0000","last_undegraded":"2024-03-30T13:09:30.947833+0000","last_fullsized":"2024-03-30T13:09:30.947833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:38:53.208942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948057+0000","last_change":"2024-03-30T13:09:29.868671+0000","last_active":"2024-03-30T13:09:30.948057+0000","last_peered":"2024-03-30T13:09:30.948057+0000","last_clean":"2024-03-30T13:09:30.948057+0000","last_became_active":"2024-03-30T13:09:29.867823+0000","last_became_peered":"2024-03-30T13:09:29.867823+0000","last_unstale":"2024-03-30T13:09:30.948057+0000","last_undegraded":"2024-03-30T13:09:30.948057+0000","last_fullsized":"2024-03-30T13:09:30.948057+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:13:44.984173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.949984+0000","last_change":"2024-03-30T13:09:29.885155+0000","last_active":"2024-03-30T13:09:30.949984+0000","last_peered":"2024-03-30T13:09:30.949984+0000","last_clean":"2024-03-30T13:09:30.949984+0000","last_became_active":"2024-03-30T13:09:29.884217+0000","last_became_peered":"2024-03-30T13:09:29.884217+0000","last_unstale":"2024-03-30T13:09:30.949984+0000","last_undegraded":"2024-03-30T13:09:30.949984+0000","last_fullsized":"2024-03-30T13:09:30.949984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:54:24.311844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948452+0000","last_change":"2024-03-30T13:09:29.886322+0000","last_active":"2024-03-30T13:09:30.948452+0000","last_peered":"2024-03-30T13:09:30.948452+0000","last_clean":"2024-03-30T13:09:30.948452+0000","last_became_active":"2024-03-30T13:09:29.885512+0000","last_became_peered":"2024-03-30T13:09:29.885512+0000","last_unstale":"2024-03-30T13:09:30.948452+0000","last_undegraded":"2024-03-30T13:09:30.948452+0000","last_fullsized":"2024-03-30T13:09:30.948452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:53:21.703122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.845727+0000","last_change":"2024-03-30T13:09:27.845727+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.845727+0000","last_undegraded":"2024-03-30T13:09:27.845727+0000","last_fullsized":"2024-03-30T13:09:27.845727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.839126+0000","last_change":"2024-03-30T13:09:27.839126+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.839126+0000","last_undegraded":"2024-03-30T13:09:27.839126+0000","last_fullsized":"2024-03-30T13:09:27.839126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.949257+0000","last_change":"2024-03-30T13:09:29.886539+0000","last_active":"2024-03-30T13:09:30.949257+0000","last_peered":"2024-03-30T13:09:30.949257+0000","last_clean":"2024-03-30T13:09:30.949257+0000","last_became_active":"2024-03-30T13:09:29.885773+0000","last_became_peered":"2024-03-30T13:09:29.885773+0000","last_unstale":"2024-03-30T13:09:30.949257+0000","last_undegraded":"2024-03-30T13:09:30.949257+0000","last_fullsized":"2024-03-30T13:09:30.949257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:10:19.372050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.841163+0000","last_change":"2024-03-30T13:09:27.841163+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.841163+0000","last_undegraded":"2024-03-30T13:09:27.841163+0000","last_fullsized":"2024-03-30T13:09:27.841163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947927+0000","last_change":"2024-03-30T13:09:28.880430+0000","last_active":"2024-03-30T13:09:30.947927+0000","last_peered":"2024-03-30T13:09:30.947927+0000","last_clean":"2024-03-30T13:09:30.947927+0000","last_became_active":"2024-03-30T13:09:28.880137+0000","last_became_peered":"2024-03-30T13:09:28.880137+0000","last_unstale":"2024-03-30T13:09:30.947927+0000","last_undegraded":"2024-03-30T13:09:30.947927+0000","last_fullsized":"2024-03-30T13:09:30.947927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:11:42.230422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948704+0000","last_change":"2024-03-30T13:09:28.871392+0000","last_active":"2024-03-30T13:09:30.948704+0000","last_peered":"2024-03-30T13:09:30.948704+0000","last_clean":"2024-03-30T13:09:30.948704+0000","last_became_active":"2024-03-30T13:09:28.870685+0000","last_became_peered":"2024-03-30T13:09:28.870685+0000","last_unstale":"2024-03-30T13:09:30.948704+0000","last_undegraded":"2024-03-30T13:09:30.948704+0000","last_fullsized":"2024-03-30T13:09:30.948704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:50.691759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.949913+0000","last_change":"2024-03-30T13:09:28.867269+0000","last_active":"2024-03-30T13:09:30.949913+0000","last_peered":"2024-03-30T13:09:30.949913+0000","last_clean":"2024-03-30T13:09:30.949913+0000","last_became_active":"2024-03-30T13:09:28.866017+0000","last_became_peered":"2024-03-30T13:09:28.866017+0000","last_unstale":"2024-03-30T13:09:30.949913+0000","last_undegraded":"2024-03-30T13:09:30.949913+0000","last_fullsized":"2024-03-30T13:09:30.949913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:12.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947234+0000","last_change":"2024-03-30T13:09:29.882556+0000","last_active":"2024-03-30T13:09:30.947234+0000","last_peered":"2024-03-30T13:09:30.947234+0000","last_clean":"2024-03-30T13:09:30.947234+0000","last_became_active":"2024-03-30T13:09:29.881722+0000","last_became_peered":"2024-03-30T13:09:29.881722+0000","last_unstale":"2024-03-30T13:09:30.947234+0000","last_undegraded":"2024-03-30T13:09:30.947234+0000","last_fullsized":"2024-03-30T13:09:30.947234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:40:32.144646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.842673+0000","last_change":"2024-03-30T13:09:27.842673+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.842673+0000","last_undegraded":"2024-03-30T13:09:27.842673+0000","last_fullsized":"2024-03-30T13:09:27.842673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947486+0000","last_change":"2024-03-30T13:09:28.877610+0000","last_active":"2024-03-30T13:09:30.947486+0000","last_peered":"2024-03-30T13:09:30.947486+0000","last_clean":"2024-03-30T13:09:30.947486+0000","last_became_active":"2024-03-30T13:09:28.876759+0000","last_became_peered":"2024-03-30T13:09:28.876759+0000","last_unstale":"2024-03-30T13:09:30.947486+0000","last_undegraded":"2024-03-30T13:09:30.947486+0000","last_fullsized":"2024-03-30T13:09:30.947486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:45.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.841323+0000","last_change":"2024-03-30T13:09:27.841323+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.841323+0000","last_undegraded":"2024-03-30T13:09:27.841323+0000","last_fullsized":"2024-03-30T13:09:27.841323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.837718+0000","last_change":"2024-03-30T13:09:27.837718+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.837718+0000","last_undegraded":"2024-03-30T13:09:27.837718+0000","last_fullsized":"2024-03-30T13:09:27.837718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.837239+0000","last_change":"2024-03-30T13:09:27.837239+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.837239+0000","last_undegraded":"2024-03-30T13:09:27.837239+0000","last_fullsized":"2024-03-30T13:09:27.837239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.839857+0000","last_change":"2024-03-30T13:09:27.839857+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.839857+0000","last_undegraded":"2024-03-30T13:09:27.839857+0000","last_fullsized":"2024-03-30T13:09:27.839857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948852+0000","last_change":"2024-03-30T13:09:28.883472+0000","last_active":"2024-03-30T13:09:30.948852+0000","last_peered":"2024-03-30T13:09:30.948852+0000","last_clean":"2024-03-30T13:09:30.948852+0000","last_became_active":"2024-03-30T13:09:28.882831+0000","last_became_peered":"2024-03-30T13:09:28.882831+0000","last_unstale":"2024-03-30T13:09:30.948852+0000","last_undegraded":"2024-03-30T13:09:30.948852+0000","last_fullsized":"2024-03-30T13:09:30.948852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:36:32.082287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.842808+0000","last_change":"2024-03-30T13:09:27.842808+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.842808+0000","last_undegraded":"2024-03-30T13:09:27.842808+0000","last_fullsized":"2024-03-30T13:09:27.842808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.841883+0000","last_change":"2024-03-30T13:09:27.841883+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.841883+0000","last_undegraded":"2024-03-30T13:09:27.841883+0000","last_fullsized":"2024-03-30T13:09:27.841883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.842887+0000","last_change":"2024-03-30T13:09:27.842887+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.842887+0000","last_undegraded":"2024-03-30T13:09:27.842887+0000","last_fullsized":"2024-03-30T13:09:27.842887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948028+0000","last_change":"2024-03-30T13:09:29.882375+0000","last_active":"2024-03-30T13:09:30.948028+0000","last_peered":"2024-03-30T13:09:30.948028+0000","last_clean":"2024-03-30T13:09:30.948028+0000","last_became_active":"2024-03-30T13:09:29.881482+0000","last_became_peered":"2024-03-30T13:09:29.881482+0000","last_unstale":"2024-03-30T13:09:30.948028+0000","last_undegraded":"2024-03-30T13:09:30.948028+0000","last_fullsized":"2024-03-30T13:09:30.948028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:55.993277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.841642+0000","last_change":"2024-03-30T13:09:27.841642+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.841642+0000","last_undegraded":"2024-03-30T13:09:27.841642+0000","last_fullsized":"2024-03-30T13:09:27.841642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948310+0000","last_change":"2024-03-30T13:09:28.878852+0000","last_active":"2024-03-30T13:09:30.948310+0000","last_peered":"2024-03-30T13:09:30.948310+0000","last_clean":"2024-03-30T13:09:30.948310+0000","last_became_active":"2024-03-30T13:09:28.878141+0000","last_became_peered":"2024-03-30T13:09:28.878141+0000","last_unstale":"2024-03-30T13:09:30.948310+0000","last_undegraded":"2024-03-30T13:09:30.948310+0000","last_fullsized":"2024-03-30T13:09:30.948310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:45.992657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948410+0000","last_change":"2024-03-30T13:09:28.870959+0000","last_active":"2024-03-30T13:09:30.948410+0000","last_peered":"2024-03-30T13:09:30.948410+0000","last_clean":"2024-03-30T13:09:30.948410+0000","last_became_active":"2024-03-30T13:09:28.870260+0000","last_became_peered":"2024-03-30T13:09:28.870260+0000","last_unstale":"2024-03-30T13:09:30.948410+0000","last_undegraded":"2024-03-30T13:09:30.948410+0000","last_fullsized":"2024-03-30T13:09:30.948410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:40:50.743992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948026+0000","last_change":"2024-03-30T13:09:29.892465+0000","last_active":"2024-03-30T13:09:30.948026+0000","last_peered":"2024-03-30T13:09:30.948026+0000","last_clean":"2024-03-30T13:09:30.948026+0000","last_became_active":"2024-03-30T13:09:29.892122+0000","last_became_peered":"2024-03-30T13:09:29.892122+0000","last_unstale":"2024-03-30T13:09:30.948026+0000","last_undegraded":"2024-03-30T13:09:30.948026+0000","last_fullsized":"2024-03-30T13:09:30.948026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:02.351984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.949436+0000","last_change":"2024-03-30T13:09:28.868343+0000","last_active":"2024-03-30T13:09:30.949436+0000","last_peered":"2024-03-30T13:09:30.949436+0000","last_clean":"2024-03-30T13:09:30.949436+0000","last_became_active":"2024-03-30T13:09:28.867641+0000","last_became_peered":"2024-03-30T13:09:28.867641+0000","last_unstale":"2024-03-30T13:09:30.949436+0000","last_undegraded":"2024-03-30T13:09:30.949436+0000","last_fullsized":"2024-03-30T13:09:30.949436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:48.242355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946373+0000","last_change":"2024-03-30T13:09:29.872735+0000","last_active":"2024-03-30T13:09:30.946373+0000","last_peered":"2024-03-30T13:09:30.946373+0000","last_clean":"2024-03-30T13:09:30.946373+0000","last_became_active":"2024-03-30T13:09:29.872283+0000","last_became_peered":"2024-03-30T13:09:29.872283+0000","last_unstale":"2024-03-30T13:09:30.946373+0000","last_undegraded":"2024-03-30T13:09:30.946373+0000","last_fullsized":"2024-03-30T13:09:30.946373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:51.696454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.837463+0000","last_change":"2024-03-30T13:09:27.837463+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.837463+0000","last_undegraded":"2024-03-30T13:09:27.837463+0000","last_fullsized":"2024-03-30T13:09:27.837463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946693+0000","last_change":"2024-03-30T13:09:29.869822+0000","last_active":"2024-03-30T13:09:30.946693+0000","last_peered":"2024-03-30T13:09:30.946693+0000","last_clean":"2024-03-30T13:09:30.946693+0000","last_became_active":"2024-03-30T13:09:29.869472+0000","last_became_peered":"2024-03-30T13:09:29.869472+0000","last_unstale":"2024-03-30T13:09:30.946693+0000","last_undegraded":"2024-03-30T13:09:30.946693+0000","last_fullsized":"2024-03-30T13:09:30.946693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:13.749687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.843918+0000","last_change":"2024-03-30T13:09:27.843918+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.843918+0000","last_undegraded":"2024-03-30T13:09:27.843918+0000","last_fullsized":"2024-03-30T13:09:27.843918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946433+0000","last_change":"2024-03-30T13:09:29.867232+0000","last_active":"2024-03-30T13:09:30.946433+0000","last_peered":"2024-03-30T13:09:30.946433+0000","last_clean":"2024-03-30T13:09:30.946433+0000","last_became_active":"2024-03-30T13:09:29.866898+0000","last_became_peered":"2024-03-30T13:09:29.866898+0000","last_unstale":"2024-03-30T13:09:30.946433+0000","last_undegraded":"2024-03-30T13:09:30.946433+0000","last_fullsized":"2024-03-30T13:09:30.946433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:36:33.086982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947146+0000","last_change":"2024-03-30T13:09:28.881005+0000","last_active":"2024-03-30T13:09:30.947146+0000","last_peered":"2024-03-30T13:09:30.947146+0000","last_clean":"2024-03-30T13:09:30.947146+0000","last_became_active":"2024-03-30T13:09:28.880255+0000","last_became_peered":"2024-03-30T13:09:28.880255+0000","last_unstale":"2024-03-30T13:09:30.947146+0000","last_undegraded":"2024-03-30T13:09:30.947146+0000","last_fullsized":"2024-03-30T13:09:30.947146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:40.502300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.836034+0000","last_change":"2024-03-30T13:09:27.836034+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.836034+0000","last_undegraded":"2024-03-30T13:09:27.836034+0000","last_fullsized":"2024-03-30T13:09:27.836034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947978+0000","last_change":"2024-03-30T13:09:29.877519+0000","last_active":"2024-03-30T13:09:30.947978+0000","last_peered":"2024-03-30T13:09:30.947978+0000","last_clean":"2024-03-30T13:09:30.947978+0000","last_became_active":"2024-03-30T13:09:29.877116+0000","last_became_peered":"2024-03-30T13:09:29.877116+0000","last_unstale":"2024-03-30T13:09:30.947978+0000","last_undegraded":"2024-03-30T13:09:30.947978+0000","last_fullsized":"2024-03-30T13:09:30.947978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:14:47.916843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.840975+0000","last_change":"2024-03-30T13:09:27.840975+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.840975+0000","last_undegraded":"2024-03-30T13:09:27.840975+0000","last_fullsized":"2024-03-30T13:09:27.840975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.836922+0000","last_change":"2024-03-30T13:09:27.836922+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.836922+0000","last_undegraded":"2024-03-30T13:09:27.836922+0000","last_fullsized":"2024-03-30T13:09:27.836922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.841284+0000","last_change":"2024-03-30T13:09:27.841284+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.841284+0000","last_undegraded":"2024-03-30T13:09:27.841284+0000","last_fullsized":"2024-03-30T13:09:27.841284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.836770+0000","last_change":"2024-03-30T13:09:27.836770+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.836770+0000","last_undegraded":"2024-03-30T13:09:27.836770+0000","last_fullsized":"2024-03-30T13:09:27.836770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.841762+0000","last_change":"2024-03-30T13:09:27.841762+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.841762+0000","last_undegraded":"2024-03-30T13:09:27.841762+0000","last_fullsized":"2024-03-30T13:09:27.841762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947407+0000","last_change":"2024-03-30T13:09:28.875196+0000","last_active":"2024-03-30T13:09:30.947407+0000","last_peered":"2024-03-30T13:09:30.947407+0000","last_clean":"2024-03-30T13:09:30.947407+0000","last_became_active":"2024-03-30T13:09:28.872737+0000","last_became_peered":"2024-03-30T13:09:28.872737+0000","last_unstale":"2024-03-30T13:09:30.947407+0000","last_undegraded":"2024-03-30T13:09:30.947407+0000","last_fullsized":"2024-03-30T13:09:30.947407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:41.511149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947253+0000","last_change":"2024-03-30T13:09:29.872890+0000","last_active":"2024-03-30T13:09:30.947253+0000","last_peered":"2024-03-30T13:09:30.947253+0000","last_clean":"2024-03-30T13:09:30.947253+0000","last_became_active":"2024-03-30T13:09:29.872187+0000","last_became_peered":"2024-03-30T13:09:29.872187+0000","last_unstale":"2024-03-30T13:09:30.947253+0000","last_undegraded":"2024-03-30T13:09:30.947253+0000","last_fullsized":"2024-03-30T13:09:30.947253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:52:42.329062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.840274+0000","last_change":"2024-03-30T13:09:27.840274+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.840274+0000","last_undegraded":"2024-03-30T13:09:27.840274+0000","last_fullsized":"2024-03-30T13:09:27.840274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:09:28.831621+0000","last_change":"2024-03-30T13:09:28.831621+0000","last_active":"2024-03-30T13:09:28.831621+0000","last_peered":"2024-03-30T13:09:28.831621+0000","last_clean":"2024-03-30T13:09:28.831621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:28.831621+0000","last_undegraded":"2024-03-30T13:09:28.831621+0000","last_fullsized":"2024-03-30T13:09:28.831621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-03-30T13:09:27.844781+0000","last_change":"2024-03-30T13:09:27.844781+0000","last_active":"2024-03-30T13:09:27.826926+0000","last_peered":"2024-03-30T13:09:27.826926+0000","last_clean":"2024-03-30T13:09:27.826926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:09:27.844781+0000","last_undegraded":"2024-03-30T13:09:27.844781+0000","last_fullsized":"2024-03-30T13:09:27.844781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-30T13:09:27.842856+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:09:27.842856+0000","last_peered":"2024-03-30T13:09:27.842856+0000","last_clean":"2024-03-30T13:09:27.842856+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:09:27.842856+0000","last_undegraded":"2024-03-30T13:09:27.842856+0000","last_fullsized":"2024-03-30T13:09:27.842856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":104,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":719873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":123688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":123688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":123688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":123688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":719873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":148951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":142617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:09:34.024 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:09:34.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8ae15f640 1 Processor -- start 2024-03-30T13:09:34.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8ae15f640 1 -- start start 2024-03-30T13:09:34.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8ae15f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb8a815fc60 0x7fb8a80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8ae15f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8a815d350 0x7fb8a815d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8ae15f640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a815ce50 con 0x7fb8a815f050 2024-03-30T13:09:34.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8ae15f640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb8a80b4f70 con 0x7fb8a815fc60 2024-03-30T13:09:34.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8ae15f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a80b5250 con 0x7fb8a815d350 2024-03-30T13:09:34.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8a77fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb8a815fc60 0x7fb8a80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:34.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8a7fff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8a815d350 0x7fb8a815d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:34.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb89ffff640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb8a815f050 0x7fb8a815f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:47210/0 (socket says 172.21.15.83:47210) 2024-03-30T13:09:34.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb89ffff640 1 -- 172.21.15.83:0/1386019401 learned_addr learned my addr 172.21.15.83:0/1386019401 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:34.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8a7fff640 1 -- 172.21.15.83:0/1386019401 >> v2:172.21.15.153:3300/0 conn(0x7fb8a815fc60 msgr2=0x7fb8a80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:34.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8a7fff640 1 --2- 172.21.15.83:0/1386019401 >> v2:172.21.15.153:3300/0 conn(0x7fb8a815fc60 0x7fb8a80b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8a7fff640 1 -- 172.21.15.83:0/1386019401 >> v1:172.21.15.153:6789/0 conn(0x7fb8a815f050 legacy=0x7fb8a815f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.178+0000 7fb8a7fff640 1 -- 172.21.15.83:0/1386019401 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a80b5530 con 0x7fb8a815d350 2024-03-30T13:09:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.182+0000 7fb8a7fff640 1 --2- 172.21.15.83:0/1386019401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8a815d350 0x7fb8a815d7e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009d90 tx=0x7fb8a001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53eb0809874a4d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.182+0000 7fb8a6ffd640 1 -- 172.21.15.83:0/1386019401 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00b2070 con 0x7fb8a815d350 2024-03-30T13:09:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.182+0000 7fb8a6ffd640 1 -- 172.21.15.83:0/1386019401 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a00a5a20 con 0x7fb8a815d350 2024-03-30T13:09:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.182+0000 7fb8a6ffd640 1 -- 172.21.15.83:0/1386019401 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00a5df0 con 0x7fb8a815d350 2024-03-30T13:09:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.182+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1386019401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8a815d350 msgr2=0x7fb8a815d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.182+0000 7fb8ae15f640 1 --2- 172.21.15.83:0/1386019401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8a815d350 0x7fb8a815d7e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009d90 tx=0x7fb8a001c940 comp rx=0 tx=0).stop 2024-03-30T13:09:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.182+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1386019401 shutdown_connections 2024-03-30T13:09:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.182+0000 7fb8ae15f640 1 --2- 172.21.15.83:0/1386019401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8a815d350 0x7fb8a815d7e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.182+0000 7fb8ae15f640 1 --2- 172.21.15.83:0/1386019401 >> v2:172.21.15.153:3300/0 conn(0x7fb8a815fc60 0x7fb8a80b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.182+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1386019401 >> 172.21.15.83:0/1386019401 conn(0x7fb8a80b68c0 msgr2=0x7fb8a80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.182+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1386019401 shutdown_connections 2024-03-30T13:09:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.182+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1386019401 wait complete. 2024-03-30T13:09:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8ae15f640 1 Processor -- start 2024-03-30T13:09:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8ae15f640 1 -- start start 2024-03-30T13:09:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8ae15f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8a815d350 0x7fb8a8149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8ae15f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8a815f050 0x7fb8a814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8ae15f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a815fc60 0x7fb8a80af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8ae15f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a8166380 con 0x7fb8a815d350 2024-03-30T13:09:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8ae15f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a815c9a0 con 0x7fb8a815fc60 2024-03-30T13:09:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8ae15f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a8166500 con 0x7fb8a815f050 2024-03-30T13:09:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb89ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8a815d350 0x7fb8a8149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb89ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8a815d350 0x7fb8a8149880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45564/0 (socket says 172.21.15.83:45564) 2024-03-30T13:09:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb89ffff640 1 -- 172.21.15.83:0/1181032943 learned_addr learned my addr 172.21.15.83:0/1181032943 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8a77fe640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8a815f050 0x7fb8a814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8a7fff640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a815fc60 0x7fb8a80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb89ffff640 1 -- 172.21.15.83:0/1181032943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8a815f050 msgr2=0x7fb8a814b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb89ffff640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8a815f050 0x7fb8a814b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb89ffff640 1 -- 172.21.15.83:0/1181032943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a815fc60 msgr2=0x7fb8a80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb89ffff640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a815fc60 0x7fb8a80af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb89ffff640 1 -- 172.21.15.83:0/1181032943 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a8149dc0 con 0x7fb8a815d350 2024-03-30T13:09:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb89ffff640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8a815d350 0x7fb8a8149880 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c500 tx=0x7fb89800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8a4ff9640 1 -- 172.21.15.83:0/1181032943 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898017070 con 0x7fb8a815d350 2024-03-30T13:09:34.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8a4ff9640 1 -- 172.21.15.83:0/1181032943 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb898005cf0 con 0x7fb8a815d350 2024-03-30T13:09:34.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1181032943 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a814a7a0 con 0x7fb8a815d350 2024-03-30T13:09:34.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8a4ff9640 1 -- 172.21.15.83:0/1181032943 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8980072f0 con 0x7fb8a815d350 2024-03-30T13:09:34.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1181032943 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a814ad40 con 0x7fb8a815d350 2024-03-30T13:09:34.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1181032943 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a8068dd0 con 0x7fb8a815d350 2024-03-30T13:09:34.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8a4ff9640 1 -- 172.21.15.83:0/1181032943 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb89801a070 con 0x7fb8a815d350 2024-03-30T13:09:34.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.186+0000 7fb8a4ff9640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb888067fc0 0x7fb88806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.190+0000 7fb8a77fe640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb888067fc0 0x7fb88806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:34.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.190+0000 7fb8a4ff9640 1 -- 172.21.15.83:0/1181032943 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb898085770 con 0x7fb8a815d350 2024-03-30T13:09:34.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.190+0000 7fb8a77fe640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb888067fc0 0x7fb88806a480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8067a60 tx=0x7fb890008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:34.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.194+0000 7fb8a4ff9640 1 -- 172.21.15.83:0/1181032943 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb8a8149dc0 con 0x7fb8a815d350 2024-03-30T13:09:34.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.350+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1181032943 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8a814c7b0 con 0x7fb888067fc0 2024-03-30T13:09:34.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.354+0000 7fb8a4ff9640 1 -- 172.21.15.83:0/1181032943 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251949 (secure 0 0 0) 0x7fb8a814c7b0 con 0x7fb888067fc0 2024-03-30T13:09:34.363 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:34.364 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:09:34.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.358+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1181032943 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb888067fc0 msgr2=0x7fb88806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.358+0000 7fb8ae15f640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb888067fc0 0x7fb88806a480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8067a60 tx=0x7fb890008040 comp rx=0 tx=0).stop 2024-03-30T13:09:34.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.358+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1181032943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8a815d350 msgr2=0x7fb8a8149880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.358+0000 7fb8ae15f640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8a815d350 0x7fb8a8149880 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c500 tx=0x7fb89800c9c0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.358+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1181032943 shutdown_connections 2024-03-30T13:09:34.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.358+0000 7fb8ae15f640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb888067fc0 0x7fb88806a480 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.358+0000 7fb8ae15f640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a815fc60 0x7fb8a80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.358+0000 7fb8ae15f640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8a815f050 0x7fb8a814b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.358+0000 7fb8ae15f640 1 --2- 172.21.15.83:0/1181032943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8a815d350 0x7fb8a8149880 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.358+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1181032943 >> 172.21.15.83:0/1181032943 conn(0x7fb8a80b68c0 msgr2=0x7fb8a80b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:34.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.358+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1181032943 shutdown_connections 2024-03-30T13:09:34.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.358+0000 7fb8ae15f640 1 -- 172.21.15.83:0/1181032943 wait complete. 2024-03-30T13:09:34.379 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-03-30T13:09:34.160415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224512,"kb_used_data":4156,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750208,"statfs":{"total":773094113280,"available":772864212992,"internally_reserved":0,"allocated":4255744,"data_stored":2370032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001421"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.878126+0000","last_change":"2024-03-30T13:09:29.898609+0000","last_active":"2024-03-30T13:09:30.878126+0000","last_peered":"2024-03-30T13:09:30.878126+0000","last_clean":"2024-03-30T13:09:30.878126+0000","last_became_active":"2024-03-30T13:09:29.895103+0000","last_became_peered":"2024-03-30T13:09:29.895103+0000","last_unstale":"2024-03-30T13:09:30.878126+0000","last_undegraded":"2024-03-30T13:09:30.878126+0000","last_fullsized":"2024-03-30T13:09:30.878126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:56:27.554107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.872934+0000","last_change":"2024-03-30T13:09:29.884191+0000","last_active":"2024-03-30T13:09:30.872934+0000","last_peered":"2024-03-30T13:09:30.872934+0000","last_clean":"2024-03-30T13:09:30.872934+0000","last_became_active":"2024-03-30T13:09:29.883808+0000","last_became_peered":"2024-03-30T13:09:29.883808+0000","last_unstale":"2024-03-30T13:09:30.872934+0000","last_undegraded":"2024-03-30T13:09:30.872934+0000","last_fullsized":"2024-03-30T13:09:30.872934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:49:43.700095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948647+0000","last_change":"2024-03-30T13:09:29.894457+0000","last_active":"2024-03-30T13:09:30.948647+0000","last_peered":"2024-03-30T13:09:30.948647+0000","last_clean":"2024-03-30T13:09:30.948647+0000","last_became_active":"2024-03-30T13:09:29.893820+0000","last_became_peered":"2024-03-30T13:09:29.893820+0000","last_unstale":"2024-03-30T13:09:30.948647+0000","last_undegraded":"2024-03-30T13:09:30.948647+0000","last_fullsized":"2024-03-30T13:09:30.948647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:29.742588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946835+0000","last_change":"2024-03-30T13:09:29.885224+0000","last_active":"2024-03-30T13:09:30.946835+0000","last_peered":"2024-03-30T13:09:30.946835+0000","last_clean":"2024-03-30T13:09:30.946835+0000","last_became_active":"2024-03-30T13:09:29.884598+0000","last_became_peered":"2024-03-30T13:09:29.884598+0000","last_unstale":"2024-03-30T13:09:30.946835+0000","last_undegraded":"2024-03-30T13:09:30.946835+0000","last_fullsized":"2024-03-30T13:09:30.946835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:20:06.155959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946549+0000","last_change":"2024-03-30T13:09:29.885974+0000","last_active":"2024-03-30T13:09:30.946549+0000","last_peered":"2024-03-30T13:09:30.946549+0000","last_clean":"2024-03-30T13:09:30.946549+0000","last_became_active":"2024-03-30T13:09:29.885560+0000","last_became_peered":"2024-03-30T13:09:29.885560+0000","last_unstale":"2024-03-30T13:09:30.946549+0000","last_undegraded":"2024-03-30T13:09:30.946549+0000","last_fullsized":"2024-03-30T13:09:30.946549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:42.515844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.871570+0000","last_change":"2024-03-30T13:09:29.883016+0000","last_active":"2024-03-30T13:09:30.871570+0000","last_peered":"2024-03-30T13:09:30.871570+0000","last_clean":"2024-03-30T13:09:30.871570+0000","last_became_active":"2024-03-30T13:09:29.882416+0000","last_became_peered":"2024-03-30T13:09:29.882416+0000","last_unstale":"2024-03-30T13:09:30.871570+0000","last_undegraded":"2024-03-30T13:09:30.871570+0000","last_fullsized":"2024-03-30T13:09:30.871570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:00:13.647145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.876791+0000","last_change":"2024-03-30T13:09:29.908231+0000","last_active":"2024-03-30T13:09:30.876791+0000","last_peered":"2024-03-30T13:09:30.876791+0000","last_clean":"2024-03-30T13:09:30.876791+0000","last_became_active":"2024-03-30T13:09:29.906937+0000","last_became_peered":"2024-03-30T13:09:29.906937+0000","last_unstale":"2024-03-30T13:09:30.876791+0000","last_undegraded":"2024-03-30T13:09:30.876791+0000","last_fullsized":"2024-03-30T13:09:30.876791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:01:43.778926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.875970+0000","last_change":"2024-03-30T13:09:29.879080+0000","last_active":"2024-03-30T13:09:30.875970+0000","last_peered":"2024-03-30T13:09:30.875970+0000","last_clean":"2024-03-30T13:09:30.875970+0000","last_became_active":"2024-03-30T13:09:29.878138+0000","last_became_peered":"2024-03-30T13:09:29.878138+0000","last_unstale":"2024-03-30T13:09:30.875970+0000","last_undegraded":"2024-03-30T13:09:30.875970+0000","last_fullsized":"2024-03-30T13:09:30.875970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:51.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.949865+0000","last_change":"2024-03-30T13:09:29.890662+0000","last_active":"2024-03-30T13:09:30.949865+0000","last_peered":"2024-03-30T13:09:30.949865+0000","last_clean":"2024-03-30T13:09:30.949865+0000","last_became_active":"2024-03-30T13:09:29.889856+0000","last_became_peered":"2024-03-30T13:09:29.889856+0000","last_unstale":"2024-03-30T13:09:30.949865+0000","last_undegraded":"2024-03-30T13:09:30.949865+0000","last_fullsized":"2024-03-30T13:09:30.949865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:21.172612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946664+0000","last_change":"2024-03-30T13:09:29.887294+0000","last_active":"2024-03-30T13:09:30.946664+0000","last_peered":"2024-03-30T13:09:30.946664+0000","last_clean":"2024-03-30T13:09:30.946664+0000","last_became_active":"2024-03-30T13:09:29.885512+0000","last_became_peered":"2024-03-30T13:09:29.885512+0000","last_unstale":"2024-03-30T13:09:30.946664+0000","last_undegraded":"2024-03-30T13:09:30.946664+0000","last_fullsized":"2024-03-30T13:09:30.946664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:01:43.778926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.877152+0000","last_change":"2024-03-30T13:09:29.890961+0000","last_active":"2024-03-30T13:09:30.877152+0000","last_peered":"2024-03-30T13:09:30.877152+0000","last_clean":"2024-03-30T13:09:30.877152+0000","last_became_active":"2024-03-30T13:09:29.890239+0000","last_became_peered":"2024-03-30T13:09:29.890239+0000","last_unstale":"2024-03-30T13:09:30.877152+0000","last_undegraded":"2024-03-30T13:09:30.877152+0000","last_fullsized":"2024-03-30T13:09:30.877152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:14:38.151430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948131+0000","last_change":"2024-03-30T13:09:29.887772+0000","last_active":"2024-03-30T13:09:30.948131+0000","last_peered":"2024-03-30T13:09:30.948131+0000","last_clean":"2024-03-30T13:09:30.948131+0000","last_became_active":"2024-03-30T13:09:29.886913+0000","last_became_peered":"2024-03-30T13:09:29.886913+0000","last_unstale":"2024-03-30T13:09:30.948131+0000","last_undegraded":"2024-03-30T13:09:30.948131+0000","last_fullsized":"2024-03-30T13:09:30.948131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:14:38.151430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946716+0000","last_change":"2024-03-30T13:09:29.870580+0000","last_active":"2024-03-30T13:09:30.946716+0000","last_peered":"2024-03-30T13:09:30.946716+0000","last_clean":"2024-03-30T13:09:30.946716+0000","last_became_active":"2024-03-30T13:09:29.870220+0000","last_became_peered":"2024-03-30T13:09:29.870220+0000","last_unstale":"2024-03-30T13:09:30.946716+0000","last_undegraded":"2024-03-30T13:09:30.946716+0000","last_fullsized":"2024-03-30T13:09:30.946716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:33:50.145715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.871575+0000","last_change":"2024-03-30T13:09:29.883130+0000","last_active":"2024-03-30T13:09:30.871575+0000","last_peered":"2024-03-30T13:09:30.871575+0000","last_clean":"2024-03-30T13:09:30.871575+0000","last_became_active":"2024-03-30T13:09:29.882840+0000","last_became_peered":"2024-03-30T13:09:29.882840+0000","last_unstale":"2024-03-30T13:09:30.871575+0000","last_undegraded":"2024-03-30T13:09:30.871575+0000","last_fullsized":"2024-03-30T13:09:30.871575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:29.742588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947554+0000","last_change":"2024-03-30T13:09:29.906064+0000","last_active":"2024-03-30T13:09:30.947554+0000","last_peered":"2024-03-30T13:09:30.947554+0000","last_clean":"2024-03-30T13:09:30.947554+0000","last_became_active":"2024-03-30T13:09:29.905464+0000","last_became_peered":"2024-03-30T13:09:29.905464+0000","last_unstale":"2024-03-30T13:09:30.947554+0000","last_undegraded":"2024-03-30T13:09:30.947554+0000","last_fullsized":"2024-03-30T13:09:30.947554+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:20:06.155959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.877645+0000","last_change":"2024-03-30T13:09:29.892848+0000","last_active":"2024-03-30T13:09:30.877645+0000","last_peered":"2024-03-30T13:09:30.877645+0000","last_clean":"2024-03-30T13:09:30.877645+0000","last_became_active":"2024-03-30T13:09:29.892131+0000","last_became_peered":"2024-03-30T13:09:29.892131+0000","last_unstale":"2024-03-30T13:09:30.877645+0000","last_undegraded":"2024-03-30T13:09:30.877645+0000","last_fullsized":"2024-03-30T13:09:30.877645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:29.742588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.877324+0000","last_change":"2024-03-30T13:09:29.903459+0000","last_active":"2024-03-30T13:09:30.877324+0000","last_peered":"2024-03-30T13:09:30.877324+0000","last_clean":"2024-03-30T13:09:30.877324+0000","last_became_active":"2024-03-30T13:09:29.902921+0000","last_became_peered":"2024-03-30T13:09:29.902921+0000","last_unstale":"2024-03-30T13:09:30.877324+0000","last_undegraded":"2024-03-30T13:09:30.877324+0000","last_fullsized":"2024-03-30T13:09:30.877324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:57:36.646682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.873139+0000","last_change":"2024-03-30T13:09:29.890170+0000","last_active":"2024-03-30T13:09:30.873139+0000","last_peered":"2024-03-30T13:09:30.873139+0000","last_clean":"2024-03-30T13:09:30.873139+0000","last_became_active":"2024-03-30T13:09:29.889704+0000","last_became_peered":"2024-03-30T13:09:29.889704+0000","last_unstale":"2024-03-30T13:09:30.873139+0000","last_undegraded":"2024-03-30T13:09:30.873139+0000","last_fullsized":"2024-03-30T13:09:30.873139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:54.616934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.872455+0000","last_change":"2024-03-30T13:09:29.890758+0000","last_active":"2024-03-30T13:09:30.872455+0000","last_peered":"2024-03-30T13:09:30.872455+0000","last_clean":"2024-03-30T13:09:30.872455+0000","last_became_active":"2024-03-30T13:09:29.890422+0000","last_became_peered":"2024-03-30T13:09:29.890422+0000","last_unstale":"2024-03-30T13:09:30.872455+0000","last_undegraded":"2024-03-30T13:09:30.872455+0000","last_fullsized":"2024-03-30T13:09:30.872455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:24:20.740307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947833+0000","last_change":"2024-03-30T13:09:29.882486+0000","last_active":"2024-03-30T13:09:30.947833+0000","last_peered":"2024-03-30T13:09:30.947833+0000","last_clean":"2024-03-30T13:09:30.947833+0000","last_became_active":"2024-03-30T13:09:29.881938+0000","last_became_peered":"2024-03-30T13:09:29.881938+0000","last_unstale":"2024-03-30T13:09:30.947833+0000","last_undegraded":"2024-03-30T13:09:30.947833+0000","last_fullsized":"2024-03-30T13:09:30.947833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:38:53.208942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948057+0000","last_change":"2024-03-30T13:09:29.868671+0000","last_active":"2024-03-30T13:09:30.948057+0000","last_peered":"2024-03-30T13:09:30.948057+0000","last_clean":"2024-03-30T13:09:30.948057+0000","last_became_active":"2024-03-30T13:09:29.867823+0000","last_became_peered":"2024-03-30T13:09:29.867823+0000","last_unstale":"2024-03-30T13:09:30.948057+0000","last_undegraded":"2024-03-30T13:09:30.948057+0000","last_fullsized":"2024-03-30T13:09:30.948057+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:13:44.984173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.949984+0000","last_change":"2024-03-30T13:09:29.885155+0000","last_active":"2024-03-30T13:09:30.949984+0000","last_peered":"2024-03-30T13:09:30.949984+0000","last_clean":"2024-03-30T13:09:30.949984+0000","last_became_active":"2024-03-30T13:09:29.884217+0000","last_became_peered":"2024-03-30T13:09:29.884217+0000","last_unstale":"2024-03-30T13:09:30.949984+0000","last_undegraded":"2024-03-30T13:09:30.949984+0000","last_fullsized":"2024-03-30T13:09:30.949984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:54:24.311844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.945297+0000","last_change":"2024-03-30T13:09:29.869312+0000","last_active":"2024-03-30T13:09:30.945297+0000","last_peered":"2024-03-30T13:09:30.945297+0000","last_clean":"2024-03-30T13:09:30.945297+0000","last_became_active":"2024-03-30T13:09:29.868971+0000","last_became_peered":"2024-03-30T13:09:29.868971+0000","last_unstale":"2024-03-30T13:09:30.945297+0000","last_undegraded":"2024-03-30T13:09:30.945297+0000","last_fullsized":"2024-03-30T13:09:30.945297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:09.082299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947241+0000","last_change":"2024-03-30T13:09:29.873497+0000","last_active":"2024-03-30T13:09:30.947241+0000","last_peered":"2024-03-30T13:09:30.947241+0000","last_clean":"2024-03-30T13:09:30.947241+0000","last_became_active":"2024-03-30T13:09:29.872722+0000","last_became_peered":"2024-03-30T13:09:29.872722+0000","last_unstale":"2024-03-30T13:09:30.947241+0000","last_undegraded":"2024-03-30T13:09:30.947241+0000","last_fullsized":"2024-03-30T13:09:30.947241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:01:43.778926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948185+0000","last_change":"2024-03-30T13:09:29.902117+0000","last_active":"2024-03-30T13:09:30.948185+0000","last_peered":"2024-03-30T13:09:30.948185+0000","last_clean":"2024-03-30T13:09:30.948185+0000","last_became_active":"2024-03-30T13:09:29.901805+0000","last_became_peered":"2024-03-30T13:09:29.901805+0000","last_unstale":"2024-03-30T13:09:30.948185+0000","last_undegraded":"2024-03-30T13:09:30.948185+0000","last_fullsized":"2024-03-30T13:09:30.948185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:34.220639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.873339+0000","last_change":"2024-03-30T13:09:29.902601+0000","last_active":"2024-03-30T13:09:30.873339+0000","last_peered":"2024-03-30T13:09:30.873339+0000","last_clean":"2024-03-30T13:09:30.873339+0000","last_became_active":"2024-03-30T13:09:29.902245+0000","last_became_peered":"2024-03-30T13:09:29.902245+0000","last_unstale":"2024-03-30T13:09:30.873339+0000","last_undegraded":"2024-03-30T13:09:30.873339+0000","last_fullsized":"2024-03-30T13:09:30.873339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:41:26.118302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947239+0000","last_change":"2024-03-30T13:09:29.879871+0000","last_active":"2024-03-30T13:09:30.947239+0000","last_peered":"2024-03-30T13:09:30.947239+0000","last_clean":"2024-03-30T13:09:30.947239+0000","last_became_active":"2024-03-30T13:09:29.879226+0000","last_became_peered":"2024-03-30T13:09:29.879226+0000","last_unstale":"2024-03-30T13:09:30.947239+0000","last_undegraded":"2024-03-30T13:09:30.947239+0000","last_fullsized":"2024-03-30T13:09:30.947239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:14:38.151430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948196+0000","last_change":"2024-03-30T13:09:29.873578+0000","last_active":"2024-03-30T13:09:30.948196+0000","last_peered":"2024-03-30T13:09:30.948196+0000","last_clean":"2024-03-30T13:09:30.948196+0000","last_became_active":"2024-03-30T13:09:29.872823+0000","last_became_peered":"2024-03-30T13:09:29.872823+0000","last_unstale":"2024-03-30T13:09:30.948196+0000","last_undegraded":"2024-03-30T13:09:30.948196+0000","last_fullsized":"2024-03-30T13:09:30.948196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:10.244810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948452+0000","last_change":"2024-03-30T13:09:29.886322+0000","last_active":"2024-03-30T13:09:30.948452+0000","last_peered":"2024-03-30T13:09:30.948452+0000","last_clean":"2024-03-30T13:09:30.948452+0000","last_became_active":"2024-03-30T13:09:29.885512+0000","last_became_peered":"2024-03-30T13:09:29.885512+0000","last_unstale":"2024-03-30T13:09:30.948452+0000","last_undegraded":"2024-03-30T13:09:30.948452+0000","last_fullsized":"2024-03-30T13:09:30.948452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:53:21.703122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.876793+0000","last_change":"2024-03-30T13:09:29.895915+0000","last_active":"2024-03-30T13:09:30.876793+0000","last_peered":"2024-03-30T13:09:30.876793+0000","last_clean":"2024-03-30T13:09:30.876793+0000","last_became_active":"2024-03-30T13:09:29.895205+0000","last_became_peered":"2024-03-30T13:09:29.895205+0000","last_unstale":"2024-03-30T13:09:30.876793+0000","last_undegraded":"2024-03-30T13:09:30.876793+0000","last_fullsized":"2024-03-30T13:09:30.876793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:20:06.155959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.876169+0000","last_change":"2024-03-30T13:09:29.894443+0000","last_active":"2024-03-30T13:09:30.876169+0000","last_peered":"2024-03-30T13:09:30.876169+0000","last_clean":"2024-03-30T13:09:30.876169+0000","last_became_active":"2024-03-30T13:09:29.890445+0000","last_became_peered":"2024-03-30T13:09:29.890445+0000","last_unstale":"2024-03-30T13:09:30.876169+0000","last_undegraded":"2024-03-30T13:09:30.876169+0000","last_fullsized":"2024-03-30T13:09:30.876169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:13.928750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.876406+0000","last_change":"2024-03-30T13:09:29.891236+0000","last_active":"2024-03-30T13:09:30.876406+0000","last_peered":"2024-03-30T13:09:30.876406+0000","last_clean":"2024-03-30T13:09:30.876406+0000","last_became_active":"2024-03-30T13:09:29.879944+0000","last_became_peered":"2024-03-30T13:09:29.879944+0000","last_unstale":"2024-03-30T13:09:30.876406+0000","last_undegraded":"2024-03-30T13:09:30.876406+0000","last_fullsized":"2024-03-30T13:09:30.876406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:27.429598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946075+0000","last_change":"2024-03-30T13:09:29.870176+0000","last_active":"2024-03-30T13:09:30.946075+0000","last_peered":"2024-03-30T13:09:30.946075+0000","last_clean":"2024-03-30T13:09:30.946075+0000","last_became_active":"2024-03-30T13:09:29.869877+0000","last_became_peered":"2024-03-30T13:09:29.869877+0000","last_unstale":"2024-03-30T13:09:30.946075+0000","last_undegraded":"2024-03-30T13:09:30.946075+0000","last_fullsized":"2024-03-30T13:09:30.946075+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:51.611683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.878129+0000","last_change":"2024-03-30T13:09:28.883286+0000","last_active":"2024-03-30T13:09:30.878129+0000","last_peered":"2024-03-30T13:09:30.878129+0000","last_clean":"2024-03-30T13:09:30.878129+0000","last_became_active":"2024-03-30T13:09:28.882601+0000","last_became_peered":"2024-03-30T13:09:28.882601+0000","last_unstale":"2024-03-30T13:09:30.878129+0000","last_undegraded":"2024-03-30T13:09:30.878129+0000","last_fullsized":"2024-03-30T13:09:30.878129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:30:34.737449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.878049+0000","last_change":"2024-03-30T13:09:29.900330+0000","last_active":"2024-03-30T13:09:30.878049+0000","last_peered":"2024-03-30T13:09:30.878049+0000","last_clean":"2024-03-30T13:09:30.878049+0000","last_became_active":"2024-03-30T13:09:29.899606+0000","last_became_peered":"2024-03-30T13:09:29.899606+0000","last_unstale":"2024-03-30T13:09:30.878049+0000","last_undegraded":"2024-03-30T13:09:30.878049+0000","last_fullsized":"2024-03-30T13:09:30.878049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:08:27.780349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946125+0000","last_change":"2024-03-30T13:09:28.888576+0000","last_active":"2024-03-30T13:09:30.946125+0000","last_peered":"2024-03-30T13:09:30.946125+0000","last_clean":"2024-03-30T13:09:30.946125+0000","last_became_active":"2024-03-30T13:09:28.888021+0000","last_became_peered":"2024-03-30T13:09:28.888021+0000","last_unstale":"2024-03-30T13:09:30.946125+0000","last_undegraded":"2024-03-30T13:09:30.946125+0000","last_fullsized":"2024-03-30T13:09:30.946125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:42.225609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.949257+0000","last_change":"2024-03-30T13:09:29.886539+0000","last_active":"2024-03-30T13:09:30.949257+0000","last_peered":"2024-03-30T13:09:30.949257+0000","last_clean":"2024-03-30T13:09:30.949257+0000","last_became_active":"2024-03-30T13:09:29.885773+0000","last_became_peered":"2024-03-30T13:09:29.885773+0000","last_unstale":"2024-03-30T13:09:30.949257+0000","last_undegraded":"2024-03-30T13:09:30.949257+0000","last_fullsized":"2024-03-30T13:09:30.949257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:10:19.372050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.872524+0000","last_change":"2024-03-30T13:09:28.872296+0000","last_active":"2024-03-30T13:09:30.872524+0000","last_peered":"2024-03-30T13:09:30.872524+0000","last_clean":"2024-03-30T13:09:30.872524+0000","last_became_active":"2024-03-30T13:09:28.872013+0000","last_became_peered":"2024-03-30T13:09:28.872013+0000","last_unstale":"2024-03-30T13:09:30.872524+0000","last_undegraded":"2024-03-30T13:09:30.872524+0000","last_fullsized":"2024-03-30T13:09:30.872524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:08:26.775655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947391+0000","last_change":"2024-03-30T13:09:29.879865+0000","last_active":"2024-03-30T13:09:30.947391+0000","last_peered":"2024-03-30T13:09:30.947391+0000","last_clean":"2024-03-30T13:09:30.947391+0000","last_became_active":"2024-03-30T13:09:29.878854+0000","last_became_peered":"2024-03-30T13:09:29.878854+0000","last_unstale":"2024-03-30T13:09:30.947391+0000","last_undegraded":"2024-03-30T13:09:30.947391+0000","last_fullsized":"2024-03-30T13:09:30.947391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:10.244810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947927+0000","last_change":"2024-03-30T13:09:28.880430+0000","last_active":"2024-03-30T13:09:30.947927+0000","last_peered":"2024-03-30T13:09:30.947927+0000","last_clean":"2024-03-30T13:09:30.947927+0000","last_became_active":"2024-03-30T13:09:28.880137+0000","last_became_peered":"2024-03-30T13:09:28.880137+0000","last_unstale":"2024-03-30T13:09:30.947927+0000","last_undegraded":"2024-03-30T13:09:30.947927+0000","last_fullsized":"2024-03-30T13:09:30.947927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:11:42.230422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.877195+0000","last_change":"2024-03-30T13:09:29.888121+0000","last_active":"2024-03-30T13:09:30.877195+0000","last_peered":"2024-03-30T13:09:30.877195+0000","last_clean":"2024-03-30T13:09:30.877195+0000","last_became_active":"2024-03-30T13:09:29.880460+0000","last_became_peered":"2024-03-30T13:09:29.880460+0000","last_unstale":"2024-03-30T13:09:30.877195+0000","last_undegraded":"2024-03-30T13:09:30.877195+0000","last_fullsized":"2024-03-30T13:09:30.877195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:10.244810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948704+0000","last_change":"2024-03-30T13:09:28.871392+0000","last_active":"2024-03-30T13:09:30.948704+0000","last_peered":"2024-03-30T13:09:30.948704+0000","last_clean":"2024-03-30T13:09:30.948704+0000","last_became_active":"2024-03-30T13:09:28.870685+0000","last_became_peered":"2024-03-30T13:09:28.870685+0000","last_unstale":"2024-03-30T13:09:30.948704+0000","last_undegraded":"2024-03-30T13:09:30.948704+0000","last_fullsized":"2024-03-30T13:09:30.948704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:50.691759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947912+0000","last_change":"2024-03-30T13:09:29.873807+0000","last_active":"2024-03-30T13:09:30.947912+0000","last_peered":"2024-03-30T13:09:30.947912+0000","last_clean":"2024-03-30T13:09:30.947912+0000","last_became_active":"2024-03-30T13:09:29.872980+0000","last_became_peered":"2024-03-30T13:09:29.872980+0000","last_unstale":"2024-03-30T13:09:30.947912+0000","last_undegraded":"2024-03-30T13:09:30.947912+0000","last_fullsized":"2024-03-30T13:09:30.947912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:47.132747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.949913+0000","last_change":"2024-03-30T13:09:28.867269+0000","last_active":"2024-03-30T13:09:30.949913+0000","last_peered":"2024-03-30T13:09:30.949913+0000","last_clean":"2024-03-30T13:09:30.949913+0000","last_became_active":"2024-03-30T13:09:28.866017+0000","last_became_peered":"2024-03-30T13:09:28.866017+0000","last_unstale":"2024-03-30T13:09:30.949913+0000","last_undegraded":"2024-03-30T13:09:30.949913+0000","last_fullsized":"2024-03-30T13:09:30.949913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:12.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947234+0000","last_change":"2024-03-30T13:09:29.882556+0000","last_active":"2024-03-30T13:09:30.947234+0000","last_peered":"2024-03-30T13:09:30.947234+0000","last_clean":"2024-03-30T13:09:30.947234+0000","last_became_active":"2024-03-30T13:09:29.881722+0000","last_became_peered":"2024-03-30T13:09:29.881722+0000","last_unstale":"2024-03-30T13:09:30.947234+0000","last_undegraded":"2024-03-30T13:09:30.947234+0000","last_fullsized":"2024-03-30T13:09:30.947234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:40:32.144646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.871206+0000","last_change":"2024-03-30T13:09:28.868952+0000","last_active":"2024-03-30T13:09:30.871206+0000","last_peered":"2024-03-30T13:09:30.871206+0000","last_clean":"2024-03-30T13:09:30.871206+0000","last_became_active":"2024-03-30T13:09:28.868660+0000","last_became_peered":"2024-03-30T13:09:28.868660+0000","last_unstale":"2024-03-30T13:09:30.871206+0000","last_undegraded":"2024-03-30T13:09:30.871206+0000","last_fullsized":"2024-03-30T13:09:30.871206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:07.815808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946468+0000","last_change":"2024-03-30T13:09:29.880943+0000","last_active":"2024-03-30T13:09:30.946468+0000","last_peered":"2024-03-30T13:09:30.946468+0000","last_clean":"2024-03-30T13:09:30.946468+0000","last_became_active":"2024-03-30T13:09:29.878834+0000","last_became_peered":"2024-03-30T13:09:29.878834+0000","last_unstale":"2024-03-30T13:09:30.946468+0000","last_undegraded":"2024-03-30T13:09:30.946468+0000","last_fullsized":"2024-03-30T13:09:30.946468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:45.100186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947486+0000","last_change":"2024-03-30T13:09:28.877610+0000","last_active":"2024-03-30T13:09:30.947486+0000","last_peered":"2024-03-30T13:09:30.947486+0000","last_clean":"2024-03-30T13:09:30.947486+0000","last_became_active":"2024-03-30T13:09:28.876759+0000","last_became_peered":"2024-03-30T13:09:28.876759+0000","last_unstale":"2024-03-30T13:09:30.947486+0000","last_undegraded":"2024-03-30T13:09:30.947486+0000","last_fullsized":"2024-03-30T13:09:30.947486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:12:45.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948482+0000","last_change":"2024-03-30T13:09:29.888077+0000","last_active":"2024-03-30T13:09:30.948482+0000","last_peered":"2024-03-30T13:09:30.948482+0000","last_clean":"2024-03-30T13:09:30.948482+0000","last_became_active":"2024-03-30T13:09:29.887370+0000","last_became_peered":"2024-03-30T13:09:29.887370+0000","last_unstale":"2024-03-30T13:09:30.948482+0000","last_undegraded":"2024-03-30T13:09:30.948482+0000","last_fullsized":"2024-03-30T13:09:30.948482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:34.220639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.871773+0000","last_change":"2024-03-30T13:09:28.878650+0000","last_active":"2024-03-30T13:09:30.871773+0000","last_peered":"2024-03-30T13:09:30.871773+0000","last_clean":"2024-03-30T13:09:30.871773+0000","last_became_active":"2024-03-30T13:09:28.877721+0000","last_became_peered":"2024-03-30T13:09:28.877721+0000","last_unstale":"2024-03-30T13:09:30.871773+0000","last_undegraded":"2024-03-30T13:09:30.871773+0000","last_fullsized":"2024-03-30T13:09:30.871773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:08.077604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.871789+0000","last_change":"2024-03-30T13:09:29.891188+0000","last_active":"2024-03-30T13:09:30.871789+0000","last_peered":"2024-03-30T13:09:30.871789+0000","last_clean":"2024-03-30T13:09:30.871789+0000","last_became_active":"2024-03-30T13:09:29.890360+0000","last_became_peered":"2024-03-30T13:09:29.890360+0000","last_unstale":"2024-03-30T13:09:30.871789+0000","last_undegraded":"2024-03-30T13:09:30.871789+0000","last_fullsized":"2024-03-30T13:09:30.871789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:28:36.789572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946222+0000","last_change":"2024-03-30T13:09:28.860937+0000","last_active":"2024-03-30T13:09:30.946222+0000","last_peered":"2024-03-30T13:09:30.946222+0000","last_clean":"2024-03-30T13:09:30.946222+0000","last_became_active":"2024-03-30T13:09:28.860188+0000","last_became_peered":"2024-03-30T13:09:28.860188+0000","last_unstale":"2024-03-30T13:09:30.946222+0000","last_undegraded":"2024-03-30T13:09:30.946222+0000","last_fullsized":"2024-03-30T13:09:30.946222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:07.815808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.872002+0000","last_change":"2024-03-30T13:09:29.902024+0000","last_active":"2024-03-30T13:09:30.872002+0000","last_peered":"2024-03-30T13:09:30.872002+0000","last_clean":"2024-03-30T13:09:30.872002+0000","last_became_active":"2024-03-30T13:09:29.901546+0000","last_became_peered":"2024-03-30T13:09:29.901546+0000","last_unstale":"2024-03-30T13:09:30.872002+0000","last_undegraded":"2024-03-30T13:09:30.872002+0000","last_fullsized":"2024-03-30T13:09:30.872002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:02:21.980409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948456+0000","last_change":"2024-03-30T13:09:28.873299+0000","last_active":"2024-03-30T13:09:30.948456+0000","last_peered":"2024-03-30T13:09:30.948456+0000","last_clean":"2024-03-30T13:09:30.948456+0000","last_became_active":"2024-03-30T13:09:28.872558+0000","last_became_peered":"2024-03-30T13:09:28.872558+0000","last_unstale":"2024-03-30T13:09:30.948456+0000","last_undegraded":"2024-03-30T13:09:30.948456+0000","last_fullsized":"2024-03-30T13:09:30.948456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:07.815808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948304+0000","last_change":"2024-03-30T13:09:29.900687+0000","last_active":"2024-03-30T13:09:30.948304+0000","last_peered":"2024-03-30T13:09:30.948304+0000","last_clean":"2024-03-30T13:09:30.948304+0000","last_became_active":"2024-03-30T13:09:29.900019+0000","last_became_peered":"2024-03-30T13:09:29.900019+0000","last_unstale":"2024-03-30T13:09:30.948304+0000","last_undegraded":"2024-03-30T13:09:30.948304+0000","last_fullsized":"2024-03-30T13:09:30.948304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:57:36.646682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.872161+0000","last_change":"2024-03-30T13:09:28.880353+0000","last_active":"2024-03-30T13:09:30.872161+0000","last_peered":"2024-03-30T13:09:30.872161+0000","last_clean":"2024-03-30T13:09:30.872161+0000","last_became_active":"2024-03-30T13:09:28.880074+0000","last_became_peered":"2024-03-30T13:09:28.880074+0000","last_unstale":"2024-03-30T13:09:30.872161+0000","last_undegraded":"2024-03-30T13:09:30.872161+0000","last_fullsized":"2024-03-30T13:09:30.872161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:56:26.549413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947248+0000","last_change":"2024-03-30T13:09:29.880055+0000","last_active":"2024-03-30T13:09:30.947248+0000","last_peered":"2024-03-30T13:09:30.947248+0000","last_clean":"2024-03-30T13:09:30.947248+0000","last_became_active":"2024-03-30T13:09:29.879569+0000","last_became_peered":"2024-03-30T13:09:29.879569+0000","last_unstale":"2024-03-30T13:09:30.947248+0000","last_undegraded":"2024-03-30T13:09:30.947248+0000","last_fullsized":"2024-03-30T13:09:30.947248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:47.132747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948852+0000","last_change":"2024-03-30T13:09:28.883472+0000","last_active":"2024-03-30T13:09:30.948852+0000","last_peered":"2024-03-30T13:09:30.948852+0000","last_clean":"2024-03-30T13:09:30.948852+0000","last_became_active":"2024-03-30T13:09:28.882831+0000","last_became_peered":"2024-03-30T13:09:28.882831+0000","last_unstale":"2024-03-30T13:09:30.948852+0000","last_undegraded":"2024-03-30T13:09:30.948852+0000","last_fullsized":"2024-03-30T13:09:30.948852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:36:32.082287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.871748+0000","last_change":"2024-03-30T13:09:29.875607+0000","last_active":"2024-03-30T13:09:30.871748+0000","last_peered":"2024-03-30T13:09:30.871748+0000","last_clean":"2024-03-30T13:09:30.871748+0000","last_became_active":"2024-03-30T13:09:29.875232+0000","last_became_peered":"2024-03-30T13:09:29.875232+0000","last_unstale":"2024-03-30T13:09:30.871748+0000","last_undegraded":"2024-03-30T13:09:30.871748+0000","last_fullsized":"2024-03-30T13:09:30.871748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:59:13.920107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947360+0000","last_change":"2024-03-30T13:09:28.880451+0000","last_active":"2024-03-30T13:09:30.947360+0000","last_peered":"2024-03-30T13:09:30.947360+0000","last_clean":"2024-03-30T13:09:30.947360+0000","last_became_active":"2024-03-30T13:09:28.879671+0000","last_became_peered":"2024-03-30T13:09:28.879671+0000","last_unstale":"2024-03-30T13:09:30.947360+0000","last_undegraded":"2024-03-30T13:09:30.947360+0000","last_fullsized":"2024-03-30T13:09:30.947360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:07.815808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.876812+0000","last_change":"2024-03-30T13:09:29.892506+0000","last_active":"2024-03-30T13:09:30.876812+0000","last_peered":"2024-03-30T13:09:30.876812+0000","last_clean":"2024-03-30T13:09:30.876812+0000","last_became_active":"2024-03-30T13:09:29.891890+0000","last_became_peered":"2024-03-30T13:09:29.891890+0000","last_unstale":"2024-03-30T13:09:30.876812+0000","last_undegraded":"2024-03-30T13:09:30.876812+0000","last_fullsized":"2024-03-30T13:09:30.876812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:47.132747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.871244+0000","last_change":"2024-03-30T13:09:28.888380+0000","last_active":"2024-03-30T13:09:30.871244+0000","last_peered":"2024-03-30T13:09:30.871244+0000","last_clean":"2024-03-30T13:09:30.871244+0000","last_became_active":"2024-03-30T13:09:28.887981+0000","last_became_peered":"2024-03-30T13:09:28.887981+0000","last_unstale":"2024-03-30T13:09:30.871244+0000","last_undegraded":"2024-03-30T13:09:30.871244+0000","last_fullsized":"2024-03-30T13:09:30.871244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:12.924055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.876552+0000","last_change":"2024-03-30T13:09:29.902534+0000","last_active":"2024-03-30T13:09:30.876552+0000","last_peered":"2024-03-30T13:09:30.876552+0000","last_clean":"2024-03-30T13:09:30.876552+0000","last_became_active":"2024-03-30T13:09:29.901888+0000","last_became_peered":"2024-03-30T13:09:29.901888+0000","last_unstale":"2024-03-30T13:09:30.876552+0000","last_undegraded":"2024-03-30T13:09:30.876552+0000","last_fullsized":"2024-03-30T13:09:30.876552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:50:01.199801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.871139+0000","last_change":"2024-03-30T13:09:28.876523+0000","last_active":"2024-03-30T13:09:30.871139+0000","last_peered":"2024-03-30T13:09:30.871139+0000","last_clean":"2024-03-30T13:09:30.871139+0000","last_became_active":"2024-03-30T13:09:28.876212+0000","last_became_peered":"2024-03-30T13:09:28.876212+0000","last_unstale":"2024-03-30T13:09:30.871139+0000","last_undegraded":"2024-03-30T13:09:30.871139+0000","last_fullsized":"2024-03-30T13:09:30.871139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:35.853347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948028+0000","last_change":"2024-03-30T13:09:29.882375+0000","last_active":"2024-03-30T13:09:30.948028+0000","last_peered":"2024-03-30T13:09:30.948028+0000","last_clean":"2024-03-30T13:09:30.948028+0000","last_became_active":"2024-03-30T13:09:29.881482+0000","last_became_peered":"2024-03-30T13:09:29.881482+0000","last_unstale":"2024-03-30T13:09:30.948028+0000","last_undegraded":"2024-03-30T13:09:30.948028+0000","last_fullsized":"2024-03-30T13:09:30.948028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:55.993277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948276+0000","last_change":"2024-03-30T13:09:28.876886+0000","last_active":"2024-03-30T13:09:30.948276+0000","last_peered":"2024-03-30T13:09:30.948276+0000","last_clean":"2024-03-30T13:09:30.948276+0000","last_became_active":"2024-03-30T13:09:28.876584+0000","last_became_peered":"2024-03-30T13:09:28.876584+0000","last_unstale":"2024-03-30T13:09:30.948276+0000","last_undegraded":"2024-03-30T13:09:30.948276+0000","last_fullsized":"2024-03-30T13:09:30.948276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:56:26.549413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948789+0000","last_change":"2024-03-30T13:09:29.889495+0000","last_active":"2024-03-30T13:09:30.948789+0000","last_peered":"2024-03-30T13:09:30.948789+0000","last_clean":"2024-03-30T13:09:30.948789+0000","last_became_active":"2024-03-30T13:09:29.888720+0000","last_became_peered":"2024-03-30T13:09:29.888720+0000","last_unstale":"2024-03-30T13:09:30.948789+0000","last_undegraded":"2024-03-30T13:09:30.948789+0000","last_fullsized":"2024-03-30T13:09:30.948789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:00:13.647145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948310+0000","last_change":"2024-03-30T13:09:28.878852+0000","last_active":"2024-03-30T13:09:30.948310+0000","last_peered":"2024-03-30T13:09:30.948310+0000","last_clean":"2024-03-30T13:09:30.948310+0000","last_became_active":"2024-03-30T13:09:28.878141+0000","last_became_peered":"2024-03-30T13:09:28.878141+0000","last_unstale":"2024-03-30T13:09:30.948310+0000","last_undegraded":"2024-03-30T13:09:30.948310+0000","last_fullsized":"2024-03-30T13:09:30.948310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:45.992657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947412+0000","last_change":"2024-03-30T13:09:29.884943+0000","last_active":"2024-03-30T13:09:30.947412+0000","last_peered":"2024-03-30T13:09:30.947412+0000","last_clean":"2024-03-30T13:09:30.947412+0000","last_became_active":"2024-03-30T13:09:29.884136+0000","last_became_peered":"2024-03-30T13:09:29.884136+0000","last_unstale":"2024-03-30T13:09:30.947412+0000","last_undegraded":"2024-03-30T13:09:30.947412+0000","last_fullsized":"2024-03-30T13:09:30.947412+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:57:36.646682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948410+0000","last_change":"2024-03-30T13:09:28.870959+0000","last_active":"2024-03-30T13:09:30.948410+0000","last_peered":"2024-03-30T13:09:30.948410+0000","last_clean":"2024-03-30T13:09:30.948410+0000","last_became_active":"2024-03-30T13:09:28.870260+0000","last_became_peered":"2024-03-30T13:09:28.870260+0000","last_unstale":"2024-03-30T13:09:30.948410+0000","last_undegraded":"2024-03-30T13:09:30.948410+0000","last_fullsized":"2024-03-30T13:09:30.948410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:40:50.743992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948026+0000","last_change":"2024-03-30T13:09:29.892465+0000","last_active":"2024-03-30T13:09:30.948026+0000","last_peered":"2024-03-30T13:09:30.948026+0000","last_clean":"2024-03-30T13:09:30.948026+0000","last_became_active":"2024-03-30T13:09:29.892122+0000","last_became_peered":"2024-03-30T13:09:29.892122+0000","last_unstale":"2024-03-30T13:09:30.948026+0000","last_undegraded":"2024-03-30T13:09:30.948026+0000","last_fullsized":"2024-03-30T13:09:30.948026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:02.351984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.949436+0000","last_change":"2024-03-30T13:09:28.868343+0000","last_active":"2024-03-30T13:09:30.949436+0000","last_peered":"2024-03-30T13:09:30.949436+0000","last_clean":"2024-03-30T13:09:30.949436+0000","last_became_active":"2024-03-30T13:09:28.867641+0000","last_became_peered":"2024-03-30T13:09:28.867641+0000","last_unstale":"2024-03-30T13:09:30.949436+0000","last_undegraded":"2024-03-30T13:09:30.949436+0000","last_fullsized":"2024-03-30T13:09:30.949436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:48.242355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946373+0000","last_change":"2024-03-30T13:09:29.872735+0000","last_active":"2024-03-30T13:09:30.946373+0000","last_peered":"2024-03-30T13:09:30.946373+0000","last_clean":"2024-03-30T13:09:30.946373+0000","last_became_active":"2024-03-30T13:09:29.872283+0000","last_became_peered":"2024-03-30T13:09:29.872283+0000","last_unstale":"2024-03-30T13:09:30.946373+0000","last_undegraded":"2024-03-30T13:09:30.946373+0000","last_fullsized":"2024-03-30T13:09:30.946373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:51.696454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.945742+0000","last_change":"2024-03-30T13:09:28.881145+0000","last_active":"2024-03-30T13:09:30.945742+0000","last_peered":"2024-03-30T13:09:30.945742+0000","last_clean":"2024-03-30T13:09:30.945742+0000","last_became_active":"2024-03-30T13:09:28.880392+0000","last_became_peered":"2024-03-30T13:09:28.880392+0000","last_unstale":"2024-03-30T13:09:30.945742+0000","last_undegraded":"2024-03-30T13:09:30.945742+0000","last_fullsized":"2024-03-30T13:09:30.945742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:28:28.095670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946693+0000","last_change":"2024-03-30T13:09:29.869822+0000","last_active":"2024-03-30T13:09:30.946693+0000","last_peered":"2024-03-30T13:09:30.946693+0000","last_clean":"2024-03-30T13:09:30.946693+0000","last_became_active":"2024-03-30T13:09:29.869472+0000","last_became_peered":"2024-03-30T13:09:29.869472+0000","last_unstale":"2024-03-30T13:09:30.946693+0000","last_undegraded":"2024-03-30T13:09:30.946693+0000","last_fullsized":"2024-03-30T13:09:30.946693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:13.749687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.876052+0000","last_change":"2024-03-30T13:09:28.881165+0000","last_active":"2024-03-30T13:09:30.876052+0000","last_peered":"2024-03-30T13:09:30.876052+0000","last_clean":"2024-03-30T13:09:30.876052+0000","last_became_active":"2024-03-30T13:09:28.880442+0000","last_became_peered":"2024-03-30T13:09:28.880442+0000","last_unstale":"2024-03-30T13:09:30.876052+0000","last_undegraded":"2024-03-30T13:09:30.876052+0000","last_fullsized":"2024-03-30T13:09:30.876052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:00.463452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946433+0000","last_change":"2024-03-30T13:09:29.867232+0000","last_active":"2024-03-30T13:09:30.946433+0000","last_peered":"2024-03-30T13:09:30.946433+0000","last_clean":"2024-03-30T13:09:30.946433+0000","last_became_active":"2024-03-30T13:09:29.866898+0000","last_became_peered":"2024-03-30T13:09:29.866898+0000","last_unstale":"2024-03-30T13:09:30.946433+0000","last_undegraded":"2024-03-30T13:09:30.946433+0000","last_fullsized":"2024-03-30T13:09:30.946433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:36:33.086982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947146+0000","last_change":"2024-03-30T13:09:28.881005+0000","last_active":"2024-03-30T13:09:30.947146+0000","last_peered":"2024-03-30T13:09:30.947146+0000","last_clean":"2024-03-30T13:09:30.947146+0000","last_became_active":"2024-03-30T13:09:28.880255+0000","last_became_peered":"2024-03-30T13:09:28.880255+0000","last_unstale":"2024-03-30T13:09:30.947146+0000","last_undegraded":"2024-03-30T13:09:30.947146+0000","last_fullsized":"2024-03-30T13:09:30.947146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:40.502300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.876649+0000","last_change":"2024-03-30T13:09:29.907596+0000","last_active":"2024-03-30T13:09:30.876649+0000","last_peered":"2024-03-30T13:09:30.876649+0000","last_clean":"2024-03-30T13:09:30.876649+0000","last_became_active":"2024-03-30T13:09:29.906051+0000","last_became_peered":"2024-03-30T13:09:29.906051+0000","last_unstale":"2024-03-30T13:09:30.876649+0000","last_undegraded":"2024-03-30T13:09:30.876649+0000","last_fullsized":"2024-03-30T13:09:30.876649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:45.100186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947384+0000","last_change":"2024-03-30T13:09:28.890011+0000","last_active":"2024-03-30T13:09:30.947384+0000","last_peered":"2024-03-30T13:09:30.947384+0000","last_clean":"2024-03-30T13:09:30.947384+0000","last_became_active":"2024-03-30T13:09:28.889355+0000","last_became_peered":"2024-03-30T13:09:28.889355+0000","last_unstale":"2024-03-30T13:09:30.947384+0000","last_undegraded":"2024-03-30T13:09:30.947384+0000","last_fullsized":"2024-03-30T13:09:30.947384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:35.853347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947978+0000","last_change":"2024-03-30T13:09:29.877519+0000","last_active":"2024-03-30T13:09:30.947978+0000","last_peered":"2024-03-30T13:09:30.947978+0000","last_clean":"2024-03-30T13:09:30.947978+0000","last_became_active":"2024-03-30T13:09:29.877116+0000","last_became_peered":"2024-03-30T13:09:29.877116+0000","last_unstale":"2024-03-30T13:09:30.947978+0000","last_undegraded":"2024-03-30T13:09:30.947978+0000","last_fullsized":"2024-03-30T13:09:30.947978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:14:47.916843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948370+0000","last_change":"2024-03-30T13:09:28.876267+0000","last_active":"2024-03-30T13:09:30.948370+0000","last_peered":"2024-03-30T13:09:30.948370+0000","last_clean":"2024-03-30T13:09:30.948370+0000","last_became_active":"2024-03-30T13:09:28.870782+0000","last_became_peered":"2024-03-30T13:09:28.870782+0000","last_unstale":"2024-03-30T13:09:30.948370+0000","last_undegraded":"2024-03-30T13:09:30.948370+0000","last_fullsized":"2024-03-30T13:09:30.948370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:08.077604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.948845+0000","last_change":"2024-03-30T13:09:29.896111+0000","last_active":"2024-03-30T13:09:30.948845+0000","last_peered":"2024-03-30T13:09:30.948845+0000","last_clean":"2024-03-30T13:09:30.948845+0000","last_became_active":"2024-03-30T13:09:29.895473+0000","last_became_peered":"2024-03-30T13:09:29.895473+0000","last_unstale":"2024-03-30T13:09:30.948845+0000","last_undegraded":"2024-03-30T13:09:30.948845+0000","last_fullsized":"2024-03-30T13:09:30.948845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:59:13.920107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.946306+0000","last_change":"2024-03-30T13:09:28.882033+0000","last_active":"2024-03-30T13:09:30.946306+0000","last_peered":"2024-03-30T13:09:30.946306+0000","last_clean":"2024-03-30T13:09:30.946306+0000","last_became_active":"2024-03-30T13:09:28.881818+0000","last_became_peered":"2024-03-30T13:09:28.881818+0000","last_unstale":"2024-03-30T13:09:30.946306+0000","last_undegraded":"2024-03-30T13:09:30.946306+0000","last_fullsized":"2024-03-30T13:09:30.946306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:35.853347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.945350+0000","last_change":"2024-03-30T13:09:29.881677+0000","last_active":"2024-03-30T13:09:30.945350+0000","last_peered":"2024-03-30T13:09:30.945350+0000","last_clean":"2024-03-30T13:09:30.945350+0000","last_became_active":"2024-03-30T13:09:29.881400+0000","last_became_peered":"2024-03-30T13:09:29.881400+0000","last_unstale":"2024-03-30T13:09:30.945350+0000","last_undegraded":"2024-03-30T13:09:30.945350+0000","last_fullsized":"2024-03-30T13:09:30.945350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:09:53.508098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947709+0000","last_change":"2024-03-30T13:09:28.875649+0000","last_active":"2024-03-30T13:09:30.947709+0000","last_peered":"2024-03-30T13:09:30.947709+0000","last_clean":"2024-03-30T13:09:30.947709+0000","last_became_active":"2024-03-30T13:09:28.870968+0000","last_became_peered":"2024-03-30T13:09:28.870968+0000","last_unstale":"2024-03-30T13:09:30.947709+0000","last_undegraded":"2024-03-30T13:09:30.947709+0000","last_fullsized":"2024-03-30T13:09:30.947709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:05:45.060034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.875947+0000","last_change":"2024-03-30T13:09:29.884657+0000","last_active":"2024-03-30T13:09:30.875947+0000","last_peered":"2024-03-30T13:09:30.875947+0000","last_clean":"2024-03-30T13:09:30.875947+0000","last_became_active":"2024-03-30T13:09:29.883724+0000","last_became_peered":"2024-03-30T13:09:29.883724+0000","last_unstale":"2024-03-30T13:09:30.875947+0000","last_undegraded":"2024-03-30T13:09:30.875947+0000","last_fullsized":"2024-03-30T13:09:30.875947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:36.858042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.945813+0000","last_change":"2024-03-30T13:09:28.875354+0000","last_active":"2024-03-30T13:09:30.945813+0000","last_peered":"2024-03-30T13:09:30.945813+0000","last_clean":"2024-03-30T13:09:30.945813+0000","last_became_active":"2024-03-30T13:09:28.875019+0000","last_became_peered":"2024-03-30T13:09:28.875019+0000","last_unstale":"2024-03-30T13:09:30.945813+0000","last_undegraded":"2024-03-30T13:09:30.945813+0000","last_fullsized":"2024-03-30T13:09:30.945813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:05:45.060034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.945694+0000","last_change":"2024-03-30T13:09:29.880875+0000","last_active":"2024-03-30T13:09:30.945694+0000","last_peered":"2024-03-30T13:09:30.945694+0000","last_clean":"2024-03-30T13:09:30.945694+0000","last_became_active":"2024-03-30T13:09:29.880483+0000","last_became_peered":"2024-03-30T13:09:29.880483+0000","last_unstale":"2024-03-30T13:09:30.945694+0000","last_undegraded":"2024-03-30T13:09:30.945694+0000","last_fullsized":"2024-03-30T13:09:30.945694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:39:03.754595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947555+0000","last_change":"2024-03-30T13:09:28.878861+0000","last_active":"2024-03-30T13:09:30.947555+0000","last_peered":"2024-03-30T13:09:30.947555+0000","last_clean":"2024-03-30T13:09:30.947555+0000","last_became_active":"2024-03-30T13:09:28.878124+0000","last_became_peered":"2024-03-30T13:09:28.878124+0000","last_unstale":"2024-03-30T13:09:30.947555+0000","last_undegraded":"2024-03-30T13:09:30.947555+0000","last_fullsized":"2024-03-30T13:09:30.947555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:12.924055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.871155+0000","last_change":"2024-03-30T13:09:29.879662+0000","last_active":"2024-03-30T13:09:30.871155+0000","last_peered":"2024-03-30T13:09:30.871155+0000","last_clean":"2024-03-30T13:09:30.871155+0000","last_became_active":"2024-03-30T13:09:29.879344+0000","last_became_peered":"2024-03-30T13:09:29.879344+0000","last_unstale":"2024-03-30T13:09:30.871155+0000","last_undegraded":"2024-03-30T13:09:30.871155+0000","last_fullsized":"2024-03-30T13:09:30.871155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:34.220639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947407+0000","last_change":"2024-03-30T13:09:28.875196+0000","last_active":"2024-03-30T13:09:30.947407+0000","last_peered":"2024-03-30T13:09:30.947407+0000","last_clean":"2024-03-30T13:09:30.947407+0000","last_became_active":"2024-03-30T13:09:28.872737+0000","last_became_peered":"2024-03-30T13:09:28.872737+0000","last_unstale":"2024-03-30T13:09:30.947407+0000","last_undegraded":"2024-03-30T13:09:30.947407+0000","last_fullsized":"2024-03-30T13:09:30.947407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:41.511149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.947253+0000","last_change":"2024-03-30T13:09:29.872890+0000","last_active":"2024-03-30T13:09:30.947253+0000","last_peered":"2024-03-30T13:09:30.947253+0000","last_clean":"2024-03-30T13:09:30.947253+0000","last_became_active":"2024-03-30T13:09:29.872187+0000","last_became_peered":"2024-03-30T13:09:29.872187+0000","last_unstale":"2024-03-30T13:09:30.947253+0000","last_undegraded":"2024-03-30T13:09:30.947253+0000","last_fullsized":"2024-03-30T13:09:30.947253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:52:42.329062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.871214+0000","last_change":"2024-03-30T13:09:28.889080+0000","last_active":"2024-03-30T13:09:30.871214+0000","last_peered":"2024-03-30T13:09:30.871214+0000","last_clean":"2024-03-30T13:09:30.871214+0000","last_became_active":"2024-03-30T13:09:28.888859+0000","last_became_peered":"2024-03-30T13:09:28.888859+0000","last_unstale":"2024-03-30T13:09:30.871214+0000","last_undegraded":"2024-03-30T13:09:30.871214+0000","last_fullsized":"2024-03-30T13:09:30.871214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:50:00.195106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.877436+0000","last_change":"2024-03-30T13:09:29.879493+0000","last_active":"2024-03-30T13:09:30.877436+0000","last_peered":"2024-03-30T13:09:30.877436+0000","last_clean":"2024-03-30T13:09:30.877436+0000","last_became_active":"2024-03-30T13:09:29.876988+0000","last_became_peered":"2024-03-30T13:09:29.876988+0000","last_unstale":"2024-03-30T13:09:30.877436+0000","last_undegraded":"2024-03-30T13:09:30.877436+0000","last_fullsized":"2024-03-30T13:09:30.877436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:28.831621+0000","last_clean_scrub_stamp":"2024-03-30T13:09:28.831621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:34.220639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.877650+0000","last_change":"2024-03-30T13:09:28.886160+0000","last_active":"2024-03-30T13:09:30.877650+0000","last_peered":"2024-03-30T13:09:30.877650+0000","last_clean":"2024-03-30T13:09:30.877650+0000","last_became_active":"2024-03-30T13:09:28.885506+0000","last_became_peered":"2024-03-30T13:09:28.885506+0000","last_unstale":"2024-03-30T13:09:30.877650+0000","last_undegraded":"2024-03-30T13:09:30.877650+0000","last_fullsized":"2024-03-30T13:09:30.877650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:09:27.826926+0000","last_clean_scrub_stamp":"2024-03-30T13:09:27.826926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:34.647127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-30T13:09:30.877631+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:09:30.877631+0000","last_peered":"2024-03-30T13:09:30.877631+0000","last_clean":"2024-03-30T13:09:30.877631+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:09:30.877631+0000","last_undegraded":"2024-03-30T13:09:30.877631+0000","last_fullsized":"2024-03-30T13:09:30.877631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":739305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":385024,"data_stored":149463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":385024,"data_stored":149519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":150481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":150481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":739215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":148951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":142617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:09:34.383 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-30T13:09:34.383 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-30T13:09:34.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff75e56f640 1 Processor -- start 2024-03-30T13:09:34.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff75e56f640 1 -- start start 2024-03-30T13:09:34.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff75e56f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff75815aae0 0x7ff75815b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff75e56f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff75806c670 0x7ff75806caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff75e56f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff75815bec0 con 0x7ff7580b6550 2024-03-30T13:09:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff75e56f640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff75806cfe0 con 0x7ff75815aae0 2024-03-30T13:09:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff75e56f640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff7580b57c0 con 0x7ff75806c670 2024-03-30T13:09:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff757fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff75815aae0 0x7ff75815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff74ffff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff7580b6550 0x7ff7580b50b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40016/0 (socket says 172.21.15.83:40016) 2024-03-30T13:09:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff74ffff640 1 -- 172.21.15.83:0/3781555134 learned_addr learned my addr 172.21.15.83:0/3781555134 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff75cb0c640 1 --2- 172.21.15.83:0/3781555134 >> v2:172.21.15.153:3300/0 conn(0x7ff75806c670 0x7ff75806caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff757fff640 1 -- 172.21.15.83:0/3781555134 >> v2:172.21.15.153:3300/0 conn(0x7ff75806c670 msgr2=0x7ff75806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff757fff640 1 --2- 172.21.15.83:0/3781555134 >> v2:172.21.15.153:3300/0 conn(0x7ff75806c670 0x7ff75806caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff757fff640 1 -- 172.21.15.83:0/3781555134 >> v1:172.21.15.83:6789/0 conn(0x7ff7580b6550 legacy=0x7ff7580b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff7577fe640 1 -- 172.21.15.83:0/3781555134 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2237121919 0 0) 0x7ff740001120 con 0x7ff7580b6550 2024-03-30T13:09:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff757fff640 1 -- 172.21.15.83:0/3781555134 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7580b6a10 con 0x7ff75815aae0 2024-03-30T13:09:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.550+0000 7ff75cb0c640 1 --2- 172.21.15.83:0/3781555134 >> v2:172.21.15.153:3300/0 conn(0x7ff75806c670 0x7ff75806caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:34.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff757fff640 1 --2- 172.21.15.83:0/3781555134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff75815aae0 0x7ff75815b980 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff7580b0810 tx=0x7ff74801e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b93a341453875d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:34.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff7577fe640 1 -- 172.21.15.83:0/3781555134 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7480b3070 con 0x7ff75815aae0 2024-03-30T13:09:34.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff7577fe640 1 -- 172.21.15.83:0/3781555134 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7480ae600 con 0x7ff75815aae0 2024-03-30T13:09:34.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff7577fe640 1 -- 172.21.15.83:0/3781555134 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7480ae9d0 con 0x7ff75815aae0 2024-03-30T13:09:34.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 -- 172.21.15.83:0/3781555134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff75815aae0 msgr2=0x7ff75815b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 --2- 172.21.15.83:0/3781555134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff75815aae0 0x7ff75815b980 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff7580b0810 tx=0x7ff74801e610 comp rx=0 tx=0).stop 2024-03-30T13:09:34.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 -- 172.21.15.83:0/3781555134 shutdown_connections 2024-03-30T13:09:34.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 --2- 172.21.15.83:0/3781555134 >> v2:172.21.15.153:3300/0 conn(0x7ff75806c670 0x7ff75806caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 --2- 172.21.15.83:0/3781555134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff75815aae0 0x7ff75815b980 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 -- 172.21.15.83:0/3781555134 >> 172.21.15.83:0/3781555134 conn(0x7ff758071fe0 msgr2=0x7ff7580723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:34.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 -- 172.21.15.83:0/3781555134 shutdown_connections 2024-03-30T13:09:34.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 -- 172.21.15.83:0/3781555134 wait complete. 2024-03-30T13:09:34.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 Processor -- start 2024-03-30T13:09:34.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 -- start start 2024-03-30T13:09:34.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff75806c670 0x7ff75814a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7580b6550 0x7ff758148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff75815aae0 0x7ff7580ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff7580cefa0 con 0x7ff7580b6550 2024-03-30T13:09:34.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff7580cee20 con 0x7ff75806c670 2024-03-30T13:09:34.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff75e56f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff7580cf120 con 0x7ff75815aae0 2024-03-30T13:09:34.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff74ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7580b6550 0x7ff758148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:34.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff74ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7580b6550 0x7ff758148240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45580/0 (socket says 172.21.15.83:45580) 2024-03-30T13:09:34.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.554+0000 7ff74ffff640 1 -- 172.21.15.83:0/2914324685 learned_addr learned my addr 172.21.15.83:0/2914324685 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff757fff640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff75806c670 0x7ff75814a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff75cb0c640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff75815aae0 0x7ff7580ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff74ffff640 1 -- 172.21.15.83:0/2914324685 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff75815aae0 msgr2=0x7ff7580ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff74ffff640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff75815aae0 0x7ff7580ac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff74ffff640 1 -- 172.21.15.83:0/2914324685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff75806c670 msgr2=0x7ff75814a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff74ffff640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff75806c670 0x7ff75814a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff74ffff640 1 -- 172.21.15.83:0/2914324685 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75814a430 con 0x7ff7580b6550 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff74ffff640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7580b6550 0x7ff758148240 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff74000c780 tx=0x7ff74000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff7557fa640 1 -- 172.21.15.83:0/2914324685 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740018070 con 0x7ff7580b6550 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff7557fa640 1 -- 172.21.15.83:0/2914324685 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7400072d0 con 0x7ff7580b6550 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff75e56f640 1 -- 172.21.15.83:0/2914324685 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7580a9700 con 0x7ff7580b6550 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff7557fa640 1 -- 172.21.15.83:0/2914324685 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7400047f0 con 0x7ff7580b6550 2024-03-30T13:09:34.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff75e56f640 1 -- 172.21.15.83:0/2914324685 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff758148780 con 0x7ff7580b6550 2024-03-30T13:09:34.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff75e56f640 1 -- 172.21.15.83:0/2914324685 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff75804f9e0 con 0x7ff7580b6550 2024-03-30T13:09:34.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff7557fa640 1 -- 172.21.15.83:0/2914324685 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff74001b070 con 0x7ff7580b6550 2024-03-30T13:09:34.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff7557fa640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff738067fc0 0x7ff73806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff757fff640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff738067fc0 0x7ff73806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:34.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff7557fa640 1 -- 172.21.15.83:0/2914324685 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff7400857a0 con 0x7ff7580b6550 2024-03-30T13:09:34.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.558+0000 7ff757fff640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff738067fc0 0x7ff73806a480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff7480b0000 tx=0x7ff7480a9000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:34.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.562+0000 7ff7557fa640 1 -- 172.21.15.83:0/2914324685 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff75815bec0 con 0x7ff7580b6550 2024-03-30T13:09:34.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.850+0000 7ff75e56f640 1 -- 172.21.15.83:0/2914324685 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff75806ed90 con 0x7ff7580b6550 2024-03-30T13:09:34.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff7557fa640 1 -- 172.21.15.83:0/2914324685 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7ff74005ae20 con 0x7ff7580b6550 2024-03-30T13:09:34.859 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2024-03-30T13:09:34.859 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPDghmyhIFFhAAN45m5XmwvXOH8BGl9v+GGw== 2024-03-30T13:09:34.860 INFO:teuthology.orchestra.run.smithi083.stdout: caps mds = "allow" 2024-03-30T13:09:34.860 INFO:teuthology.orchestra.run.smithi083.stdout: caps mon = "allow r" 2024-03-30T13:09:34.860 INFO:teuthology.orchestra.run.smithi083.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-30T13:09:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:updated caps for client.0 2024-03-30T13:09:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff75e56f640 1 -- 172.21.15.83:0/2914324685 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff738067fc0 msgr2=0x7ff73806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff75e56f640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff738067fc0 0x7ff73806a480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff7480b0000 tx=0x7ff7480a9000 comp rx=0 tx=0).stop 2024-03-30T13:09:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff75e56f640 1 -- 172.21.15.83:0/2914324685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7580b6550 msgr2=0x7ff758148240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff75e56f640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7580b6550 0x7ff758148240 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff74000c780 tx=0x7ff74000cc40 comp rx=0 tx=0).stop 2024-03-30T13:09:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff75e56f640 1 -- 172.21.15.83:0/2914324685 shutdown_connections 2024-03-30T13:09:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff75e56f640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff738067fc0 0x7ff73806a480 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff75e56f640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff75815aae0 0x7ff7580ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff75e56f640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7580b6550 0x7ff758148240 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff75e56f640 1 --2- 172.21.15.83:0/2914324685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff75806c670 0x7ff75814a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:34.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff75e56f640 1 -- 172.21.15.83:0/2914324685 >> 172.21.15.83:0/2914324685 conn(0x7ff758071fe0 msgr2=0x7ff75814eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:34.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff75e56f640 1 -- 172.21.15.83:0/2914324685 shutdown_connections 2024-03-30T13:09:34.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.854+0000 7ff75e56f640 1 -- 172.21.15.83:0/2914324685 wait complete. 2024-03-30T13:09:34.877 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:09:34.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.990+0000 7fb0e31df640 1 Processor -- start 2024-03-30T13:09:34.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.990+0000 7fb0e31df640 1 -- start start 2024-03-30T13:09:34.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e31df640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0b18c0 0x7fb0dc0b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e31df640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb0dc0cd920 0x7fb0dc0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:34.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e31df640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0dc0b3aa0 con 0x7fb0dc06b660 2024-03-30T13:09:34.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e31df640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb0dc15cc00 con 0x7fb0dc0cd920 2024-03-30T13:09:34.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e31df640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc06bc00 con 0x7fb0dc0b18c0 2024-03-30T13:09:34.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e0f7b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0b18c0 0x7fb0dc0b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e177c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb0dc0cd920 0x7fb0dc0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e0f7b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0b18c0 0x7fb0dc0b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:34572/0 (socket says 172.21.15.83:34572) 2024-03-30T13:09:35.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0dbfff640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb0dc06b660 0x7fb0dc15d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:47220/0 (socket says 172.21.15.83:47220) 2024-03-30T13:09:35.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e0f7b640 1 -- 172.21.15.83:0/2117405061 learned_addr learned my addr 172.21.15.83:0/2117405061 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:35.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e0f7b640 1 -- 172.21.15.83:0/2117405061 >> v2:172.21.15.153:3300/0 conn(0x7fb0dc0cd920 msgr2=0x7fb0dc0cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e0f7b640 1 --2- 172.21.15.83:0/2117405061 >> v2:172.21.15.153:3300/0 conn(0x7fb0dc0cd920 0x7fb0dc0cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e0f7b640 1 -- 172.21.15.83:0/2117405061 >> v1:172.21.15.153:6789/0 conn(0x7fb0dc06b660 legacy=0x7fb0dc15d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e0f7b640 1 -- 172.21.15.83:0/2117405061 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc06bee0 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.994+0000 7fb0e177c640 1 --2- 172.21.15.83:0/2117405061 >> v2:172.21.15.153:3300/0 conn(0x7fb0dc0cd920 0x7fb0dc0cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:09:35.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e0f7b640 1 --2- 172.21.15.83:0/2117405061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0b18c0 0x7fb0dc0b3560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009870 tx=0x7fb0d401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5ce02fad916c9d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:35.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0db7fe640 1 -- 172.21.15.83:0/2117405061 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40a7070 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0db7fe640 1 -- 172.21.15.83:0/2117405061 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d40b0070 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0db7fe640 1 -- 172.21.15.83:0/2117405061 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40ab890 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 -- 172.21.15.83:0/2117405061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0b18c0 msgr2=0x7fb0dc0b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 --2- 172.21.15.83:0/2117405061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0b18c0 0x7fb0dc0b3560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009870 tx=0x7fb0d401c560 comp rx=0 tx=0).stop 2024-03-30T13:09:35.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 -- 172.21.15.83:0/2117405061 shutdown_connections 2024-03-30T13:09:35.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 --2- 172.21.15.83:0/2117405061 >> v2:172.21.15.153:3300/0 conn(0x7fb0dc0cd920 0x7fb0dc0cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 --2- 172.21.15.83:0/2117405061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0b18c0 0x7fb0dc0b3560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 -- 172.21.15.83:0/2117405061 >> 172.21.15.83:0/2117405061 conn(0x7fb0dc09aa50 msgr2=0x7fb0dc0b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:35.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 -- 172.21.15.83:0/2117405061 shutdown_connections 2024-03-30T13:09:35.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 -- 172.21.15.83:0/2117405061 wait complete. 2024-03-30T13:09:35.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 Processor -- start 2024-03-30T13:09:35.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 -- start start 2024-03-30T13:09:35.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0dc06b660 0x7fb0dc156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0dc0b18c0 0x7fb0dc0c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0cd920 0x7fb0dc06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc169470 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc1692f0 con 0x7fb0dc06b660 2024-03-30T13:09:35.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e31df640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc1695f0 con 0x7fb0dc0cd920 2024-03-30T13:09:35.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0dbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0dc0b18c0 0x7fb0dc0c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0dbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0dc0b18c0 0x7fb0dc0c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45584/0 (socket says 172.21.15.83:45584) 2024-03-30T13:09:35.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0dbfff640 1 -- 172.21.15.83:0/2196103629 learned_addr learned my addr 172.21.15.83:0/2196103629 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:35.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e177c640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0cd920 0x7fb0dc06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e0f7b640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0dc06b660 0x7fb0dc156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0dbfff640 1 -- 172.21.15.83:0/2196103629 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0cd920 msgr2=0x7fb0dc06ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0dbfff640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0cd920 0x7fb0dc06ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0dbfff640 1 -- 172.21.15.83:0/2196103629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0dc06b660 msgr2=0x7fb0dc156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0dbfff640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0dc06b660 0x7fb0dc156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0dbfff640 1 -- 172.21.15.83:0/2196103629 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc0c6780 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e177c640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0cd920 0x7fb0dc06ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:35.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0e0f7b640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0dc06b660 0x7fb0dc156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:35.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0dbfff640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0dc0b18c0 0x7fb0dc0c6050 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400c370 tx=0x7fb0c400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:35.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0d97fa640 1 -- 172.21.15.83:0/2196103629 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c40074e0 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:34.998+0000 7fb0d97fa640 1 -- 172.21.15.83:0/2196103629 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c4007680 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.002+0000 7fb0e31df640 1 -- 172.21.15.83:0/2196103629 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0dc0c6a60 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.002+0000 7fb0d97fa640 1 -- 172.21.15.83:0/2196103629 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4004a30 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.002+0000 7fb0e31df640 1 -- 172.21.15.83:0/2196103629 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0dc06f2b0 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.002+0000 7fb0e31df640 1 -- 172.21.15.83:0/2196103629 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0dc0686c0 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.002+0000 7fb0d97fa640 1 -- 172.21.15.83:0/2196103629 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb0c401a020 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.002+0000 7fb0d97fa640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb0bc067fc0 0x7fb0bc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.002+0000 7fb0d97fa640 1 -- 172.21.15.83:0/2196103629 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb0c4085c50 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.002+0000 7fb0e0f7b640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb0bc067fc0 0x7fb0bc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.002+0000 7fb0e0f7b640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb0bc067fc0 0x7fb0bc06a480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40af000 tx=0x7fb0d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:35.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.006+0000 7fb0d97fa640 1 -- 172.21.15.83:0/2196103629 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb0c408b020 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.390+0000 7fb0e31df640 1 -- 172.21.15.83:0/2196103629 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0dc06df40 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.390+0000 7fb0d97fa640 1 -- 172.21.15.83:0/2196103629 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5184 (secure 0 0 0) 0x7fb0c4055e40 con 0x7fb0dc0b18c0 2024-03-30T13:09:35.397 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:09:35.397 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2103427036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2103427036},{"type":"v1","addr":"172.21.15.153:6833","nonce":2103427036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/718325648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":718325648},{"type":"v1","addr":"172.21.15.153:6835","nonce":718325648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2547254149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2547254149},{"type":"v1","addr":"172.21.15.83:6836","nonce":2547254149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:09:29.206969+0000","modified":"2024-03-30T13:09:32.236603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1254317891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1254317891},{"type":"v1","addr":"172.21.15.83:6837","nonce":1254317891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":2}]} 2024-03-30T13:09:35.397 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 15 2024-03-30T13:09:35.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.394+0000 7fb0e31df640 1 -- 172.21.15.83:0/2196103629 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb0bc067fc0 msgr2=0x7fb0bc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.394+0000 7fb0e31df640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb0bc067fc0 0x7fb0bc06a480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40af000 tx=0x7fb0d4008040 comp rx=0 tx=0).stop 2024-03-30T13:09:35.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.394+0000 7fb0e31df640 1 -- 172.21.15.83:0/2196103629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0dc0b18c0 msgr2=0x7fb0dc0c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.394+0000 7fb0e31df640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0dc0b18c0 0x7fb0dc0c6050 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400c370 tx=0x7fb0c400c830 comp rx=0 tx=0).stop 2024-03-30T13:09:35.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.394+0000 7fb0e31df640 1 -- 172.21.15.83:0/2196103629 shutdown_connections 2024-03-30T13:09:35.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.394+0000 7fb0e31df640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb0bc067fc0 0x7fb0bc06a480 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.394+0000 7fb0e31df640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0dc0cd920 0x7fb0dc06ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.394+0000 7fb0e31df640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0dc0b18c0 0x7fb0dc0c6050 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.394+0000 7fb0e31df640 1 --2- 172.21.15.83:0/2196103629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0dc06b660 0x7fb0dc156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.394+0000 7fb0e31df640 1 -- 172.21.15.83:0/2196103629 >> 172.21.15.83:0/2196103629 conn(0x7fb0dc09aa50 msgr2=0x7fb0dc15d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:35.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.394+0000 7fb0e31df640 1 -- 172.21.15.83:0/2196103629 shutdown_connections 2024-03-30T13:09:35.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.394+0000 7fb0e31df640 1 -- 172.21.15.83:0/2196103629 wait complete. 2024-03-30T13:09:35.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T13:09:29.206969+0000', 'modified': '2024-03-30T13:09:32.236603+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5211': {'gid': 5211, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6837/1254317891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6835', 'nonce': 1254317891}, {'type': 'v1', 'addr': '172.21.15.83:6837', 'nonce': 1254317891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5211, 'qdb_cluster': [5211]} 2024-03-30T13:09:35.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-30T13:09:35.819 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-30T13:09:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.934+0000 7fc5be93f640 1 Processor -- start 2024-03-30T13:09:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.934+0000 7fc5be93f640 1 -- start start 2024-03-30T13:09:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.934+0000 7fc5be93f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5b80b0080 0x7fc5b80b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.934+0000 7fc5be93f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc5b815da30 0x7fc5b806e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.934+0000 7fc5be93f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5b8070720 con 0x7fc5b80b6340 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.934+0000 7fc5be93f640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc5b80b67a0 con 0x7fc5b815da30 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.934+0000 7fc5be93f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b806fb10 con 0x7fc5b80b0080 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.934+0000 7fc5b77fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc5b80b6340 0x7fc5b815d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:40026/0 (socket says 172.21.15.83:40026) 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.934+0000 7fc5b77fe640 1 -- 172.21.15.83:0/148982863 learned_addr learned my addr 172.21.15.83:0/148982863 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5b80b0080 0x7fc5b80b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/148982863 >> v2:172.21.15.153:3300/0 conn(0x7fc5b815da30 0x7fc5b806e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1684208686 0 0) 0x7fc5b8070720 con 0x7fc5b80b6340 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5a0003530 con 0x7fc5b80b6340 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1248696484 0 0) 0x7fc5a0003530 con 0x7fc5b80b6340 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5b80b0080 msgr2=0x7fc5b80b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5b80b0080 0x7fc5b80b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 >> v2:172.21.15.153:3300/0 conn(0x7fc5b815da30 msgr2=0x7fc5b806e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 --2- 172.21.15.83:0/148982863 >> v2:172.21.15.153:3300/0 conn(0x7fc5b815da30 0x7fc5b806e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b806fdf0 con 0x7fc5b80b6340 2024-03-30T13:09:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fc5ac001680 con 0x7fc5b80b6340 2024-03-30T13:09:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 >> v1:172.21.15.83:6789/0 conn(0x7fc5b80b6340 legacy=0x7fc5b815d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5a00039c0 0x7fc5a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5b80b0080 0x7fc5a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5a0004d50 0x7fc5a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b806fb10 con 0x7fc5a0004d50 2024-03-30T13:09:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a000b9d0 con 0x7fc5a00039c0 2024-03-30T13:09:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a000bb50 con 0x7fc5b80b0080 2024-03-30T13:09:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5a0004d50 0x7fc5a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5b80b0080 0x7fc5a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5a00039c0 0x7fc5a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5bcedc640 1 -- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5b80b0080 msgr2=0x7fc5a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5b80b0080 0x7fc5a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5bcedc640 1 -- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5a00039c0 msgr2=0x7fc5a0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5a00039c0 0x7fc5a0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5bcedc640 1 -- 172.21.15.83:0/148982863 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a0003530 con 0x7fc5a0004d50 2024-03-30T13:09:35.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5b80b0080 0x7fc5a0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:35.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5a00039c0 0x7fc5a0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:35.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5a0004d50 0x7fc5a00051d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009fc0 tx=0x7fc5b001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6000b6d21dedc62 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:35.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00b2070 con 0x7fc5a0004d50 2024-03-30T13:09:35.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b00a5cd0 con 0x7fc5a0004d50 2024-03-30T13:09:35.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.938+0000 7fc5b6ffd640 1 -- 172.21.15.83:0/148982863 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0009c10 con 0x7fc5a0004d50 2024-03-30T13:09:35.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 -- 172.21.15.83:0/148982863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5a0004d50 msgr2=0x7fc5a00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 --2- 172.21.15.83:0/148982863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5a0004d50 0x7fc5a00051d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009fc0 tx=0x7fc5b001ccc0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5bcedc640 1 -- 172.21.15.83:0/148982863 reap_dead start 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 -- 172.21.15.83:0/148982863 shutdown_connections 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 -- 172.21.15.83:0/148982863 >> 172.21.15.83:0/148982863 conn(0x7fc5b8072f00 msgr2=0x7fc5b806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 -- 172.21.15.83:0/148982863 shutdown_connections 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 -- 172.21.15.83:0/148982863 wait complete. 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 Processor -- start 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 -- start start 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a0004d50 0x7fc5b8138290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5b80b4d50 0x7fc5b80b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5b8140ce0 0x7fc5b8141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b815dec0 con 0x7fc5b8140ce0 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b80703b0 con 0x7fc5b80b4d50 2024-03-30T13:09:35.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b806f7e0 con 0x7fc5a0004d50 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5bcedc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5b8140ce0 0x7fc5b8141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5bcedc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5b8140ce0 0x7fc5b8141160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45596/0 (socket says 172.21.15.83:45596) 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5bcedc640 1 -- 172.21.15.83:0/3479307876 learned_addr learned my addr 172.21.15.83:0/3479307876 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a0004d50 0x7fc5b8138290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5b80b4d50 0x7fc5b80b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5bcedc640 1 -- 172.21.15.83:0/3479307876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a0004d50 msgr2=0x7fc5b8138290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a0004d50 0x7fc5b8138290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5bcedc640 1 -- 172.21.15.83:0/3479307876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5b80b4d50 msgr2=0x7fc5b80b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5b80b4d50 0x7fc5b80b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5bcedc640 1 -- 172.21.15.83:0/3479307876 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b80ae740 con 0x7fc5b8140ce0 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5b80b4d50 0x7fc5b80b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5b8140ce0 0x7fc5b8141160 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0002240 tx=0x7fc5b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5b4ff9640 1 -- 172.21.15.83:0/3479307876 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00bd070 con 0x7fc5b8140ce0 2024-03-30T13:09:35.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5b4ff9640 1 -- 172.21.15.83:0/3479307876 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b00a5ad0 con 0x7fc5b8140ce0 2024-03-30T13:09:35.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 -- 172.21.15.83:0/3479307876 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b80aea20 con 0x7fc5b8140ce0 2024-03-30T13:09:35.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5b4ff9640 1 -- 172.21.15.83:0/3479307876 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00b2040 con 0x7fc5b8140ce0 2024-03-30T13:09:35.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.942+0000 7fc5be93f640 1 -- 172.21.15.83:0/3479307876 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b80aefe0 con 0x7fc5b8140ce0 2024-03-30T13:09:35.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b4ff9640 1 -- 172.21.15.83:0/3479307876 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc5b00039a0 con 0x7fc5b8140ce0 2024-03-30T13:09:35.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b4ff9640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc5a4067fc0 0x7fc5a406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b4ff9640 1 -- 172.21.15.83:0/3479307876 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc5b0120760 con 0x7fc5b8140ce0 2024-03-30T13:09:35.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc5a4067fc0 0x7fc5a406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5c1ac1000 1 Processor -- start 2024-03-30T13:09:35.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5c1ac1000 1 -- start start 2024-03-30T13:09:35.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc5a4067fc0 0x7fc5a406a480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80099b0 tx=0x7fc5a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5c1ac1000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def7ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5c1ac1000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7acdc0 0x560def75fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5c1ac1000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7600b0 0x560def760490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5c1ac1000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560def5b2950 con 0x560def7ac4a0 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5c1ac1000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560def54f990 con 0x560def7acdc0 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5c1ac1000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x560def5ae900 con 0x560def7600b0 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def7ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def7ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45606/0 (socket says 172.21.15.83:45606) 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b7fff640 1 -- 172.21.15.83:0/2869428229 learned_addr learned my addr 172.21.15.83:0/2869428229 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/2869428229 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7600b0 0x560def760490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/2869428229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7acdc0 0x560def75fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b7fff640 1 -- 172.21.15.83:0/2869428229 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7600b0 msgr2=0x560def760490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/2869428229 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7600b0 0x560def760490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b7fff640 1 -- 172.21.15.83:0/2869428229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7acdc0 msgr2=0x560def75fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/2869428229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7acdc0 0x560def75fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b7fff640 1 -- 172.21.15.83:0/2869428229 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560def5f7100 con 0x560def7ac4a0 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/2869428229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def7ac880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8013d00 tx=0x7fc5a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acff8bf2c69499b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc59dffb640 1 -- 172.21.15.83:0/2869428229 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8023440 con 0x560def7ac4a0 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc59dffb640 1 -- 172.21.15.83:0/2869428229 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a8028070 con 0x560def7ac4a0 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.946+0000 7fc59dffb640 1 -- 172.21.15.83:0/2869428229 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8023820 con 0x560def7ac4a0 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/2869428229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 msgr2=0x560def7ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/2869428229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def7ac880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8013d00 tx=0x7fc5a8016000 comp rx=0 tx=0).stop 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/2869428229 shutdown_connections 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/2869428229 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7600b0 0x560def760490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/2869428229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7acdc0 0x560def75fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/2869428229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def7ac880 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/2869428229 >> 172.21.15.83:0/2869428229 conn(0x560def64ab80 msgr2=0x560def78f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/2869428229 shutdown_connections 2024-03-30T13:09:35.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/2869428229 wait complete. 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 -- start start 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 Processor -- start 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7600b0 0x560def767cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def790690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7acdc0 0x560def790bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560def54a7b0 con 0x560def7ac4a0 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560def5703e0 con 0x560def7600b0 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x560def5b6f80 con 0x560def7acdc0 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 10 client.0 _ll_register_callbacks cb 0x560def6130f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5b77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def790690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5b77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def790690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45612/0 (socket says 172.21.15.83:45612) 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5b77fe640 1 -- 172.21.15.83:0/380985177 learned_addr learned my addr 172.21.15.83:0/380985177 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:35.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7acdc0 0x560def790bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7600b0 0x560def767cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5b77fe640 1 -- 172.21.15.83:0/380985177 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7acdc0 msgr2=0x560def790bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7acdc0 0x560def790bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5b77fe640 1 -- 172.21.15.83:0/380985177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7600b0 msgr2=0x560def767cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7600b0 0x560def767cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5b77fe640 1 -- 172.21.15.83:0/380985177 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560def57c8c0 con 0x560def7ac4a0 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def790690 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0104f0 tx=0x7fc5ac0109b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db690cc42de9afda server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc596ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc596ffd640 1 -- 172.21.15.83:0/380985177 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac013770 con 0x560def7ac4a0 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc596ffd640 1 -- 172.21.15.83:0/380985177 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc5ac013910 con 0x560def7ac4a0 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/380985177 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5a8028070 con 0x560def7ac4a0 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc596ffd640 1 -- 172.21.15.83:0/380985177 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fc5ac021050 con 0x560def7ac4a0 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 10 client.5382 fetch_fsmap learned FSMap version 15 2024-03-30T13:09:35.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/380985177 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x560def53ae80 con 0x560def7ac4a0 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc596ffd640 1 -- 172.21.15.83:0/380985177 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a8028070 con 0x560def7ac4a0 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc596ffd640 1 -- 172.21.15.83:0/380985177 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7fc5ac024020 con 0x560def7ac4a0 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 10 client.5382 fetch_fsmap finished waiting for FSMap version 15 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 10 client.5382 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 20 client.5382 populate_metadata read hostname 'smithi083' 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560def7bc540 0x560def7be930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 4 client.5382 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/380985177 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560def54dbc0 con 0x560def7bc540 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560def7bc540 0x560def7be930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560def7bc540 0x560def7be930 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc5ca8871d098032 server_cookie=16351166933ed38f in_seq=0 out_seq=0 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.950+0000 7fc596ffd640 10 client.5382 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc596ffd640 1 -- 172.21.15.83:0/380985177 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x560def54dbc0 con 0x560def7bc540 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc596ffd640 10 client.5382 handle_command_reply: tid=0 2024-03-30T13:09:35.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc5c1ac1000 1 client.5382 shutdown 2024-03-30T13:09:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/380985177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 msgr2=0x560def790690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def790690 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0104f0 tx=0x7fc5ac0109b0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/380985177 shutdown_connections 2024-03-30T13:09:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7acdc0 0x560def790bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560def7bc540 0x560def7be930 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def790690 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/380985177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7600b0 0x560def767cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/380985177 >> 172.21.15.83:0/380985177 conn(0x560def64ab80 msgr2=0x560def75f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc596ffd640 0 client.5382 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:09:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/380985177 shutdown_connections 2024-03-30T13:09:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/380985177 wait complete. 2024-03-30T13:09:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.954+0000 7fc5c1ac1000 20 client.5382 trim_cache size 0 max 16384 2024-03-30T13:09:35.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.970+0000 7fc5c1ac1000 1 Processor -- start 2024-03-30T13:09:35.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.970+0000 7fc5c1ac1000 1 -- start start 2024-03-30T13:09:35.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7600b0 0x560def766bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def78eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7acdc0 0x560def78f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b8200e80 con 0x560def7ac4a0 2024-03-30T13:09:35.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b81fff80 con 0x560def7600b0 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b81f5320 con 0x560def7acdc0 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def78eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def78eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45624/0 (socket says 172.21.15.83:45624) 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b77fe640 1 -- 172.21.15.83:0/1804191748 learned_addr learned my addr 172.21.15.83:0/1804191748 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/1804191748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7acdc0 0x560def78f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/1804191748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7600b0 0x560def766bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b77fe640 1 -- 172.21.15.83:0/1804191748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7acdc0 msgr2=0x560def78f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/1804191748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7acdc0 0x560def78f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b77fe640 1 -- 172.21.15.83:0/1804191748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7600b0 msgr2=0x560def766bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/1804191748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7600b0 0x560def766bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b77fe640 1 -- 172.21.15.83:0/1804191748 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560def56d490 con 0x560def7ac4a0 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/1804191748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def78eb20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac001210 tx=0x7fc5ac009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b94f23bb13c889 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc59d7fa640 1 -- 172.21.15.83:0/1804191748 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac013770 con 0x560def7ac4a0 2024-03-30T13:09:35.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc59d7fa640 1 -- 172.21.15.83:0/1804191748 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ac029070 con 0x560def7ac4a0 2024-03-30T13:09:35.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc59d7fa640 1 -- 172.21.15.83:0/1804191748 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac02d650 con 0x560def7ac4a0 2024-03-30T13:09:35.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/1804191748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 msgr2=0x560def78eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/1804191748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def78eb20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac001210 tx=0x7fc5ac009070 comp rx=0 tx=0).stop 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/1804191748 shutdown_connections 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/1804191748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def7acdc0 0x560def78f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/1804191748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7ac4a0 0x560def78eb20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/1804191748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7600b0 0x560def766bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/1804191748 >> 172.21.15.83:0/1804191748 conn(0x560def64ab80 msgr2=0x560def7664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/1804191748 shutdown_connections 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/1804191748 wait complete. 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 -- start start 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 Processor -- start 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7600b0 0x560def8020f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7acdc0 0x560def7bf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def75f5a0 0x560def7bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560def64cdf0 con 0x560def7600b0 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b81f5970 con 0x560def7acdc0 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x560def5688f0 con 0x560def75f5a0 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5c1ac1000 10 client.0 _ll_register_callbacks cb 0x7fc5ac001b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7600b0 0x560def8020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7600b0 0x560def8020f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45636/0 (socket says 172.21.15.83:45636) 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b7fff640 1 -- 172.21.15.83:0/630404291 learned_addr learned my addr 172.21.15.83:0/630404291 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def75f5a0 0x560def7bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b7fff640 1 -- 172.21.15.83:0/630404291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def75f5a0 msgr2=0x560def7bfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7acdc0 0x560def7bf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def75f5a0 0x560def7bfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b7fff640 1 -- 172.21.15.83:0/630404291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7acdc0 msgr2=0x560def7bf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7acdc0 0x560def7bf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5b7fff640 1 -- 172.21.15.83:0/630404291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560def56be80 con 0x560def7600b0 2024-03-30T13:09:35.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.974+0000 7fc5bcedc640 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def75f5a0 0x560def7bfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5b7fff640 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7600b0 0x560def8020f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80136b0 tx=0x7fc5a8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c88d2d8438d49c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc596ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc596ffd640 1 -- 172.21.15.83:0/630404291 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a803e060 con 0x560def7600b0 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc596ffd640 1 -- 172.21.15.83:0/630404291 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc5a8039640 con 0x560def7600b0 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/630404291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5ac029070 con 0x560def7600b0 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc596ffd640 1 -- 172.21.15.83:0/630404291 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fc5a8044050 con 0x560def7600b0 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 10 client.5388 fetch_fsmap learned FSMap version 15 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/630404291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x560def559270 con 0x560def7600b0 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc596ffd640 1 -- 172.21.15.83:0/630404291 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ac029070 con 0x560def7600b0 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc596ffd640 1 -- 172.21.15.83:0/630404291 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7fc5a8047020 con 0x560def7600b0 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 10 client.5388 fetch_fsmap finished waiting for FSMap version 15 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 10 client.5388 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 20 client.5388 populate_metadata read hostname 'smithi083' 2024-03-30T13:09:35.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560def7c0020 0x560def7c0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 4 client.5388 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/630404291 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "status"}) -- 0x560def5bfe90 con 0x560def7c0020 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560def7c0020 0x560def7c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc596ffd640 10 client.5388 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5b77fe640 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560def7c0020 0x560def7c0400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f2746419a5083e0 server_cookie=dc159f312eb9cb0d in_seq=0 out_seq=0 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc596ffd640 1 -- 172.21.15.83:0/630404291 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x7fc5ac033160 con 0x560def7c0020 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc596ffd640 10 client.5388 handle_command_reply: tid=0 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 client.5388 shutdown 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/630404291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7600b0 msgr2=0x560def8020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7600b0 0x560def8020f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80136b0 tx=0x7fc5a8004740 comp rx=0 tx=0).stop 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/630404291 shutdown_connections 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560def75f5a0 0x560def7bfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560def7acdc0 0x560def7bf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560def7c0020 0x560def7c0400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 --2- 172.21.15.83:0/630404291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560def7600b0 0x560def8020f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/630404291 >> 172.21.15.83:0/630404291 conn(0x560def64ab80 msgr2=0x560def7b9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:35.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc596ffd640 0 client.5388 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:09:35.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/630404291 shutdown_connections 2024-03-30T13:09:35.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 1 -- 172.21.15.83:0/630404291 wait complete. 2024-03-30T13:09:35.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5c1ac1000 20 client.5388 trim_cache size 0 max 16384 2024-03-30T13:09:35.990 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:09:35.990 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "7979f39b-f62b-4bbb-8ee9-a3dd267196bf", 2024-03-30T13:09:35.990 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-03-30T13:09:35.990 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 5211, 2024-03-30T13:09:35.990 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-03-30T13:09:35.991 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-03-30T13:09:35.991 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-03-30T13:09:35.991 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 6.1192836289999999, 2024-03-30T13:09:35.991 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 15, 2024-03-30T13:09:35.991 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 34, 2024-03-30T13:09:35.991 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 34, 2024-03-30T13:09:35.991 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 13.301832001999999 2024-03-30T13:09:35.991 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:09:35.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5be93f640 1 -- 172.21.15.83:0/3479307876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc5a4067fc0 msgr2=0x7fc5a406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5be93f640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc5a4067fc0 0x7fc5a406a480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80099b0 tx=0x7fc5a8008040 comp rx=0 tx=0).stop 2024-03-30T13:09:35.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5be93f640 1 -- 172.21.15.83:0/3479307876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5b8140ce0 msgr2=0x7fc5b8141160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:35.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5be93f640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5b8140ce0 0x7fc5b8141160 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0002240 tx=0x7fc5b0009750 comp rx=0 tx=0).stop 2024-03-30T13:09:35.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5be93f640 1 -- 172.21.15.83:0/3479307876 shutdown_connections 2024-03-30T13:09:35.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5be93f640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc5a4067fc0 0x7fc5a406a480 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5be93f640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5b8140ce0 0x7fc5b8141160 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5be93f640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5b80b4d50 0x7fc5b80b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5be93f640 1 --2- 172.21.15.83:0/3479307876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a0004d50 0x7fc5b8138290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:35.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5be93f640 1 -- 172.21.15.83:0/3479307876 >> 172.21.15.83:0/3479307876 conn(0x7fc5b8072f00 msgr2=0x7fc5b806c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:35.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5be93f640 1 -- 172.21.15.83:0/3479307876 shutdown_connections 2024-03-30T13:09:35.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:35.978+0000 7fc5be93f640 1 -- 172.21.15.83:0/3479307876 wait complete. 2024-03-30T13:09:36.001 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:09:36.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.102+0000 7f0c5ae35640 1 Processor -- start 2024-03-30T13:09:36.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.102+0000 7f0c5ae35640 1 -- start start 2024-03-30T13:09:36.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c5ae35640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c5415aa00 0x7f0c540b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:36.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c5ae35640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0c540702a0 0x7f0c5406c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:36.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c5ae35640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c5415ade0 con 0x7f0c5406cbb0 2024-03-30T13:09:36.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c5ae35640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0c5406e790 con 0x7f0c540702a0 2024-03-30T13:09:36.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c5ae35640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0c5406ea70 con 0x7f0c5415aa00 2024-03-30T13:09:36.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c58bd1640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c5415aa00 0x7f0c540b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:36.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c53fff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0c540702a0 0x7f0c5406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:36.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c58bd1640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c5415aa00 0x7f0c540b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:34676/0 (socket says 172.21.15.83:34676) 2024-03-30T13:09:36.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c593d2640 1 --1- 172.21.15.83:0/2458209202 >> v1:172.21.15.153:6789/0 conn(0x7f0c5406cbb0 0x7f0c5415e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:47228/0 (socket says 172.21.15.83:47228) 2024-03-30T13:09:36.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c58bd1640 1 -- 172.21.15.83:0/2458209202 learned_addr learned my addr 172.21.15.83:0/2458209202 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:36.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c58bd1640 1 -- 172.21.15.83:0/2458209202 >> v2:172.21.15.153:3300/0 conn(0x7f0c540702a0 msgr2=0x7f0c5406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:36.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c58bd1640 1 --2- 172.21.15.83:0/2458209202 >> v2:172.21.15.153:3300/0 conn(0x7f0c540702a0 0x7f0c5406c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:36.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c58bd1640 1 -- 172.21.15.83:0/2458209202 >> v1:172.21.15.153:6789/0 conn(0x7f0c5406cbb0 legacy=0x7f0c5415e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:36.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c58bd1640 1 -- 172.21.15.83:0/2458209202 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5406ed50 con 0x7f0c5415aa00 2024-03-30T13:09:36.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.106+0000 7f0c58bd1640 1 --2- 172.21.15.83:0/2458209202 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c5415aa00 0x7f0c540b4600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009870 tx=0x7f0c4801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad942bd0ff435ca7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:36.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c537fe640 1 -- 172.21.15.83:0/2458209202 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480b0070 con 0x7f0c5415aa00 2024-03-30T13:09:36.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c537fe640 1 -- 172.21.15.83:0/2458209202 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c480ab600 con 0x7f0c5415aa00 2024-03-30T13:09:36.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c537fe640 1 -- 172.21.15.83:0/2458209202 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480ab9d0 con 0x7f0c5415aa00 2024-03-30T13:09:36.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 -- 172.21.15.83:0/2458209202 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c5415aa00 msgr2=0x7f0c540b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:36.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 --2- 172.21.15.83:0/2458209202 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c5415aa00 0x7f0c540b4600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009870 tx=0x7f0c4801c560 comp rx=0 tx=0).stop 2024-03-30T13:09:36.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 -- 172.21.15.83:0/2458209202 shutdown_connections 2024-03-30T13:09:36.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 --2- 172.21.15.83:0/2458209202 >> v2:172.21.15.153:3300/0 conn(0x7f0c540702a0 0x7f0c5406c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:36.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 --2- 172.21.15.83:0/2458209202 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c5415aa00 0x7f0c540b4600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:36.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 -- 172.21.15.83:0/2458209202 >> 172.21.15.83:0/2458209202 conn(0x7f0c54072030 msgr2=0x7f0c54072440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:36.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 -- 172.21.15.83:0/2458209202 shutdown_connections 2024-03-30T13:09:36.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 -- 172.21.15.83:0/2458209202 wait complete. 2024-03-30T13:09:36.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 Processor -- start 2024-03-30T13:09:36.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 -- start start 2024-03-30T13:09:36.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c5406cbb0 0x7f0c5414bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:36.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c540702a0 0x7f0c541434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:36.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c5415aa00 0x7f0c54148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:36.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0c54070680 con 0x7f0c5406cbb0 2024-03-30T13:09:36.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5406cfc0 con 0x7f0c540702a0 2024-03-30T13:09:36.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c5ae35640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0c54070800 con 0x7f0c5415aa00 2024-03-30T13:09:36.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c58bd1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c5406cbb0 0x7f0c5414bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:36.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c58bd1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c5406cbb0 0x7f0c5414bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45646/0 (socket says 172.21.15.83:45646) 2024-03-30T13:09:36.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c58bd1640 1 -- 172.21.15.83:0/1119979312 learned_addr learned my addr 172.21.15.83:0/1119979312 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c593d2640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c5415aa00 0x7f0c54148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c53fff640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c540702a0 0x7f0c541434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c58bd1640 1 -- 172.21.15.83:0/1119979312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c5415aa00 msgr2=0x7f0c54148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c58bd1640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c5415aa00 0x7f0c54148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c58bd1640 1 -- 172.21.15.83:0/1119979312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c540702a0 msgr2=0x7f0c541434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c58bd1640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c540702a0 0x7f0c541434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.110+0000 7f0c58bd1640 1 -- 172.21.15.83:0/1119979312 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c54149c20 con 0x7f0c5406cbb0 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.114+0000 7f0c58bd1640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c5406cbb0 0x7f0c5414bdf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0c480ae040 tx=0x7f0c4801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.114+0000 7f0c517fa640 1 -- 172.21.15.83:0/1119979312 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480b0040 con 0x7f0c5406cbb0 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.114+0000 7f0c5ae35640 1 -- 172.21.15.83:0/1119979312 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c54149940 con 0x7f0c5406cbb0 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.114+0000 7f0c517fa640 1 -- 172.21.15.83:0/1119979312 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c480ab400 con 0x7f0c5406cbb0 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.114+0000 7f0c517fa640 1 -- 172.21.15.83:0/1119979312 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480b6660 con 0x7f0c5406cbb0 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.114+0000 7f0c5ae35640 1 -- 172.21.15.83:0/1119979312 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c54142cc0 con 0x7f0c5406cbb0 2024-03-30T13:09:36.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.114+0000 7f0c5ae35640 1 -- 172.21.15.83:0/1119979312 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c54068dd0 con 0x7f0c5406cbb0 2024-03-30T13:09:36.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.114+0000 7f0c517fa640 1 -- 172.21.15.83:0/1119979312 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f0c480be030 con 0x7f0c5406cbb0 2024-03-30T13:09:36.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.114+0000 7f0c517fa640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0c38067ff0 0x7f0c3806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:36.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.114+0000 7f0c517fa640 1 -- 172.21.15.83:0/1119979312 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0c4811fd80 con 0x7f0c5406cbb0 2024-03-30T13:09:36.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.114+0000 7f0c53fff640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0c38067ff0 0x7f0c3806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:36.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.114+0000 7f0c53fff640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0c38067ff0 0x7f0c3806a4b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0c5415bb50 tx=0x7f0c4000a2a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:36.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.118+0000 7f0c517fa640 1 -- 172.21.15.83:0/1119979312 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f0c480c5060 con 0x7f0c5406cbb0 2024-03-30T13:09:36.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 -- 172.21.15.83:0/1119979312 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0c540b5b80 con 0x7f0c5406cbb0 2024-03-30T13:09:36.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c517fa640 1 -- 172.21.15.83:0/1119979312 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7f0c48016150 con 0x7f0c5406cbb0 2024-03-30T13:09:36.311 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:09:36.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 -- 172.21.15.83:0/1119979312 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0c38067ff0 msgr2=0x7f0c3806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:36.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0c38067ff0 0x7f0c3806a4b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0c5415bb50 tx=0x7f0c4000a2a0 comp rx=0 tx=0).stop 2024-03-30T13:09:36.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 -- 172.21.15.83:0/1119979312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c5406cbb0 msgr2=0x7f0c5414bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:36.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c5406cbb0 0x7f0c5414bdf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0c480ae040 tx=0x7f0c4801ada0 comp rx=0 tx=0).stop 2024-03-30T13:09:36.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 -- 172.21.15.83:0/1119979312 shutdown_connections 2024-03-30T13:09:36.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0c38067ff0 0x7f0c3806a4b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:36.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c5415aa00 0x7f0c54148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:36.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c540702a0 0x7f0c541434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:36.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 --2- 172.21.15.83:0/1119979312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c5406cbb0 0x7f0c5414bdf0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:36.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 -- 172.21.15.83:0/1119979312 >> 172.21.15.83:0/1119979312 conn(0x7f0c54072030 msgr2=0x7f0c5415d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:36.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 -- 172.21.15.83:0/1119979312 shutdown_connections 2024-03-30T13:09:36.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36.306+0000 7f0c5ae35640 1 -- 172.21.15.83:0/1119979312 wait complete. 2024-03-30T13:09:36.329 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:09:36.329 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:09:36.329 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-03-30T13:09:36.329 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-30T13:09:36.329 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-30T13:09:36.329 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:09:36.329 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:09:36.330 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:09:36.330 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:09:36.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:36.330 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-03-30T13:09:36.335 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:09:36.335 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:09:36.335 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-30T13:09:36.336 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42418sec preferred_lft 42418sec 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 02:42:4c:95:04:e4 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:09:36.337 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-30T13:09:36.338 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:36.338 INFO:teuthology.orchestra.run.smithi083.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:09:36.338 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:09:36.338 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-03-30T13:09:36.338 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:36.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:36.338 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:09:36.386 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-03-30T13:09:36.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:36.387 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-03-30T13:09:36.438 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-03-30T13:09:36.438 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:09:36.438 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-30T13:09:36.438 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:09:36.438 INFO:teuthology.orchestra.run.smithi083.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-03-30T13:09:36.438 INFO:teuthology.orchestra.run.smithi083.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-30T13:09:36.439 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:09:36.439 INFO:teuthology.orchestra.run.smithi083.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:09:36.439 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:09:36.439 INFO:teuthology.orchestra.run.smithi083.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:09:36.439 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:09:36.439 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:09:36.439 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-03-30T13:09:36.439 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:09:36.440 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:09:36.440 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:09:36.440 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-03-30T13:09:36.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:09:36.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:09:36.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:36.550 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-03-30T13:09:36.602 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-30T13:09:36.602 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-30T13:09:36.602 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:09:36.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:36.603 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2024-03-30T13:09:36.656 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-30T13:09:36.656 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:09:36.656 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-30T13:09:36.701 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:09:36.702 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:09:36.702 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-30T13:09:36.750 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-03-30T13:09:36.807 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:09:36.855 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-03-30T13:09:36.855 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/run/lock 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-03-30T13:09:36.856 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/fs/nfsd 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/run/rpc_pipefs 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-0 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-1 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-2 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-3 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-03-30T13:09:36.857 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:09:36.858 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:09:36.858 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:09:36.858 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:09:36.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:36.859 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-03-30T13:09:36.906 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-30T13:09:36.907 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-30T13:09:36.951 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-03-30T13:09:36.963 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:09:37.015 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-03-30T13:09:37.015 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-03-30T13:09:37.015 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-03-30T13:09:37.015 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-03-30T13:09:37.015 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-03-30T13:09:37.015 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-03-30T13:09:37.015 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/run/lock 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/fs/nfsd 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-03-30T13:09:37.016 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-03-30T13:09:37.017 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:09:37.017 INFO:teuthology.orchestra.run.smithi083.stdout:/run/rpc_pipefs 2024-03-30T13:09:37.017 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-03-30T13:09:37.017 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-03-30T13:09:37.017 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-0 2024-03-30T13:09:37.017 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-1 2024-03-30T13:09:37.017 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-2 2024-03-30T13:09:37.017 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-3 2024-03-30T13:09:37.017 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-03-30T13:09:37.017 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:09:37.017 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:09:37.018 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:09:37.018 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:09:37.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:37.019 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-03-30T13:09:37.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:2024-03-30T13:09:37.018+0000 7f9991c5b580 -1 init, newargv = 0x5639895b5700 newargc=15 2024-03-30T13:09:37.023 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:ceph-fuse[37969]: starting ceph client 2024-03-30T13:09:37.027 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:ceph-fuse[37969]: starting fuse 2024-03-30T13:09:38.128 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-03-30T13:09:38.144 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:09:38.193 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-03-30T13:09:38.193 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-03-30T13:09:38.193 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-03-30T13:09:38.193 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-03-30T13:09:38.193 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-03-30T13:09:38.194 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-03-30T13:09:38.194 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-03-30T13:09:38.194 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-03-30T13:09:38.194 INFO:teuthology.orchestra.run.smithi083.stdout:/run/lock 2024-03-30T13:09:38.194 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-03-30T13:09:38.194 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-03-30T13:09:38.194 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-03-30T13:09:38.194 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:09:38.194 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-03-30T13:09:38.194 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-03-30T13:09:38.194 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-03-30T13:09:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-03-30T13:09:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/fs/nfsd 2024-03-30T13:09:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-03-30T13:09:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-03-30T13:09:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:09:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:/run/rpc_pipefs 2024-03-30T13:09:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-03-30T13:09:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-03-30T13:09:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-0 2024-03-30T13:09:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-1 2024-03-30T13:09:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-2 2024-03-30T13:09:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-3 2024-03-30T13:09:38.196 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-03-30T13:09:38.196 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:09:38.196 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:09:38.196 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:09:38.196 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:09:38.196 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-30T13:09:38.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:38.197 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-03-30T13:09:38.244 INFO:teuthology.orchestra.run.smithi083.stdout:45 2024-03-30T13:09:38.244 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-03-30T13:09:38.244 DEBUG:teuthology.orchestra.run.smithi083:> sudo stdin-killer -- python3 -c ' 2024-03-30T13:09:38.244 DEBUG:teuthology.orchestra.run.smithi083:> import glob 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> import re 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> import os 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> import subprocess 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> def _find_admin_socket(client_name): 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> files = glob.glob(asok_path) 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> # Given a non-glob path, it better be there 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> if "*" not in asok_path: 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> assert(len(files) == 1) 2024-03-30T13:09:38.245 DEBUG:teuthology.orchestra.run.smithi083:> return files[0] 2024-03-30T13:09:38.246 DEBUG:teuthology.orchestra.run.smithi083:> 2024-03-30T13:09:38.246 DEBUG:teuthology.orchestra.run.smithi083:> for f in files: 2024-03-30T13:09:38.246 DEBUG:teuthology.orchestra.run.smithi083:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-30T13:09:38.246 DEBUG:teuthology.orchestra.run.smithi083:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-30T13:09:38.246 DEBUG:teuthology.orchestra.run.smithi083:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-30T13:09:38.246 DEBUG:teuthology.orchestra.run.smithi083:> contents = proc_f.read() 2024-03-30T13:09:38.246 DEBUG:teuthology.orchestra.run.smithi083:> if mountpoint in contents: 2024-03-30T13:09:38.246 DEBUG:teuthology.orchestra.run.smithi083:> return f 2024-03-30T13:09:38.246 DEBUG:teuthology.orchestra.run.smithi083:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-30T13:09:38.246 DEBUG:teuthology.orchestra.run.smithi083:> 2024-03-30T13:09:38.246 DEBUG:teuthology.orchestra.run.smithi083:> print(_find_admin_socket("client.0")) 2024-03-30T13:09:38.246 DEBUG:teuthology.orchestra.run.smithi083:> ' 2024-03-30T13:09:38.364 INFO:teuthology.orchestra.run.smithi083.stdout:/var/run/ceph/ceph-client.0.37969.asok 2024-03-30T13:09:38.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:09:38.375 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37969.asok 2024-03-30T13:09:38.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:38.375 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37969.asok status 2024-03-30T13:09:38.526 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:09:38.526 INFO:teuthology.orchestra.run.smithi083.stdout: "metadata": { 2024-03-30T13:09:38.526 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_sha1": "ac1710396f9f7c389fa4b407711bc5157a8c0bf7", 2024-03-30T13:09:38.526 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.0.0-2519-gac171039 (ac1710396f9f7c389fa4b407711bc5157a8c0bf7) squid (dev)", 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: "entity_id": "0", 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": "smithi083", 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: "pid": "37969", 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: "root": "/" 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_count": 0, 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_pinned_count": 0, 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 5400, 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: "inst": { 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: "name": { 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "client", 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: "num": 5400 2024-03-30T13:09:38.527 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 3478224677 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 3478224677 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: "inst_str": "client.5400 192.168.0.1:0/3478224677", 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: "addr_str": "192.168.0.1:0/3478224677", 2024-03-30T13:09:38.528 INFO:teuthology.orchestra.run.smithi083.stdout: "inode_count": 1, 2024-03-30T13:09:38.529 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_epoch": 15, 2024-03-30T13:09:38.529 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch": 34, 2024-03-30T13:09:38.529 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch_barrier": 0, 2024-03-30T13:09:38.529 INFO:teuthology.orchestra.run.smithi083.stdout: "blocklisted": false, 2024-03-30T13:09:38.529 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs" 2024-03-30T13:09:38.529 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:09:38.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:38.542 DEBUG:teuthology.orchestra.run.smithi083:> stat --file-system '--printf=%T 2024-03-30T13:09:38.542 DEBUG:teuthology.orchestra.run.smithi083:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-30T13:09:38.548 INFO:teuthology.orchestra.run.smithi083.stdout:fuseblk 2024-03-30T13:09:38.548 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-30T13:09:38.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:38.548 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-30T13:09:38.602 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:09:38.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3095b8640 1 Processor -- start 2024-03-30T13:09:38.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3095b8640 1 -- start start 2024-03-30T13:09:38.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3095b8640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc30415c490 0x7fc3040cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:38.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3095b8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3040b49c0 0x7fc30409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:38.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3095b8640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc3040cdde0 0x7fc30409af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:38.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3095b8640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc3040ce2b0 con 0x7fc3040cdde0 2024-03-30T13:09:38.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3095b8640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc3040ce590 con 0x7fc30415c490 2024-03-30T13:09:38.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3095b8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc3040c5f30 con 0x7fc3040b49c0 2024-03-30T13:09:38.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3037fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc3040cdde0 0x7fc30409af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:38.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3037fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc3040cdde0 0x7fc30409af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48586/0 (socket says 172.21.15.83:48586) 2024-03-30T13:09:38.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3037fe640 1 -- 172.21.15.83:0/142531949 learned_addr learned my addr 172.21.15.83:0/142531949 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:38.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc2fbfff640 1 --2- 172.21.15.83:0/142531949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3040b49c0 0x7fc30409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:38.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc302ffd640 1 --2- 172.21.15.83:0/142531949 >> v2:172.21.15.153:3300/0 conn(0x7fc30415c490 0x7fc3040cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:38.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3037fe640 1 -- 172.21.15.83:0/142531949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3040b49c0 msgr2=0x7fc30409aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:38.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3037fe640 1 --2- 172.21.15.83:0/142531949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3040b49c0 0x7fc30409aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:38.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3037fe640 1 -- 172.21.15.83:0/142531949 >> v2:172.21.15.153:3300/0 conn(0x7fc30415c490 msgr2=0x7fc3040cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:38.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3037fe640 1 --2- 172.21.15.83:0/142531949 >> v2:172.21.15.153:3300/0 conn(0x7fc30415c490 0x7fc3040cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:38.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc3037fe640 1 -- 172.21.15.83:0/142531949 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3040c6210 con 0x7fc3040cdde0 2024-03-30T13:09:38.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc2fbfff640 1 --2- 172.21.15.83:0/142531949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3040b49c0 0x7fc30409aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:38.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.770+0000 7fc302ffd640 1 --2- 172.21.15.83:0/142531949 >> v2:172.21.15.153:3300/0 conn(0x7fc30415c490 0x7fc3040cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:38.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3037fe640 1 --2- 172.21.15.83:0/142531949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3040cdde0 0x7fc30409af90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc3040751b0 tx=0x7fc2fc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c8e17f4b78eb99 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:38.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3027fc640 1 -- 172.21.15.83:0/142531949 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0a5670 con 0x7fc3040cdde0 2024-03-30T13:09:38.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3027fc640 1 -- 172.21.15.83:0/142531949 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2fc0a5810 con 0x7fc3040cdde0 2024-03-30T13:09:38.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3027fc640 1 -- 172.21.15.83:0/142531949 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0a5be0 con 0x7fc3040cdde0 2024-03-30T13:09:38.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3095b8640 1 -- 172.21.15.83:0/142531949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3040cdde0 msgr2=0x7fc30409af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:38.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3095b8640 1 --2- 172.21.15.83:0/142531949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3040cdde0 0x7fc30409af90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc3040751b0 tx=0x7fc2fc01c9f0 comp rx=0 tx=0).stop 2024-03-30T13:09:38.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3095b8640 1 -- 172.21.15.83:0/142531949 shutdown_connections 2024-03-30T13:09:38.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3095b8640 1 --2- 172.21.15.83:0/142531949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3040cdde0 0x7fc30409af90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:38.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3095b8640 1 --2- 172.21.15.83:0/142531949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3040b49c0 0x7fc30409aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:38.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3095b8640 1 --2- 172.21.15.83:0/142531949 >> v2:172.21.15.153:3300/0 conn(0x7fc30415c490 0x7fc3040cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:38.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3095b8640 1 -- 172.21.15.83:0/142531949 >> 172.21.15.83:0/142531949 conn(0x7fc3040b3da0 msgr2=0x7fc3040b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:38.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3095b8640 1 -- 172.21.15.83:0/142531949 shutdown_connections 2024-03-30T13:09:38.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3095b8640 1 -- 172.21.15.83:0/142531949 wait complete. 2024-03-30T13:09:38.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3095b8640 1 Processor -- start 2024-03-30T13:09:38.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.774+0000 7fc3095b8640 1 -- start start 2024-03-30T13:09:38.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3095b8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3040b49c0 0x7fc30406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:38.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3095b8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3040cdde0 0x7fc3040ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:38.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3095b8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc30415c490 0x7fc30415e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:38.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3095b8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc3040d0a20 con 0x7fc30415c490 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3095b8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc3040d08a0 con 0x7fc3040b49c0 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3095b8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc3040d0ba0 con 0x7fc3040cdde0 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3037fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc30415c490 0x7fc30415e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3037fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc30415c490 0x7fc30415e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48592/0 (socket says 172.21.15.83:48592) 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3037fe640 1 -- 172.21.15.83:0/3155092508 learned_addr learned my addr 172.21.15.83:0/3155092508 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc2fbfff640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3040cdde0 0x7fc3040ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc302ffd640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3040b49c0 0x7fc30406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3037fe640 1 -- 172.21.15.83:0/3155092508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3040cdde0 msgr2=0x7fc3040ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3037fe640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3040cdde0 0x7fc3040ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3037fe640 1 -- 172.21.15.83:0/3155092508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3040b49c0 msgr2=0x7fc30406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3037fe640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3040b49c0 0x7fc30406d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3037fe640 1 -- 172.21.15.83:0/3155092508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3040cc140 con 0x7fc30415c490 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3037fe640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc30415c490 0x7fc30415e3e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0af040 tx=0x7fc2fc019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:38.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc2fb7fe640 1 -- 172.21.15.83:0/3155092508 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc009510 con 0x7fc30415c490 2024-03-30T13:09:38.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc2fb7fe640 1 -- 172.21.15.83:0/3155092508 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2fc0be070 con 0x7fc30415c490 2024-03-30T13:09:38.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3095b8640 1 -- 172.21.15.83:0/3155092508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3040cb0a0 con 0x7fc30415c490 2024-03-30T13:09:38.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc2fb7fe640 1 -- 172.21.15.83:0/3155092508 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0b8b00 con 0x7fc30415c490 2024-03-30T13:09:38.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3095b8640 1 -- 172.21.15.83:0/3155092508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3040cb660 con 0x7fc30415c490 2024-03-30T13:09:38.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc3095b8640 1 -- 172.21.15.83:0/3155092508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc304068dd0 con 0x7fc30415c490 2024-03-30T13:09:38.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc2fb7fe640 1 -- 172.21.15.83:0/3155092508 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc2fc0b8ca0 con 0x7fc30415c490 2024-03-30T13:09:38.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc2fb7fe640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc2e4067fc0 0x7fc2e406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:38.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc302ffd640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc2e4067fc0 0x7fc2e406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:38.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc2fb7fe640 1 -- 172.21.15.83:0/3155092508 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc2fc121770 con 0x7fc30415c490 2024-03-30T13:09:38.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.778+0000 7fc302ffd640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc2e4067fc0 0x7fc2e406a480 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc3040cd140 tx=0x7fc2f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:38.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.782+0000 7fc2fb7fe640 1 -- 172.21.15.83:0/3155092508 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fc2fc0165e0 con 0x7fc30415c490 2024-03-30T13:09:38.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.986+0000 7fc3095b8640 1 -- 172.21.15.83:0/3155092508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc3040cad90 con 0x7fc30415c490 2024-03-30T13:09:38.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.986+0000 7fc2fb7fe640 1 -- 172.21.15.83:0/3155092508 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7fc2fc0f1fb0 con 0x7fc30415c490 2024-03-30T13:09:38.994 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:09:38.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.990+0000 7fc3095b8640 1 -- 172.21.15.83:0/3155092508 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc2e4067fc0 msgr2=0x7fc2e406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:38.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.990+0000 7fc3095b8640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc2e4067fc0 0x7fc2e406a480 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc3040cd140 tx=0x7fc2f4008040 comp rx=0 tx=0).stop 2024-03-30T13:09:38.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.990+0000 7fc3095b8640 1 -- 172.21.15.83:0/3155092508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc30415c490 msgr2=0x7fc30415e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:38.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.990+0000 7fc3095b8640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc30415c490 0x7fc30415e3e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0af040 tx=0x7fc2fc019790 comp rx=0 tx=0).stop 2024-03-30T13:09:38.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.990+0000 7fc3095b8640 1 -- 172.21.15.83:0/3155092508 shutdown_connections 2024-03-30T13:09:38.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.990+0000 7fc3095b8640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc2e4067fc0 0x7fc2e406a480 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:38.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.990+0000 7fc3095b8640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc30415c490 0x7fc30415e3e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:38.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.990+0000 7fc3095b8640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3040cdde0 0x7fc3040ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:38.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.990+0000 7fc3095b8640 1 --2- 172.21.15.83:0/3155092508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3040b49c0 0x7fc30406d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:38.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.990+0000 7fc3095b8640 1 -- 172.21.15.83:0/3155092508 >> 172.21.15.83:0/3155092508 conn(0x7fc3040b3da0 msgr2=0x7fc30406fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:38.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.990+0000 7fc3095b8640 1 -- 172.21.15.83:0/3155092508 shutdown_connections 2024-03-30T13:09:38.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:38.990+0000 7fc3095b8640 1 -- 172.21.15.83:0/3155092508 wait complete. 2024-03-30T13:09:39.017 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:09:39.017 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:09:39.017 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-03-30T13:09:39.017 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-30T13:09:39.017 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-30T13:09:39.017 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:09:39.017 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:09:39.017 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:09:39.018 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:09:39.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:39.018 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-03-30T13:09:39.025 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:09:39.025 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:09:39.025 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:09:39.025 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:39.025 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-03-30T13:09:39.025 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:39.025 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:09:39.025 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:09:39.025 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42417sec preferred_lft 42417sec 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:0b:ab:5b:f5 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-03-30T13:09:39.027 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:09:39.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:39.028 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:09:39.079 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-03-30T13:09:39.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:39.081 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-03-30T13:09:39.133 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-03-30T13:09:39.133 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:09:39.133 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-30T13:09:39.133 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:09:39.134 INFO:teuthology.orchestra.run.smithi153.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-03-30T13:09:39.134 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-30T13:09:39.134 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:09:39.134 INFO:teuthology.orchestra.run.smithi153.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:09:39.134 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:09:39.134 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-30T13:09:39.134 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:09:39.134 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:09:39.134 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-30T13:09:39.135 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:09:39.135 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:09:39.135 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:09:39.135 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-30T13:09:39.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:09:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:09:39.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:09:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:09:39.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:39.257 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-03-30T13:09:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-30T13:09:39.263 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-30T13:09:39.264 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:09:39.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:39.264 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-03-30T13:09:39.320 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-30T13:09:39.321 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:09:39.321 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-30T13:09:39.367 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:09:39.368 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:09:39.368 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-30T13:09:39.416 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-03-30T13:09:39.473 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:09:39.521 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-03-30T13:09:39.521 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-03-30T13:09:39.521 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-03-30T13:09:39.521 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-03-30T13:09:39.521 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-03-30T13:09:39.521 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-03-30T13:09:39.521 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/run/lock 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/fs/nfsd 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-03-30T13:09:39.522 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:09:39.523 INFO:teuthology.orchestra.run.smithi153.stdout:/run/rpc_pipefs 2024-03-30T13:09:39.523 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-03-30T13:09:39.523 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-03-30T13:09:39.523 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-4 2024-03-30T13:09:39.523 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-5 2024-03-30T13:09:39.523 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-6 2024-03-30T13:09:39.523 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-7 2024-03-30T13:09:39.523 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-03-30T13:09:39.523 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:09:39.523 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:09:39.523 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:09:39.523 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:09:39.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:39.525 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-03-30T13:09:39.579 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-30T13:09:39.579 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-30T13:09:39.625 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-03-30T13:09:39.639 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:09:39.688 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-03-30T13:09:39.688 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-03-30T13:09:39.688 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-03-30T13:09:39.688 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-03-30T13:09:39.688 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-03-30T13:09:39.688 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-03-30T13:09:39.688 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-03-30T13:09:39.688 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-03-30T13:09:39.688 INFO:teuthology.orchestra.run.smithi153.stdout:/run/lock 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/fs/nfsd 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/run/rpc_pipefs 2024-03-30T13:09:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-03-30T13:09:39.690 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-03-30T13:09:39.690 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-4 2024-03-30T13:09:39.690 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-5 2024-03-30T13:09:39.690 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-6 2024-03-30T13:09:39.690 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-7 2024-03-30T13:09:39.690 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-03-30T13:09:39.690 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:09:39.690 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:09:39.690 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:09:39.690 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:09:39.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:39.691 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-03-30T13:09:39.706 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:2024-03-30T13:09:39.700+0000 7fcc6fa25580 -1 init, newargv = 0x55d405c499a0 newargc=15 2024-03-30T13:09:39.706 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33195]: starting ceph client 2024-03-30T13:09:39.713 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33195]: starting fuse 2024-03-30T13:09:40.812 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-03-30T13:09:40.828 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:09:40.877 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-03-30T13:09:40.877 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-03-30T13:09:40.877 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-03-30T13:09:40.877 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-03-30T13:09:40.877 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-03-30T13:09:40.877 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-03-30T13:09:40.877 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-03-30T13:09:40.877 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-03-30T13:09:40.877 INFO:teuthology.orchestra.run.smithi153.stdout:/run/lock 2024-03-30T13:09:40.877 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-03-30T13:09:40.877 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/fs/nfsd 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysusers.service 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/run/rpc_pipefs 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-03-30T13:09:40.878 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-03-30T13:09:40.879 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-4 2024-03-30T13:09:40.879 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-5 2024-03-30T13:09:40.879 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-6 2024-03-30T13:09:40.879 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-7 2024-03-30T13:09:40.879 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-03-30T13:09:40.879 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:09:40.879 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:09:40.879 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:09:40.879 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:09:40.879 INFO:teuthology.orchestra.run.smithi153.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-30T13:09:40.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:40.880 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-03-30T13:09:40.927 INFO:teuthology.orchestra.run.smithi153.stdout:45 2024-03-30T13:09:40.928 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-03-30T13:09:40.928 DEBUG:teuthology.orchestra.run.smithi153:> sudo stdin-killer -- python3 -c ' 2024-03-30T13:09:40.928 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-03-30T13:09:40.928 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-03-30T13:09:40.928 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-03-30T13:09:40.928 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-03-30T13:09:40.928 DEBUG:teuthology.orchestra.run.smithi153:> 2024-03-30T13:09:40.928 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-03-30T13:09:40.928 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-30T13:09:40.928 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-03-30T13:09:40.928 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> 2024-03-30T13:09:40.929 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.1")) 2024-03-30T13:09:40.930 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-03-30T13:09:41.053 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.1.33195.asok 2024-03-30T13:09:41.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-30T13:09:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:09:41.065 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33195.asok 2024-03-30T13:09:41.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:41.066 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33195.asok status 2024-03-30T13:09:41.215 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-30T13:09:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-03-30T13:09:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "ac1710396f9f7c389fa4b407711bc5157a8c0bf7", 2024-03-30T13:09:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 19.0.0-2519-gac171039 (ac1710396f9f7c389fa4b407711bc5157a8c0bf7) squid (dev)", 2024-03-30T13:09:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "1", 2024-03-30T13:09:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-03-30T13:09:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-30T13:09:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "33195", 2024-03-30T13:09:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-03-30T13:09:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-30T13:09:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-03-30T13:09:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5176, 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 5176 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 81048748 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-03-30T13:09:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 81048748 2024-03-30T13:09:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-30T13:09:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.5176 192.168.0.1:0/81048748", 2024-03-30T13:09:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/81048748", 2024-03-30T13:09:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-03-30T13:09:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 15, 2024-03-30T13:09:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 34, 2024-03-30T13:09:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-03-30T13:09:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-03-30T13:09:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-03-30T13:09:41.217 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-30T13:09:41.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:41.229 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-03-30T13:09:41.229 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-30T13:09:41.234 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-03-30T13:09:41.235 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-30T13:09:41.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:41.235 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-30T13:09:41.294 DEBUG:tasks.cephfs.test_uninlining:setting inline_data:1 2024-03-30T13:09:41.294 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs inline_data 1 --yes-i-really-really-mean-it 2024-03-30T13:09:41.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c271b640 1 Processor -- start 2024-03-30T13:09:41.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c271b640 1 -- start start 2024-03-30T13:09:41.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c271b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb1bc0d10b0 0x7fb1bc0d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:41.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c271b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb1bc0d3020 0x7fb1bc15e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:41.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c271b640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1bc0cf350 con 0x7fb1bc0d1490 2024-03-30T13:09:41.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c271b640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb1bc0cf630 con 0x7fb1bc0d3020 2024-03-30T13:09:41.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c271b640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb1bc0cf910 con 0x7fb1bc0d10b0 2024-03-30T13:09:41.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c0cb8640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb1bc0d3020 0x7fb1bc15e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:41.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c0cb8640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb1bc0d3020 0x7fb1bc15e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48598/0 (socket says 172.21.15.83:48598) 2024-03-30T13:09:41.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c0cb8640 1 -- 172.21.15.83:0/3044252743 learned_addr learned my addr 172.21.15.83:0/3044252743 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:41.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1bbfff640 1 --2- 172.21.15.83:0/3044252743 >> v2:172.21.15.153:3300/0 conn(0x7fb1bc0d10b0 0x7fb1bc0d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:41.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c0cb8640 1 -- 172.21.15.83:0/3044252743 >> v2:172.21.15.153:3300/0 conn(0x7fb1bc0d10b0 msgr2=0x7fb1bc0d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:41.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c0cb8640 1 --2- 172.21.15.83:0/3044252743 >> v2:172.21.15.153:3300/0 conn(0x7fb1bc0d10b0 0x7fb1bc0d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:41.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.418+0000 7fb1c0cb8640 1 -- 172.21.15.83:0/3044252743 >> v1:172.21.15.153:6789/0 conn(0x7fb1bc0d1490 legacy=0x7fb1bc15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:41.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1c0cb8640 1 -- 172.21.15.83:0/3044252743 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc0cfbf0 con 0x7fb1bc0d3020 2024-03-30T13:09:41.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1c0cb8640 1 --2- 172.21.15.83:0/3044252743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0d3020 0x7fb1bc15e7c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc073c10 tx=0x7fb1b401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce6c8ad736a3dbb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:41.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1baffd640 1 -- 172.21.15.83:0/3044252743 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40a5740 con 0x7fb1bc0d3020 2024-03-30T13:09:41.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1baffd640 1 -- 172.21.15.83:0/3044252743 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b40a58e0 con 0x7fb1bc0d3020 2024-03-30T13:09:41.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1baffd640 1 -- 172.21.15.83:0/3044252743 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40a5cb0 con 0x7fb1bc0d3020 2024-03-30T13:09:41.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1c271b640 1 -- 172.21.15.83:0/3044252743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0d3020 msgr2=0x7fb1bc15e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:41.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1c271b640 1 --2- 172.21.15.83:0/3044252743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0d3020 0x7fb1bc15e7c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc073c10 tx=0x7fb1b401c9f0 comp rx=0 tx=0).stop 2024-03-30T13:09:41.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1c271b640 1 -- 172.21.15.83:0/3044252743 shutdown_connections 2024-03-30T13:09:41.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1c271b640 1 --2- 172.21.15.83:0/3044252743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0d3020 0x7fb1bc15e7c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:41.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1c271b640 1 --2- 172.21.15.83:0/3044252743 >> v2:172.21.15.153:3300/0 conn(0x7fb1bc0d10b0 0x7fb1bc0d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:41.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1c271b640 1 -- 172.21.15.83:0/3044252743 >> 172.21.15.83:0/3044252743 conn(0x7fb1bc0d4460 msgr2=0x7fb1bc0d4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:41.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1c271b640 1 -- 172.21.15.83:0/3044252743 shutdown_connections 2024-03-30T13:09:41.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.422+0000 7fb1c271b640 1 -- 172.21.15.83:0/3044252743 wait complete. 2024-03-30T13:09:41.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1c271b640 1 Processor -- start 2024-03-30T13:09:41.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1c271b640 1 -- start start 2024-03-30T13:09:41.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1c271b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1bc0d10b0 0x7fb1bc0c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:41.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1c271b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0d1490 0x7fb1bc0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:41.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1c271b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb1bc0d3020 0x7fb1bc15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:41.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1c271b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc16afa0 con 0x7fb1bc0d1490 2024-03-30T13:09:41.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1c271b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc16ae20 con 0x7fb1bc0d10b0 2024-03-30T13:09:41.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1c271b640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb1bc16b120 con 0x7fb1bc0d3020 2024-03-30T13:09:41.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1bb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0d1490 0x7fb1bc0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:41.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1bb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0d1490 0x7fb1bc0ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48610/0 (socket says 172.21.15.83:48610) 2024-03-30T13:09:41.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1bb7fe640 1 -- 172.21.15.83:0/2446314962 learned_addr learned my addr 172.21.15.83:0/2446314962 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:41.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1bbfff640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1bc0d10b0 0x7fb1bc0c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:41.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1c0cb8640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb1bc0d3020 0x7fb1bc15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:41.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1bb7fe640 1 -- 172.21.15.83:0/2446314962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb1bc0d3020 msgr2=0x7fb1bc15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:41.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1bb7fe640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb1bc0d3020 0x7fb1bc15d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:41.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1bb7fe640 1 -- 172.21.15.83:0/2446314962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1bc0d10b0 msgr2=0x7fb1bc0c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:41.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1bb7fe640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1bc0d10b0 0x7fb1bc0c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:41.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1bb7fe640 1 -- 172.21.15.83:0/2446314962 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc0caf50 con 0x7fb1bc0d1490 2024-03-30T13:09:41.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1bb7fe640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0d1490 0x7fb1bc0ca4e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000c3a0 tx=0x7fb1b000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:41.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1b8ff9640 1 -- 172.21.15.83:0/2446314962 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b00052d0 con 0x7fb1bc0d1490 2024-03-30T13:09:41.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1b8ff9640 1 -- 172.21.15.83:0/2446314962 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b0005470 con 0x7fb1bc0d1490 2024-03-30T13:09:41.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1b8ff9640 1 -- 172.21.15.83:0/2446314962 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0007260 con 0x7fb1bc0d1490 2024-03-30T13:09:41.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1c271b640 1 -- 172.21.15.83:0/2446314962 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1bc0b7220 con 0x7fb1bc0d1490 2024-03-30T13:09:41.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1c271b640 1 -- 172.21.15.83:0/2446314962 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1bc0b77e0 con 0x7fb1bc0d1490 2024-03-30T13:09:41.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.426+0000 7fb1c271b640 1 -- 172.21.15.83:0/2446314962 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1bc0686c0 con 0x7fb1bc0d1490 2024-03-30T13:09:41.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.430+0000 7fb1b8ff9640 1 -- 172.21.15.83:0/2446314962 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb1b0007400 con 0x7fb1bc0d1490 2024-03-30T13:09:41.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.430+0000 7fb1b8ff9640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb1a8067fc0 0x7fb1a806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:41.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.430+0000 7fb1b8ff9640 1 -- 172.21.15.83:0/2446314962 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb1b0085920 con 0x7fb1bc0d1490 2024-03-30T13:09:41.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.430+0000 7fb1bbfff640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb1a8067fc0 0x7fb1a806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:41.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.430+0000 7fb1bbfff640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb1a8067fc0 0x7fb1a806a480 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00b930 tx=0x7fb1ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:41.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.434+0000 7fb1b8ff9640 1 -- 172.21.15.83:0/2446314962 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb1b0056160 con 0x7fb1bc0d1490 2024-03-30T13:09:41.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:41.634+0000 7fb1c271b640 1 -- 172.21.15.83:0/2446314962 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "1", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb1bc0b6d80 con 0x7fb1bc0d1490 2024-03-30T13:09:42.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.226+0000 7fb1b8ff9640 1 -- 172.21.15.83:0/2446314962 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "1", "yes_i_really_really_mean_it": true}]=0 inline data enabled v16) ==== 165+0+0 (secure 0 0 0) 0x7fb1b0055a60 con 0x7fb1bc0d1490 2024-03-30T13:09:42.234 INFO:teuthology.orchestra.run.smithi083.stderr:inline data enabled 2024-03-30T13:09:42.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.230+0000 7fb1c271b640 1 -- 172.21.15.83:0/2446314962 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb1a8067fc0 msgr2=0x7fb1a806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:42.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.230+0000 7fb1c271b640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb1a8067fc0 0x7fb1a806a480 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00b930 tx=0x7fb1ac008040 comp rx=0 tx=0).stop 2024-03-30T13:09:42.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.230+0000 7fb1c271b640 1 -- 172.21.15.83:0/2446314962 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0d1490 msgr2=0x7fb1bc0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:42.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.230+0000 7fb1c271b640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0d1490 0x7fb1bc0ca4e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000c3a0 tx=0x7fb1b000c860 comp rx=0 tx=0).stop 2024-03-30T13:09:42.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.230+0000 7fb1c271b640 1 -- 172.21.15.83:0/2446314962 shutdown_connections 2024-03-30T13:09:42.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.230+0000 7fb1c271b640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb1a8067fc0 0x7fb1a806a480 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:42.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.230+0000 7fb1c271b640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb1bc0d3020 0x7fb1bc15d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:42.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.230+0000 7fb1c271b640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0d1490 0x7fb1bc0ca4e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:42.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.230+0000 7fb1c271b640 1 --2- 172.21.15.83:0/2446314962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1bc0d10b0 0x7fb1bc0c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:42.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.230+0000 7fb1c271b640 1 -- 172.21.15.83:0/2446314962 >> 172.21.15.83:0/2446314962 conn(0x7fb1bc0d4460 msgr2=0x7fb1bc15efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:42.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.230+0000 7fb1c271b640 1 -- 172.21.15.83:0/2446314962 shutdown_connections 2024-03-30T13:09:42.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:42.230+0000 7fb1c271b640 1 -- 172.21.15.83:0/2446314962 wait complete. 2024-03-30T13:09:42.253 DEBUG:tasks.cephfs.test_uninlining:fetching tarball 2024-03-30T13:09:42.254 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && wget http://download.ceph.com/qa/linux-5.4.tar.gz 2024-03-30T13:09:42.289 INFO:teuthology.orchestra.run.smithi083.stderr:--2024-03-30 13:09:42-- http://download.ceph.com/qa/linux-5.4.tar.gz 2024-03-30T13:09:42.290 INFO:teuthology.orchestra.run.smithi083.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-03-30T13:09:42.311 INFO:teuthology.orchestra.run.smithi083.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-03-30T13:09:42.331 INFO:teuthology.orchestra.run.smithi083.stderr:HTTP request sent, awaiting response... 200 OK 2024-03-30T13:09:42.332 INFO:teuthology.orchestra.run.smithi083.stderr:Length: 172616875 (165M) [application/octet-stream] 2024-03-30T13:09:42.337 INFO:teuthology.orchestra.run.smithi083.stderr:Saving to: 'linux-5.4.tar.gz' 2024-03-30T13:09:42.342 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-03-30T13:09:42.373 INFO:teuthology.orchestra.run.smithi083.stderr: 0K .......... .......... .......... .......... .......... 0% 1.38M 1m59s 2024-03-30T13:09:42.393 INFO:teuthology.orchestra.run.smithi083.stderr: 50K .......... .......... .......... .......... .......... 0% 2.47M 93s 2024-03-30T13:09:42.396 INFO:teuthology.orchestra.run.smithi083.stderr: 100K .......... .......... .......... .......... .......... 0% 13.3M 66s 2024-03-30T13:09:42.399 INFO:teuthology.orchestra.run.smithi083.stderr: 150K .......... .......... .......... .......... .......... 0% 18.3M 52s 2024-03-30T13:09:42.415 INFO:teuthology.orchestra.run.smithi083.stderr: 200K .......... .......... .......... .......... .......... 0% 2.96M 52s 2024-03-30T13:09:42.418 INFO:teuthology.orchestra.run.smithi083.stderr: 250K .......... .......... .......... .......... .......... 0% 16.9M 45s 2024-03-30T13:09:42.421 INFO:teuthology.orchestra.run.smithi083.stderr: 300K .......... .......... .......... .......... .......... 0% 19.5M 40s 2024-03-30T13:09:42.423 INFO:teuthology.orchestra.run.smithi083.stderr: 350K .......... .......... .......... .......... .......... 0% 19.4M 36s 2024-03-30T13:09:42.436 INFO:teuthology.orchestra.run.smithi083.stderr: 400K .......... .......... .......... .......... .......... 0% 3.76M 37s 2024-03-30T13:09:42.440 INFO:teuthology.orchestra.run.smithi083.stderr: 450K .......... .......... .......... .......... .......... 0% 16.0M 34s 2024-03-30T13:09:42.442 INFO:teuthology.orchestra.run.smithi083.stderr: 500K .......... .......... .......... .......... .......... 0% 20.6M 32s 2024-03-30T13:09:42.444 INFO:teuthology.orchestra.run.smithi083.stderr: 550K .......... .......... .......... .......... .......... 0% 20.2M 30s 2024-03-30T13:09:42.447 INFO:teuthology.orchestra.run.smithi083.stderr: 600K .......... .......... .......... .......... .......... 0% 20.1M 28s 2024-03-30T13:09:42.449 INFO:teuthology.orchestra.run.smithi083.stderr: 650K .......... .......... .......... .......... .......... 0% 17.3M 27s 2024-03-30T13:09:42.452 INFO:teuthology.orchestra.run.smithi083.stderr: 700K .......... .......... .......... .......... .......... 0% 17.0M 26s 2024-03-30T13:09:42.455 INFO:teuthology.orchestra.run.smithi083.stderr: 750K .......... .......... .......... .......... .......... 0% 17.0M 25s 2024-03-30T13:09:42.458 INFO:teuthology.orchestra.run.smithi083.stderr: 800K .......... .......... .......... .......... .......... 0% 17.3M 24s 2024-03-30T13:09:42.462 INFO:teuthology.orchestra.run.smithi083.stderr: 850K .......... .......... .......... .......... .......... 0% 11.6M 23s 2024-03-30T13:09:42.465 INFO:teuthology.orchestra.run.smithi083.stderr: 900K .......... .......... .......... .......... .......... 0% 19.5M 22s 2024-03-30T13:09:42.466 INFO:teuthology.orchestra.run.smithi083.stderr: 950K .......... .......... .......... .......... .......... 0% 26.9M 22s 2024-03-30T13:09:42.468 INFO:teuthology.orchestra.run.smithi083.stderr: 1000K .......... .......... .......... .......... .......... 0% 31.6M 21s 2024-03-30T13:09:42.470 INFO:teuthology.orchestra.run.smithi083.stderr: 1050K .......... .......... .......... .......... .......... 0% 28.9M 20s 2024-03-30T13:09:42.471 INFO:teuthology.orchestra.run.smithi083.stderr: 1100K .......... .......... .......... .......... .......... 0% 31.9M 19s 2024-03-30T13:09:42.473 INFO:teuthology.orchestra.run.smithi083.stderr: 1150K .......... .......... .......... .......... .......... 0% 32.3M 19s 2024-03-30T13:09:42.474 INFO:teuthology.orchestra.run.smithi083.stderr: 1200K .......... .......... .......... .......... .......... 0% 32.0M 18s 2024-03-30T13:09:42.476 INFO:teuthology.orchestra.run.smithi083.stderr: 1250K .......... .......... .......... .......... .......... 0% 27.3M 18s 2024-03-30T13:09:42.477 INFO:teuthology.orchestra.run.smithi083.stderr: 1300K .......... .......... .......... .......... .......... 0% 31.7M 17s 2024-03-30T13:09:42.479 INFO:teuthology.orchestra.run.smithi083.stderr: 1350K .......... .......... .......... .......... .......... 0% 29.8M 17s 2024-03-30T13:09:42.481 INFO:teuthology.orchestra.run.smithi083.stderr: 1400K .......... .......... .......... .......... .......... 0% 31.3M 17s 2024-03-30T13:09:42.482 INFO:teuthology.orchestra.run.smithi083.stderr: 1450K .......... .......... .......... .......... .......... 0% 26.8M 16s 2024-03-30T13:09:42.484 INFO:teuthology.orchestra.run.smithi083.stderr: 1500K .......... .......... .......... .......... .......... 0% 29.7M 16s 2024-03-30T13:09:42.486 INFO:teuthology.orchestra.run.smithi083.stderr: 1550K .......... .......... .......... .......... .......... 0% 30.2M 15s 2024-03-30T13:09:42.487 INFO:teuthology.orchestra.run.smithi083.stderr: 1600K .......... .......... .......... .......... .......... 0% 30.3M 15s 2024-03-30T13:09:42.489 INFO:teuthology.orchestra.run.smithi083.stderr: 1650K .......... .......... .......... .......... .......... 1% 27.4M 15s 2024-03-30T13:09:42.491 INFO:teuthology.orchestra.run.smithi083.stderr: 1700K .......... .......... .......... .......... .......... 1% 30.0M 15s 2024-03-30T13:09:42.492 INFO:teuthology.orchestra.run.smithi083.stderr: 1750K .......... .......... .......... .......... .......... 1% 29.8M 14s 2024-03-30T13:09:42.495 INFO:teuthology.orchestra.run.smithi083.stderr: 1800K .......... .......... .......... .......... .......... 1% 18.1M 14s 2024-03-30T13:09:42.497 INFO:teuthology.orchestra.run.smithi083.stderr: 1850K .......... .......... .......... .......... .......... 1% 29.1M 14s 2024-03-30T13:09:42.498 INFO:teuthology.orchestra.run.smithi083.stderr: 1900K .......... .......... .......... .......... .......... 1% 34.9M 14s 2024-03-30T13:09:42.500 INFO:teuthology.orchestra.run.smithi083.stderr: 1950K .......... .......... .......... .......... .......... 1% 35.6M 14s 2024-03-30T13:09:42.501 INFO:teuthology.orchestra.run.smithi083.stderr: 2000K .......... .......... .......... .......... .......... 1% 34.8M 13s 2024-03-30T13:09:42.505 INFO:teuthology.orchestra.run.smithi083.stderr: 2050K .......... .......... .......... .......... .......... 1% 15.2M 13s 2024-03-30T13:09:42.507 INFO:teuthology.orchestra.run.smithi083.stderr: 2100K .......... .......... .......... .......... .......... 1% 19.5M 13s 2024-03-30T13:09:42.509 INFO:teuthology.orchestra.run.smithi083.stderr: 2150K .......... .......... .......... .......... .......... 1% 22.3M 13s 2024-03-30T13:09:42.511 INFO:teuthology.orchestra.run.smithi083.stderr: 2200K .......... .......... .......... .......... .......... 1% 21.8M 13s 2024-03-30T13:09:42.514 INFO:teuthology.orchestra.run.smithi083.stderr: 2250K .......... .......... .......... .......... .......... 1% 18.9M 13s 2024-03-30T13:09:42.516 INFO:teuthology.orchestra.run.smithi083.stderr: 2300K .......... .......... .......... .......... .......... 1% 21.6M 13s 2024-03-30T13:09:42.518 INFO:teuthology.orchestra.run.smithi083.stderr: 2350K .......... .......... .......... .......... .......... 1% 21.2M 13s 2024-03-30T13:09:42.521 INFO:teuthology.orchestra.run.smithi083.stderr: 2400K .......... .......... .......... .......... .......... 1% 21.5M 12s 2024-03-30T13:09:42.524 INFO:teuthology.orchestra.run.smithi083.stderr: 2450K .......... .......... .......... .......... .......... 1% 17.2M 12s 2024-03-30T13:09:42.526 INFO:teuthology.orchestra.run.smithi083.stderr: 2500K .......... .......... .......... .......... .......... 1% 20.1M 12s 2024-03-30T13:09:42.529 INFO:teuthology.orchestra.run.smithi083.stderr: 2550K .......... .......... .......... .......... .......... 1% 20.1M 12s 2024-03-30T13:09:42.531 INFO:teuthology.orchestra.run.smithi083.stderr: 2600K .......... .......... .......... .......... .......... 1% 19.2M 12s 2024-03-30T13:09:42.534 INFO:teuthology.orchestra.run.smithi083.stderr: 2650K .......... .......... .......... .......... .......... 1% 16.7M 12s 2024-03-30T13:09:42.536 INFO:teuthology.orchestra.run.smithi083.stderr: 2700K .......... .......... .......... .......... .......... 1% 18.9M 12s 2024-03-30T13:09:42.540 INFO:teuthology.orchestra.run.smithi083.stderr: 2750K .......... .......... .......... .......... .......... 1% 17.6M 12s 2024-03-30T13:09:42.542 INFO:teuthology.orchestra.run.smithi083.stderr: 2800K .......... .......... .......... .......... .......... 1% 16.8M 12s 2024-03-30T13:09:42.546 INFO:teuthology.orchestra.run.smithi083.stderr: 2850K .......... .......... .......... .......... .......... 1% 12.1M 12s 2024-03-30T13:09:42.549 INFO:teuthology.orchestra.run.smithi083.stderr: 2900K .......... .......... .......... .......... .......... 1% 16.7M 12s 2024-03-30T13:09:42.552 INFO:teuthology.orchestra.run.smithi083.stderr: 2950K .......... .......... .......... .......... .......... 1% 17.2M 12s 2024-03-30T13:09:42.555 INFO:teuthology.orchestra.run.smithi083.stderr: 3000K .......... .......... .......... .......... .......... 1% 17.0M 12s 2024-03-30T13:09:42.563 INFO:teuthology.orchestra.run.smithi083.stderr: 3050K .......... .......... .......... .......... .......... 1% 14.6M 12s 2024-03-30T13:09:42.564 INFO:teuthology.orchestra.run.smithi083.stderr: 3100K .......... .......... .......... .......... .......... 1% 17.4M 12s 2024-03-30T13:09:42.565 INFO:teuthology.orchestra.run.smithi083.stderr: 3150K .......... .......... .......... .......... .......... 1% 17.3M 12s 2024-03-30T13:09:42.567 INFO:teuthology.orchestra.run.smithi083.stderr: 3200K .......... .......... .......... .......... .......... 1% 17.2M 12s 2024-03-30T13:09:42.570 INFO:teuthology.orchestra.run.smithi083.stderr: 3250K .......... .......... .......... .......... .......... 1% 14.5M 12s 2024-03-30T13:09:42.573 INFO:teuthology.orchestra.run.smithi083.stderr: 3300K .......... .......... .......... .......... .......... 1% 18.0M 12s 2024-03-30T13:09:42.576 INFO:teuthology.orchestra.run.smithi083.stderr: 3350K .......... .......... .......... .......... .......... 2% 17.0M 12s 2024-03-30T13:09:42.579 INFO:teuthology.orchestra.run.smithi083.stderr: 3400K .......... .......... .......... .......... .......... 2% 16.8M 12s 2024-03-30T13:09:42.582 INFO:teuthology.orchestra.run.smithi083.stderr: 3450K .......... .......... .......... .......... .......... 2% 15.1M 12s 2024-03-30T13:09:42.584 INFO:teuthology.orchestra.run.smithi083.stderr: 3500K .......... .......... .......... .......... .......... 2% 17.7M 11s 2024-03-30T13:09:42.587 INFO:teuthology.orchestra.run.smithi083.stderr: 3550K .......... .......... .......... .......... .......... 2% 17.3M 11s 2024-03-30T13:09:42.590 INFO:teuthology.orchestra.run.smithi083.stderr: 3600K .......... .......... .......... .......... .......... 2% 17.3M 11s 2024-03-30T13:09:42.593 INFO:teuthology.orchestra.run.smithi083.stderr: 3650K .......... .......... .......... .......... .......... 2% 15.0M 11s 2024-03-30T13:09:42.599 INFO:teuthology.orchestra.run.smithi083.stderr: 3700K .......... .......... .......... .......... .......... 2% 8.21M 12s 2024-03-30T13:09:42.602 INFO:teuthology.orchestra.run.smithi083.stderr: 3750K .......... .......... .......... .......... .......... 2% 19.7M 11s 2024-03-30T13:09:42.604 INFO:teuthology.orchestra.run.smithi083.stderr: 3800K .......... .......... .......... .......... .......... 2% 22.0M 11s 2024-03-30T13:09:42.606 INFO:teuthology.orchestra.run.smithi083.stderr: 3850K .......... .......... .......... .......... .......... 2% 19.9M 11s 2024-03-30T13:09:42.609 INFO:teuthology.orchestra.run.smithi083.stderr: 3900K .......... .......... .......... .......... .......... 2% 23.4M 11s 2024-03-30T13:09:42.611 INFO:teuthology.orchestra.run.smithi083.stderr: 3950K .......... .......... .......... .......... .......... 2% 23.1M 11s 2024-03-30T13:09:42.614 INFO:teuthology.orchestra.run.smithi083.stderr: 4000K .......... .......... .......... .......... .......... 2% 23.1M 11s 2024-03-30T13:09:42.615 INFO:teuthology.orchestra.run.smithi083.stderr: 4050K .......... .......... .......... .......... .......... 2% 18.6M 11s 2024-03-30T13:09:42.618 INFO:teuthology.orchestra.run.smithi083.stderr: 4100K .......... .......... .......... .......... .......... 2% 23.2M 11s 2024-03-30T13:09:42.620 INFO:teuthology.orchestra.run.smithi083.stderr: 4150K .......... .......... .......... .......... .......... 2% 22.7M 11s 2024-03-30T13:09:42.622 INFO:teuthology.orchestra.run.smithi083.stderr: 4200K .......... .......... .......... .......... .......... 2% 22.6M 11s 2024-03-30T13:09:42.625 INFO:teuthology.orchestra.run.smithi083.stderr: 4250K .......... .......... .......... .......... .......... 2% 17.0M 11s 2024-03-30T13:09:42.627 INFO:teuthology.orchestra.run.smithi083.stderr: 4300K .......... .......... .......... .......... .......... 2% 19.9M 11s 2024-03-30T13:09:42.630 INFO:teuthology.orchestra.run.smithi083.stderr: 4350K .......... .......... .......... .......... .......... 2% 16.8M 11s 2024-03-30T13:09:42.633 INFO:teuthology.orchestra.run.smithi083.stderr: 4400K .......... .......... .......... .......... .......... 2% 17.8M 11s 2024-03-30T13:09:42.637 INFO:teuthology.orchestra.run.smithi083.stderr: 4450K .......... .......... .......... .......... .......... 2% 11.9M 11s 2024-03-30T13:09:42.640 INFO:teuthology.orchestra.run.smithi083.stderr: 4500K .......... .......... .......... .......... .......... 2% 17.3M 11s 2024-03-30T13:09:42.643 INFO:teuthology.orchestra.run.smithi083.stderr: 4550K .......... .......... .......... .......... .......... 2% 16.3M 11s 2024-03-30T13:09:42.646 INFO:teuthology.orchestra.run.smithi083.stderr: 4600K .......... .......... .......... .......... .......... 2% 13.6M 11s 2024-03-30T13:09:42.649 INFO:teuthology.orchestra.run.smithi083.stderr: 4650K .......... .......... .......... .......... .......... 2% 15.2M 11s 2024-03-30T13:09:42.653 INFO:teuthology.orchestra.run.smithi083.stderr: 4700K .......... .......... .......... .......... .......... 2% 15.6M 11s 2024-03-30T13:09:42.656 INFO:teuthology.orchestra.run.smithi083.stderr: 4750K .......... .......... .......... .......... .......... 2% 16.0M 11s 2024-03-30T13:09:42.659 INFO:teuthology.orchestra.run.smithi083.stderr: 4800K .......... .......... .......... .......... .......... 2% 16.5M 11s 2024-03-30T13:09:42.662 INFO:teuthology.orchestra.run.smithi083.stderr: 4850K .......... .......... .......... .......... .......... 2% 12.8M 11s 2024-03-30T13:09:42.666 INFO:teuthology.orchestra.run.smithi083.stderr: 4900K .......... .......... .......... .......... .......... 2% 14.7M 11s 2024-03-30T13:09:42.669 INFO:teuthology.orchestra.run.smithi083.stderr: 4950K .......... .......... .......... .......... .......... 2% 13.8M 11s 2024-03-30T13:09:42.672 INFO:teuthology.orchestra.run.smithi083.stderr: 5000K .......... .......... .......... .......... .......... 2% 16.2M 11s 2024-03-30T13:09:42.676 INFO:teuthology.orchestra.run.smithi083.stderr: 5050K .......... .......... .......... .......... .......... 3% 15.2M 11s 2024-03-30T13:09:42.679 INFO:teuthology.orchestra.run.smithi083.stderr: 5100K .......... .......... .......... .......... .......... 3% 16.6M 11s 2024-03-30T13:09:42.682 INFO:teuthology.orchestra.run.smithi083.stderr: 5150K .......... .......... .......... .......... .......... 3% 12.8M 11s 2024-03-30T13:09:42.685 INFO:teuthology.orchestra.run.smithi083.stderr: 5200K .......... .......... .......... .......... .......... 3% 18.7M 11s 2024-03-30T13:09:42.687 INFO:teuthology.orchestra.run.smithi083.stderr: 5250K .......... .......... .......... .......... .......... 3% 22.1M 11s 2024-03-30T13:09:42.689 INFO:teuthology.orchestra.run.smithi083.stderr: 5300K .......... .......... .......... .......... .......... 3% 26.2M 11s 2024-03-30T13:09:42.691 INFO:teuthology.orchestra.run.smithi083.stderr: 5350K .......... .......... .......... .......... .......... 3% 27.1M 11s 2024-03-30T13:09:42.693 INFO:teuthology.orchestra.run.smithi083.stderr: 5400K .......... .......... .......... .......... .......... 3% 23.9M 11s 2024-03-30T13:09:42.695 INFO:teuthology.orchestra.run.smithi083.stderr: 5450K .......... .......... .......... .......... .......... 3% 20.6M 11s 2024-03-30T13:09:42.697 INFO:teuthology.orchestra.run.smithi083.stderr: 5500K .......... .......... .......... .......... .......... 3% 23.7M 11s 2024-03-30T13:09:42.700 INFO:teuthology.orchestra.run.smithi083.stderr: 5550K .......... .......... .......... .......... .......... 3% 20.9M 11s 2024-03-30T13:09:42.702 INFO:teuthology.orchestra.run.smithi083.stderr: 5600K .......... .......... .......... .......... .......... 3% 22.5M 11s 2024-03-30T13:09:42.704 INFO:teuthology.orchestra.run.smithi083.stderr: 5650K .......... .......... .......... .......... .......... 3% 19.6M 10s 2024-03-30T13:09:42.706 INFO:teuthology.orchestra.run.smithi083.stderr: 5700K .......... .......... .......... .......... .......... 3% 23.0M 10s 2024-03-30T13:09:42.709 INFO:teuthology.orchestra.run.smithi083.stderr: 5750K .......... .......... .......... .......... .......... 3% 23.4M 10s 2024-03-30T13:09:42.711 INFO:teuthology.orchestra.run.smithi083.stderr: 5800K .......... .......... .......... .......... .......... 3% 24.8M 10s 2024-03-30T13:09:42.713 INFO:teuthology.orchestra.run.smithi083.stderr: 5850K .......... .......... .......... .......... .......... 3% 22.2M 10s 2024-03-30T13:09:42.714 INFO:teuthology.orchestra.run.smithi083.stderr: 5900K .......... .......... .......... .......... .......... 3% 25.4M 10s 2024-03-30T13:09:42.717 INFO:teuthology.orchestra.run.smithi083.stderr: 5950K .......... .......... .......... .......... .......... 3% 24.7M 10s 2024-03-30T13:09:42.719 INFO:teuthology.orchestra.run.smithi083.stderr: 6000K .......... .......... .......... .......... .......... 3% 24.7M 10s 2024-03-30T13:09:42.721 INFO:teuthology.orchestra.run.smithi083.stderr: 6050K .......... .......... .......... .......... .......... 3% 20.9M 10s 2024-03-30T13:09:42.723 INFO:teuthology.orchestra.run.smithi083.stderr: 6100K .......... .......... .......... .......... .......... 3% 22.9M 10s 2024-03-30T13:09:42.725 INFO:teuthology.orchestra.run.smithi083.stderr: 6150K .......... .......... .......... .......... .......... 3% 24.0M 10s 2024-03-30T13:09:42.727 INFO:teuthology.orchestra.run.smithi083.stderr: 6200K .......... .......... .......... .......... .......... 3% 23.1M 10s 2024-03-30T13:09:42.729 INFO:teuthology.orchestra.run.smithi083.stderr: 6250K .......... .......... .......... .......... .......... 3% 20.1M 10s 2024-03-30T13:09:42.733 INFO:teuthology.orchestra.run.smithi083.stderr: 6300K .......... .......... .......... .......... .......... 3% 13.8M 10s 2024-03-30T13:09:42.735 INFO:teuthology.orchestra.run.smithi083.stderr: 6350K .......... .......... .......... .......... .......... 3% 28.1M 10s 2024-03-30T13:09:42.737 INFO:teuthology.orchestra.run.smithi083.stderr: 6400K .......... .......... .......... .......... .......... 3% 22.8M 10s 2024-03-30T13:09:42.739 INFO:teuthology.orchestra.run.smithi083.stderr: 6450K .......... .......... .......... .......... .......... 3% 21.5M 10s 2024-03-30T13:09:42.742 INFO:teuthology.orchestra.run.smithi083.stderr: 6500K .......... .......... .......... .......... .......... 3% 22.6M 10s 2024-03-30T13:09:42.744 INFO:teuthology.orchestra.run.smithi083.stderr: 6550K .......... .......... .......... .......... .......... 3% 21.9M 10s 2024-03-30T13:09:42.746 INFO:teuthology.orchestra.run.smithi083.stderr: 6600K .......... .......... .......... .......... .......... 3% 22.6M 10s 2024-03-30T13:09:42.748 INFO:teuthology.orchestra.run.smithi083.stderr: 6650K .......... .......... .......... .......... .......... 3% 20.2M 10s 2024-03-30T13:09:42.750 INFO:teuthology.orchestra.run.smithi083.stderr: 6700K .......... .......... .......... .......... .......... 4% 23.4M 10s 2024-03-30T13:09:42.752 INFO:teuthology.orchestra.run.smithi083.stderr: 6750K .......... .......... .......... .......... .......... 4% 23.5M 10s 2024-03-30T13:09:42.755 INFO:teuthology.orchestra.run.smithi083.stderr: 6800K .......... .......... .......... .......... .......... 4% 22.9M 10s 2024-03-30T13:09:42.757 INFO:teuthology.orchestra.run.smithi083.stderr: 6850K .......... .......... .......... .......... .......... 4% 19.3M 10s 2024-03-30T13:09:42.759 INFO:teuthology.orchestra.run.smithi083.stderr: 6900K .......... .......... .......... .......... .......... 4% 22.8M 10s 2024-03-30T13:09:42.761 INFO:teuthology.orchestra.run.smithi083.stderr: 6950K .......... .......... .......... .......... .......... 4% 23.0M 10s 2024-03-30T13:09:42.763 INFO:teuthology.orchestra.run.smithi083.stderr: 7000K .......... .......... .......... .......... .......... 4% 22.8M 10s 2024-03-30T13:09:42.766 INFO:teuthology.orchestra.run.smithi083.stderr: 7050K .......... .......... .......... .......... .......... 4% 21.0M 10s 2024-03-30T13:09:42.768 INFO:teuthology.orchestra.run.smithi083.stderr: 7100K .......... .......... .......... .......... .......... 4% 23.6M 10s 2024-03-30T13:09:42.770 INFO:teuthology.orchestra.run.smithi083.stderr: 7150K .......... .......... .......... .......... .......... 4% 23.5M 10s 2024-03-30T13:09:42.772 INFO:teuthology.orchestra.run.smithi083.stderr: 7200K .......... .......... .......... .......... .......... 4% 23.8M 10s 2024-03-30T13:09:42.775 INFO:teuthology.orchestra.run.smithi083.stderr: 7250K .......... .......... .......... .......... .......... 4% 20.4M 10s 2024-03-30T13:09:42.776 INFO:teuthology.orchestra.run.smithi083.stderr: 7300K .......... .......... .......... .......... .......... 4% 24.1M 10s 2024-03-30T13:09:42.779 INFO:teuthology.orchestra.run.smithi083.stderr: 7350K .......... .......... .......... .......... .......... 4% 23.4M 10s 2024-03-30T13:09:42.781 INFO:teuthology.orchestra.run.smithi083.stderr: 7400K .......... .......... .......... .......... .......... 4% 23.3M 10s 2024-03-30T13:09:42.783 INFO:teuthology.orchestra.run.smithi083.stderr: 7450K .......... .......... .......... .......... .......... 4% 20.4M 10s 2024-03-30T13:09:42.785 INFO:teuthology.orchestra.run.smithi083.stderr: 7500K .......... .......... .......... .......... .......... 4% 24.6M 10s 2024-03-30T13:09:42.787 INFO:teuthology.orchestra.run.smithi083.stderr: 7550K .......... .......... .......... .......... .......... 4% 23.9M 10s 2024-03-30T13:09:42.789 INFO:teuthology.orchestra.run.smithi083.stderr: 7600K .......... .......... .......... .......... .......... 4% 23.9M 9s 2024-03-30T13:09:42.791 INFO:teuthology.orchestra.run.smithi083.stderr: 7650K .......... .......... .......... .......... .......... 4% 19.7M 9s 2024-03-30T13:09:42.793 INFO:teuthology.orchestra.run.smithi083.stderr: 7700K .......... .......... .......... .......... .......... 4% 24.1M 9s 2024-03-30T13:09:42.796 INFO:teuthology.orchestra.run.smithi083.stderr: 7750K .......... .......... .......... .......... .......... 4% 23.6M 9s 2024-03-30T13:09:42.798 INFO:teuthology.orchestra.run.smithi083.stderr: 7800K .......... .......... .......... .......... .......... 4% 23.9M 9s 2024-03-30T13:09:42.800 INFO:teuthology.orchestra.run.smithi083.stderr: 7850K .......... .......... .......... .......... .......... 4% 20.3M 9s 2024-03-30T13:09:42.802 INFO:teuthology.orchestra.run.smithi083.stderr: 7900K .......... .......... .......... .......... .......... 4% 23.1M 9s 2024-03-30T13:09:42.804 INFO:teuthology.orchestra.run.smithi083.stderr: 7950K .......... .......... .......... .......... .......... 4% 22.5M 9s 2024-03-30T13:09:42.807 INFO:teuthology.orchestra.run.smithi083.stderr: 8000K .......... .......... .......... .......... .......... 4% 22.5M 9s 2024-03-30T13:09:42.810 INFO:teuthology.orchestra.run.smithi083.stderr: 8050K .......... .......... .......... .......... .......... 4% 19.5M 9s 2024-03-30T13:09:42.811 INFO:teuthology.orchestra.run.smithi083.stderr: 8100K .......... .......... .......... .......... .......... 4% 24.2M 9s 2024-03-30T13:09:42.813 INFO:teuthology.orchestra.run.smithi083.stderr: 8150K .......... .......... .......... .......... .......... 4% 27.0M 9s 2024-03-30T13:09:42.821 INFO:teuthology.orchestra.run.smithi083.stderr: 8200K .......... .......... .......... .......... .......... 4% 20.2M 9s 2024-03-30T13:09:42.821 INFO:teuthology.orchestra.run.smithi083.stderr: 8250K .......... .......... .......... .......... .......... 4% 19.4M 9s 2024-03-30T13:09:42.826 INFO:teuthology.orchestra.run.smithi083.stderr: 8300K .......... .......... .......... .......... .......... 4% 21.6M 9s 2024-03-30T13:09:42.826 INFO:teuthology.orchestra.run.smithi083.stderr: 8350K .......... .......... .......... .......... .......... 4% 15.0M 9s 2024-03-30T13:09:42.826 INFO:teuthology.orchestra.run.smithi083.stderr: 8400K .......... .......... .......... .......... .......... 5% 22.6M 9s 2024-03-30T13:09:42.829 INFO:teuthology.orchestra.run.smithi083.stderr: 8450K .......... .......... .......... .......... .......... 5% 14.2M 9s 2024-03-30T13:09:42.832 INFO:teuthology.orchestra.run.smithi083.stderr: 8500K .......... .......... .......... .......... .......... 5% 16.7M 9s 2024-03-30T13:09:42.835 INFO:teuthology.orchestra.run.smithi083.stderr: 8550K .......... .......... .......... .......... .......... 5% 15.8M 9s 2024-03-30T13:09:42.839 INFO:teuthology.orchestra.run.smithi083.stderr: 8600K .......... .......... .......... .......... .......... 5% 14.2M 9s 2024-03-30T13:09:42.842 INFO:teuthology.orchestra.run.smithi083.stderr: 8650K .......... .......... .......... .......... .......... 5% 19.3M 9s 2024-03-30T13:09:42.843 INFO:teuthology.orchestra.run.smithi083.stderr: 8700K .......... .......... .......... .......... .......... 5% 20.3M 9s 2024-03-30T13:09:42.845 INFO:teuthology.orchestra.run.smithi083.stderr: 8750K .......... .......... .......... .......... .......... 5% 29.2M 9s 2024-03-30T13:09:42.846 INFO:teuthology.orchestra.run.smithi083.stderr: 8800K .......... .......... .......... .......... .......... 5% 35.7M 9s 2024-03-30T13:09:42.848 INFO:teuthology.orchestra.run.smithi083.stderr: 8850K .......... .......... .......... .......... .......... 5% 33.4M 9s 2024-03-30T13:09:42.849 INFO:teuthology.orchestra.run.smithi083.stderr: 8900K .......... .......... .......... .......... .......... 5% 38.9M 9s 2024-03-30T13:09:42.850 INFO:teuthology.orchestra.run.smithi083.stderr: 8950K .......... .......... .......... .......... .......... 5% 38.2M 9s 2024-03-30T13:09:42.852 INFO:teuthology.orchestra.run.smithi083.stderr: 9000K .......... .......... .......... .......... .......... 5% 37.1M 9s 2024-03-30T13:09:42.853 INFO:teuthology.orchestra.run.smithi083.stderr: 9050K .......... .......... .......... .......... .......... 5% 31.4M 9s 2024-03-30T13:09:42.854 INFO:teuthology.orchestra.run.smithi083.stderr: 9100K .......... .......... .......... .......... .......... 5% 35.4M 9s 2024-03-30T13:09:42.856 INFO:teuthology.orchestra.run.smithi083.stderr: 9150K .......... .......... .......... .......... .......... 5% 36.8M 9s 2024-03-30T13:09:42.857 INFO:teuthology.orchestra.run.smithi083.stderr: 9200K .......... .......... .......... .......... .......... 5% 36.2M 9s 2024-03-30T13:09:42.859 INFO:teuthology.orchestra.run.smithi083.stderr: 9250K .......... .......... .......... .......... .......... 5% 25.6M 9s 2024-03-30T13:09:42.860 INFO:teuthology.orchestra.run.smithi083.stderr: 9300K .......... .......... .......... .......... .......... 5% 39.7M 9s 2024-03-30T13:09:42.862 INFO:teuthology.orchestra.run.smithi083.stderr: 9350K .......... .......... .......... .......... .......... 5% 38.3M 9s 2024-03-30T13:09:42.863 INFO:teuthology.orchestra.run.smithi083.stderr: 9400K .......... .......... .......... .......... .......... 5% 31.4M 9s 2024-03-30T13:09:42.865 INFO:teuthology.orchestra.run.smithi083.stderr: 9450K .......... .......... .......... .......... .......... 5% 26.3M 9s 2024-03-30T13:09:42.867 INFO:teuthology.orchestra.run.smithi083.stderr: 9500K .......... .......... .......... .......... .......... 5% 31.0M 9s 2024-03-30T13:09:42.868 INFO:teuthology.orchestra.run.smithi083.stderr: 9550K .......... .......... .......... .......... .......... 5% 33.2M 9s 2024-03-30T13:09:42.870 INFO:teuthology.orchestra.run.smithi083.stderr: 9600K .......... .......... .......... .......... .......... 5% 29.3M 9s 2024-03-30T13:09:42.873 INFO:teuthology.orchestra.run.smithi083.stderr: 9650K .......... .......... .......... .......... .......... 5% 20.4M 9s 2024-03-30T13:09:42.874 INFO:teuthology.orchestra.run.smithi083.stderr: 9700K .......... .......... .......... .......... .......... 5% 28.1M 9s 2024-03-30T13:09:42.876 INFO:teuthology.orchestra.run.smithi083.stderr: 9750K .......... .......... .......... .......... .......... 5% 28.4M 9s 2024-03-30T13:09:42.877 INFO:teuthology.orchestra.run.smithi083.stderr: 9800K .......... .......... .......... .......... .......... 5% 28.4M 9s 2024-03-30T13:09:42.879 INFO:teuthology.orchestra.run.smithi083.stderr: 9850K .......... .......... .......... .......... .......... 5% 27.4M 9s 2024-03-30T13:09:42.881 INFO:teuthology.orchestra.run.smithi083.stderr: 9900K .......... .......... .......... .......... .......... 5% 31.9M 9s 2024-03-30T13:09:42.882 INFO:teuthology.orchestra.run.smithi083.stderr: 9950K .......... .......... .......... .......... .......... 5% 31.8M 9s 2024-03-30T13:09:42.884 INFO:teuthology.orchestra.run.smithi083.stderr: 10000K .......... .......... .......... .......... .......... 5% 32.2M 9s 2024-03-30T13:09:42.885 INFO:teuthology.orchestra.run.smithi083.stderr: 10050K .......... .......... .......... .......... .......... 5% 27.7M 9s 2024-03-30T13:09:42.887 INFO:teuthology.orchestra.run.smithi083.stderr: 10100K .......... .......... .......... .......... .......... 6% 30.3M 9s 2024-03-30T13:09:42.889 INFO:teuthology.orchestra.run.smithi083.stderr: 10150K .......... .......... .......... .......... .......... 6% 32.0M 9s 2024-03-30T13:09:42.890 INFO:teuthology.orchestra.run.smithi083.stderr: 10200K .......... .......... .......... .......... .......... 6% 31.6M 9s 2024-03-30T13:09:42.892 INFO:teuthology.orchestra.run.smithi083.stderr: 10250K .......... .......... .......... .......... .......... 6% 26.2M 9s 2024-03-30T13:09:42.894 INFO:teuthology.orchestra.run.smithi083.stderr: 10300K .......... .......... .......... .......... .......... 6% 31.6M 9s 2024-03-30T13:09:42.895 INFO:teuthology.orchestra.run.smithi083.stderr: 10350K .......... .......... .......... .......... .......... 6% 30.8M 8s 2024-03-30T13:09:42.897 INFO:teuthology.orchestra.run.smithi083.stderr: 10400K .......... .......... .......... .......... .......... 6% 18.3M 8s 2024-03-30T13:09:42.899 INFO:teuthology.orchestra.run.smithi083.stderr: 10450K .......... .......... .......... .......... .......... 6% 31.1M 8s 2024-03-30T13:09:42.901 INFO:teuthology.orchestra.run.smithi083.stderr: 10500K .......... .......... .......... .......... .......... 6% 35.4M 8s 2024-03-30T13:09:42.902 INFO:teuthology.orchestra.run.smithi083.stderr: 10550K .......... .......... .......... .......... .......... 6% 35.1M 8s 2024-03-30T13:09:42.903 INFO:teuthology.orchestra.run.smithi083.stderr: 10600K .......... .......... .......... .......... .......... 6% 35.3M 8s 2024-03-30T13:09:42.905 INFO:teuthology.orchestra.run.smithi083.stderr: 10650K .......... .......... .......... .......... .......... 6% 31.1M 8s 2024-03-30T13:09:42.906 INFO:teuthology.orchestra.run.smithi083.stderr: 10700K .......... .......... .......... .......... .......... 6% 34.4M 8s 2024-03-30T13:09:42.908 INFO:teuthology.orchestra.run.smithi083.stderr: 10750K .......... .......... .......... .......... .......... 6% 34.4M 8s 2024-03-30T13:09:42.909 INFO:teuthology.orchestra.run.smithi083.stderr: 10800K .......... .......... .......... .......... .......... 6% 35.0M 8s 2024-03-30T13:09:42.911 INFO:teuthology.orchestra.run.smithi083.stderr: 10850K .......... .......... .......... .......... .......... 6% 28.3M 8s 2024-03-30T13:09:42.913 INFO:teuthology.orchestra.run.smithi083.stderr: 10900K .......... .......... .......... .......... .......... 6% 32.4M 8s 2024-03-30T13:09:42.914 INFO:teuthology.orchestra.run.smithi083.stderr: 10950K .......... .......... .......... .......... .......... 6% 30.7M 8s 2024-03-30T13:09:42.915 INFO:teuthology.orchestra.run.smithi083.stderr: 11000K .......... .......... .......... .......... .......... 6% 31.9M 8s 2024-03-30T13:09:42.917 INFO:teuthology.orchestra.run.smithi083.stderr: 11050K .......... .......... .......... .......... .......... 6% 27.2M 8s 2024-03-30T13:09:42.919 INFO:teuthology.orchestra.run.smithi083.stderr: 11100K .......... .......... .......... .......... .......... 6% 30.6M 8s 2024-03-30T13:09:42.921 INFO:teuthology.orchestra.run.smithi083.stderr: 11150K .......... .......... .......... .......... .......... 6% 31.3M 8s 2024-03-30T13:09:42.922 INFO:teuthology.orchestra.run.smithi083.stderr: 11200K .......... .......... .......... .......... .......... 6% 30.9M 8s 2024-03-30T13:09:42.924 INFO:teuthology.orchestra.run.smithi083.stderr: 11250K .......... .......... .......... .......... .......... 6% 27.2M 8s 2024-03-30T13:09:42.926 INFO:teuthology.orchestra.run.smithi083.stderr: 11300K .......... .......... .......... .......... .......... 6% 30.9M 8s 2024-03-30T13:09:42.927 INFO:teuthology.orchestra.run.smithi083.stderr: 11350K .......... .......... .......... .......... .......... 6% 30.2M 8s 2024-03-30T13:09:42.929 INFO:teuthology.orchestra.run.smithi083.stderr: 11400K .......... .......... .......... .......... .......... 6% 30.5M 8s 2024-03-30T13:09:42.931 INFO:teuthology.orchestra.run.smithi083.stderr: 11450K .......... .......... .......... .......... .......... 6% 26.0M 8s 2024-03-30T13:09:42.932 INFO:teuthology.orchestra.run.smithi083.stderr: 11500K .......... .......... .......... .......... .......... 6% 30.5M 8s 2024-03-30T13:09:42.934 INFO:teuthology.orchestra.run.smithi083.stderr: 11550K .......... .......... .......... .......... .......... 6% 30.4M 8s 2024-03-30T13:09:42.936 INFO:teuthology.orchestra.run.smithi083.stderr: 11600K .......... .......... .......... .......... .......... 6% 30.1M 8s 2024-03-30T13:09:42.937 INFO:teuthology.orchestra.run.smithi083.stderr: 11650K .......... .......... .......... .......... .......... 6% 25.6M 8s 2024-03-30T13:09:42.939 INFO:teuthology.orchestra.run.smithi083.stderr: 11700K .......... .......... .......... .......... .......... 6% 28.5M 8s 2024-03-30T13:09:42.942 INFO:teuthology.orchestra.run.smithi083.stderr: 11750K .......... .......... .......... .......... .......... 7% 28.7M 8s 2024-03-30T13:09:42.943 INFO:teuthology.orchestra.run.smithi083.stderr: 11800K .......... .......... .......... .......... .......... 7% 29.2M 8s 2024-03-30T13:09:42.945 INFO:teuthology.orchestra.run.smithi083.stderr: 11850K .......... .......... .......... .......... .......... 7% 24.7M 8s 2024-03-30T13:09:42.946 INFO:teuthology.orchestra.run.smithi083.stderr: 11900K .......... .......... .......... .......... .......... 7% 27.5M 8s 2024-03-30T13:09:42.948 INFO:teuthology.orchestra.run.smithi083.stderr: 11950K .......... .......... .......... .......... .......... 7% 28.2M 8s 2024-03-30T13:09:42.950 INFO:teuthology.orchestra.run.smithi083.stderr: 12000K .......... .......... .......... .......... .......... 7% 28.4M 8s 2024-03-30T13:09:42.952 INFO:teuthology.orchestra.run.smithi083.stderr: 12050K .......... .......... .......... .......... .......... 7% 23.2M 8s 2024-03-30T13:09:42.953 INFO:teuthology.orchestra.run.smithi083.stderr: 12100K .......... .......... .......... .......... .......... 7% 27.8M 8s 2024-03-30T13:09:42.956 INFO:teuthology.orchestra.run.smithi083.stderr: 12150K .......... .......... .......... .......... .......... 7% 28.0M 8s 2024-03-30T13:09:42.957 INFO:teuthology.orchestra.run.smithi083.stderr: 12200K .......... .......... .......... .......... .......... 7% 27.6M 8s 2024-03-30T13:09:42.959 INFO:teuthology.orchestra.run.smithi083.stderr: 12250K .......... .......... .......... .......... .......... 7% 21.6M 8s 2024-03-30T13:09:42.961 INFO:teuthology.orchestra.run.smithi083.stderr: 12300K .......... .......... .......... .......... .......... 7% 33.2M 8s 2024-03-30T13:09:42.962 INFO:teuthology.orchestra.run.smithi083.stderr: 12350K .......... .......... .......... .......... .......... 7% 35.0M 8s 2024-03-30T13:09:42.964 INFO:teuthology.orchestra.run.smithi083.stderr: 12400K .......... .......... .......... .......... .......... 7% 33.9M 8s 2024-03-30T13:09:42.965 INFO:teuthology.orchestra.run.smithi083.stderr: 12450K .......... .......... .......... .......... .......... 7% 30.7M 8s 2024-03-30T13:09:42.967 INFO:teuthology.orchestra.run.smithi083.stderr: 12500K .......... .......... .......... .......... .......... 7% 33.8M 8s 2024-03-30T13:09:42.968 INFO:teuthology.orchestra.run.smithi083.stderr: 12550K .......... .......... .......... .......... .......... 7% 32.7M 8s 2024-03-30T13:09:42.969 INFO:teuthology.orchestra.run.smithi083.stderr: 12600K .......... .......... .......... .......... .......... 7% 33.7M 8s 2024-03-30T13:09:42.971 INFO:teuthology.orchestra.run.smithi083.stderr: 12650K .......... .......... .......... .......... .......... 7% 25.9M 8s 2024-03-30T13:09:42.973 INFO:teuthology.orchestra.run.smithi083.stderr: 12700K .......... .......... .......... .......... .......... 7% 30.7M 8s 2024-03-30T13:09:42.975 INFO:teuthology.orchestra.run.smithi083.stderr: 12750K .......... .......... .......... .......... .......... 7% 27.8M 8s 2024-03-30T13:09:42.978 INFO:teuthology.orchestra.run.smithi083.stderr: 12800K .......... .......... .......... .......... .......... 7% 19.3M 8s 2024-03-30T13:09:42.979 INFO:teuthology.orchestra.run.smithi083.stderr: 12850K .......... .......... .......... .......... .......... 7% 22.6M 8s 2024-03-30T13:09:42.981 INFO:teuthology.orchestra.run.smithi083.stderr: 12900K .......... .......... .......... .......... .......... 7% 33.7M 8s 2024-03-30T13:09:42.983 INFO:teuthology.orchestra.run.smithi083.stderr: 12950K .......... .......... .......... .......... .......... 7% 27.6M 8s 2024-03-30T13:09:42.984 INFO:teuthology.orchestra.run.smithi083.stderr: 13000K .......... .......... .......... .......... .......... 7% 34.1M 8s 2024-03-30T13:09:42.986 INFO:teuthology.orchestra.run.smithi083.stderr: 13050K .......... .......... .......... .......... .......... 7% 24.2M 8s 2024-03-30T13:09:42.988 INFO:teuthology.orchestra.run.smithi083.stderr: 13100K .......... .......... .......... .......... .......... 7% 30.5M 8s 2024-03-30T13:09:42.989 INFO:teuthology.orchestra.run.smithi083.stderr: 13150K .......... .......... .......... .......... .......... 7% 29.3M 8s 2024-03-30T13:09:42.991 INFO:teuthology.orchestra.run.smithi083.stderr: 13200K .......... .......... .......... .......... .......... 7% 28.9M 8s 2024-03-30T13:09:42.993 INFO:teuthology.orchestra.run.smithi083.stderr: 13250K .......... .......... .......... .......... .......... 7% 25.8M 8s 2024-03-30T13:09:42.994 INFO:teuthology.orchestra.run.smithi083.stderr: 13300K .......... .......... .......... .......... .......... 7% 28.9M 8s 2024-03-30T13:09:42.996 INFO:teuthology.orchestra.run.smithi083.stderr: 13350K .......... .......... .......... .......... .......... 7% 26.6M 8s 2024-03-30T13:09:42.998 INFO:teuthology.orchestra.run.smithi083.stderr: 13400K .......... .......... .......... .......... .......... 7% 32.8M 8s 2024-03-30T13:09:43.000 INFO:teuthology.orchestra.run.smithi083.stderr: 13450K .......... .......... .......... .......... .......... 8% 27.2M 8s 2024-03-30T13:09:43.001 INFO:teuthology.orchestra.run.smithi083.stderr: 13500K .......... .......... .......... .......... .......... 8% 31.0M 8s 2024-03-30T13:09:43.003 INFO:teuthology.orchestra.run.smithi083.stderr: 13550K .......... .......... .......... .......... .......... 8% 29.8M 8s 2024-03-30T13:09:43.004 INFO:teuthology.orchestra.run.smithi083.stderr: 13600K .......... .......... .......... .......... .......... 8% 32.9M 8s 2024-03-30T13:09:43.006 INFO:teuthology.orchestra.run.smithi083.stderr: 13650K .......... .......... .......... .......... .......... 8% 26.4M 8s 2024-03-30T13:09:43.008 INFO:teuthology.orchestra.run.smithi083.stderr: 13700K .......... .......... .......... .......... .......... 8% 31.9M 8s 2024-03-30T13:09:43.009 INFO:teuthology.orchestra.run.smithi083.stderr: 13750K .......... .......... .......... .......... .......... 8% 30.6M 8s 2024-03-30T13:09:43.011 INFO:teuthology.orchestra.run.smithi083.stderr: 13800K .......... .......... .......... .......... .......... 8% 30.6M 8s 2024-03-30T13:09:43.013 INFO:teuthology.orchestra.run.smithi083.stderr: 13850K .......... .......... .......... .......... .......... 8% 25.7M 8s 2024-03-30T13:09:43.016 INFO:teuthology.orchestra.run.smithi083.stderr: 13900K .......... .......... .......... .......... .......... 8% 28.0M 8s 2024-03-30T13:09:43.017 INFO:teuthology.orchestra.run.smithi083.stderr: 13950K .......... .......... .......... .......... .......... 8% 28.4M 7s 2024-03-30T13:09:43.018 INFO:teuthology.orchestra.run.smithi083.stderr: 14000K .......... .......... .......... .......... .......... 8% 27.4M 7s 2024-03-30T13:09:43.020 INFO:teuthology.orchestra.run.smithi083.stderr: 14050K .......... .......... .......... .......... .......... 8% 23.9M 7s 2024-03-30T13:09:43.022 INFO:teuthology.orchestra.run.smithi083.stderr: 14100K .......... .......... .......... .......... .......... 8% 26.3M 7s 2024-03-30T13:09:43.024 INFO:teuthology.orchestra.run.smithi083.stderr: 14150K .......... .......... .......... .......... .......... 8% 26.9M 7s 2024-03-30T13:09:43.026 INFO:teuthology.orchestra.run.smithi083.stderr: 14200K .......... .......... .......... .......... .......... 8% 26.5M 7s 2024-03-30T13:09:43.028 INFO:teuthology.orchestra.run.smithi083.stderr: 14250K .......... .......... .......... .......... .......... 8% 23.2M 7s 2024-03-30T13:09:43.030 INFO:teuthology.orchestra.run.smithi083.stderr: 14300K .......... .......... .......... .......... .......... 8% 28.1M 7s 2024-03-30T13:09:43.031 INFO:teuthology.orchestra.run.smithi083.stderr: 14350K .......... .......... .......... .......... .......... 8% 26.4M 7s 2024-03-30T13:09:43.033 INFO:teuthology.orchestra.run.smithi083.stderr: 14400K .......... .......... .......... .......... .......... 8% 26.5M 7s 2024-03-30T13:09:43.035 INFO:teuthology.orchestra.run.smithi083.stderr: 14450K .......... .......... .......... .......... .......... 8% 22.6M 7s 2024-03-30T13:09:43.039 INFO:teuthology.orchestra.run.smithi083.stderr: 14500K .......... .......... .......... .......... .......... 8% 15.6M 7s 2024-03-30T13:09:43.040 INFO:teuthology.orchestra.run.smithi083.stderr: 14550K .......... .......... .......... .......... .......... 8% 29.4M 7s 2024-03-30T13:09:43.042 INFO:teuthology.orchestra.run.smithi083.stderr: 14600K .......... .......... .......... .......... .......... 8% 23.4M 7s 2024-03-30T13:09:43.044 INFO:teuthology.orchestra.run.smithi083.stderr: 14650K .......... .......... .......... .......... .......... 8% 23.9M 7s 2024-03-30T13:09:43.046 INFO:teuthology.orchestra.run.smithi083.stderr: 14700K .......... .......... .......... .......... .......... 8% 30.8M 7s 2024-03-30T13:09:43.047 INFO:teuthology.orchestra.run.smithi083.stderr: 14750K .......... .......... .......... .......... .......... 8% 32.3M 7s 2024-03-30T13:09:43.049 INFO:teuthology.orchestra.run.smithi083.stderr: 14800K .......... .......... .......... .......... .......... 8% 35.2M 7s 2024-03-30T13:09:43.051 INFO:teuthology.orchestra.run.smithi083.stderr: 14850K .......... .......... .......... .......... .......... 8% 25.9M 7s 2024-03-30T13:09:43.052 INFO:teuthology.orchestra.run.smithi083.stderr: 14900K .......... .......... .......... .......... .......... 8% 34.9M 7s 2024-03-30T13:09:43.054 INFO:teuthology.orchestra.run.smithi083.stderr: 14950K .......... .......... .......... .......... .......... 8% 30.7M 7s 2024-03-30T13:09:43.056 INFO:teuthology.orchestra.run.smithi083.stderr: 15000K .......... .......... .......... .......... .......... 8% 33.7M 7s 2024-03-30T13:09:43.059 INFO:teuthology.orchestra.run.smithi083.stderr: 15050K .......... .......... .......... .......... .......... 8% 29.9M 7s 2024-03-30T13:09:43.059 INFO:teuthology.orchestra.run.smithi083.stderr: 15100K .......... .......... .......... .......... .......... 8% 32.7M 7s 2024-03-30T13:09:43.061 INFO:teuthology.orchestra.run.smithi083.stderr: 15150K .......... .......... .......... .......... .......... 9% 32.8M 7s 2024-03-30T13:09:43.061 INFO:teuthology.orchestra.run.smithi083.stderr: 15200K .......... .......... .......... .......... .......... 9% 34.0M 7s 2024-03-30T13:09:43.063 INFO:teuthology.orchestra.run.smithi083.stderr: 15250K .......... .......... .......... .......... .......... 9% 28.0M 7s 2024-03-30T13:09:43.064 INFO:teuthology.orchestra.run.smithi083.stderr: 15300K .......... .......... .......... .......... .......... 9% 35.7M 7s 2024-03-30T13:09:43.066 INFO:teuthology.orchestra.run.smithi083.stderr: 15350K .......... .......... .......... .......... .......... 9% 35.8M 7s 2024-03-30T13:09:43.067 INFO:teuthology.orchestra.run.smithi083.stderr: 15400K .......... .......... .......... .......... .......... 9% 34.5M 7s 2024-03-30T13:09:43.069 INFO:teuthology.orchestra.run.smithi083.stderr: 15450K .......... .......... .......... .......... .......... 9% 29.8M 7s 2024-03-30T13:09:43.070 INFO:teuthology.orchestra.run.smithi083.stderr: 15500K .......... .......... .......... .......... .......... 9% 33.1M 7s 2024-03-30T13:09:43.072 INFO:teuthology.orchestra.run.smithi083.stderr: 15550K .......... .......... .......... .......... .......... 9% 33.1M 7s 2024-03-30T13:09:43.073 INFO:teuthology.orchestra.run.smithi083.stderr: 15600K .......... .......... .......... .......... .......... 9% 32.3M 7s 2024-03-30T13:09:43.075 INFO:teuthology.orchestra.run.smithi083.stderr: 15650K .......... .......... .......... .......... .......... 9% 27.6M 7s 2024-03-30T13:09:43.077 INFO:teuthology.orchestra.run.smithi083.stderr: 15700K .......... .......... .......... .......... .......... 9% 32.8M 7s 2024-03-30T13:09:43.078 INFO:teuthology.orchestra.run.smithi083.stderr: 15750K .......... .......... .......... .......... .......... 9% 32.0M 7s 2024-03-30T13:09:43.080 INFO:teuthology.orchestra.run.smithi083.stderr: 15800K .......... .......... .......... .......... .......... 9% 32.2M 7s 2024-03-30T13:09:43.081 INFO:teuthology.orchestra.run.smithi083.stderr: 15850K .......... .......... .......... .......... .......... 9% 27.7M 7s 2024-03-30T13:09:43.083 INFO:teuthology.orchestra.run.smithi083.stderr: 15900K .......... .......... .......... .......... .......... 9% 31.9M 7s 2024-03-30T13:09:43.084 INFO:teuthology.orchestra.run.smithi083.stderr: 15950K .......... .......... .......... .......... .......... 9% 31.4M 7s 2024-03-30T13:09:43.086 INFO:teuthology.orchestra.run.smithi083.stderr: 16000K .......... .......... .......... .......... .......... 9% 31.9M 7s 2024-03-30T13:09:43.088 INFO:teuthology.orchestra.run.smithi083.stderr: 16050K .......... .......... .......... .......... .......... 9% 25.7M 7s 2024-03-30T13:09:43.089 INFO:teuthology.orchestra.run.smithi083.stderr: 16100K .......... .......... .......... .......... .......... 9% 32.2M 7s 2024-03-30T13:09:43.091 INFO:teuthology.orchestra.run.smithi083.stderr: 16150K .......... .......... .......... .......... .......... 9% 30.9M 7s 2024-03-30T13:09:43.092 INFO:teuthology.orchestra.run.smithi083.stderr: 16200K .......... .......... .......... .......... .......... 9% 31.7M 7s 2024-03-30T13:09:43.096 INFO:teuthology.orchestra.run.smithi083.stderr: 16250K .......... .......... .......... .......... .......... 9% 25.0M 7s 2024-03-30T13:09:43.096 INFO:teuthology.orchestra.run.smithi083.stderr: 16300K .......... .......... .......... .......... .......... 9% 31.1M 7s 2024-03-30T13:09:43.099 INFO:teuthology.orchestra.run.smithi083.stderr: 16350K .......... .......... .......... .......... .......... 9% 26.2M 7s 2024-03-30T13:09:43.100 INFO:teuthology.orchestra.run.smithi083.stderr: 16400K .......... .......... .......... .......... .......... 9% 24.4M 7s 2024-03-30T13:09:43.102 INFO:teuthology.orchestra.run.smithi083.stderr: 16450K .......... .......... .......... .......... .......... 9% 22.0M 7s 2024-03-30T13:09:43.104 INFO:teuthology.orchestra.run.smithi083.stderr: 16500K .......... .......... .......... .......... .......... 9% 27.3M 7s 2024-03-30T13:09:43.106 INFO:teuthology.orchestra.run.smithi083.stderr: 16550K .......... .......... .......... .......... .......... 9% 25.7M 7s 2024-03-30T13:09:43.108 INFO:teuthology.orchestra.run.smithi083.stderr: 16600K .......... .......... .......... .......... .......... 9% 30.1M 7s 2024-03-30T13:09:43.109 INFO:teuthology.orchestra.run.smithi083.stderr: 16650K .......... .......... .......... .......... .......... 9% 22.0M 7s 2024-03-30T13:09:43.111 INFO:teuthology.orchestra.run.smithi083.stderr: 16700K .......... .......... .......... .......... .......... 9% 29.6M 7s 2024-03-30T13:09:43.113 INFO:teuthology.orchestra.run.smithi083.stderr: 16750K .......... .......... .......... .......... .......... 9% 32.7M 7s 2024-03-30T13:09:43.114 INFO:teuthology.orchestra.run.smithi083.stderr: 16800K .......... .......... .......... .......... .......... 9% 32.4M 7s 2024-03-30T13:09:43.116 INFO:teuthology.orchestra.run.smithi083.stderr: 16850K .......... .......... .......... .......... .......... 10% 26.1M 7s 2024-03-30T13:09:43.119 INFO:teuthology.orchestra.run.smithi083.stderr: 16900K .......... .......... .......... .......... .......... 10% 20.9M 7s 2024-03-30T13:09:43.120 INFO:teuthology.orchestra.run.smithi083.stderr: 16950K .......... .......... .......... .......... .......... 10% 32.4M 7s 2024-03-30T13:09:43.121 INFO:teuthology.orchestra.run.smithi083.stderr: 17000K .......... .......... .......... .......... .......... 10% 32.2M 7s 2024-03-30T13:09:43.123 INFO:teuthology.orchestra.run.smithi083.stderr: 17050K .......... .......... .......... .......... .......... 10% 27.8M 7s 2024-03-30T13:09:43.125 INFO:teuthology.orchestra.run.smithi083.stderr: 17100K .......... .......... .......... .......... .......... 10% 33.1M 7s 2024-03-30T13:09:43.126 INFO:teuthology.orchestra.run.smithi083.stderr: 17150K .......... .......... .......... .......... .......... 10% 31.1M 7s 2024-03-30T13:09:43.128 INFO:teuthology.orchestra.run.smithi083.stderr: 17200K .......... .......... .......... .......... .......... 10% 30.4M 7s 2024-03-30T13:09:43.130 INFO:teuthology.orchestra.run.smithi083.stderr: 17250K .......... .......... .......... .......... .......... 10% 27.0M 7s 2024-03-30T13:09:43.132 INFO:teuthology.orchestra.run.smithi083.stderr: 17300K .......... .......... .......... .......... .......... 10% 32.0M 7s 2024-03-30T13:09:43.133 INFO:teuthology.orchestra.run.smithi083.stderr: 17350K .......... .......... .......... .......... .......... 10% 33.0M 7s 2024-03-30T13:09:43.135 INFO:teuthology.orchestra.run.smithi083.stderr: 17400K .......... .......... .......... .......... .......... 10% 30.2M 7s 2024-03-30T13:09:43.138 INFO:teuthology.orchestra.run.smithi083.stderr: 17450K .......... .......... .......... .......... .......... 10% 19.3M 7s 2024-03-30T13:09:43.138 INFO:teuthology.orchestra.run.smithi083.stderr: 17500K .......... .......... .......... .......... .......... 10% 32.0M 7s 2024-03-30T13:09:43.140 INFO:teuthology.orchestra.run.smithi083.stderr: 17550K .......... .......... .......... .......... .......... 10% 33.4M 7s 2024-03-30T13:09:43.142 INFO:teuthology.orchestra.run.smithi083.stderr: 17600K .......... .......... .......... .......... .......... 10% 31.6M 7s 2024-03-30T13:09:43.143 INFO:teuthology.orchestra.run.smithi083.stderr: 17650K .......... .......... .......... .......... .......... 10% 27.6M 7s 2024-03-30T13:09:43.145 INFO:teuthology.orchestra.run.smithi083.stderr: 17700K .......... .......... .......... .......... .......... 10% 32.3M 7s 2024-03-30T13:09:43.146 INFO:teuthology.orchestra.run.smithi083.stderr: 17750K .......... .......... .......... .......... .......... 10% 31.8M 7s 2024-03-30T13:09:43.148 INFO:teuthology.orchestra.run.smithi083.stderr: 17800K .......... .......... .......... .......... .......... 10% 29.4M 7s 2024-03-30T13:09:43.150 INFO:teuthology.orchestra.run.smithi083.stderr: 17850K .......... .......... .......... .......... .......... 10% 25.2M 7s 2024-03-30T13:09:43.152 INFO:teuthology.orchestra.run.smithi083.stderr: 17900K .......... .......... .......... .......... .......... 10% 30.0M 7s 2024-03-30T13:09:43.153 INFO:teuthology.orchestra.run.smithi083.stderr: 17950K .......... .......... .......... .......... .......... 10% 30.9M 7s 2024-03-30T13:09:43.155 INFO:teuthology.orchestra.run.smithi083.stderr: 18000K .......... .......... .......... .......... .......... 10% 28.6M 7s 2024-03-30T13:09:43.157 INFO:teuthology.orchestra.run.smithi083.stderr: 18050K .......... .......... .......... .......... .......... 10% 25.4M 7s 2024-03-30T13:09:43.159 INFO:teuthology.orchestra.run.smithi083.stderr: 18100K .......... .......... .......... .......... .......... 10% 31.9M 7s 2024-03-30T13:09:43.161 INFO:teuthology.orchestra.run.smithi083.stderr: 18150K .......... .......... .......... .......... .......... 10% 31.6M 7s 2024-03-30T13:09:43.162 INFO:teuthology.orchestra.run.smithi083.stderr: 18200K .......... .......... .......... .......... .......... 10% 31.2M 7s 2024-03-30T13:09:43.164 INFO:teuthology.orchestra.run.smithi083.stderr: 18250K .......... .......... .......... .......... .......... 10% 24.9M 7s 2024-03-30T13:09:43.165 INFO:teuthology.orchestra.run.smithi083.stderr: 18300K .......... .......... .......... .......... .......... 10% 30.3M 7s 2024-03-30T13:09:43.166 INFO:teuthology.orchestra.run.smithi083.stderr: 18350K .......... .......... .......... .......... .......... 10% 30.7M 7s 2024-03-30T13:09:43.168 INFO:teuthology.orchestra.run.smithi083.stderr: 18400K .......... .......... .......... .......... .......... 10% 30.6M 7s 2024-03-30T13:09:43.170 INFO:teuthology.orchestra.run.smithi083.stderr: 18450K .......... .......... .......... .......... .......... 10% 26.5M 7s 2024-03-30T13:09:43.172 INFO:teuthology.orchestra.run.smithi083.stderr: 18500K .......... .......... .......... .......... .......... 11% 29.5M 7s 2024-03-30T13:09:43.173 INFO:teuthology.orchestra.run.smithi083.stderr: 18550K .......... .......... .......... .......... .......... 11% 31.1M 7s 2024-03-30T13:09:43.177 INFO:teuthology.orchestra.run.smithi083.stderr: 18600K .......... .......... .......... .......... .......... 11% 14.0M 7s 2024-03-30T13:09:43.180 INFO:teuthology.orchestra.run.smithi083.stderr: 18650K .......... .......... .......... .......... .......... 11% 25.1M 7s 2024-03-30T13:09:43.181 INFO:teuthology.orchestra.run.smithi083.stderr: 18700K .......... .......... .......... .......... .......... 11% 30.5M 7s 2024-03-30T13:09:43.183 INFO:teuthology.orchestra.run.smithi083.stderr: 18750K .......... .......... .......... .......... .......... 11% 29.0M 7s 2024-03-30T13:09:43.184 INFO:teuthology.orchestra.run.smithi083.stderr: 18800K .......... .......... .......... .......... .......... 11% 30.5M 7s 2024-03-30T13:09:43.186 INFO:teuthology.orchestra.run.smithi083.stderr: 18850K .......... .......... .......... .......... .......... 11% 27.1M 7s 2024-03-30T13:09:43.187 INFO:teuthology.orchestra.run.smithi083.stderr: 18900K .......... .......... .......... .......... .......... 11% 32.5M 7s 2024-03-30T13:09:43.188 INFO:teuthology.orchestra.run.smithi083.stderr: 18950K .......... .......... .......... .......... .......... 11% 32.2M 7s 2024-03-30T13:09:43.190 INFO:teuthology.orchestra.run.smithi083.stderr: 19000K .......... .......... .......... .......... .......... 11% 32.7M 7s 2024-03-30T13:09:43.192 INFO:teuthology.orchestra.run.smithi083.stderr: 19050K .......... .......... .......... .......... .......... 11% 27.7M 7s 2024-03-30T13:09:43.194 INFO:teuthology.orchestra.run.smithi083.stderr: 19100K .......... .......... .......... .......... .......... 11% 32.4M 7s 2024-03-30T13:09:43.195 INFO:teuthology.orchestra.run.smithi083.stderr: 19150K .......... .......... .......... .......... .......... 11% 32.2M 7s 2024-03-30T13:09:43.197 INFO:teuthology.orchestra.run.smithi083.stderr: 19200K .......... .......... .......... .......... .......... 11% 32.1M 7s 2024-03-30T13:09:43.198 INFO:teuthology.orchestra.run.smithi083.stderr: 19250K .......... .......... .......... .......... .......... 11% 27.8M 7s 2024-03-30T13:09:43.199 INFO:teuthology.orchestra.run.smithi083.stderr: 19300K .......... .......... .......... .......... .......... 11% 31.9M 7s 2024-03-30T13:09:43.202 INFO:teuthology.orchestra.run.smithi083.stderr: 19350K .......... .......... .......... .......... .......... 11% 31.1M 7s 2024-03-30T13:09:43.203 INFO:teuthology.orchestra.run.smithi083.stderr: 19400K .......... .......... .......... .......... .......... 11% 31.7M 7s 2024-03-30T13:09:43.204 INFO:teuthology.orchestra.run.smithi083.stderr: 19450K .......... .......... .......... .......... .......... 11% 27.9M 7s 2024-03-30T13:09:43.206 INFO:teuthology.orchestra.run.smithi083.stderr: 19500K .......... .......... .......... .......... .......... 11% 31.7M 7s 2024-03-30T13:09:43.207 INFO:teuthology.orchestra.run.smithi083.stderr: 19550K .......... .......... .......... .......... .......... 11% 31.5M 7s 2024-03-30T13:09:43.209 INFO:teuthology.orchestra.run.smithi083.stderr: 19600K .......... .......... .......... .......... .......... 11% 31.5M 7s 2024-03-30T13:09:43.212 INFO:teuthology.orchestra.run.smithi083.stderr: 19650K .......... .......... .......... .......... .......... 11% 27.0M 7s 2024-03-30T13:09:43.212 INFO:teuthology.orchestra.run.smithi083.stderr: 19700K .......... .......... .......... .......... .......... 11% 30.9M 7s 2024-03-30T13:09:43.214 INFO:teuthology.orchestra.run.smithi083.stderr: 19750K .......... .......... .......... .......... .......... 11% 32.0M 7s 2024-03-30T13:09:43.215 INFO:teuthology.orchestra.run.smithi083.stderr: 19800K .......... .......... .......... .......... .......... 11% 30.4M 7s 2024-03-30T13:09:43.217 INFO:teuthology.orchestra.run.smithi083.stderr: 19850K .......... .......... .......... .......... .......... 11% 26.1M 7s 2024-03-30T13:09:43.219 INFO:teuthology.orchestra.run.smithi083.stderr: 19900K .......... .......... .......... .......... .......... 11% 30.5M 7s 2024-03-30T13:09:43.221 INFO:teuthology.orchestra.run.smithi083.stderr: 19950K .......... .......... .......... .......... .......... 11% 31.0M 7s 2024-03-30T13:09:43.223 INFO:teuthology.orchestra.run.smithi083.stderr: 20000K .......... .......... .......... .......... .......... 11% 30.7M 7s 2024-03-30T13:09:43.224 INFO:teuthology.orchestra.run.smithi083.stderr: 20050K .......... .......... .......... .......... .......... 11% 26.1M 7s 2024-03-30T13:09:43.225 INFO:teuthology.orchestra.run.smithi083.stderr: 20100K .......... .......... .......... .......... .......... 11% 29.0M 7s 2024-03-30T13:09:43.232 INFO:teuthology.orchestra.run.smithi083.stderr: 20150K .......... .......... .......... .......... .......... 11% 27.2M 7s 2024-03-30T13:09:43.232 INFO:teuthology.orchestra.run.smithi083.stderr: 20200K .......... .......... .......... .......... .......... 12% 32.8M 7s 2024-03-30T13:09:43.232 INFO:teuthology.orchestra.run.smithi083.stderr: 20250K .......... .......... .......... .......... .......... 12% 26.8M 7s 2024-03-30T13:09:43.232 INFO:teuthology.orchestra.run.smithi083.stderr: 20300K .......... .......... .......... .......... .......... 12% 31.8M 7s 2024-03-30T13:09:43.234 INFO:teuthology.orchestra.run.smithi083.stderr: 20350K .......... .......... .......... .......... .......... 12% 33.7M 7s 2024-03-30T13:09:43.235 INFO:teuthology.orchestra.run.smithi083.stderr: 20400K .......... .......... .......... .......... .......... 12% 32.9M 7s 2024-03-30T13:09:43.237 INFO:teuthology.orchestra.run.smithi083.stderr: 20450K .......... .......... .......... .......... .......... 12% 24.2M 6s 2024-03-30T13:09:43.238 INFO:teuthology.orchestra.run.smithi083.stderr: 20500K .......... .......... .......... .......... .......... 12% 37.1M 6s 2024-03-30T13:09:43.240 INFO:teuthology.orchestra.run.smithi083.stderr: 20550K .......... .......... .......... .......... .......... 12% 41.3M 6s 2024-03-30T13:09:43.241 INFO:teuthology.orchestra.run.smithi083.stderr: 20600K .......... .......... .......... .......... .......... 12% 39.3M 6s 2024-03-30T13:09:43.242 INFO:teuthology.orchestra.run.smithi083.stderr: 20650K .......... .......... .......... .......... .......... 12% 32.8M 6s 2024-03-30T13:09:43.244 INFO:teuthology.orchestra.run.smithi083.stderr: 20700K .......... .......... .......... .......... .......... 12% 34.5M 6s 2024-03-30T13:09:43.245 INFO:teuthology.orchestra.run.smithi083.stderr: 20750K .......... .......... .......... .......... .......... 12% 40.9M 6s 2024-03-30T13:09:43.246 INFO:teuthology.orchestra.run.smithi083.stderr: 20800K .......... .......... .......... .......... .......... 12% 39.1M 6s 2024-03-30T13:09:43.248 INFO:teuthology.orchestra.run.smithi083.stderr: 20850K .......... .......... .......... .......... .......... 12% 34.4M 6s 2024-03-30T13:09:43.249 INFO:teuthology.orchestra.run.smithi083.stderr: 20900K .......... .......... .......... .......... .......... 12% 37.2M 6s 2024-03-30T13:09:43.251 INFO:teuthology.orchestra.run.smithi083.stderr: 20950K .......... .......... .......... .......... .......... 12% 36.3M 6s 2024-03-30T13:09:43.252 INFO:teuthology.orchestra.run.smithi083.stderr: 21000K .......... .......... .......... .......... .......... 12% 29.6M 6s 2024-03-30T13:09:43.253 INFO:teuthology.orchestra.run.smithi083.stderr: 21050K .......... .......... .......... .......... .......... 12% 33.9M 6s 2024-03-30T13:09:43.255 INFO:teuthology.orchestra.run.smithi083.stderr: 21100K .......... .......... .......... .......... .......... 12% 38.6M 6s 2024-03-30T13:09:43.256 INFO:teuthology.orchestra.run.smithi083.stderr: 21150K .......... .......... .......... .......... .......... 12% 41.3M 6s 2024-03-30T13:09:43.257 INFO:teuthology.orchestra.run.smithi083.stderr: 21200K .......... .......... .......... .......... .......... 12% 38.3M 6s 2024-03-30T13:09:43.259 INFO:teuthology.orchestra.run.smithi083.stderr: 21250K .......... .......... .......... .......... .......... 12% 32.8M 6s 2024-03-30T13:09:43.260 INFO:teuthology.orchestra.run.smithi083.stderr: 21300K .......... .......... .......... .......... .......... 12% 38.7M 6s 2024-03-30T13:09:43.261 INFO:teuthology.orchestra.run.smithi083.stderr: 21350K .......... .......... .......... .......... .......... 12% 36.3M 6s 2024-03-30T13:09:43.263 INFO:teuthology.orchestra.run.smithi083.stderr: 21400K .......... .......... .......... .......... .......... 12% 35.2M 6s 2024-03-30T13:09:43.264 INFO:teuthology.orchestra.run.smithi083.stderr: 21450K .......... .......... .......... .......... .......... 12% 30.7M 6s 2024-03-30T13:09:43.265 INFO:teuthology.orchestra.run.smithi083.stderr: 21500K .......... .......... .......... .......... .......... 12% 35.3M 6s 2024-03-30T13:09:43.268 INFO:teuthology.orchestra.run.smithi083.stderr: 21550K .......... .......... .......... .......... .......... 12% 25.4M 6s 2024-03-30T13:09:43.269 INFO:teuthology.orchestra.run.smithi083.stderr: 21600K .......... .......... .......... .......... .......... 12% 41.8M 6s 2024-03-30T13:09:43.272 INFO:teuthology.orchestra.run.smithi083.stderr: 21650K .......... .......... .......... .......... .......... 12% 32.4M 6s 2024-03-30T13:09:43.272 INFO:teuthology.orchestra.run.smithi083.stderr: 21700K .......... .......... .......... .......... .......... 12% 38.7M 6s 2024-03-30T13:09:43.273 INFO:teuthology.orchestra.run.smithi083.stderr: 21750K .......... .......... .......... .......... .......... 12% 40.1M 6s 2024-03-30T13:09:43.274 INFO:teuthology.orchestra.run.smithi083.stderr: 21800K .......... .......... .......... .......... .......... 12% 40.5M 6s 2024-03-30T13:09:43.276 INFO:teuthology.orchestra.run.smithi083.stderr: 21850K .......... .......... .......... .......... .......... 12% 34.4M 6s 2024-03-30T13:09:43.277 INFO:teuthology.orchestra.run.smithi083.stderr: 21900K .......... .......... .......... .......... .......... 13% 39.6M 6s 2024-03-30T13:09:43.278 INFO:teuthology.orchestra.run.smithi083.stderr: 21950K .......... .......... .......... .......... .......... 13% 39.0M 6s 2024-03-30T13:09:43.279 INFO:teuthology.orchestra.run.smithi083.stderr: 22000K .......... .......... .......... .......... .......... 13% 37.1M 6s 2024-03-30T13:09:43.281 INFO:teuthology.orchestra.run.smithi083.stderr: 22050K .......... .......... .......... .......... .......... 13% 31.5M 6s 2024-03-30T13:09:43.282 INFO:teuthology.orchestra.run.smithi083.stderr: 22100K .......... .......... .......... .......... .......... 13% 34.6M 6s 2024-03-30T13:09:43.283 INFO:teuthology.orchestra.run.smithi083.stderr: 22150K .......... .......... .......... .......... .......... 13% 34.4M 6s 2024-03-30T13:09:43.285 INFO:teuthology.orchestra.run.smithi083.stderr: 22200K .......... .......... .......... .......... .......... 13% 34.4M 6s 2024-03-30T13:09:43.286 INFO:teuthology.orchestra.run.smithi083.stderr: 22250K .......... .......... .......... .......... .......... 13% 29.5M 6s 2024-03-30T13:09:43.288 INFO:teuthology.orchestra.run.smithi083.stderr: 22300K .......... .......... .......... .......... .......... 13% 35.7M 6s 2024-03-30T13:09:43.289 INFO:teuthology.orchestra.run.smithi083.stderr: 22350K .......... .......... .......... .......... .......... 13% 35.4M 6s 2024-03-30T13:09:43.291 INFO:teuthology.orchestra.run.smithi083.stderr: 22400K .......... .......... .......... .......... .......... 13% 33.8M 6s 2024-03-30T13:09:43.292 INFO:teuthology.orchestra.run.smithi083.stderr: 22450K .......... .......... .......... .......... .......... 13% 29.9M 6s 2024-03-30T13:09:43.294 INFO:teuthology.orchestra.run.smithi083.stderr: 22500K .......... .......... .......... .......... .......... 13% 32.0M 6s 2024-03-30T13:09:43.295 INFO:teuthology.orchestra.run.smithi083.stderr: 22550K .......... .......... .......... .......... .......... 13% 33.3M 6s 2024-03-30T13:09:43.296 INFO:teuthology.orchestra.run.smithi083.stderr: 22600K .......... .......... .......... .......... .......... 13% 34.8M 6s 2024-03-30T13:09:43.298 INFO:teuthology.orchestra.run.smithi083.stderr: 22650K .......... .......... .......... .......... .......... 13% 27.8M 6s 2024-03-30T13:09:43.301 INFO:teuthology.orchestra.run.smithi083.stderr: 22700K .......... .......... .......... .......... .......... 13% 19.4M 6s 2024-03-30T13:09:43.302 INFO:teuthology.orchestra.run.smithi083.stderr: 22750K .......... .......... .......... .......... .......... 13% 37.6M 6s 2024-03-30T13:09:43.304 INFO:teuthology.orchestra.run.smithi083.stderr: 22800K .......... .......... .......... .......... .......... 13% 37.9M 6s 2024-03-30T13:09:43.306 INFO:teuthology.orchestra.run.smithi083.stderr: 22850K .......... .......... .......... .......... .......... 13% 32.2M 6s 2024-03-30T13:09:43.306 INFO:teuthology.orchestra.run.smithi083.stderr: 22900K .......... .......... .......... .......... .......... 13% 38.7M 6s 2024-03-30T13:09:43.308 INFO:teuthology.orchestra.run.smithi083.stderr: 22950K .......... .......... .......... .......... .......... 13% 37.0M 6s 2024-03-30T13:09:43.309 INFO:teuthology.orchestra.run.smithi083.stderr: 23000K .......... .......... .......... .......... .......... 13% 37.5M 6s 2024-03-30T13:09:43.310 INFO:teuthology.orchestra.run.smithi083.stderr: 23050K .......... .......... .......... .......... .......... 13% 30.9M 6s 2024-03-30T13:09:43.312 INFO:teuthology.orchestra.run.smithi083.stderr: 23100K .......... .......... .......... .......... .......... 13% 36.5M 6s 2024-03-30T13:09:43.313 INFO:teuthology.orchestra.run.smithi083.stderr: 23150K .......... .......... .......... .......... .......... 13% 38.7M 6s 2024-03-30T13:09:43.314 INFO:teuthology.orchestra.run.smithi083.stderr: 23200K .......... .......... .......... .......... .......... 13% 37.3M 6s 2024-03-30T13:09:43.316 INFO:teuthology.orchestra.run.smithi083.stderr: 23250K .......... .......... .......... .......... .......... 13% 34.0M 6s 2024-03-30T13:09:43.317 INFO:teuthology.orchestra.run.smithi083.stderr: 23300K .......... .......... .......... .......... .......... 13% 39.8M 6s 2024-03-30T13:09:43.318 INFO:teuthology.orchestra.run.smithi083.stderr: 23350K .......... .......... .......... .......... .......... 13% 37.7M 6s 2024-03-30T13:09:43.319 INFO:teuthology.orchestra.run.smithi083.stderr: 23400K .......... .......... .......... .......... .......... 13% 39.5M 6s 2024-03-30T13:09:43.321 INFO:teuthology.orchestra.run.smithi083.stderr: 23450K .......... .......... .......... .......... .......... 13% 34.2M 6s 2024-03-30T13:09:43.322 INFO:teuthology.orchestra.run.smithi083.stderr: 23500K .......... .......... .......... .......... .......... 13% 37.8M 6s 2024-03-30T13:09:43.323 INFO:teuthology.orchestra.run.smithi083.stderr: 23550K .......... .......... .......... .......... .......... 14% 39.4M 6s 2024-03-30T13:09:43.325 INFO:teuthology.orchestra.run.smithi083.stderr: 23600K .......... .......... .......... .......... .......... 14% 38.1M 6s 2024-03-30T13:09:43.327 INFO:teuthology.orchestra.run.smithi083.stderr: 23650K .......... .......... .......... .......... .......... 14% 27.7M 6s 2024-03-30T13:09:43.329 INFO:teuthology.orchestra.run.smithi083.stderr: 23700K .......... .......... .......... .......... .......... 14% 22.2M 6s 2024-03-30T13:09:43.331 INFO:teuthology.orchestra.run.smithi083.stderr: 23750K .......... .......... .......... .......... .......... 14% 28.5M 6s 2024-03-30T13:09:43.333 INFO:teuthology.orchestra.run.smithi083.stderr: 23800K .......... .......... .......... .......... .......... 14% 29.1M 6s 2024-03-30T13:09:43.334 INFO:teuthology.orchestra.run.smithi083.stderr: 23850K .......... .......... .......... .......... .......... 14% 27.5M 6s 2024-03-30T13:09:43.336 INFO:teuthology.orchestra.run.smithi083.stderr: 23900K .......... .......... .......... .......... .......... 14% 32.7M 6s 2024-03-30T13:09:43.337 INFO:teuthology.orchestra.run.smithi083.stderr: 23950K .......... .......... .......... .......... .......... 14% 33.2M 6s 2024-03-30T13:09:43.338 INFO:teuthology.orchestra.run.smithi083.stderr: 24000K .......... .......... .......... .......... .......... 14% 33.4M 6s 2024-03-30T13:09:43.340 INFO:teuthology.orchestra.run.smithi083.stderr: 24050K .......... .......... .......... .......... .......... 14% 28.3M 6s 2024-03-30T13:09:43.342 INFO:teuthology.orchestra.run.smithi083.stderr: 24100K .......... .......... .......... .......... .......... 14% 32.9M 6s 2024-03-30T13:09:43.343 INFO:teuthology.orchestra.run.smithi083.stderr: 24150K .......... .......... .......... .......... .......... 14% 33.0M 6s 2024-03-30T13:09:43.345 INFO:teuthology.orchestra.run.smithi083.stderr: 24200K .......... .......... .......... .......... .......... 14% 33.0M 6s 2024-03-30T13:09:43.346 INFO:teuthology.orchestra.run.smithi083.stderr: 24250K .......... .......... .......... .......... .......... 14% 27.7M 6s 2024-03-30T13:09:43.348 INFO:teuthology.orchestra.run.smithi083.stderr: 24300K .......... .......... .......... .......... .......... 14% 32.3M 6s 2024-03-30T13:09:43.349 INFO:teuthology.orchestra.run.smithi083.stderr: 24350K .......... .......... .......... .......... .......... 14% 32.5M 6s 2024-03-30T13:09:43.351 INFO:teuthology.orchestra.run.smithi083.stderr: 24400K .......... .......... .......... .......... .......... 14% 33.0M 6s 2024-03-30T13:09:43.353 INFO:teuthology.orchestra.run.smithi083.stderr: 24450K .......... .......... .......... .......... .......... 14% 27.9M 6s 2024-03-30T13:09:43.355 INFO:teuthology.orchestra.run.smithi083.stderr: 24500K .......... .......... .......... .......... .......... 14% 31.6M 6s 2024-03-30T13:09:43.356 INFO:teuthology.orchestra.run.smithi083.stderr: 24550K .......... .......... .......... .......... .......... 14% 28.6M 6s 2024-03-30T13:09:43.358 INFO:teuthology.orchestra.run.smithi083.stderr: 24600K .......... .......... .......... .......... .......... 14% 28.4M 6s 2024-03-30T13:09:43.362 INFO:teuthology.orchestra.run.smithi083.stderr: 24650K .......... .......... .......... .......... .......... 14% 22.3M 6s 2024-03-30T13:09:43.362 INFO:teuthology.orchestra.run.smithi083.stderr: 24700K .......... .......... .......... .......... .......... 14% 23.8M 6s 2024-03-30T13:09:43.364 INFO:teuthology.orchestra.run.smithi083.stderr: 24750K .......... .......... .......... .......... .......... 14% 24.2M 6s 2024-03-30T13:09:43.366 INFO:teuthology.orchestra.run.smithi083.stderr: 24800K .......... .......... .......... .......... .......... 14% 30.0M 6s 2024-03-30T13:09:43.367 INFO:teuthology.orchestra.run.smithi083.stderr: 24850K .......... .......... .......... .......... .......... 14% 29.6M 6s 2024-03-30T13:09:43.368 INFO:teuthology.orchestra.run.smithi083.stderr: 24900K .......... .......... .......... .......... .......... 14% 39.4M 6s 2024-03-30T13:09:43.370 INFO:teuthology.orchestra.run.smithi083.stderr: 24950K .......... .......... .......... .......... .......... 14% 39.4M 6s 2024-03-30T13:09:43.371 INFO:teuthology.orchestra.run.smithi083.stderr: 25000K .......... .......... .......... .......... .......... 14% 36.4M 6s 2024-03-30T13:09:43.377 INFO:teuthology.orchestra.run.smithi083.stderr: 25050K .......... .......... .......... .......... .......... 14% 31.8M 6s 2024-03-30T13:09:43.377 INFO:teuthology.orchestra.run.smithi083.stderr: 25100K .......... .......... .......... .......... .......... 14% 37.9M 6s 2024-03-30T13:09:43.377 INFO:teuthology.orchestra.run.smithi083.stderr: 25150K .......... .......... .......... .......... .......... 14% 35.1M 6s 2024-03-30T13:09:43.377 INFO:teuthology.orchestra.run.smithi083.stderr: 25200K .......... .......... .......... .......... .......... 14% 33.5M 6s 2024-03-30T13:09:43.379 INFO:teuthology.orchestra.run.smithi083.stderr: 25250K .......... .......... .......... .......... .......... 15% 28.3M 6s 2024-03-30T13:09:43.380 INFO:teuthology.orchestra.run.smithi083.stderr: 25300K .......... .......... .......... .......... .......... 15% 34.2M 6s 2024-03-30T13:09:43.381 INFO:teuthology.orchestra.run.smithi083.stderr: 25350K .......... .......... .......... .......... .......... 15% 33.4M 6s 2024-03-30T13:09:43.383 INFO:teuthology.orchestra.run.smithi083.stderr: 25400K .......... .......... .......... .......... .......... 15% 31.1M 6s 2024-03-30T13:09:43.385 INFO:teuthology.orchestra.run.smithi083.stderr: 25450K .......... .......... .......... .......... .......... 15% 28.4M 6s 2024-03-30T13:09:43.386 INFO:teuthology.orchestra.run.smithi083.stderr: 25500K .......... .......... .......... .......... .......... 15% 32.3M 6s 2024-03-30T13:09:43.388 INFO:teuthology.orchestra.run.smithi083.stderr: 25550K .......... .......... .......... .......... .......... 15% 31.5M 6s 2024-03-30T13:09:43.390 INFO:teuthology.orchestra.run.smithi083.stderr: 25600K .......... .......... .......... .......... .......... 15% 26.1M 6s 2024-03-30T13:09:43.392 INFO:teuthology.orchestra.run.smithi083.stderr: 25650K .......... .......... .......... .......... .......... 15% 19.8M 6s 2024-03-30T13:09:43.394 INFO:teuthology.orchestra.run.smithi083.stderr: 25700K .......... .......... .......... .......... .......... 15% 29.7M 6s 2024-03-30T13:09:43.395 INFO:teuthology.orchestra.run.smithi083.stderr: 25750K .......... .......... .......... .......... .......... 15% 29.6M 6s 2024-03-30T13:09:43.397 INFO:teuthology.orchestra.run.smithi083.stderr: 25800K .......... .......... .......... .......... .......... 15% 30.0M 6s 2024-03-30T13:09:43.399 INFO:teuthology.orchestra.run.smithi083.stderr: 25850K .......... .......... .......... .......... .......... 15% 25.0M 6s 2024-03-30T13:09:43.400 INFO:teuthology.orchestra.run.smithi083.stderr: 25900K .......... .......... .......... .......... .......... 15% 29.8M 6s 2024-03-30T13:09:43.402 INFO:teuthology.orchestra.run.smithi083.stderr: 25950K .......... .......... .......... .......... .......... 15% 28.5M 6s 2024-03-30T13:09:43.404 INFO:teuthology.orchestra.run.smithi083.stderr: 26000K .......... .......... .......... .......... .......... 15% 29.7M 6s 2024-03-30T13:09:43.406 INFO:teuthology.orchestra.run.smithi083.stderr: 26050K .......... .......... .......... .......... .......... 15% 25.4M 6s 2024-03-30T13:09:43.407 INFO:teuthology.orchestra.run.smithi083.stderr: 26100K .......... .......... .......... .......... .......... 15% 28.9M 6s 2024-03-30T13:09:43.409 INFO:teuthology.orchestra.run.smithi083.stderr: 26150K .......... .......... .......... .......... .......... 15% 29.1M 6s 2024-03-30T13:09:43.411 INFO:teuthology.orchestra.run.smithi083.stderr: 26200K .......... .......... .......... .......... .......... 15% 28.5M 6s 2024-03-30T13:09:43.413 INFO:teuthology.orchestra.run.smithi083.stderr: 26250K .......... .......... .......... .......... .......... 15% 24.5M 6s 2024-03-30T13:09:43.415 INFO:teuthology.orchestra.run.smithi083.stderr: 26300K .......... .......... .......... .......... .......... 15% 28.0M 6s 2024-03-30T13:09:43.416 INFO:teuthology.orchestra.run.smithi083.stderr: 26350K .......... .......... .......... .......... .......... 15% 27.9M 6s 2024-03-30T13:09:43.418 INFO:teuthology.orchestra.run.smithi083.stderr: 26400K .......... .......... .......... .......... .......... 15% 28.2M 6s 2024-03-30T13:09:43.420 INFO:teuthology.orchestra.run.smithi083.stderr: 26450K .......... .......... .......... .......... .......... 15% 24.1M 6s 2024-03-30T13:09:43.422 INFO:teuthology.orchestra.run.smithi083.stderr: 26500K .......... .......... .......... .......... .......... 15% 28.5M 6s 2024-03-30T13:09:43.424 INFO:teuthology.orchestra.run.smithi083.stderr: 26550K .......... .......... .......... .......... .......... 15% 27.1M 6s 2024-03-30T13:09:43.425 INFO:teuthology.orchestra.run.smithi083.stderr: 26600K .......... .......... .......... .......... .......... 15% 28.0M 6s 2024-03-30T13:09:43.427 INFO:teuthology.orchestra.run.smithi083.stderr: 26650K .......... .......... .......... .......... .......... 15% 22.8M 6s 2024-03-30T13:09:43.429 INFO:teuthology.orchestra.run.smithi083.stderr: 26700K .......... .......... .......... .......... .......... 15% 28.1M 6s 2024-03-30T13:09:43.431 INFO:teuthology.orchestra.run.smithi083.stderr: 26750K .......... .......... .......... .......... .......... 15% 26.9M 6s 2024-03-30T13:09:43.434 INFO:teuthology.orchestra.run.smithi083.stderr: 26800K .......... .......... .......... .......... .......... 15% 17.6M 6s 2024-03-30T13:09:43.436 INFO:teuthology.orchestra.run.smithi083.stderr: 26850K .......... .......... .......... .......... .......... 15% 24.8M 6s 2024-03-30T13:09:43.439 INFO:teuthology.orchestra.run.smithi083.stderr: 26900K .......... .......... .......... .......... .......... 15% 29.8M 6s 2024-03-30T13:09:43.439 INFO:teuthology.orchestra.run.smithi083.stderr: 26950K .......... .......... .......... .......... .......... 16% 29.9M 6s 2024-03-30T13:09:43.441 INFO:teuthology.orchestra.run.smithi083.stderr: 27000K .......... .......... .......... .......... .......... 16% 29.2M 6s 2024-03-30T13:09:43.442 INFO:teuthology.orchestra.run.smithi083.stderr: 27050K .......... .......... .......... .......... .......... 16% 25.4M 6s 2024-03-30T13:09:43.444 INFO:teuthology.orchestra.run.smithi083.stderr: 27100K .......... .......... .......... .......... .......... 16% 29.4M 6s 2024-03-30T13:09:43.446 INFO:teuthology.orchestra.run.smithi083.stderr: 27150K .......... .......... .......... .......... .......... 16% 29.5M 6s 2024-03-30T13:09:43.447 INFO:teuthology.orchestra.run.smithi083.stderr: 27200K .......... .......... .......... .......... .......... 16% 29.3M 6s 2024-03-30T13:09:43.449 INFO:teuthology.orchestra.run.smithi083.stderr: 27250K .......... .......... .......... .......... .......... 16% 25.3M 6s 2024-03-30T13:09:43.451 INFO:teuthology.orchestra.run.smithi083.stderr: 27300K .......... .......... .......... .......... .......... 16% 29.1M 6s 2024-03-30T13:09:43.453 INFO:teuthology.orchestra.run.smithi083.stderr: 27350K .......... .......... .......... .......... .......... 16% 29.1M 6s 2024-03-30T13:09:43.455 INFO:teuthology.orchestra.run.smithi083.stderr: 27400K .......... .......... .......... .......... .......... 16% 32.1M 6s 2024-03-30T13:09:43.456 INFO:teuthology.orchestra.run.smithi083.stderr: 27450K .......... .......... .......... .......... .......... 16% 32.4M 6s 2024-03-30T13:09:43.457 INFO:teuthology.orchestra.run.smithi083.stderr: 27500K .......... .......... .......... .......... .......... 16% 39.2M 6s 2024-03-30T13:09:43.459 INFO:teuthology.orchestra.run.smithi083.stderr: 27550K .......... .......... .......... .......... .......... 16% 37.1M 6s 2024-03-30T13:09:43.460 INFO:teuthology.orchestra.run.smithi083.stderr: 27600K .......... .......... .......... .......... .......... 16% 38.1M 6s 2024-03-30T13:09:43.461 INFO:teuthology.orchestra.run.smithi083.stderr: 27650K .......... .......... .......... .......... .......... 16% 32.9M 6s 2024-03-30T13:09:43.462 INFO:teuthology.orchestra.run.smithi083.stderr: 27700K .......... .......... .......... .......... .......... 16% 37.5M 6s 2024-03-30T13:09:43.464 INFO:teuthology.orchestra.run.smithi083.stderr: 27750K .......... .......... .......... .......... .......... 16% 31.9M 6s 2024-03-30T13:09:43.466 INFO:teuthology.orchestra.run.smithi083.stderr: 27800K .......... .......... .......... .......... .......... 16% 30.8M 6s 2024-03-30T13:09:43.468 INFO:teuthology.orchestra.run.smithi083.stderr: 27850K .......... .......... .......... .......... .......... 16% 26.5M 6s 2024-03-30T13:09:43.469 INFO:teuthology.orchestra.run.smithi083.stderr: 27900K .......... .......... .......... .......... .......... 16% 32.1M 6s 2024-03-30T13:09:43.471 INFO:teuthology.orchestra.run.smithi083.stderr: 27950K .......... .......... .......... .......... .......... 16% 30.0M 6s 2024-03-30T13:09:43.472 INFO:teuthology.orchestra.run.smithi083.stderr: 28000K .......... .......... .......... .......... .......... 16% 30.6M 6s 2024-03-30T13:09:43.474 INFO:teuthology.orchestra.run.smithi083.stderr: 28050K .......... .......... .......... .......... .......... 16% 25.5M 6s 2024-03-30T13:09:43.476 INFO:teuthology.orchestra.run.smithi083.stderr: 28100K .......... .......... .......... .......... .......... 16% 29.9M 6s 2024-03-30T13:09:43.477 INFO:teuthology.orchestra.run.smithi083.stderr: 28150K .......... .......... .......... .......... .......... 16% 30.4M 6s 2024-03-30T13:09:43.479 INFO:teuthology.orchestra.run.smithi083.stderr: 28200K .......... .......... .......... .......... .......... 16% 29.1M 6s 2024-03-30T13:09:43.482 INFO:teuthology.orchestra.run.smithi083.stderr: 28250K .......... .......... .......... .......... .......... 16% 25.7M 6s 2024-03-30T13:09:43.483 INFO:teuthology.orchestra.run.smithi083.stderr: 28300K .......... .......... .......... .......... .......... 16% 33.1M 6s 2024-03-30T13:09:43.484 INFO:teuthology.orchestra.run.smithi083.stderr: 28350K .......... .......... .......... .......... .......... 16% 33.5M 6s 2024-03-30T13:09:43.485 INFO:teuthology.orchestra.run.smithi083.stderr: 28400K .......... .......... .......... .......... .......... 16% 34.1M 6s 2024-03-30T13:09:43.487 INFO:teuthology.orchestra.run.smithi083.stderr: 28450K .......... .......... .......... .......... .......... 16% 30.0M 6s 2024-03-30T13:09:43.489 INFO:teuthology.orchestra.run.smithi083.stderr: 28500K .......... .......... .......... .......... .......... 16% 34.4M 6s 2024-03-30T13:09:43.490 INFO:teuthology.orchestra.run.smithi083.stderr: 28550K .......... .......... .......... .......... .......... 16% 34.3M 6s 2024-03-30T13:09:43.492 INFO:teuthology.orchestra.run.smithi083.stderr: 28600K .......... .......... .......... .......... .......... 16% 33.7M 6s 2024-03-30T13:09:43.493 INFO:teuthology.orchestra.run.smithi083.stderr: 28650K .......... .......... .......... .......... .......... 17% 26.6M 6s 2024-03-30T13:09:43.495 INFO:teuthology.orchestra.run.smithi083.stderr: 28700K .......... .......... .......... .......... .......... 17% 33.6M 6s 2024-03-30T13:09:43.496 INFO:teuthology.orchestra.run.smithi083.stderr: 28750K .......... .......... .......... .......... .......... 17% 34.5M 6s 2024-03-30T13:09:43.497 INFO:teuthology.orchestra.run.smithi083.stderr: 28800K .......... .......... .......... .......... .......... 17% 34.4M 6s 2024-03-30T13:09:43.499 INFO:teuthology.orchestra.run.smithi083.stderr: 28850K .......... .......... .......... .......... .......... 17% 27.2M 6s 2024-03-30T13:09:43.500 INFO:teuthology.orchestra.run.smithi083.stderr: 28900K .......... .......... .......... .......... .......... 17% 33.3M 6s 2024-03-30T13:09:43.503 INFO:teuthology.orchestra.run.smithi083.stderr: 28950K .......... .......... .......... .......... .......... 17% 31.8M 6s 2024-03-30T13:09:43.503 INFO:teuthology.orchestra.run.smithi083.stderr: 29000K .......... .......... .......... .......... .......... 17% 37.6M 6s 2024-03-30T13:09:43.505 INFO:teuthology.orchestra.run.smithi083.stderr: 29050K .......... .......... .......... .......... .......... 17% 31.9M 6s 2024-03-30T13:09:43.507 INFO:teuthology.orchestra.run.smithi083.stderr: 29100K .......... .......... .......... .......... .......... 17% 35.7M 6s 2024-03-30T13:09:43.508 INFO:teuthology.orchestra.run.smithi083.stderr: 29150K .......... .......... .......... .......... .......... 17% 39.5M 6s 2024-03-30T13:09:43.510 INFO:teuthology.orchestra.run.smithi083.stderr: 29200K .......... .......... .......... .......... .......... 17% 36.2M 6s 2024-03-30T13:09:43.511 INFO:teuthology.orchestra.run.smithi083.stderr: 29250K .......... .......... .......... .......... .......... 17% 34.1M 6s 2024-03-30T13:09:43.513 INFO:teuthology.orchestra.run.smithi083.stderr: 29300K .......... .......... .......... .......... .......... 17% 41.4M 6s 2024-03-30T13:09:43.518 INFO:teuthology.orchestra.run.smithi083.stderr: 29350K .......... .......... .......... .......... .......... 17% 38.7M 6s 2024-03-30T13:09:43.518 INFO:teuthology.orchestra.run.smithi083.stderr: 29400K .......... .......... .......... .......... .......... 17% 32.3M 6s 2024-03-30T13:09:43.518 INFO:teuthology.orchestra.run.smithi083.stderr: 29450K .......... .......... .......... .......... .......... 17% 27.6M 6s 2024-03-30T13:09:43.518 INFO:teuthology.orchestra.run.smithi083.stderr: 29500K .......... .......... .......... .......... .......... 17% 31.3M 6s 2024-03-30T13:09:43.519 INFO:teuthology.orchestra.run.smithi083.stderr: 29550K .......... .......... .......... .......... .......... 17% 32.2M 6s 2024-03-30T13:09:43.521 INFO:teuthology.orchestra.run.smithi083.stderr: 29600K .......... .......... .......... .......... .......... 17% 32.2M 6s 2024-03-30T13:09:43.523 INFO:teuthology.orchestra.run.smithi083.stderr: 29650K .......... .......... .......... .......... .......... 17% 26.4M 6s 2024-03-30T13:09:43.526 INFO:teuthology.orchestra.run.smithi083.stderr: 29700K .......... .......... .......... .......... .......... 17% 29.9M 6s 2024-03-30T13:09:43.526 INFO:teuthology.orchestra.run.smithi083.stderr: 29750K .......... .......... .......... .......... .......... 17% 24.2M 6s 2024-03-30T13:09:43.528 INFO:teuthology.orchestra.run.smithi083.stderr: 29800K .......... .......... .......... .......... .......... 17% 34.5M 6s 2024-03-30T13:09:43.529 INFO:teuthology.orchestra.run.smithi083.stderr: 29850K .......... .......... .......... .......... .......... 17% 27.9M 6s 2024-03-30T13:09:43.531 INFO:teuthology.orchestra.run.smithi083.stderr: 29900K .......... .......... .......... .......... .......... 17% 32.6M 6s 2024-03-30T13:09:43.532 INFO:teuthology.orchestra.run.smithi083.stderr: 29950K .......... .......... .......... .......... .......... 17% 32.1M 6s 2024-03-30T13:09:43.534 INFO:teuthology.orchestra.run.smithi083.stderr: 30000K .......... .......... .......... .......... .......... 17% 33.2M 6s 2024-03-30T13:09:43.536 INFO:teuthology.orchestra.run.smithi083.stderr: 30050K .......... .......... .......... .......... .......... 17% 27.5M 6s 2024-03-30T13:09:43.537 INFO:teuthology.orchestra.run.smithi083.stderr: 30100K .......... .......... .......... .......... .......... 17% 32.8M 6s 2024-03-30T13:09:43.539 INFO:teuthology.orchestra.run.smithi083.stderr: 30150K .......... .......... .......... .......... .......... 17% 32.6M 6s 2024-03-30T13:09:43.540 INFO:teuthology.orchestra.run.smithi083.stderr: 30200K .......... .......... .......... .......... .......... 17% 32.1M 5s 2024-03-30T13:09:43.542 INFO:teuthology.orchestra.run.smithi083.stderr: 30250K .......... .......... .......... .......... .......... 17% 28.1M 5s 2024-03-30T13:09:43.544 INFO:teuthology.orchestra.run.smithi083.stderr: 30300K .......... .......... .......... .......... .......... 18% 31.5M 5s 2024-03-30T13:09:43.545 INFO:teuthology.orchestra.run.smithi083.stderr: 30350K .......... .......... .......... .......... .......... 18% 32.0M 5s 2024-03-30T13:09:43.546 INFO:teuthology.orchestra.run.smithi083.stderr: 30400K .......... .......... .......... .......... .......... 18% 33.6M 5s 2024-03-30T13:09:43.548 INFO:teuthology.orchestra.run.smithi083.stderr: 30450K .......... .......... .......... .......... .......... 18% 30.7M 5s 2024-03-30T13:09:43.549 INFO:teuthology.orchestra.run.smithi083.stderr: 30500K .......... .......... .......... .......... .......... 18% 34.1M 5s 2024-03-30T13:09:43.551 INFO:teuthology.orchestra.run.smithi083.stderr: 30550K .......... .......... .......... .......... .......... 18% 32.9M 5s 2024-03-30T13:09:43.552 INFO:teuthology.orchestra.run.smithi083.stderr: 30600K .......... .......... .......... .......... .......... 18% 34.6M 5s 2024-03-30T13:09:43.555 INFO:teuthology.orchestra.run.smithi083.stderr: 30650K .......... .......... .......... .......... .......... 18% 29.3M 5s 2024-03-30T13:09:43.555 INFO:teuthology.orchestra.run.smithi083.stderr: 30700K .......... .......... .......... .......... .......... 18% 34.6M 5s 2024-03-30T13:09:43.557 INFO:teuthology.orchestra.run.smithi083.stderr: 30750K .......... .......... .......... .......... .......... 18% 33.8M 5s 2024-03-30T13:09:43.559 INFO:teuthology.orchestra.run.smithi083.stderr: 30800K .......... .......... .......... .......... .......... 18% 33.6M 5s 2024-03-30T13:09:43.560 INFO:teuthology.orchestra.run.smithi083.stderr: 30850K .......... .......... .......... .......... .......... 18% 29.5M 5s 2024-03-30T13:09:43.562 INFO:teuthology.orchestra.run.smithi083.stderr: 30900K .......... .......... .......... .......... .......... 18% 20.1M 5s 2024-03-30T13:09:43.564 INFO:teuthology.orchestra.run.smithi083.stderr: 30950K .......... .......... .......... .......... .......... 18% 38.1M 5s 2024-03-30T13:09:43.565 INFO:teuthology.orchestra.run.smithi083.stderr: 31000K .......... .......... .......... .......... .......... 18% 39.7M 5s 2024-03-30T13:09:43.577 INFO:teuthology.orchestra.run.smithi083.stderr: 31050K .......... .......... .......... .......... .......... 18% 31.9M 5s 2024-03-30T13:09:43.577 INFO:teuthology.orchestra.run.smithi083.stderr: 31100K .......... .......... .......... .......... .......... 18% 34.5M 5s 2024-03-30T13:09:43.577 INFO:teuthology.orchestra.run.smithi083.stderr: 31150K .......... .......... .......... .......... .......... 18% 35.7M 5s 2024-03-30T13:09:43.577 INFO:teuthology.orchestra.run.smithi083.stderr: 31200K .......... .......... .......... .......... .......... 18% 35.2M 5s 2024-03-30T13:09:43.577 INFO:teuthology.orchestra.run.smithi083.stderr: 31250K .......... .......... .......... .......... .......... 18% 30.1M 5s 2024-03-30T13:09:43.577 INFO:teuthology.orchestra.run.smithi083.stderr: 31300K .......... .......... .......... .......... .......... 18% 37.0M 5s 2024-03-30T13:09:43.577 INFO:teuthology.orchestra.run.smithi083.stderr: 31350K .......... .......... .......... .......... .......... 18% 38.4M 5s 2024-03-30T13:09:43.578 INFO:teuthology.orchestra.run.smithi083.stderr: 31400K .......... .......... .......... .......... .......... 18% 36.7M 5s 2024-03-30T13:09:43.579 INFO:teuthology.orchestra.run.smithi083.stderr: 31450K .......... .......... .......... .......... .......... 18% 32.2M 5s 2024-03-30T13:09:43.579 INFO:teuthology.orchestra.run.smithi083.stderr: 31500K .......... .......... .......... .......... .......... 18% 36.5M 5s 2024-03-30T13:09:43.580 INFO:teuthology.orchestra.run.smithi083.stderr: 31550K .......... .......... .......... .......... .......... 18% 37.4M 5s 2024-03-30T13:09:43.582 INFO:teuthology.orchestra.run.smithi083.stderr: 31600K .......... .......... .......... .......... .......... 18% 36.7M 5s 2024-03-30T13:09:43.583 INFO:teuthology.orchestra.run.smithi083.stderr: 31650K .......... .......... .......... .......... .......... 18% 30.4M 5s 2024-03-30T13:09:43.585 INFO:teuthology.orchestra.run.smithi083.stderr: 31700K .......... .......... .......... .......... .......... 18% 35.9M 5s 2024-03-30T13:09:43.586 INFO:teuthology.orchestra.run.smithi083.stderr: 31750K .......... .......... .......... .......... .......... 18% 36.1M 5s 2024-03-30T13:09:43.588 INFO:teuthology.orchestra.run.smithi083.stderr: 31800K .......... .......... .......... .......... .......... 18% 36.2M 5s 2024-03-30T13:09:43.589 INFO:teuthology.orchestra.run.smithi083.stderr: 31850K .......... .......... .......... .......... .......... 18% 31.3M 5s 2024-03-30T13:09:43.590 INFO:teuthology.orchestra.run.smithi083.stderr: 31900K .......... .......... .......... .......... .......... 18% 33.0M 5s 2024-03-30T13:09:43.592 INFO:teuthology.orchestra.run.smithi083.stderr: 31950K .......... .......... .......... .......... .......... 18% 35.4M 5s 2024-03-30T13:09:43.593 INFO:teuthology.orchestra.run.smithi083.stderr: 32000K .......... .......... .......... .......... .......... 19% 34.6M 5s 2024-03-30T13:09:43.595 INFO:teuthology.orchestra.run.smithi083.stderr: 32050K .......... .......... .......... .......... .......... 19% 27.8M 5s 2024-03-30T13:09:43.596 INFO:teuthology.orchestra.run.smithi083.stderr: 32100K .......... .......... .......... .......... .......... 19% 32.4M 5s 2024-03-30T13:09:43.598 INFO:teuthology.orchestra.run.smithi083.stderr: 32150K .......... .......... .......... .......... .......... 19% 33.2M 5s 2024-03-30T13:09:43.599 INFO:teuthology.orchestra.run.smithi083.stderr: 32200K .......... .......... .......... .......... .......... 19% 32.7M 5s 2024-03-30T13:09:43.601 INFO:teuthology.orchestra.run.smithi083.stderr: 32250K .......... .......... .......... .......... .......... 19% 28.0M 5s 2024-03-30T13:09:43.603 INFO:teuthology.orchestra.run.smithi083.stderr: 32300K .......... .......... .......... .......... .......... 19% 30.1M 5s 2024-03-30T13:09:43.605 INFO:teuthology.orchestra.run.smithi083.stderr: 32350K .......... .......... .......... .......... .......... 19% 27.9M 5s 2024-03-30T13:09:43.606 INFO:teuthology.orchestra.run.smithi083.stderr: 32400K .......... .......... .......... .......... .......... 19% 28.6M 5s 2024-03-30T13:09:43.608 INFO:teuthology.orchestra.run.smithi083.stderr: 32450K .......... .......... .......... .......... .......... 19% 23.7M 5s 2024-03-30T13:09:43.610 INFO:teuthology.orchestra.run.smithi083.stderr: 32500K .......... .......... .......... .......... .......... 19% 24.5M 5s 2024-03-30T13:09:43.612 INFO:teuthology.orchestra.run.smithi083.stderr: 32550K .......... .......... .......... .......... .......... 19% 25.2M 5s 2024-03-30T13:09:43.614 INFO:teuthology.orchestra.run.smithi083.stderr: 32600K .......... .......... .......... .......... .......... 19% 24.4M 5s 2024-03-30T13:09:43.616 INFO:teuthology.orchestra.run.smithi083.stderr: 32650K .......... .......... .......... .......... .......... 19% 22.7M 5s 2024-03-30T13:09:43.618 INFO:teuthology.orchestra.run.smithi083.stderr: 32700K .......... .......... .......... .......... .......... 19% 26.8M 5s 2024-03-30T13:09:43.620 INFO:teuthology.orchestra.run.smithi083.stderr: 32750K .......... .......... .......... .......... .......... 19% 23.1M 5s 2024-03-30T13:09:43.622 INFO:teuthology.orchestra.run.smithi083.stderr: 32800K .......... .......... .......... .......... .......... 19% 23.9M 5s 2024-03-30T13:09:43.625 INFO:teuthology.orchestra.run.smithi083.stderr: 32850K .......... .......... .......... .......... .......... 19% 21.3M 5s 2024-03-30T13:09:43.627 INFO:teuthology.orchestra.run.smithi083.stderr: 32900K .......... .......... .......... .......... .......... 19% 23.6M 5s 2024-03-30T13:09:43.630 INFO:teuthology.orchestra.run.smithi083.stderr: 32950K .......... .......... .......... .......... .......... 19% 21.9M 5s 2024-03-30T13:09:43.631 INFO:teuthology.orchestra.run.smithi083.stderr: 33000K .......... .......... .......... .......... .......... 19% 23.3M 5s 2024-03-30T13:09:43.633 INFO:teuthology.orchestra.run.smithi083.stderr: 33050K .......... .......... .......... .......... .......... 19% 22.1M 5s 2024-03-30T13:09:43.635 INFO:teuthology.orchestra.run.smithi083.stderr: 33100K .......... .......... .......... .......... .......... 19% 25.4M 5s 2024-03-30T13:09:43.637 INFO:teuthology.orchestra.run.smithi083.stderr: 33150K .......... .......... .......... .......... .......... 19% 27.5M 5s 2024-03-30T13:09:43.653 INFO:teuthology.orchestra.run.smithi083.stderr: 33200K .......... .......... .......... .......... .......... 19% 27.1M 5s 2024-03-30T13:09:43.654 INFO:teuthology.orchestra.run.smithi083.stderr: 33250K .......... .......... .......... .......... .......... 19% 23.4M 5s 2024-03-30T13:09:43.654 INFO:teuthology.orchestra.run.smithi083.stderr: 33300K .......... .......... .......... .......... .......... 19% 30.0M 5s 2024-03-30T13:09:43.654 INFO:teuthology.orchestra.run.smithi083.stderr: 33350K .......... .......... .......... .......... .......... 19% 32.4M 5s 2024-03-30T13:09:43.654 INFO:teuthology.orchestra.run.smithi083.stderr: 33400K .......... .......... .......... .......... .......... 19% 31.3M 5s 2024-03-30T13:09:43.654 INFO:teuthology.orchestra.run.smithi083.stderr: 33450K .......... .......... .......... .......... .......... 19% 26.8M 5s 2024-03-30T13:09:43.654 INFO:teuthology.orchestra.run.smithi083.stderr: 33500K .......... .......... .......... .......... .......... 19% 32.2M 5s 2024-03-30T13:09:43.654 INFO:teuthology.orchestra.run.smithi083.stderr: 33550K .......... .......... .......... .......... .......... 19% 30.4M 5s 2024-03-30T13:09:43.654 INFO:teuthology.orchestra.run.smithi083.stderr: 33600K .......... .......... .......... .......... .......... 19% 29.8M 5s 2024-03-30T13:09:43.656 INFO:teuthology.orchestra.run.smithi083.stderr: 33650K .......... .......... .......... .......... .......... 19% 25.8M 5s 2024-03-30T13:09:43.657 INFO:teuthology.orchestra.run.smithi083.stderr: 33700K .......... .......... .......... .......... .......... 20% 28.0M 5s 2024-03-30T13:09:43.658 INFO:teuthology.orchestra.run.smithi083.stderr: 33750K .......... .......... .......... .......... .......... 20% 23.1M 5s 2024-03-30T13:09:43.660 INFO:teuthology.orchestra.run.smithi083.stderr: 33800K .......... .......... .......... .......... .......... 20% 21.5M 5s 2024-03-30T13:09:43.664 INFO:teuthology.orchestra.run.smithi083.stderr: 33850K .......... .......... .......... .......... .......... 20% 13.6M 5s 2024-03-30T13:09:43.666 INFO:teuthology.orchestra.run.smithi083.stderr: 33900K .......... .......... .......... .......... .......... 20% 23.8M 5s 2024-03-30T13:09:43.668 INFO:teuthology.orchestra.run.smithi083.stderr: 33950K .......... .......... .......... .......... .......... 20% 22.6M 5s 2024-03-30T13:09:43.670 INFO:teuthology.orchestra.run.smithi083.stderr: 34000K .......... .......... .......... .......... .......... 20% 23.2M 5s 2024-03-30T13:09:43.672 INFO:teuthology.orchestra.run.smithi083.stderr: 34050K .......... .......... .......... .......... .......... 20% 21.3M 5s 2024-03-30T13:09:43.674 INFO:teuthology.orchestra.run.smithi083.stderr: 34100K .......... .......... .......... .......... .......... 20% 26.7M 5s 2024-03-30T13:09:43.676 INFO:teuthology.orchestra.run.smithi083.stderr: 34150K .......... .......... .......... .......... .......... 20% 25.4M 5s 2024-03-30T13:09:43.678 INFO:teuthology.orchestra.run.smithi083.stderr: 34200K .......... .......... .......... .......... .......... 20% 26.3M 5s 2024-03-30T13:09:43.680 INFO:teuthology.orchestra.run.smithi083.stderr: 34250K .......... .......... .......... .......... .......... 20% 22.5M 5s 2024-03-30T13:09:43.682 INFO:teuthology.orchestra.run.smithi083.stderr: 34300K .......... .......... .......... .......... .......... 20% 25.7M 5s 2024-03-30T13:09:43.684 INFO:teuthology.orchestra.run.smithi083.stderr: 34350K .......... .......... .......... .......... .......... 20% 24.5M 5s 2024-03-30T13:09:43.686 INFO:teuthology.orchestra.run.smithi083.stderr: 34400K .......... .......... .......... .......... .......... 20% 25.1M 5s 2024-03-30T13:09:43.688 INFO:teuthology.orchestra.run.smithi083.stderr: 34450K .......... .......... .......... .......... .......... 20% 21.1M 5s 2024-03-30T13:09:43.690 INFO:teuthology.orchestra.run.smithi083.stderr: 34500K .......... .......... .......... .......... .......... 20% 24.8M 5s 2024-03-30T13:09:43.692 INFO:teuthology.orchestra.run.smithi083.stderr: 34550K .......... .......... .......... .......... .......... 20% 25.2M 5s 2024-03-30T13:09:43.694 INFO:teuthology.orchestra.run.smithi083.stderr: 34600K .......... .......... .......... .......... .......... 20% 25.2M 5s 2024-03-30T13:09:43.696 INFO:teuthology.orchestra.run.smithi083.stderr: 34650K .......... .......... .......... .......... .......... 20% 27.3M 5s 2024-03-30T13:09:43.698 INFO:teuthology.orchestra.run.smithi083.stderr: 34700K .......... .......... .......... .......... .......... 20% 31.3M 5s 2024-03-30T13:09:43.699 INFO:teuthology.orchestra.run.smithi083.stderr: 34750K .......... .......... .......... .......... .......... 20% 29.0M 5s 2024-03-30T13:09:43.701 INFO:teuthology.orchestra.run.smithi083.stderr: 34800K .......... .......... .......... .......... .......... 20% 30.2M 5s 2024-03-30T13:09:43.703 INFO:teuthology.orchestra.run.smithi083.stderr: 34850K .......... .......... .......... .......... .......... 20% 24.9M 5s 2024-03-30T13:09:43.705 INFO:teuthology.orchestra.run.smithi083.stderr: 34900K .......... .......... .......... .......... .......... 20% 26.7M 5s 2024-03-30T13:09:43.706 INFO:teuthology.orchestra.run.smithi083.stderr: 34950K .......... .......... .......... .......... .......... 20% 25.5M 5s 2024-03-30T13:09:43.709 INFO:teuthology.orchestra.run.smithi083.stderr: 35000K .......... .......... .......... .......... .......... 20% 19.5M 5s 2024-03-30T13:09:43.710 INFO:teuthology.orchestra.run.smithi083.stderr: 35050K .......... .......... .......... .......... .......... 20% 33.1M 5s 2024-03-30T13:09:43.712 INFO:teuthology.orchestra.run.smithi083.stderr: 35100K .......... .......... .......... .......... .......... 20% 32.8M 5s 2024-03-30T13:09:43.713 INFO:teuthology.orchestra.run.smithi083.stderr: 35150K .......... .......... .......... .......... .......... 20% 30.7M 5s 2024-03-30T13:09:43.715 INFO:teuthology.orchestra.run.smithi083.stderr: 35200K .......... .......... .......... .......... .......... 20% 28.9M 5s 2024-03-30T13:09:43.717 INFO:teuthology.orchestra.run.smithi083.stderr: 35250K .......... .......... .......... .......... .......... 20% 25.4M 5s 2024-03-30T13:09:43.719 INFO:teuthology.orchestra.run.smithi083.stderr: 35300K .......... .......... .......... .......... .......... 20% 29.0M 5s 2024-03-30T13:09:43.720 INFO:teuthology.orchestra.run.smithi083.stderr: 35350K .......... .......... .......... .......... .......... 21% 26.6M 5s 2024-03-30T13:09:43.723 INFO:teuthology.orchestra.run.smithi083.stderr: 35400K .......... .......... .......... .......... .......... 21% 24.7M 5s 2024-03-30T13:09:43.725 INFO:teuthology.orchestra.run.smithi083.stderr: 35450K .......... .......... .......... .......... .......... 21% 22.1M 5s 2024-03-30T13:09:43.727 INFO:teuthology.orchestra.run.smithi083.stderr: 35500K .......... .......... .......... .......... .......... 21% 24.9M 5s 2024-03-30T13:09:43.729 INFO:teuthology.orchestra.run.smithi083.stderr: 35550K .......... .......... .......... .......... .......... 21% 24.7M 5s 2024-03-30T13:09:43.731 INFO:teuthology.orchestra.run.smithi083.stderr: 35600K .......... .......... .......... .......... .......... 21% 25.7M 5s 2024-03-30T13:09:43.732 INFO:teuthology.orchestra.run.smithi083.stderr: 35650K .......... .......... .......... .......... .......... 21% 30.1M 5s 2024-03-30T13:09:43.733 INFO:teuthology.orchestra.run.smithi083.stderr: 35700K .......... .......... .......... .......... .......... 21% 39.5M 5s 2024-03-30T13:09:43.735 INFO:teuthology.orchestra.run.smithi083.stderr: 35750K .......... .......... .......... .......... .......... 21% 38.4M 5s 2024-03-30T13:09:43.736 INFO:teuthology.orchestra.run.smithi083.stderr: 35800K .......... .......... .......... .......... .......... 21% 39.3M 5s 2024-03-30T13:09:43.737 INFO:teuthology.orchestra.run.smithi083.stderr: 35850K .......... .......... .......... .......... .......... 21% 32.5M 5s 2024-03-30T13:09:43.739 INFO:teuthology.orchestra.run.smithi083.stderr: 35900K .......... .......... .......... .......... .......... 21% 37.1M 5s 2024-03-30T13:09:43.740 INFO:teuthology.orchestra.run.smithi083.stderr: 35950K .......... .......... .......... .......... .......... 21% 40.3M 5s 2024-03-30T13:09:43.741 INFO:teuthology.orchestra.run.smithi083.stderr: 36000K .......... .......... .......... .......... .......... 21% 39.5M 5s 2024-03-30T13:09:43.742 INFO:teuthology.orchestra.run.smithi083.stderr: 36050K .......... .......... .......... .......... .......... 21% 33.9M 5s 2024-03-30T13:09:43.744 INFO:teuthology.orchestra.run.smithi083.stderr: 36100K .......... .......... .......... .......... .......... 21% 38.8M 5s 2024-03-30T13:09:43.745 INFO:teuthology.orchestra.run.smithi083.stderr: 36150K .......... .......... .......... .......... .......... 21% 36.4M 5s 2024-03-30T13:09:43.746 INFO:teuthology.orchestra.run.smithi083.stderr: 36200K .......... .......... .......... .......... .......... 21% 36.4M 5s 2024-03-30T13:09:43.748 INFO:teuthology.orchestra.run.smithi083.stderr: 36250K .......... .......... .......... .......... .......... 21% 31.3M 5s 2024-03-30T13:09:43.749 INFO:teuthology.orchestra.run.smithi083.stderr: 36300K .......... .......... .......... .......... .......... 21% 36.5M 5s 2024-03-30T13:09:43.751 INFO:teuthology.orchestra.run.smithi083.stderr: 36350K .......... .......... .......... .......... .......... 21% 36.3M 5s 2024-03-30T13:09:43.753 INFO:teuthology.orchestra.run.smithi083.stderr: 36400K .......... .......... .......... .......... .......... 21% 25.2M 5s 2024-03-30T13:09:43.756 INFO:teuthology.orchestra.run.smithi083.stderr: 36450K .......... .......... .......... .......... .......... 21% 20.7M 5s 2024-03-30T13:09:43.757 INFO:teuthology.orchestra.run.smithi083.stderr: 36500K .......... .......... .......... .......... .......... 21% 31.7M 5s 2024-03-30T13:09:43.758 INFO:teuthology.orchestra.run.smithi083.stderr: 36550K .......... .......... .......... .......... .......... 21% 32.0M 5s 2024-03-30T13:09:43.760 INFO:teuthology.orchestra.run.smithi083.stderr: 36600K .......... .......... .......... .......... .......... 21% 32.8M 5s 2024-03-30T13:09:43.762 INFO:teuthology.orchestra.run.smithi083.stderr: 36650K .......... .......... .......... .......... .......... 21% 27.6M 5s 2024-03-30T13:09:43.763 INFO:teuthology.orchestra.run.smithi083.stderr: 36700K .......... .......... .......... .......... .......... 21% 31.3M 5s 2024-03-30T13:09:43.765 INFO:teuthology.orchestra.run.smithi083.stderr: 36750K .......... .......... .......... .......... .......... 21% 31.3M 5s 2024-03-30T13:09:43.766 INFO:teuthology.orchestra.run.smithi083.stderr: 36800K .......... .......... .......... .......... .......... 21% 30.7M 5s 2024-03-30T13:09:43.768 INFO:teuthology.orchestra.run.smithi083.stderr: 36850K .......... .......... .......... .......... .......... 21% 25.8M 5s 2024-03-30T13:09:43.769 INFO:teuthology.orchestra.run.smithi083.stderr: 36900K .......... .......... .......... .......... .......... 21% 38.0M 5s 2024-03-30T13:09:43.771 INFO:teuthology.orchestra.run.smithi083.stderr: 36950K .......... .......... .......... .......... .......... 21% 36.8M 5s 2024-03-30T13:09:43.772 INFO:teuthology.orchestra.run.smithi083.stderr: 37000K .......... .......... .......... .......... .......... 21% 39.1M 5s 2024-03-30T13:09:43.774 INFO:teuthology.orchestra.run.smithi083.stderr: 37050K .......... .......... .......... .......... .......... 22% 31.5M 5s 2024-03-30T13:09:43.775 INFO:teuthology.orchestra.run.smithi083.stderr: 37100K .......... .......... .......... .......... .......... 22% 27.7M 5s 2024-03-30T13:09:43.777 INFO:teuthology.orchestra.run.smithi083.stderr: 37150K .......... .......... .......... .......... .......... 22% 28.8M 5s 2024-03-30T13:09:43.784 INFO:teuthology.orchestra.run.smithi083.stderr: 37200K .......... .......... .......... .......... .......... 22% 27.9M 5s 2024-03-30T13:09:43.784 INFO:teuthology.orchestra.run.smithi083.stderr: 37250K .......... .......... .......... .......... .......... 22% 23.8M 5s 2024-03-30T13:09:43.784 INFO:teuthology.orchestra.run.smithi083.stderr: 37300K .......... .......... .......... .......... .......... 22% 27.9M 5s 2024-03-30T13:09:43.785 INFO:teuthology.orchestra.run.smithi083.stderr: 37350K .......... .......... .......... .......... .......... 22% 28.1M 5s 2024-03-30T13:09:43.786 INFO:teuthology.orchestra.run.smithi083.stderr: 37400K .......... .......... .......... .......... .......... 22% 26.9M 5s 2024-03-30T13:09:43.788 INFO:teuthology.orchestra.run.smithi083.stderr: 37450K .......... .......... .......... .......... .......... 22% 24.1M 5s 2024-03-30T13:09:43.790 INFO:teuthology.orchestra.run.smithi083.stderr: 37500K .......... .......... .......... .......... .......... 22% 29.4M 5s 2024-03-30T13:09:43.792 INFO:teuthology.orchestra.run.smithi083.stderr: 37550K .......... .......... .......... .......... .......... 22% 27.5M 5s 2024-03-30T13:09:43.793 INFO:teuthology.orchestra.run.smithi083.stderr: 37600K .......... .......... .......... .......... .......... 22% 28.7M 5s 2024-03-30T13:09:43.795 INFO:teuthology.orchestra.run.smithi083.stderr: 37650K .......... .......... .......... .......... .......... 22% 21.6M 5s 2024-03-30T13:09:43.797 INFO:teuthology.orchestra.run.smithi083.stderr: 37700K .......... .......... .......... .......... .......... 22% 30.8M 5s 2024-03-30T13:09:43.799 INFO:teuthology.orchestra.run.smithi083.stderr: 37750K .......... .......... .......... .......... .......... 22% 31.3M 5s 2024-03-30T13:09:43.800 INFO:teuthology.orchestra.run.smithi083.stderr: 37800K .......... .......... .......... .......... .......... 22% 32.4M 5s 2024-03-30T13:09:43.802 INFO:teuthology.orchestra.run.smithi083.stderr: 37850K .......... .......... .......... .......... .......... 22% 27.4M 5s 2024-03-30T13:09:43.803 INFO:teuthology.orchestra.run.smithi083.stderr: 37900K .......... .......... .......... .......... .......... 22% 32.0M 5s 2024-03-30T13:09:43.805 INFO:teuthology.orchestra.run.smithi083.stderr: 37950K .......... .......... .......... .......... .......... 22% 24.9M 5s 2024-03-30T13:09:43.807 INFO:teuthology.orchestra.run.smithi083.stderr: 38000K .......... .......... .......... .......... .......... 22% 34.2M 5s 2024-03-30T13:09:43.808 INFO:teuthology.orchestra.run.smithi083.stderr: 38050K .......... .......... .......... .......... .......... 22% 29.7M 5s 2024-03-30T13:09:43.810 INFO:teuthology.orchestra.run.smithi083.stderr: 38100K .......... .......... .......... .......... .......... 22% 34.3M 5s 2024-03-30T13:09:43.811 INFO:teuthology.orchestra.run.smithi083.stderr: 38150K .......... .......... .......... .......... .......... 22% 32.9M 5s 2024-03-30T13:09:43.813 INFO:teuthology.orchestra.run.smithi083.stderr: 38200K .......... .......... .......... .......... .......... 22% 33.1M 5s 2024-03-30T13:09:43.815 INFO:teuthology.orchestra.run.smithi083.stderr: 38250K .......... .......... .......... .......... .......... 22% 28.3M 5s 2024-03-30T13:09:43.816 INFO:teuthology.orchestra.run.smithi083.stderr: 38300K .......... .......... .......... .......... .......... 22% 34.2M 5s 2024-03-30T13:09:43.817 INFO:teuthology.orchestra.run.smithi083.stderr: 38350K .......... .......... .......... .......... .......... 22% 33.2M 5s 2024-03-30T13:09:43.819 INFO:teuthology.orchestra.run.smithi083.stderr: 38400K .......... .......... .......... .......... .......... 22% 31.7M 5s 2024-03-30T13:09:43.821 INFO:teuthology.orchestra.run.smithi083.stderr: 38450K .......... .......... .......... .......... .......... 22% 28.0M 5s 2024-03-30T13:09:43.822 INFO:teuthology.orchestra.run.smithi083.stderr: 38500K .......... .......... .......... .......... .......... 22% 31.6M 5s 2024-03-30T13:09:43.824 INFO:teuthology.orchestra.run.smithi083.stderr: 38550K .......... .......... .......... .......... .......... 22% 31.5M 5s 2024-03-30T13:09:43.826 INFO:teuthology.orchestra.run.smithi083.stderr: 38600K .......... .......... .......... .......... .......... 22% 31.5M 5s 2024-03-30T13:09:43.827 INFO:teuthology.orchestra.run.smithi083.stderr: 38650K .......... .......... .......... .......... .......... 22% 26.6M 5s 2024-03-30T13:09:43.829 INFO:teuthology.orchestra.run.smithi083.stderr: 38700K .......... .......... .......... .......... .......... 22% 32.2M 5s 2024-03-30T13:09:43.830 INFO:teuthology.orchestra.run.smithi083.stderr: 38750K .......... .......... .......... .......... .......... 23% 30.1M 5s 2024-03-30T13:09:43.832 INFO:teuthology.orchestra.run.smithi083.stderr: 38800K .......... .......... .......... .......... .......... 23% 31.4M 5s 2024-03-30T13:09:43.834 INFO:teuthology.orchestra.run.smithi083.stderr: 38850K .......... .......... .......... .......... .......... 23% 27.1M 5s 2024-03-30T13:09:43.835 INFO:teuthology.orchestra.run.smithi083.stderr: 38900K .......... .......... .......... .......... .......... 23% 31.2M 5s 2024-03-30T13:09:43.837 INFO:teuthology.orchestra.run.smithi083.stderr: 38950K .......... .......... .......... .......... .......... 23% 30.0M 5s 2024-03-30T13:09:43.839 INFO:teuthology.orchestra.run.smithi083.stderr: 39000K .......... .......... .......... .......... .......... 23% 29.7M 5s 2024-03-30T13:09:43.841 INFO:teuthology.orchestra.run.smithi083.stderr: 39050K .......... .......... .......... .......... .......... 23% 26.7M 5s 2024-03-30T13:09:43.843 INFO:teuthology.orchestra.run.smithi083.stderr: 39100K .......... .......... .......... .......... .......... 23% 19.0M 5s 2024-03-30T13:09:43.845 INFO:teuthology.orchestra.run.smithi083.stderr: 39150K .......... .......... .......... .......... .......... 23% 33.0M 5s 2024-03-30T13:09:43.846 INFO:teuthology.orchestra.run.smithi083.stderr: 39200K .......... .......... .......... .......... .......... 23% 32.8M 5s 2024-03-30T13:09:43.848 INFO:teuthology.orchestra.run.smithi083.stderr: 39250K .......... .......... .......... .......... .......... 23% 29.3M 5s 2024-03-30T13:09:43.849 INFO:teuthology.orchestra.run.smithi083.stderr: 39300K .......... .......... .......... .......... .......... 23% 33.1M 5s 2024-03-30T13:09:43.851 INFO:teuthology.orchestra.run.smithi083.stderr: 39350K .......... .......... .......... .......... .......... 23% 32.3M 5s 2024-03-30T13:09:43.852 INFO:teuthology.orchestra.run.smithi083.stderr: 39400K .......... .......... .......... .......... .......... 23% 32.0M 5s 2024-03-30T13:09:43.854 INFO:teuthology.orchestra.run.smithi083.stderr: 39450K .......... .......... .......... .......... .......... 23% 28.6M 5s 2024-03-30T13:09:43.856 INFO:teuthology.orchestra.run.smithi083.stderr: 39500K .......... .......... .......... .......... .......... 23% 30.3M 5s 2024-03-30T13:09:43.857 INFO:teuthology.orchestra.run.smithi083.stderr: 39550K .......... .......... .......... .......... .......... 23% 32.1M 5s 2024-03-30T13:09:43.859 INFO:teuthology.orchestra.run.smithi083.stderr: 39600K .......... .......... .......... .......... .......... 23% 31.7M 5s 2024-03-30T13:09:43.860 INFO:teuthology.orchestra.run.smithi083.stderr: 39650K .......... .......... .......... .......... .......... 23% 28.7M 5s 2024-03-30T13:09:43.862 INFO:teuthology.orchestra.run.smithi083.stderr: 39700K .......... .......... .......... .......... .......... 23% 33.3M 5s 2024-03-30T13:09:43.863 INFO:teuthology.orchestra.run.smithi083.stderr: 39750K .......... .......... .......... .......... .......... 23% 32.5M 5s 2024-03-30T13:09:43.865 INFO:teuthology.orchestra.run.smithi083.stderr: 39800K .......... .......... .......... .......... .......... 23% 31.8M 5s 2024-03-30T13:09:43.867 INFO:teuthology.orchestra.run.smithi083.stderr: 39850K .......... .......... .......... .......... .......... 23% 27.0M 5s 2024-03-30T13:09:43.868 INFO:teuthology.orchestra.run.smithi083.stderr: 39900K .......... .......... .......... .......... .......... 23% 34.3M 5s 2024-03-30T13:09:43.869 INFO:teuthology.orchestra.run.smithi083.stderr: 39950K .......... .......... .......... .......... .......... 23% 38.1M 5s 2024-03-30T13:09:43.871 INFO:teuthology.orchestra.run.smithi083.stderr: 40000K .......... .......... .......... .......... .......... 23% 38.2M 5s 2024-03-30T13:09:43.872 INFO:teuthology.orchestra.run.smithi083.stderr: 40050K .......... .......... .......... .......... .......... 23% 32.8M 5s 2024-03-30T13:09:43.873 INFO:teuthology.orchestra.run.smithi083.stderr: 40100K .......... .......... .......... .......... .......... 23% 38.3M 5s 2024-03-30T13:09:43.874 INFO:teuthology.orchestra.run.smithi083.stderr: 40150K .......... .......... .......... .......... .......... 23% 37.3M 5s 2024-03-30T13:09:43.876 INFO:teuthology.orchestra.run.smithi083.stderr: 40200K .......... .......... .......... .......... .......... 23% 36.9M 5s 2024-03-30T13:09:43.878 INFO:teuthology.orchestra.run.smithi083.stderr: 40250K .......... .......... .......... .......... .......... 23% 27.2M 5s 2024-03-30T13:09:43.879 INFO:teuthology.orchestra.run.smithi083.stderr: 40300K .......... .......... .......... .......... .......... 23% 36.2M 5s 2024-03-30T13:09:43.881 INFO:teuthology.orchestra.run.smithi083.stderr: 40350K .......... .......... .......... .......... .......... 23% 35.5M 5s 2024-03-30T13:09:43.882 INFO:teuthology.orchestra.run.smithi083.stderr: 40400K .......... .......... .......... .......... .......... 23% 34.2M 5s 2024-03-30T13:09:43.884 INFO:teuthology.orchestra.run.smithi083.stderr: 40450K .......... .......... .......... .......... .......... 24% 27.2M 5s 2024-03-30T13:09:43.886 INFO:teuthology.orchestra.run.smithi083.stderr: 40500K .......... .......... .......... .......... .......... 24% 25.0M 5s 2024-03-30T13:09:43.887 INFO:teuthology.orchestra.run.smithi083.stderr: 40550K .......... .......... .......... .......... .......... 24% 28.3M 5s 2024-03-30T13:09:43.889 INFO:teuthology.orchestra.run.smithi083.stderr: 40600K .......... .......... .......... .......... .......... 24% 28.2M 5s 2024-03-30T13:09:43.891 INFO:teuthology.orchestra.run.smithi083.stderr: 40650K .......... .......... .......... .......... .......... 24% 24.0M 5s 2024-03-30T13:09:43.893 INFO:teuthology.orchestra.run.smithi083.stderr: 40700K .......... .......... .......... .......... .......... 24% 28.4M 5s 2024-03-30T13:09:43.895 INFO:teuthology.orchestra.run.smithi083.stderr: 40750K .......... .......... .......... .......... .......... 24% 27.5M 5s 2024-03-30T13:09:43.896 INFO:teuthology.orchestra.run.smithi083.stderr: 40800K .......... .......... .......... .......... .......... 24% 30.2M 5s 2024-03-30T13:09:43.898 INFO:teuthology.orchestra.run.smithi083.stderr: 40850K .......... .......... .......... .......... .......... 24% 25.8M 5s 2024-03-30T13:09:43.900 INFO:teuthology.orchestra.run.smithi083.stderr: 40900K .......... .......... .......... .......... .......... 24% 28.3M 5s 2024-03-30T13:09:43.902 INFO:teuthology.orchestra.run.smithi083.stderr: 40950K .......... .......... .......... .......... .......... 24% 28.8M 5s 2024-03-30T13:09:43.903 INFO:teuthology.orchestra.run.smithi083.stderr: 41000K .......... .......... .......... .......... .......... 24% 28.6M 5s 2024-03-30T13:09:43.905 INFO:teuthology.orchestra.run.smithi083.stderr: 41050K .......... .......... .......... .......... .......... 24% 25.8M 5s 2024-03-30T13:09:43.906 INFO:teuthology.orchestra.run.smithi083.stderr: 41100K .......... .......... .......... .......... .......... 24% 38.1M 5s 2024-03-30T13:09:43.908 INFO:teuthology.orchestra.run.smithi083.stderr: 41150K .......... .......... .......... .......... .......... 24% 37.8M 5s 2024-03-30T13:09:43.909 INFO:teuthology.orchestra.run.smithi083.stderr: 41200K .......... .......... .......... .......... .......... 24% 38.6M 5s 2024-03-30T13:09:43.910 INFO:teuthology.orchestra.run.smithi083.stderr: 41250K .......... .......... .......... .......... .......... 24% 35.5M 5s 2024-03-30T13:09:43.912 INFO:teuthology.orchestra.run.smithi083.stderr: 41300K .......... .......... .......... .......... .......... 24% 40.6M 5s 2024-03-30T13:09:43.913 INFO:teuthology.orchestra.run.smithi083.stderr: 41350K .......... .......... .......... .......... .......... 24% 40.1M 5s 2024-03-30T13:09:43.914 INFO:teuthology.orchestra.run.smithi083.stderr: 41400K .......... .......... .......... .......... .......... 24% 29.7M 5s 2024-03-30T13:09:43.916 INFO:teuthology.orchestra.run.smithi083.stderr: 41450K .......... .......... .......... .......... .......... 24% 22.8M 5s 2024-03-30T13:09:43.918 INFO:teuthology.orchestra.run.smithi083.stderr: 41500K .......... .......... .......... .......... .......... 24% 29.5M 5s 2024-03-30T13:09:43.920 INFO:teuthology.orchestra.run.smithi083.stderr: 41550K .......... .......... .......... .......... .......... 24% 32.2M 5s 2024-03-30T13:09:43.921 INFO:teuthology.orchestra.run.smithi083.stderr: 41600K .......... .......... .......... .......... .......... 24% 39.8M 5s 2024-03-30T13:09:43.923 INFO:teuthology.orchestra.run.smithi083.stderr: 41650K .......... .......... .......... .......... .......... 24% 31.4M 5s 2024-03-30T13:09:43.924 INFO:teuthology.orchestra.run.smithi083.stderr: 41700K .......... .......... .......... .......... .......... 24% 38.3M 5s 2024-03-30T13:09:43.925 INFO:teuthology.orchestra.run.smithi083.stderr: 41750K .......... .......... .......... .......... .......... 24% 36.9M 5s 2024-03-30T13:09:43.927 INFO:teuthology.orchestra.run.smithi083.stderr: 41800K .......... .......... .......... .......... .......... 24% 34.6M 5s 2024-03-30T13:09:43.928 INFO:teuthology.orchestra.run.smithi083.stderr: 41850K .......... .......... .......... .......... .......... 24% 30.5M 5s 2024-03-30T13:09:43.930 INFO:teuthology.orchestra.run.smithi083.stderr: 41900K .......... .......... .......... .......... .......... 24% 31.6M 5s 2024-03-30T13:09:43.931 INFO:teuthology.orchestra.run.smithi083.stderr: 41950K .......... .......... .......... .......... .......... 24% 30.6M 5s 2024-03-30T13:09:43.933 INFO:teuthology.orchestra.run.smithi083.stderr: 42000K .......... .......... .......... .......... .......... 24% 31.1M 5s 2024-03-30T13:09:43.935 INFO:teuthology.orchestra.run.smithi083.stderr: 42050K .......... .......... .......... .......... .......... 24% 22.3M 5s 2024-03-30T13:09:43.936 INFO:teuthology.orchestra.run.smithi083.stderr: 42100K .......... .......... .......... .......... .......... 25% 33.7M 5s 2024-03-30T13:09:43.938 INFO:teuthology.orchestra.run.smithi083.stderr: 42150K .......... .......... .......... .......... .......... 25% 35.3M 5s 2024-03-30T13:09:43.939 INFO:teuthology.orchestra.run.smithi083.stderr: 42200K .......... .......... .......... .......... .......... 25% 34.6M 5s 2024-03-30T13:09:43.941 INFO:teuthology.orchestra.run.smithi083.stderr: 42250K .......... .......... .......... .......... .......... 25% 30.1M 5s 2024-03-30T13:09:43.942 INFO:teuthology.orchestra.run.smithi083.stderr: 42300K .......... .......... .......... .......... .......... 25% 33.5M 5s 2024-03-30T13:09:43.944 INFO:teuthology.orchestra.run.smithi083.stderr: 42350K .......... .......... .......... .......... .......... 25% 34.7M 5s 2024-03-30T13:09:43.945 INFO:teuthology.orchestra.run.smithi083.stderr: 42400K .......... .......... .......... .......... .......... 25% 33.8M 5s 2024-03-30T13:09:43.947 INFO:teuthology.orchestra.run.smithi083.stderr: 42450K .......... .......... .......... .......... .......... 25% 28.3M 5s 2024-03-30T13:09:43.948 INFO:teuthology.orchestra.run.smithi083.stderr: 42500K .......... .......... .......... .......... .......... 25% 34.3M 5s 2024-03-30T13:09:43.950 INFO:teuthology.orchestra.run.smithi083.stderr: 42550K .......... .......... .......... .......... .......... 25% 34.8M 5s 2024-03-30T13:09:43.951 INFO:teuthology.orchestra.run.smithi083.stderr: 42600K .......... .......... .......... .......... .......... 25% 32.4M 5s 2024-03-30T13:09:43.953 INFO:teuthology.orchestra.run.smithi083.stderr: 42650K .......... .......... .......... .......... .......... 25% 26.8M 5s 2024-03-30T13:09:43.955 INFO:teuthology.orchestra.run.smithi083.stderr: 42700K .......... .......... .......... .......... .......... 25% 31.8M 5s 2024-03-30T13:09:43.956 INFO:teuthology.orchestra.run.smithi083.stderr: 42750K .......... .......... .......... .......... .......... 25% 31.7M 5s 2024-03-30T13:09:43.958 INFO:teuthology.orchestra.run.smithi083.stderr: 42800K .......... .......... .......... .......... .......... 25% 29.9M 5s 2024-03-30T13:09:43.960 INFO:teuthology.orchestra.run.smithi083.stderr: 42850K .......... .......... .......... .......... .......... 25% 25.4M 5s 2024-03-30T13:09:43.961 INFO:teuthology.orchestra.run.smithi083.stderr: 42900K .......... .......... .......... .......... .......... 25% 29.7M 5s 2024-03-30T13:09:43.963 INFO:teuthology.orchestra.run.smithi083.stderr: 42950K .......... .......... .......... .......... .......... 25% 29.8M 5s 2024-03-30T13:09:43.965 INFO:teuthology.orchestra.run.smithi083.stderr: 43000K .......... .......... .......... .......... .......... 25% 30.1M 5s 2024-03-30T13:09:43.967 INFO:teuthology.orchestra.run.smithi083.stderr: 43050K .......... .......... .......... .......... .......... 25% 24.8M 5s 2024-03-30T13:09:43.968 INFO:teuthology.orchestra.run.smithi083.stderr: 43100K .......... .......... .......... .......... .......... 25% 29.4M 5s 2024-03-30T13:09:43.971 INFO:teuthology.orchestra.run.smithi083.stderr: 43150K .......... .......... .......... .......... .......... 25% 29.9M 5s 2024-03-30T13:09:43.973 INFO:teuthology.orchestra.run.smithi083.stderr: 43200K .......... .......... .......... .......... .......... 25% 18.1M 5s 2024-03-30T13:09:43.974 INFO:teuthology.orchestra.run.smithi083.stderr: 43250K .......... .......... .......... .......... .......... 25% 26.6M 5s 2024-03-30T13:09:43.976 INFO:teuthology.orchestra.run.smithi083.stderr: 43300K .......... .......... .......... .......... .......... 25% 30.5M 5s 2024-03-30T13:09:43.978 INFO:teuthology.orchestra.run.smithi083.stderr: 43350K .......... .......... .......... .......... .......... 25% 30.3M 5s 2024-03-30T13:09:43.979 INFO:teuthology.orchestra.run.smithi083.stderr: 43400K .......... .......... .......... .......... .......... 25% 29.3M 5s 2024-03-30T13:09:43.981 INFO:teuthology.orchestra.run.smithi083.stderr: 43450K .......... .......... .......... .......... .......... 25% 26.6M 5s 2024-03-30T13:09:43.983 INFO:teuthology.orchestra.run.smithi083.stderr: 43500K .......... .......... .......... .......... .......... 25% 29.9M 5s 2024-03-30T13:09:43.984 INFO:teuthology.orchestra.run.smithi083.stderr: 43550K .......... .......... .......... .......... .......... 25% 28.7M 5s 2024-03-30T13:09:43.986 INFO:teuthology.orchestra.run.smithi083.stderr: 43600K .......... .......... .......... .......... .......... 25% 28.2M 5s 2024-03-30T13:09:43.988 INFO:teuthology.orchestra.run.smithi083.stderr: 43650K .......... .......... .......... .......... .......... 25% 29.1M 5s 2024-03-30T13:09:43.989 INFO:teuthology.orchestra.run.smithi083.stderr: 43700K .......... .......... .......... .......... .......... 25% 31.4M 5s 2024-03-30T13:09:43.991 INFO:teuthology.orchestra.run.smithi083.stderr: 43750K .......... .......... .......... .......... .......... 25% 28.6M 5s 2024-03-30T13:09:43.993 INFO:teuthology.orchestra.run.smithi083.stderr: 43800K .......... .......... .......... .......... .......... 26% 29.9M 5s 2024-03-30T13:09:43.995 INFO:teuthology.orchestra.run.smithi083.stderr: 43850K .......... .......... .......... .......... .......... 26% 25.7M 5s 2024-03-30T13:09:43.997 INFO:teuthology.orchestra.run.smithi083.stderr: 43900K .......... .......... .......... .......... .......... 26% 28.6M 5s 2024-03-30T13:09:43.998 INFO:teuthology.orchestra.run.smithi083.stderr: 43950K .......... .......... .......... .......... .......... 26% 28.6M 5s 2024-03-30T13:09:44.000 INFO:teuthology.orchestra.run.smithi083.stderr: 44000K .......... .......... .......... .......... .......... 26% 28.7M 5s 2024-03-30T13:09:44.002 INFO:teuthology.orchestra.run.smithi083.stderr: 44050K .......... .......... .......... .......... .......... 26% 24.4M 5s 2024-03-30T13:09:44.004 INFO:teuthology.orchestra.run.smithi083.stderr: 44100K .......... .......... .......... .......... .......... 26% 25.1M 5s 2024-03-30T13:09:44.006 INFO:teuthology.orchestra.run.smithi083.stderr: 44150K .......... .......... .......... .......... .......... 26% 26.2M 5s 2024-03-30T13:09:44.007 INFO:teuthology.orchestra.run.smithi083.stderr: 44200K .......... .......... .......... .......... .......... 26% 26.0M 5s 2024-03-30T13:09:44.010 INFO:teuthology.orchestra.run.smithi083.stderr: 44250K .......... .......... .......... .......... .......... 26% 22.2M 5s 2024-03-30T13:09:44.012 INFO:teuthology.orchestra.run.smithi083.stderr: 44300K .......... .......... .......... .......... .......... 26% 25.1M 5s 2024-03-30T13:09:44.014 INFO:teuthology.orchestra.run.smithi083.stderr: 44350K .......... .......... .......... .......... .......... 26% 25.7M 5s 2024-03-30T13:09:44.015 INFO:teuthology.orchestra.run.smithi083.stderr: 44400K .......... .......... .......... .......... .......... 26% 25.9M 5s 2024-03-30T13:09:44.018 INFO:teuthology.orchestra.run.smithi083.stderr: 44450K .......... .......... .......... .......... .......... 26% 22.9M 5s 2024-03-30T13:09:44.019 INFO:teuthology.orchestra.run.smithi083.stderr: 44500K .......... .......... .......... .......... .......... 26% 24.9M 5s 2024-03-30T13:09:44.021 INFO:teuthology.orchestra.run.smithi083.stderr: 44550K .......... .......... .......... .......... .......... 26% 26.5M 5s 2024-03-30T13:09:44.023 INFO:teuthology.orchestra.run.smithi083.stderr: 44600K .......... .......... .......... .......... .......... 26% 25.6M 5s 2024-03-30T13:09:44.025 INFO:teuthology.orchestra.run.smithi083.stderr: 44650K .......... .......... .......... .......... .......... 26% 21.9M 5s 2024-03-30T13:09:44.027 INFO:teuthology.orchestra.run.smithi083.stderr: 44700K .......... .......... .......... .......... .......... 26% 29.8M 5s 2024-03-30T13:09:44.029 INFO:teuthology.orchestra.run.smithi083.stderr: 44750K .......... .......... .......... .......... .......... 26% 29.8M 5s 2024-03-30T13:09:44.030 INFO:teuthology.orchestra.run.smithi083.stderr: 44800K .......... .......... .......... .......... .......... 26% 29.8M 5s 2024-03-30T13:09:44.032 INFO:teuthology.orchestra.run.smithi083.stderr: 44850K .......... .......... .......... .......... .......... 26% 24.9M 5s 2024-03-30T13:09:44.034 INFO:teuthology.orchestra.run.smithi083.stderr: 44900K .......... .......... .......... .......... .......... 26% 29.1M 5s 2024-03-30T13:09:44.036 INFO:teuthology.orchestra.run.smithi083.stderr: 44950K .......... .......... .......... .......... .......... 26% 29.6M 5s 2024-03-30T13:09:44.037 INFO:teuthology.orchestra.run.smithi083.stderr: 45000K .......... .......... .......... .......... .......... 26% 29.8M 5s 2024-03-30T13:09:44.040 INFO:teuthology.orchestra.run.smithi083.stderr: 45050K .......... .......... .......... .......... .......... 26% 21.0M 5s 2024-03-30T13:09:44.042 INFO:teuthology.orchestra.run.smithi083.stderr: 45100K .......... .......... .......... .......... .......... 26% 25.5M 5s 2024-03-30T13:09:44.044 INFO:teuthology.orchestra.run.smithi083.stderr: 45150K .......... .......... .......... .......... .......... 26% 22.0M 5s 2024-03-30T13:09:44.046 INFO:teuthology.orchestra.run.smithi083.stderr: 45200K .......... .......... .......... .......... .......... 26% 28.5M 5s 2024-03-30T13:09:44.048 INFO:teuthology.orchestra.run.smithi083.stderr: 45250K .......... .......... .......... .......... .......... 26% 25.0M 5s 2024-03-30T13:09:44.049 INFO:teuthology.orchestra.run.smithi083.stderr: 45300K .......... .......... .......... .......... .......... 26% 28.0M 5s 2024-03-30T13:09:44.051 INFO:teuthology.orchestra.run.smithi083.stderr: 45350K .......... .......... .......... .......... .......... 26% 32.4M 5s 2024-03-30T13:09:44.055 INFO:teuthology.orchestra.run.smithi083.stderr: 45400K .......... .......... .......... .......... .......... 26% 36.0M 5s 2024-03-30T13:09:44.055 INFO:teuthology.orchestra.run.smithi083.stderr: 45450K .......... .......... .......... .......... .......... 26% 31.1M 5s 2024-03-30T13:09:44.055 INFO:teuthology.orchestra.run.smithi083.stderr: 45500K .......... .......... .......... .......... .......... 27% 35.2M 5s 2024-03-30T13:09:44.057 INFO:teuthology.orchestra.run.smithi083.stderr: 45550K .......... .......... .......... .......... .......... 27% 29.8M 5s 2024-03-30T13:09:44.058 INFO:teuthology.orchestra.run.smithi083.stderr: 45600K .......... .......... .......... .......... .......... 27% 37.0M 5s 2024-03-30T13:09:44.059 INFO:teuthology.orchestra.run.smithi083.stderr: 45650K .......... .......... .......... .......... .......... 27% 30.3M 5s 2024-03-30T13:09:44.061 INFO:teuthology.orchestra.run.smithi083.stderr: 45700K .......... .......... .......... .......... .......... 27% 31.4M 5s 2024-03-30T13:09:44.063 INFO:teuthology.orchestra.run.smithi083.stderr: 45750K .......... .......... .......... .......... .......... 27% 31.0M 5s 2024-03-30T13:09:44.064 INFO:teuthology.orchestra.run.smithi083.stderr: 45800K .......... .......... .......... .......... .......... 27% 26.9M 5s 2024-03-30T13:09:44.067 INFO:teuthology.orchestra.run.smithi083.stderr: 45850K .......... .......... .......... .......... .......... 27% 23.5M 5s 2024-03-30T13:09:44.068 INFO:teuthology.orchestra.run.smithi083.stderr: 45900K .......... .......... .......... .......... .......... 27% 27.4M 5s 2024-03-30T13:09:44.070 INFO:teuthology.orchestra.run.smithi083.stderr: 45950K .......... .......... .......... .......... .......... 27% 26.9M 5s 2024-03-30T13:09:44.072 INFO:teuthology.orchestra.run.smithi083.stderr: 46000K .......... .......... .......... .......... .......... 27% 27.4M 5s 2024-03-30T13:09:44.074 INFO:teuthology.orchestra.run.smithi083.stderr: 46050K .......... .......... .......... .......... .......... 27% 23.3M 5s 2024-03-30T13:09:44.077 INFO:teuthology.orchestra.run.smithi083.stderr: 46100K .......... .......... .......... .......... .......... 27% 25.7M 5s 2024-03-30T13:09:44.078 INFO:teuthology.orchestra.run.smithi083.stderr: 46150K .......... .......... .......... .......... .......... 27% 20.2M 5s 2024-03-30T13:09:44.080 INFO:teuthology.orchestra.run.smithi083.stderr: 46200K .......... .......... .......... .......... .......... 27% 27.7M 5s 2024-03-30T13:09:44.082 INFO:teuthology.orchestra.run.smithi083.stderr: 46250K .......... .......... .......... .......... .......... 27% 24.0M 5s 2024-03-30T13:09:44.084 INFO:teuthology.orchestra.run.smithi083.stderr: 46300K .......... .......... .......... .......... .......... 27% 36.2M 5s 2024-03-30T13:09:44.085 INFO:teuthology.orchestra.run.smithi083.stderr: 46350K .......... .......... .......... .......... .......... 27% 35.3M 5s 2024-03-30T13:09:44.087 INFO:teuthology.orchestra.run.smithi083.stderr: 46400K .......... .......... .......... .......... .......... 27% 30.8M 5s 2024-03-30T13:09:44.088 INFO:teuthology.orchestra.run.smithi083.stderr: 46450K .......... .......... .......... .......... .......... 27% 26.8M 5s 2024-03-30T13:09:44.090 INFO:teuthology.orchestra.run.smithi083.stderr: 46500K .......... .......... .......... .......... .......... 27% 30.9M 5s 2024-03-30T13:09:44.092 INFO:teuthology.orchestra.run.smithi083.stderr: 46550K .......... .......... .......... .......... .......... 27% 30.4M 5s 2024-03-30T13:09:44.093 INFO:teuthology.orchestra.run.smithi083.stderr: 46600K .......... .......... .......... .......... .......... 27% 30.4M 5s 2024-03-30T13:09:44.095 INFO:teuthology.orchestra.run.smithi083.stderr: 46650K .......... .......... .......... .......... .......... 27% 25.0M 5s 2024-03-30T13:09:44.097 INFO:teuthology.orchestra.run.smithi083.stderr: 46700K .......... .......... .......... .......... .......... 27% 30.0M 5s 2024-03-30T13:09:44.098 INFO:teuthology.orchestra.run.smithi083.stderr: 46750K .......... .......... .......... .......... .......... 27% 29.3M 5s 2024-03-30T13:09:44.100 INFO:teuthology.orchestra.run.smithi083.stderr: 46800K .......... .......... .......... .......... .......... 27% 29.9M 5s 2024-03-30T13:09:44.102 INFO:teuthology.orchestra.run.smithi083.stderr: 46850K .......... .......... .......... .......... .......... 27% 24.9M 5s 2024-03-30T13:09:44.104 INFO:teuthology.orchestra.run.smithi083.stderr: 46900K .......... .......... .......... .......... .......... 27% 29.3M 5s 2024-03-30T13:09:44.105 INFO:teuthology.orchestra.run.smithi083.stderr: 46950K .......... .......... .......... .......... .......... 27% 29.0M 5s 2024-03-30T13:09:44.107 INFO:teuthology.orchestra.run.smithi083.stderr: 47000K .......... .......... .......... .......... .......... 27% 28.9M 5s 2024-03-30T13:09:44.109 INFO:teuthology.orchestra.run.smithi083.stderr: 47050K .......... .......... .......... .......... .......... 27% 25.8M 5s 2024-03-30T13:09:44.111 INFO:teuthology.orchestra.run.smithi083.stderr: 47100K .......... .......... .......... .......... .......... 27% 29.6M 5s 2024-03-30T13:09:44.112 INFO:teuthology.orchestra.run.smithi083.stderr: 47150K .......... .......... .......... .......... .......... 28% 30.0M 5s 2024-03-30T13:09:44.114 INFO:teuthology.orchestra.run.smithi083.stderr: 47200K .......... .......... .......... .......... .......... 28% 29.4M 5s 2024-03-30T13:09:44.117 INFO:teuthology.orchestra.run.smithi083.stderr: 47250K .......... .......... .......... .......... .......... 28% 16.1M 5s 2024-03-30T13:09:44.119 INFO:teuthology.orchestra.run.smithi083.stderr: 47300K .......... .......... .......... .......... .......... 28% 30.0M 5s 2024-03-30T13:09:44.120 INFO:teuthology.orchestra.run.smithi083.stderr: 47350K .......... .......... .......... .......... .......... 28% 30.3M 5s 2024-03-30T13:09:44.122 INFO:teuthology.orchestra.run.smithi083.stderr: 47400K .......... .......... .......... .......... .......... 28% 31.9M 5s 2024-03-30T13:09:44.124 INFO:teuthology.orchestra.run.smithi083.stderr: 47450K .......... .......... .......... .......... .......... 28% 26.6M 5s 2024-03-30T13:09:44.125 INFO:teuthology.orchestra.run.smithi083.stderr: 47500K .......... .......... .......... .......... .......... 28% 31.5M 5s 2024-03-30T13:09:44.127 INFO:teuthology.orchestra.run.smithi083.stderr: 47550K .......... .......... .......... .......... .......... 28% 30.9M 5s 2024-03-30T13:09:44.128 INFO:teuthology.orchestra.run.smithi083.stderr: 47600K .......... .......... .......... .......... .......... 28% 32.2M 5s 2024-03-30T13:09:44.130 INFO:teuthology.orchestra.run.smithi083.stderr: 47650K .......... .......... .......... .......... .......... 28% 27.0M 5s 2024-03-30T13:09:44.132 INFO:teuthology.orchestra.run.smithi083.stderr: 47700K .......... .......... .......... .......... .......... 28% 31.0M 5s 2024-03-30T13:09:44.133 INFO:teuthology.orchestra.run.smithi083.stderr: 47750K .......... .......... .......... .......... .......... 28% 32.9M 5s 2024-03-30T13:09:44.134 INFO:teuthology.orchestra.run.smithi083.stderr: 47800K .......... .......... .......... .......... .......... 28% 35.0M 5s 2024-03-30T13:09:44.136 INFO:teuthology.orchestra.run.smithi083.stderr: 47850K .......... .......... .......... .......... .......... 28% 30.3M 5s 2024-03-30T13:09:44.137 INFO:teuthology.orchestra.run.smithi083.stderr: 47900K .......... .......... .......... .......... .......... 28% 34.9M 5s 2024-03-30T13:09:44.139 INFO:teuthology.orchestra.run.smithi083.stderr: 47950K .......... .......... .......... .......... .......... 28% 34.7M 5s 2024-03-30T13:09:44.140 INFO:teuthology.orchestra.run.smithi083.stderr: 48000K .......... .......... .......... .......... .......... 28% 34.6M 5s 2024-03-30T13:09:44.142 INFO:teuthology.orchestra.run.smithi083.stderr: 48050K .......... .......... .......... .......... .......... 28% 29.7M 5s 2024-03-30T13:09:44.143 INFO:teuthology.orchestra.run.smithi083.stderr: 48100K .......... .......... .......... .......... .......... 28% 34.1M 5s 2024-03-30T13:09:44.145 INFO:teuthology.orchestra.run.smithi083.stderr: 48150K .......... .......... .......... .......... .......... 28% 34.2M 5s 2024-03-30T13:09:44.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48200K .......... .......... .......... .......... .......... 28% 33.1M 5s 2024-03-30T13:09:44.148 INFO:teuthology.orchestra.run.smithi083.stderr: 48250K .......... .......... .......... .......... .......... 28% 28.6M 5s 2024-03-30T13:09:44.149 INFO:teuthology.orchestra.run.smithi083.stderr: 48300K .......... .......... .......... .......... .......... 28% 33.8M 5s 2024-03-30T13:09:44.151 INFO:teuthology.orchestra.run.smithi083.stderr: 48350K .......... .......... .......... .......... .......... 28% 31.3M 5s 2024-03-30T13:09:44.152 INFO:teuthology.orchestra.run.smithi083.stderr: 48400K .......... .......... .......... .......... .......... 28% 32.7M 4s 2024-03-30T13:09:44.154 INFO:teuthology.orchestra.run.smithi083.stderr: 48450K .......... .......... .......... .......... .......... 28% 27.3M 4s 2024-03-30T13:09:44.156 INFO:teuthology.orchestra.run.smithi083.stderr: 48500K .......... .......... .......... .......... .......... 28% 32.5M 4s 2024-03-30T13:09:44.157 INFO:teuthology.orchestra.run.smithi083.stderr: 48550K .......... .......... .......... .......... .......... 28% 32.3M 4s 2024-03-30T13:09:44.159 INFO:teuthology.orchestra.run.smithi083.stderr: 48600K .......... .......... .......... .......... .......... 28% 32.2M 4s 2024-03-30T13:09:44.160 INFO:teuthology.orchestra.run.smithi083.stderr: 48650K .......... .......... .......... .......... .......... 28% 28.4M 4s 2024-03-30T13:09:44.162 INFO:teuthology.orchestra.run.smithi083.stderr: 48700K .......... .......... .......... .......... .......... 28% 33.2M 4s 2024-03-30T13:09:44.163 INFO:teuthology.orchestra.run.smithi083.stderr: 48750K .......... .......... .......... .......... .......... 28% 32.7M 4s 2024-03-30T13:09:44.165 INFO:teuthology.orchestra.run.smithi083.stderr: 48800K .......... .......... .......... .......... .......... 28% 32.5M 4s 2024-03-30T13:09:44.167 INFO:teuthology.orchestra.run.smithi083.stderr: 48850K .......... .......... .......... .......... .......... 29% 20.6M 4s 2024-03-30T13:09:44.169 INFO:teuthology.orchestra.run.smithi083.stderr: 48900K .......... .......... .......... .......... .......... 29% 26.3M 4s 2024-03-30T13:09:44.171 INFO:teuthology.orchestra.run.smithi083.stderr: 48950K .......... .......... .......... .......... .......... 29% 25.8M 4s 2024-03-30T13:09:44.173 INFO:teuthology.orchestra.run.smithi083.stderr: 49000K .......... .......... .......... .......... .......... 29% 27.3M 4s 2024-03-30T13:09:44.175 INFO:teuthology.orchestra.run.smithi083.stderr: 49050K .......... .......... .......... .......... .......... 29% 23.8M 4s 2024-03-30T13:09:44.176 INFO:teuthology.orchestra.run.smithi083.stderr: 49100K .......... .......... .......... .......... .......... 29% 31.0M 4s 2024-03-30T13:09:44.178 INFO:teuthology.orchestra.run.smithi083.stderr: 49150K .......... .......... .......... .......... .......... 29% 30.5M 4s 2024-03-30T13:09:44.179 INFO:teuthology.orchestra.run.smithi083.stderr: 49200K .......... .......... .......... .......... .......... 29% 35.8M 4s 2024-03-30T13:09:44.181 INFO:teuthology.orchestra.run.smithi083.stderr: 49250K .......... .......... .......... .......... .......... 29% 30.6M 4s 2024-03-30T13:09:44.183 INFO:teuthology.orchestra.run.smithi083.stderr: 49300K .......... .......... .......... .......... .......... 29% 33.3M 4s 2024-03-30T13:09:44.184 INFO:teuthology.orchestra.run.smithi083.stderr: 49350K .......... .......... .......... .......... .......... 29% 34.7M 4s 2024-03-30T13:09:44.185 INFO:teuthology.orchestra.run.smithi083.stderr: 49400K .......... .......... .......... .......... .......... 29% 32.1M 4s 2024-03-30T13:09:44.187 INFO:teuthology.orchestra.run.smithi083.stderr: 49450K .......... .......... .......... .......... .......... 29% 29.2M 4s 2024-03-30T13:09:44.188 INFO:teuthology.orchestra.run.smithi083.stderr: 49500K .......... .......... .......... .......... .......... 29% 40.4M 4s 2024-03-30T13:09:44.191 INFO:teuthology.orchestra.run.smithi083.stderr: 49550K .......... .......... .......... .......... .......... 29% 27.0M 4s 2024-03-30T13:09:44.193 INFO:teuthology.orchestra.run.smithi083.stderr: 49600K .......... .......... .......... .......... .......... 29% 21.4M 4s 2024-03-30T13:09:44.195 INFO:teuthology.orchestra.run.smithi083.stderr: 49650K .......... .......... .......... .......... .......... 29% 24.8M 4s 2024-03-30T13:09:44.195 INFO:teuthology.orchestra.run.smithi083.stderr: 49700K .......... .......... .......... .......... .......... 29% 40.9M 4s 2024-03-30T13:09:44.197 INFO:teuthology.orchestra.run.smithi083.stderr: 49750K .......... .......... .......... .......... .......... 29% 40.0M 4s 2024-03-30T13:09:44.198 INFO:teuthology.orchestra.run.smithi083.stderr: 49800K .......... .......... .......... .......... .......... 29% 37.2M 4s 2024-03-30T13:09:44.200 INFO:teuthology.orchestra.run.smithi083.stderr: 49850K .......... .......... .......... .......... .......... 29% 34.9M 4s 2024-03-30T13:09:44.201 INFO:teuthology.orchestra.run.smithi083.stderr: 49900K .......... .......... .......... .......... .......... 29% 42.3M 4s 2024-03-30T13:09:44.202 INFO:teuthology.orchestra.run.smithi083.stderr: 49950K .......... .......... .......... .......... .......... 29% 32.4M 4s 2024-03-30T13:09:44.203 INFO:teuthology.orchestra.run.smithi083.stderr: 50000K .......... .......... .......... .......... .......... 29% 40.4M 4s 2024-03-30T13:09:44.205 INFO:teuthology.orchestra.run.smithi083.stderr: 50050K .......... .......... .......... .......... .......... 29% 34.9M 4s 2024-03-30T13:09:44.206 INFO:teuthology.orchestra.run.smithi083.stderr: 50100K .......... .......... .......... .......... .......... 29% 38.8M 4s 2024-03-30T13:09:44.207 INFO:teuthology.orchestra.run.smithi083.stderr: 50150K .......... .......... .......... .......... .......... 29% 39.7M 4s 2024-03-30T13:09:44.209 INFO:teuthology.orchestra.run.smithi083.stderr: 50200K .......... .......... .......... .......... .......... 29% 39.9M 4s 2024-03-30T13:09:44.210 INFO:teuthology.orchestra.run.smithi083.stderr: 50250K .......... .......... .......... .......... .......... 29% 25.6M 4s 2024-03-30T13:09:44.211 INFO:teuthology.orchestra.run.smithi083.stderr: 50300K .......... .......... .......... .......... .......... 29% 42.2M 4s 2024-03-30T13:09:44.213 INFO:teuthology.orchestra.run.smithi083.stderr: 50350K .......... .......... .......... .......... .......... 29% 41.0M 4s 2024-03-30T13:09:44.214 INFO:teuthology.orchestra.run.smithi083.stderr: 50400K .......... .......... .......... .......... .......... 29% 41.9M 4s 2024-03-30T13:09:44.217 INFO:teuthology.orchestra.run.smithi083.stderr: 50450K .......... .......... .......... .......... .......... 29% 33.8M 4s 2024-03-30T13:09:44.217 INFO:teuthology.orchestra.run.smithi083.stderr: 50500K .......... .......... .......... .......... .......... 29% 39.1M 4s 2024-03-30T13:09:44.219 INFO:teuthology.orchestra.run.smithi083.stderr: 50550K .......... .......... .......... .......... .......... 30% 39.5M 4s 2024-03-30T13:09:44.219 INFO:teuthology.orchestra.run.smithi083.stderr: 50600K .......... .......... .......... .......... .......... 30% 38.5M 4s 2024-03-30T13:09:44.221 INFO:teuthology.orchestra.run.smithi083.stderr: 50650K .......... .......... .......... .......... .......... 30% 33.4M 4s 2024-03-30T13:09:44.224 INFO:teuthology.orchestra.run.smithi083.stderr: 50700K .......... .......... .......... .......... .......... 30% 38.6M 4s 2024-03-30T13:09:44.224 INFO:teuthology.orchestra.run.smithi083.stderr: 50750K .......... .......... .......... .......... .......... 30% 36.4M 4s 2024-03-30T13:09:44.226 INFO:teuthology.orchestra.run.smithi083.stderr: 50800K .......... .......... .......... .......... .......... 30% 38.5M 4s 2024-03-30T13:09:44.227 INFO:teuthology.orchestra.run.smithi083.stderr: 50850K .......... .......... .......... .......... .......... 30% 32.1M 4s 2024-03-30T13:09:44.228 INFO:teuthology.orchestra.run.smithi083.stderr: 50900K .......... .......... .......... .......... .......... 30% 33.1M 4s 2024-03-30T13:09:44.229 INFO:teuthology.orchestra.run.smithi083.stderr: 50950K .......... .......... .......... .......... .......... 30% 30.1M 4s 2024-03-30T13:09:44.231 INFO:teuthology.orchestra.run.smithi083.stderr: 51000K .......... .......... .......... .......... .......... 30% 23.0M 4s 2024-03-30T13:09:44.233 INFO:teuthology.orchestra.run.smithi083.stderr: 51050K .......... .......... .......... .......... .......... 30% 25.0M 4s 2024-03-30T13:09:44.235 INFO:teuthology.orchestra.run.smithi083.stderr: 51100K .......... .......... .......... .......... .......... 30% 32.2M 4s 2024-03-30T13:09:44.236 INFO:teuthology.orchestra.run.smithi083.stderr: 51150K .......... .......... .......... .......... .......... 30% 32.4M 4s 2024-03-30T13:09:44.238 INFO:teuthology.orchestra.run.smithi083.stderr: 51200K .......... .......... .......... .......... .......... 30% 32.7M 4s 2024-03-30T13:09:44.240 INFO:teuthology.orchestra.run.smithi083.stderr: 51250K .......... .......... .......... .......... .......... 30% 27.0M 4s 2024-03-30T13:09:44.241 INFO:teuthology.orchestra.run.smithi083.stderr: 51300K .......... .......... .......... .......... .......... 30% 30.2M 4s 2024-03-30T13:09:44.244 INFO:teuthology.orchestra.run.smithi083.stderr: 51350K .......... .......... .......... .......... .......... 30% 17.2M 4s 2024-03-30T13:09:44.245 INFO:teuthology.orchestra.run.smithi083.stderr: 51400K .......... .......... .......... .......... .......... 30% 35.1M 4s 2024-03-30T13:09:44.247 INFO:teuthology.orchestra.run.smithi083.stderr: 51450K .......... .......... .......... .......... .......... 30% 29.5M 4s 2024-03-30T13:09:44.248 INFO:teuthology.orchestra.run.smithi083.stderr: 51500K .......... .......... .......... .......... .......... 30% 35.4M 4s 2024-03-30T13:09:44.250 INFO:teuthology.orchestra.run.smithi083.stderr: 51550K .......... .......... .......... .......... .......... 30% 35.1M 4s 2024-03-30T13:09:44.251 INFO:teuthology.orchestra.run.smithi083.stderr: 51600K .......... .......... .......... .......... .......... 30% 33.1M 4s 2024-03-30T13:09:44.253 INFO:teuthology.orchestra.run.smithi083.stderr: 51650K .......... .......... .......... .......... .......... 30% 30.2M 4s 2024-03-30T13:09:44.254 INFO:teuthology.orchestra.run.smithi083.stderr: 51700K .......... .......... .......... .......... .......... 30% 35.9M 4s 2024-03-30T13:09:44.259 INFO:teuthology.orchestra.run.smithi083.stderr: 51750K .......... .......... .......... .......... .......... 30% 35.5M 4s 2024-03-30T13:09:44.259 INFO:teuthology.orchestra.run.smithi083.stderr: 51800K .......... .......... .......... .......... .......... 30% 35.0M 4s 2024-03-30T13:09:44.260 INFO:teuthology.orchestra.run.smithi083.stderr: 51850K .......... .......... .......... .......... .......... 30% 29.4M 4s 2024-03-30T13:09:44.260 INFO:teuthology.orchestra.run.smithi083.stderr: 51900K .......... .......... .......... .......... .......... 30% 34.9M 4s 2024-03-30T13:09:44.261 INFO:teuthology.orchestra.run.smithi083.stderr: 51950K .......... .......... .......... .......... .......... 30% 33.7M 4s 2024-03-30T13:09:44.264 INFO:teuthology.orchestra.run.smithi083.stderr: 52000K .......... .......... .......... .......... .......... 30% 34.1M 4s 2024-03-30T13:09:44.265 INFO:teuthology.orchestra.run.smithi083.stderr: 52050K .......... .......... .......... .......... .......... 30% 29.4M 4s 2024-03-30T13:09:44.266 INFO:teuthology.orchestra.run.smithi083.stderr: 52100K .......... .......... .......... .......... .......... 30% 33.3M 4s 2024-03-30T13:09:44.268 INFO:teuthology.orchestra.run.smithi083.stderr: 52150K .......... .......... .......... .......... .......... 30% 32.4M 4s 2024-03-30T13:09:44.269 INFO:teuthology.orchestra.run.smithi083.stderr: 52200K .......... .......... .......... .......... .......... 30% 33.3M 4s 2024-03-30T13:09:44.271 INFO:teuthology.orchestra.run.smithi083.stderr: 52250K .......... .......... .......... .......... .......... 31% 26.5M 4s 2024-03-30T13:09:44.272 INFO:teuthology.orchestra.run.smithi083.stderr: 52300K .......... .......... .......... .......... .......... 31% 32.4M 4s 2024-03-30T13:09:44.274 INFO:teuthology.orchestra.run.smithi083.stderr: 52350K .......... .......... .......... .......... .......... 31% 33.2M 4s 2024-03-30T13:09:44.275 INFO:teuthology.orchestra.run.smithi083.stderr: 52400K .......... .......... .......... .......... .......... 31% 30.7M 4s 2024-03-30T13:09:44.277 INFO:teuthology.orchestra.run.smithi083.stderr: 52450K .......... .......... .......... .......... .......... 31% 27.7M 4s 2024-03-30T13:09:44.279 INFO:teuthology.orchestra.run.smithi083.stderr: 52500K .......... .......... .......... .......... .......... 31% 31.4M 4s 2024-03-30T13:09:44.280 INFO:teuthology.orchestra.run.smithi083.stderr: 52550K .......... .......... .......... .......... .......... 31% 33.0M 4s 2024-03-30T13:09:44.282 INFO:teuthology.orchestra.run.smithi083.stderr: 52600K .......... .......... .......... .......... .......... 31% 30.7M 4s 2024-03-30T13:09:44.284 INFO:teuthology.orchestra.run.smithi083.stderr: 52650K .......... .......... .......... .......... .......... 31% 26.6M 4s 2024-03-30T13:09:44.285 INFO:teuthology.orchestra.run.smithi083.stderr: 52700K .......... .......... .......... .......... .......... 31% 32.1M 4s 2024-03-30T13:09:44.287 INFO:teuthology.orchestra.run.smithi083.stderr: 52750K .......... .......... .......... .......... .......... 31% 29.7M 4s 2024-03-30T13:09:44.288 INFO:teuthology.orchestra.run.smithi083.stderr: 52800K .......... .......... .......... .......... .......... 31% 29.7M 4s 2024-03-30T13:09:44.292 INFO:teuthology.orchestra.run.smithi083.stderr: 52850K .......... .......... .......... .......... .......... 31% 25.9M 4s 2024-03-30T13:09:44.292 INFO:teuthology.orchestra.run.smithi083.stderr: 52900K .......... .......... .......... .......... .......... 31% 31.1M 4s 2024-03-30T13:09:44.293 INFO:teuthology.orchestra.run.smithi083.stderr: 52950K .......... .......... .......... .......... .......... 31% 30.8M 4s 2024-03-30T13:09:44.295 INFO:teuthology.orchestra.run.smithi083.stderr: 53000K .......... .......... .......... .......... .......... 31% 30.1M 4s 2024-03-30T13:09:44.297 INFO:teuthology.orchestra.run.smithi083.stderr: 53050K .......... .......... .......... .......... .......... 31% 26.1M 4s 2024-03-30T13:09:44.299 INFO:teuthology.orchestra.run.smithi083.stderr: 53100K .......... .......... .......... .......... .......... 31% 30.2M 4s 2024-03-30T13:09:44.300 INFO:teuthology.orchestra.run.smithi083.stderr: 53150K .......... .......... .......... .......... .......... 31% 29.9M 4s 2024-03-30T13:09:44.302 INFO:teuthology.orchestra.run.smithi083.stderr: 53200K .......... .......... .......... .......... .......... 31% 30.5M 4s 2024-03-30T13:09:44.304 INFO:teuthology.orchestra.run.smithi083.stderr: 53250K .......... .......... .......... .......... .......... 31% 21.7M 4s 2024-03-30T13:09:44.306 INFO:teuthology.orchestra.run.smithi083.stderr: 53300K .......... .......... .......... .......... .......... 31% 27.9M 4s 2024-03-30T13:09:44.308 INFO:teuthology.orchestra.run.smithi083.stderr: 53350K .......... .......... .......... .......... .......... 31% 26.6M 4s 2024-03-30T13:09:44.310 INFO:teuthology.orchestra.run.smithi083.stderr: 53400K .......... .......... .......... .......... .......... 31% 27.4M 4s 2024-03-30T13:09:44.312 INFO:teuthology.orchestra.run.smithi083.stderr: 53450K .......... .......... .......... .......... .......... 31% 23.9M 4s 2024-03-30T13:09:44.314 INFO:teuthology.orchestra.run.smithi083.stderr: 53500K .......... .......... .......... .......... .......... 31% 17.8M 4s 2024-03-30T13:09:44.316 INFO:teuthology.orchestra.run.smithi083.stderr: 53550K .......... .......... .......... .......... .......... 31% 22.5M 4s 2024-03-30T13:09:44.318 INFO:teuthology.orchestra.run.smithi083.stderr: 53600K .......... .......... .......... .......... .......... 31% 25.4M 4s 2024-03-30T13:09:44.321 INFO:teuthology.orchestra.run.smithi083.stderr: 53650K .......... .......... .......... .......... .......... 31% 27.7M 4s 2024-03-30T13:09:44.322 INFO:teuthology.orchestra.run.smithi083.stderr: 53700K .......... .......... .......... .......... .......... 31% 27.8M 4s 2024-03-30T13:09:44.329 INFO:teuthology.orchestra.run.smithi083.stderr: 53750K .......... .......... .......... .......... .......... 31% 29.4M 4s 2024-03-30T13:09:44.329 INFO:teuthology.orchestra.run.smithi083.stderr: 53800K .......... .......... .......... .......... .......... 31% 38.4M 4s 2024-03-30T13:09:44.329 INFO:teuthology.orchestra.run.smithi083.stderr: 53850K .......... .......... .......... .......... .......... 31% 31.8M 4s 2024-03-30T13:09:44.329 INFO:teuthology.orchestra.run.smithi083.stderr: 53900K .......... .......... .......... .......... .......... 32% 38.1M 4s 2024-03-30T13:09:44.329 INFO:teuthology.orchestra.run.smithi083.stderr: 53950K .......... .......... .......... .......... .......... 32% 38.2M 4s 2024-03-30T13:09:44.334 INFO:teuthology.orchestra.run.smithi083.stderr: 54000K .......... .......... .......... .......... .......... 32% 37.5M 4s 2024-03-30T13:09:44.334 INFO:teuthology.orchestra.run.smithi083.stderr: 54050K .......... .......... .......... .......... .......... 32% 31.0M 4s 2024-03-30T13:09:44.334 INFO:teuthology.orchestra.run.smithi083.stderr: 54100K .......... .......... .......... .......... .......... 32% 35.8M 4s 2024-03-30T13:09:44.335 INFO:teuthology.orchestra.run.smithi083.stderr: 54150K .......... .......... .......... .......... .......... 32% 32.7M 4s 2024-03-30T13:09:44.336 INFO:teuthology.orchestra.run.smithi083.stderr: 54200K .......... .......... .......... .......... .......... 32% 32.7M 4s 2024-03-30T13:09:44.338 INFO:teuthology.orchestra.run.smithi083.stderr: 54250K .......... .......... .......... .......... .......... 32% 27.8M 4s 2024-03-30T13:09:44.340 INFO:teuthology.orchestra.run.smithi083.stderr: 54300K .......... .......... .......... .......... .......... 32% 24.3M 4s 2024-03-30T13:09:44.343 INFO:teuthology.orchestra.run.smithi083.stderr: 54350K .......... .......... .......... .......... .......... 32% 35.5M 4s 2024-03-30T13:09:44.343 INFO:teuthology.orchestra.run.smithi083.stderr: 54400K .......... .......... .......... .......... .......... 32% 35.0M 4s 2024-03-30T13:09:44.344 INFO:teuthology.orchestra.run.smithi083.stderr: 54450K .......... .......... .......... .......... .......... 32% 30.7M 4s 2024-03-30T13:09:44.346 INFO:teuthology.orchestra.run.smithi083.stderr: 54500K .......... .......... .......... .......... .......... 32% 35.1M 4s 2024-03-30T13:09:44.347 INFO:teuthology.orchestra.run.smithi083.stderr: 54550K .......... .......... .......... .......... .......... 32% 28.8M 4s 2024-03-30T13:09:44.349 INFO:teuthology.orchestra.run.smithi083.stderr: 54600K .......... .......... .......... .......... .......... 32% 37.8M 4s 2024-03-30T13:09:44.352 INFO:teuthology.orchestra.run.smithi083.stderr: 54650K .......... .......... .......... .......... .......... 32% 23.5M 4s 2024-03-30T13:09:44.352 INFO:teuthology.orchestra.run.smithi083.stderr: 54700K .......... .......... .......... .......... .......... 32% 30.4M 4s 2024-03-30T13:09:44.356 INFO:teuthology.orchestra.run.smithi083.stderr: 54750K .......... .......... .......... .......... .......... 32% 31.0M 4s 2024-03-30T13:09:44.356 INFO:teuthology.orchestra.run.smithi083.stderr: 54800K .......... .......... .......... .......... .......... 32% 29.3M 4s 2024-03-30T13:09:44.358 INFO:teuthology.orchestra.run.smithi083.stderr: 54850K .......... .......... .......... .......... .......... 32% 25.7M 4s 2024-03-30T13:09:44.360 INFO:teuthology.orchestra.run.smithi083.stderr: 54900K .......... .......... .......... .......... .......... 32% 27.6M 4s 2024-03-30T13:09:44.361 INFO:teuthology.orchestra.run.smithi083.stderr: 54950K .......... .......... .......... .......... .......... 32% 28.6M 4s 2024-03-30T13:09:44.363 INFO:teuthology.orchestra.run.smithi083.stderr: 55000K .......... .......... .......... .......... .......... 32% 28.0M 4s 2024-03-30T13:09:44.365 INFO:teuthology.orchestra.run.smithi083.stderr: 55050K .......... .......... .......... .......... .......... 32% 20.1M 4s 2024-03-30T13:09:44.367 INFO:teuthology.orchestra.run.smithi083.stderr: 55100K .......... .......... .......... .......... .......... 32% 24.8M 4s 2024-03-30T13:09:44.368 INFO:teuthology.orchestra.run.smithi083.stderr: 55150K .......... .......... .......... .......... .......... 32% 37.9M 4s 2024-03-30T13:09:44.370 INFO:teuthology.orchestra.run.smithi083.stderr: 55200K .......... .......... .......... .......... .......... 32% 38.5M 4s 2024-03-30T13:09:44.371 INFO:teuthology.orchestra.run.smithi083.stderr: 55250K .......... .......... .......... .......... .......... 32% 32.7M 4s 2024-03-30T13:09:44.373 INFO:teuthology.orchestra.run.smithi083.stderr: 55300K .......... .......... .......... .......... .......... 32% 38.7M 4s 2024-03-30T13:09:44.374 INFO:teuthology.orchestra.run.smithi083.stderr: 55350K .......... .......... .......... .......... .......... 32% 37.3M 4s 2024-03-30T13:09:44.375 INFO:teuthology.orchestra.run.smithi083.stderr: 55400K .......... .......... .......... .......... .......... 32% 35.7M 4s 2024-03-30T13:09:44.378 INFO:teuthology.orchestra.run.smithi083.stderr: 55450K .......... .......... .......... .......... .......... 32% 18.5M 4s 2024-03-30T13:09:44.379 INFO:teuthology.orchestra.run.smithi083.stderr: 55500K .......... .......... .......... .......... .......... 32% 42.8M 4s 2024-03-30T13:09:44.380 INFO:teuthology.orchestra.run.smithi083.stderr: 55550K .......... .......... .......... .......... .......... 32% 42.1M 4s 2024-03-30T13:09:44.381 INFO:teuthology.orchestra.run.smithi083.stderr: 55600K .......... .......... .......... .......... .......... 33% 44.5M 4s 2024-03-30T13:09:44.383 INFO:teuthology.orchestra.run.smithi083.stderr: 55650K .......... .......... .......... .......... .......... 33% 31.5M 4s 2024-03-30T13:09:44.384 INFO:teuthology.orchestra.run.smithi083.stderr: 55700K .......... .......... .......... .......... .......... 33% 34.3M 4s 2024-03-30T13:09:44.385 INFO:teuthology.orchestra.run.smithi083.stderr: 55750K .......... .......... .......... .......... .......... 33% 34.5M 4s 2024-03-30T13:09:44.387 INFO:teuthology.orchestra.run.smithi083.stderr: 55800K .......... .......... .......... .......... .......... 33% 33.6M 4s 2024-03-30T13:09:44.389 INFO:teuthology.orchestra.run.smithi083.stderr: 55850K .......... .......... .......... .......... .......... 33% 26.1M 4s 2024-03-30T13:09:44.390 INFO:teuthology.orchestra.run.smithi083.stderr: 55900K .......... .......... .......... .......... .......... 33% 33.0M 4s 2024-03-30T13:09:44.392 INFO:teuthology.orchestra.run.smithi083.stderr: 55950K .......... .......... .......... .......... .......... 33% 33.0M 4s 2024-03-30T13:09:44.393 INFO:teuthology.orchestra.run.smithi083.stderr: 56000K .......... .......... .......... .......... .......... 33% 31.9M 4s 2024-03-30T13:09:44.395 INFO:teuthology.orchestra.run.smithi083.stderr: 56050K .......... .......... .......... .......... .......... 33% 26.2M 4s 2024-03-30T13:09:44.397 INFO:teuthology.orchestra.run.smithi083.stderr: 56100K .......... .......... .......... .......... .......... 33% 30.7M 4s 2024-03-30T13:09:44.398 INFO:teuthology.orchestra.run.smithi083.stderr: 56150K .......... .......... .......... .......... .......... 33% 32.1M 4s 2024-03-30T13:09:44.400 INFO:teuthology.orchestra.run.smithi083.stderr: 56200K .......... .......... .......... .......... .......... 33% 39.4M 4s 2024-03-30T13:09:44.401 INFO:teuthology.orchestra.run.smithi083.stderr: 56250K .......... .......... .......... .......... .......... 33% 35.8M 4s 2024-03-30T13:09:44.402 INFO:teuthology.orchestra.run.smithi083.stderr: 56300K .......... .......... .......... .......... .......... 33% 42.4M 4s 2024-03-30T13:09:44.403 INFO:teuthology.orchestra.run.smithi083.stderr: 56350K .......... .......... .......... .......... .......... 33% 41.6M 4s 2024-03-30T13:09:44.404 INFO:teuthology.orchestra.run.smithi083.stderr: 56400K .......... .......... .......... .......... .......... 33% 42.2M 4s 2024-03-30T13:09:44.406 INFO:teuthology.orchestra.run.smithi083.stderr: 56450K .......... .......... .......... .......... .......... 33% 36.3M 4s 2024-03-30T13:09:44.407 INFO:teuthology.orchestra.run.smithi083.stderr: 56500K .......... .......... .......... .......... .......... 33% 38.7M 4s 2024-03-30T13:09:44.408 INFO:teuthology.orchestra.run.smithi083.stderr: 56550K .......... .......... .......... .......... .......... 33% 41.1M 4s 2024-03-30T13:09:44.409 INFO:teuthology.orchestra.run.smithi083.stderr: 56600K .......... .......... .......... .......... .......... 33% 39.8M 4s 2024-03-30T13:09:44.411 INFO:teuthology.orchestra.run.smithi083.stderr: 56650K .......... .......... .......... .......... .......... 33% 32.8M 4s 2024-03-30T13:09:44.412 INFO:teuthology.orchestra.run.smithi083.stderr: 56700K .......... .......... .......... .......... .......... 33% 39.0M 4s 2024-03-30T13:09:44.413 INFO:teuthology.orchestra.run.smithi083.stderr: 56750K .......... .......... .......... .......... .......... 33% 38.3M 4s 2024-03-30T13:09:44.415 INFO:teuthology.orchestra.run.smithi083.stderr: 56800K .......... .......... .......... .......... .......... 33% 38.1M 4s 2024-03-30T13:09:44.416 INFO:teuthology.orchestra.run.smithi083.stderr: 56850K .......... .......... .......... .......... .......... 33% 32.0M 4s 2024-03-30T13:09:44.419 INFO:teuthology.orchestra.run.smithi083.stderr: 56900K .......... .......... .......... .......... .......... 33% 38.3M 4s 2024-03-30T13:09:44.419 INFO:teuthology.orchestra.run.smithi083.stderr: 56950K .......... .......... .......... .......... .......... 33% 37.5M 4s 2024-03-30T13:09:44.420 INFO:teuthology.orchestra.run.smithi083.stderr: 57000K .......... .......... .......... .......... .......... 33% 37.2M 4s 2024-03-30T13:09:44.422 INFO:teuthology.orchestra.run.smithi083.stderr: 57050K .......... .......... .......... .......... .......... 33% 32.6M 4s 2024-03-30T13:09:44.423 INFO:teuthology.orchestra.run.smithi083.stderr: 57100K .......... .......... .......... .......... .......... 33% 37.3M 4s 2024-03-30T13:09:44.424 INFO:teuthology.orchestra.run.smithi083.stderr: 57150K .......... .......... .......... .......... .......... 33% 36.9M 4s 2024-03-30T13:09:44.426 INFO:teuthology.orchestra.run.smithi083.stderr: 57200K .......... .......... .......... .......... .......... 33% 35.6M 4s 2024-03-30T13:09:44.428 INFO:teuthology.orchestra.run.smithi083.stderr: 57250K .......... .......... .......... .......... .......... 33% 31.3M 4s 2024-03-30T13:09:44.430 INFO:teuthology.orchestra.run.smithi083.stderr: 57300K .......... .......... .......... .......... .......... 34% 36.3M 4s 2024-03-30T13:09:44.431 INFO:teuthology.orchestra.run.smithi083.stderr: 57350K .......... .......... .......... .......... .......... 34% 17.8M 4s 2024-03-30T13:09:44.434 INFO:teuthology.orchestra.run.smithi083.stderr: 57400K .......... .......... .......... .......... .......... 34% 21.0M 4s 2024-03-30T13:09:44.437 INFO:teuthology.orchestra.run.smithi083.stderr: 57450K .......... .......... .......... .......... .......... 34% 18.9M 4s 2024-03-30T13:09:44.438 INFO:teuthology.orchestra.run.smithi083.stderr: 57500K .......... .......... .......... .......... .......... 34% 28.7M 4s 2024-03-30T13:09:44.439 INFO:teuthology.orchestra.run.smithi083.stderr: 57550K .......... .......... .......... .......... .......... 34% 30.1M 4s 2024-03-30T13:09:44.442 INFO:teuthology.orchestra.run.smithi083.stderr: 57600K .......... .......... .......... .......... .......... 34% 34.6M 4s 2024-03-30T13:09:44.442 INFO:teuthology.orchestra.run.smithi083.stderr: 57650K .......... .......... .......... .......... .......... 34% 33.0M 4s 2024-03-30T13:09:44.444 INFO:teuthology.orchestra.run.smithi083.stderr: 57700K .......... .......... .......... .......... .......... 34% 39.2M 4s 2024-03-30T13:09:44.448 INFO:teuthology.orchestra.run.smithi083.stderr: 57750K .......... .......... .......... .......... .......... 34% 25.8M 4s 2024-03-30T13:09:44.449 INFO:teuthology.orchestra.run.smithi083.stderr: 57800K .......... .......... .......... .......... .......... 34% 30.8M 4s 2024-03-30T13:09:44.450 INFO:teuthology.orchestra.run.smithi083.stderr: 57850K .......... .......... .......... .......... .......... 34% 26.0M 4s 2024-03-30T13:09:44.451 INFO:teuthology.orchestra.run.smithi083.stderr: 57900K .......... .......... .......... .......... .......... 34% 34.7M 4s 2024-03-30T13:09:44.452 INFO:teuthology.orchestra.run.smithi083.stderr: 57950K .......... .......... .......... .......... .......... 34% 32.7M 4s 2024-03-30T13:09:44.453 INFO:teuthology.orchestra.run.smithi083.stderr: 58000K .......... .......... .......... .......... .......... 34% 37.3M 4s 2024-03-30T13:09:44.455 INFO:teuthology.orchestra.run.smithi083.stderr: 58050K .......... .......... .......... .......... .......... 34% 33.0M 4s 2024-03-30T13:09:44.458 INFO:teuthology.orchestra.run.smithi083.stderr: 58100K .......... .......... .......... .......... .......... 34% 37.9M 4s 2024-03-30T13:09:44.458 INFO:teuthology.orchestra.run.smithi083.stderr: 58150K .......... .......... .......... .......... .......... 34% 36.3M 4s 2024-03-30T13:09:44.459 INFO:teuthology.orchestra.run.smithi083.stderr: 58200K .......... .......... .......... .......... .......... 34% 36.9M 4s 2024-03-30T13:09:44.464 INFO:teuthology.orchestra.run.smithi083.stderr: 58250K .......... .......... .......... .......... .......... 34% 30.7M 4s 2024-03-30T13:09:44.464 INFO:teuthology.orchestra.run.smithi083.stderr: 58300K .......... .......... .......... .......... .......... 34% 35.5M 4s 2024-03-30T13:09:44.464 INFO:teuthology.orchestra.run.smithi083.stderr: 58350K .......... .......... .......... .......... .......... 34% 35.8M 4s 2024-03-30T13:09:44.467 INFO:teuthology.orchestra.run.smithi083.stderr: 58400K .......... .......... .......... .......... .......... 34% 27.0M 4s 2024-03-30T13:09:44.467 INFO:teuthology.orchestra.run.smithi083.stderr: 58450K .......... .......... .......... .......... .......... 34% 32.5M 4s 2024-03-30T13:09:44.468 INFO:teuthology.orchestra.run.smithi083.stderr: 58500K .......... .......... .......... .......... .......... 34% 39.0M 4s 2024-03-30T13:09:44.469 INFO:teuthology.orchestra.run.smithi083.stderr: 58550K .......... .......... .......... .......... .......... 34% 39.3M 4s 2024-03-30T13:09:44.470 INFO:teuthology.orchestra.run.smithi083.stderr: 58600K .......... .......... .......... .......... .......... 34% 37.9M 4s 2024-03-30T13:09:44.471 INFO:teuthology.orchestra.run.smithi083.stderr: 58650K .......... .......... .......... .......... .......... 34% 32.6M 4s 2024-03-30T13:09:44.473 INFO:teuthology.orchestra.run.smithi083.stderr: 58700K .......... .......... .......... .......... .......... 34% 38.2M 4s 2024-03-30T13:09:44.474 INFO:teuthology.orchestra.run.smithi083.stderr: 58750K .......... .......... .......... .......... .......... 34% 36.4M 4s 2024-03-30T13:09:44.476 INFO:teuthology.orchestra.run.smithi083.stderr: 58800K .......... .......... .......... .......... .......... 34% 38.0M 4s 2024-03-30T13:09:44.477 INFO:teuthology.orchestra.run.smithi083.stderr: 58850K .......... .......... .......... .......... .......... 34% 32.2M 4s 2024-03-30T13:09:44.478 INFO:teuthology.orchestra.run.smithi083.stderr: 58900K .......... .......... .......... .......... .......... 34% 36.8M 4s 2024-03-30T13:09:44.479 INFO:teuthology.orchestra.run.smithi083.stderr: 58950K .......... .......... .......... .......... .......... 35% 38.3M 4s 2024-03-30T13:09:44.481 INFO:teuthology.orchestra.run.smithi083.stderr: 59000K .......... .......... .......... .......... .......... 35% 35.6M 4s 2024-03-30T13:09:44.483 INFO:teuthology.orchestra.run.smithi083.stderr: 59050K .......... .......... .......... .......... .......... 35% 28.7M 4s 2024-03-30T13:09:44.484 INFO:teuthology.orchestra.run.smithi083.stderr: 59100K .......... .......... .......... .......... .......... 35% 31.2M 4s 2024-03-30T13:09:44.485 INFO:teuthology.orchestra.run.smithi083.stderr: 59150K .......... .......... .......... .......... .......... 35% 34.8M 4s 2024-03-30T13:09:44.487 INFO:teuthology.orchestra.run.smithi083.stderr: 59200K .......... .......... .......... .......... .......... 35% 29.0M 4s 2024-03-30T13:09:44.489 INFO:teuthology.orchestra.run.smithi083.stderr: 59250K .......... .......... .......... .......... .......... 35% 26.1M 4s 2024-03-30T13:09:44.491 INFO:teuthology.orchestra.run.smithi083.stderr: 59300K .......... .......... .......... .......... .......... 35% 29.7M 4s 2024-03-30T13:09:44.492 INFO:teuthology.orchestra.run.smithi083.stderr: 59350K .......... .......... .......... .......... .......... 35% 29.6M 4s 2024-03-30T13:09:44.494 INFO:teuthology.orchestra.run.smithi083.stderr: 59400K .......... .......... .......... .......... .......... 35% 30.0M 4s 2024-03-30T13:09:44.496 INFO:teuthology.orchestra.run.smithi083.stderr: 59450K .......... .......... .......... .......... .......... 35% 30.5M 4s 2024-03-30T13:09:44.497 INFO:teuthology.orchestra.run.smithi083.stderr: 59500K .......... .......... .......... .......... .......... 35% 36.8M 4s 2024-03-30T13:09:44.499 INFO:teuthology.orchestra.run.smithi083.stderr: 59550K .......... .......... .......... .......... .......... 35% 20.1M 4s 2024-03-30T13:09:44.501 INFO:teuthology.orchestra.run.smithi083.stderr: 59600K .......... .......... .......... .......... .......... 35% 40.4M 4s 2024-03-30T13:09:44.502 INFO:teuthology.orchestra.run.smithi083.stderr: 59650K .......... .......... .......... .......... .......... 35% 34.4M 4s 2024-03-30T13:09:44.504 INFO:teuthology.orchestra.run.smithi083.stderr: 59700K .......... .......... .......... .......... .......... 35% 39.4M 4s 2024-03-30T13:09:44.504 INFO:teuthology.orchestra.run.smithi083.stderr: 59750K .......... .......... .......... .......... .......... 35% 41.4M 4s 2024-03-30T13:09:44.506 INFO:teuthology.orchestra.run.smithi083.stderr: 59800K .......... .......... .......... .......... .......... 35% 39.6M 4s 2024-03-30T13:09:44.507 INFO:teuthology.orchestra.run.smithi083.stderr: 59850K .......... .......... .......... .......... .......... 35% 33.7M 4s 2024-03-30T13:09:44.508 INFO:teuthology.orchestra.run.smithi083.stderr: 59900K .......... .......... .......... .......... .......... 35% 40.0M 4s 2024-03-30T13:09:44.510 INFO:teuthology.orchestra.run.smithi083.stderr: 59950K .......... .......... .......... .......... .......... 35% 40.1M 4s 2024-03-30T13:09:44.511 INFO:teuthology.orchestra.run.smithi083.stderr: 60000K .......... .......... .......... .......... .......... 35% 39.8M 4s 2024-03-30T13:09:44.512 INFO:teuthology.orchestra.run.smithi083.stderr: 60050K .......... .......... .......... .......... .......... 35% 33.8M 4s 2024-03-30T13:09:44.513 INFO:teuthology.orchestra.run.smithi083.stderr: 60100K .......... .......... .......... .......... .......... 35% 39.7M 4s 2024-03-30T13:09:44.515 INFO:teuthology.orchestra.run.smithi083.stderr: 60150K .......... .......... .......... .......... .......... 35% 39.1M 4s 2024-03-30T13:09:44.516 INFO:teuthology.orchestra.run.smithi083.stderr: 60200K .......... .......... .......... .......... .......... 35% 38.9M 4s 2024-03-30T13:09:44.517 INFO:teuthology.orchestra.run.smithi083.stderr: 60250K .......... .......... .......... .......... .......... 35% 33.8M 4s 2024-03-30T13:09:44.519 INFO:teuthology.orchestra.run.smithi083.stderr: 60300K .......... .......... .......... .......... .......... 35% 39.3M 4s 2024-03-30T13:09:44.520 INFO:teuthology.orchestra.run.smithi083.stderr: 60350K .......... .......... .......... .......... .......... 35% 38.9M 4s 2024-03-30T13:09:44.521 INFO:teuthology.orchestra.run.smithi083.stderr: 60400K .......... .......... .......... .......... .......... 35% 39.0M 4s 2024-03-30T13:09:44.523 INFO:teuthology.orchestra.run.smithi083.stderr: 60450K .......... .......... .......... .......... .......... 35% 32.2M 4s 2024-03-30T13:09:44.524 INFO:teuthology.orchestra.run.smithi083.stderr: 60500K .......... .......... .......... .......... .......... 35% 39.1M 4s 2024-03-30T13:09:44.525 INFO:teuthology.orchestra.run.smithi083.stderr: 60550K .......... .......... .......... .......... .......... 35% 38.7M 4s 2024-03-30T13:09:44.527 INFO:teuthology.orchestra.run.smithi083.stderr: 60600K .......... .......... .......... .......... .......... 35% 37.4M 4s 2024-03-30T13:09:44.528 INFO:teuthology.orchestra.run.smithi083.stderr: 60650K .......... .......... .......... .......... .......... 36% 32.7M 4s 2024-03-30T13:09:44.529 INFO:teuthology.orchestra.run.smithi083.stderr: 60700K .......... .......... .......... .......... .......... 36% 37.5M 4s 2024-03-30T13:09:44.531 INFO:teuthology.orchestra.run.smithi083.stderr: 60750K .......... .......... .......... .......... .......... 36% 35.6M 4s 2024-03-30T13:09:44.532 INFO:teuthology.orchestra.run.smithi083.stderr: 60800K .......... .......... .......... .......... .......... 36% 36.6M 4s 2024-03-30T13:09:44.534 INFO:teuthology.orchestra.run.smithi083.stderr: 60850K .......... .......... .......... .......... .......... 36% 30.5M 4s 2024-03-30T13:09:44.535 INFO:teuthology.orchestra.run.smithi083.stderr: 60900K .......... .......... .......... .......... .......... 36% 35.3M 4s 2024-03-30T13:09:44.536 INFO:teuthology.orchestra.run.smithi083.stderr: 60950K .......... .......... .......... .......... .......... 36% 36.5M 4s 2024-03-30T13:09:44.538 INFO:teuthology.orchestra.run.smithi083.stderr: 61000K .......... .......... .......... .......... .......... 36% 35.9M 4s 2024-03-30T13:09:44.539 INFO:teuthology.orchestra.run.smithi083.stderr: 61050K .......... .......... .......... .......... .......... 36% 30.5M 4s 2024-03-30T13:09:44.541 INFO:teuthology.orchestra.run.smithi083.stderr: 61100K .......... .......... .......... .......... .......... 36% 36.2M 4s 2024-03-30T13:09:44.542 INFO:teuthology.orchestra.run.smithi083.stderr: 61150K .......... .......... .......... .......... .......... 36% 35.8M 4s 2024-03-30T13:09:44.543 INFO:teuthology.orchestra.run.smithi083.stderr: 61200K .......... .......... .......... .......... .......... 36% 35.2M 4s 2024-03-30T13:09:44.545 INFO:teuthology.orchestra.run.smithi083.stderr: 61250K .......... .......... .......... .......... .......... 36% 31.1M 4s 2024-03-30T13:09:44.547 INFO:teuthology.orchestra.run.smithi083.stderr: 61300K .......... .......... .......... .......... .......... 36% 31.5M 4s 2024-03-30T13:09:44.548 INFO:teuthology.orchestra.run.smithi083.stderr: 61350K .......... .......... .......... .......... .......... 36% 35.2M 4s 2024-03-30T13:09:44.550 INFO:teuthology.orchestra.run.smithi083.stderr: 61400K .......... .......... .......... .......... .......... 36% 34.5M 4s 2024-03-30T13:09:44.552 INFO:teuthology.orchestra.run.smithi083.stderr: 61450K .......... .......... .......... .......... .......... 36% 23.4M 4s 2024-03-30T13:09:44.553 INFO:teuthology.orchestra.run.smithi083.stderr: 61500K .......... .......... .......... .......... .......... 36% 29.8M 4s 2024-03-30T13:09:44.555 INFO:teuthology.orchestra.run.smithi083.stderr: 61550K .......... .......... .......... .......... .......... 36% 30.6M 4s 2024-03-30T13:09:44.556 INFO:teuthology.orchestra.run.smithi083.stderr: 61600K .......... .......... .......... .......... .......... 36% 36.0M 4s 2024-03-30T13:09:44.557 INFO:teuthology.orchestra.run.smithi083.stderr: 61650K .......... .......... .......... .......... .......... 36% 32.1M 4s 2024-03-30T13:09:44.559 INFO:teuthology.orchestra.run.smithi083.stderr: 61700K .......... .......... .......... .......... .......... 36% 30.1M 4s 2024-03-30T13:09:44.561 INFO:teuthology.orchestra.run.smithi083.stderr: 61750K .......... .......... .......... .......... .......... 36% 33.6M 4s 2024-03-30T13:09:44.562 INFO:teuthology.orchestra.run.smithi083.stderr: 61800K .......... .......... .......... .......... .......... 36% 31.6M 4s 2024-03-30T13:09:44.564 INFO:teuthology.orchestra.run.smithi083.stderr: 61850K .......... .......... .......... .......... .......... 36% 27.5M 4s 2024-03-30T13:09:44.565 INFO:teuthology.orchestra.run.smithi083.stderr: 61900K .......... .......... .......... .......... .......... 36% 31.5M 4s 2024-03-30T13:09:44.567 INFO:teuthology.orchestra.run.smithi083.stderr: 61950K .......... .......... .......... .......... .......... 36% 27.7M 4s 2024-03-30T13:09:44.569 INFO:teuthology.orchestra.run.smithi083.stderr: 62000K .......... .......... .......... .......... .......... 36% 34.1M 4s 2024-03-30T13:09:44.570 INFO:teuthology.orchestra.run.smithi083.stderr: 62050K .......... .......... .......... .......... .......... 36% 29.3M 4s 2024-03-30T13:09:44.572 INFO:teuthology.orchestra.run.smithi083.stderr: 62100K .......... .......... .......... .......... .......... 36% 30.9M 4s 2024-03-30T13:09:44.575 INFO:teuthology.orchestra.run.smithi083.stderr: 62150K .......... .......... .......... .......... .......... 36% 30.8M 4s 2024-03-30T13:09:44.575 INFO:teuthology.orchestra.run.smithi083.stderr: 62200K .......... .......... .......... .......... .......... 36% 29.2M 4s 2024-03-30T13:09:44.577 INFO:teuthology.orchestra.run.smithi083.stderr: 62250K .......... .......... .......... .......... .......... 36% 24.4M 4s 2024-03-30T13:09:44.579 INFO:teuthology.orchestra.run.smithi083.stderr: 62300K .......... .......... .......... .......... .......... 36% 27.9M 4s 2024-03-30T13:09:44.581 INFO:teuthology.orchestra.run.smithi083.stderr: 62350K .......... .......... .......... .......... .......... 37% 28.6M 4s 2024-03-30T13:09:44.582 INFO:teuthology.orchestra.run.smithi083.stderr: 62400K .......... .......... .......... .......... .......... 37% 27.9M 4s 2024-03-30T13:09:44.584 INFO:teuthology.orchestra.run.smithi083.stderr: 62450K .......... .......... .......... .......... .......... 37% 24.0M 4s 2024-03-30T13:09:44.587 INFO:teuthology.orchestra.run.smithi083.stderr: 62500K .......... .......... .......... .......... .......... 37% 22.5M 4s 2024-03-30T13:09:44.588 INFO:teuthology.orchestra.run.smithi083.stderr: 62550K .......... .......... .......... .......... .......... 37% 31.0M 4s 2024-03-30T13:09:44.590 INFO:teuthology.orchestra.run.smithi083.stderr: 62600K .......... .......... .......... .......... .......... 37% 30.9M 4s 2024-03-30T13:09:44.592 INFO:teuthology.orchestra.run.smithi083.stderr: 62650K .......... .......... .......... .......... .......... 37% 26.3M 4s 2024-03-30T13:09:44.593 INFO:teuthology.orchestra.run.smithi083.stderr: 62700K .......... .......... .......... .......... .......... 37% 29.9M 4s 2024-03-30T13:09:44.595 INFO:teuthology.orchestra.run.smithi083.stderr: 62750K .......... .......... .......... .......... .......... 37% 32.2M 4s 2024-03-30T13:09:44.596 INFO:teuthology.orchestra.run.smithi083.stderr: 62800K .......... .......... .......... .......... .......... 37% 31.9M 4s 2024-03-30T13:09:44.598 INFO:teuthology.orchestra.run.smithi083.stderr: 62850K .......... .......... .......... .......... .......... 37% 26.9M 4s 2024-03-30T13:09:44.599 INFO:teuthology.orchestra.run.smithi083.stderr: 62900K .......... .......... .......... .......... .......... 37% 34.1M 4s 2024-03-30T13:09:44.601 INFO:teuthology.orchestra.run.smithi083.stderr: 62950K .......... .......... .......... .......... .......... 37% 35.2M 4s 2024-03-30T13:09:44.602 INFO:teuthology.orchestra.run.smithi083.stderr: 63000K .......... .......... .......... .......... .......... 37% 34.4M 4s 2024-03-30T13:09:44.604 INFO:teuthology.orchestra.run.smithi083.stderr: 63050K .......... .......... .......... .......... .......... 37% 29.9M 4s 2024-03-30T13:09:44.606 INFO:teuthology.orchestra.run.smithi083.stderr: 63100K .......... .......... .......... .......... .......... 37% 31.5M 4s 2024-03-30T13:09:44.607 INFO:teuthology.orchestra.run.smithi083.stderr: 63150K .......... .......... .......... .......... .......... 37% 29.0M 4s 2024-03-30T13:09:44.609 INFO:teuthology.orchestra.run.smithi083.stderr: 63200K .......... .......... .......... .......... .......... 37% 30.5M 4s 2024-03-30T13:09:44.611 INFO:teuthology.orchestra.run.smithi083.stderr: 63250K .......... .......... .......... .......... .......... 37% 26.1M 4s 2024-03-30T13:09:44.612 INFO:teuthology.orchestra.run.smithi083.stderr: 63300K .......... .......... .......... .......... .......... 37% 31.0M 4s 2024-03-30T13:09:44.614 INFO:teuthology.orchestra.run.smithi083.stderr: 63350K .......... .......... .......... .......... .......... 37% 32.0M 4s 2024-03-30T13:09:44.615 INFO:teuthology.orchestra.run.smithi083.stderr: 63400K .......... .......... .......... .......... .......... 37% 32.1M 4s 2024-03-30T13:09:44.617 INFO:teuthology.orchestra.run.smithi083.stderr: 63450K .......... .......... .......... .......... .......... 37% 28.6M 4s 2024-03-30T13:09:44.618 INFO:teuthology.orchestra.run.smithi083.stderr: 63500K .......... .......... .......... .......... .......... 37% 33.7M 4s 2024-03-30T13:09:44.620 INFO:teuthology.orchestra.run.smithi083.stderr: 63550K .......... .......... .......... .......... .......... 37% 33.7M 4s 2024-03-30T13:09:44.621 INFO:teuthology.orchestra.run.smithi083.stderr: 63600K .......... .......... .......... .......... .......... 37% 33.0M 4s 2024-03-30T13:09:44.624 INFO:teuthology.orchestra.run.smithi083.stderr: 63650K .......... .......... .......... .......... .......... 37% 17.1M 4s 2024-03-30T13:09:44.634 INFO:teuthology.orchestra.run.smithi083.stderr: 63700K .......... .......... .......... .......... .......... 37% 33.7M 4s 2024-03-30T13:09:44.634 INFO:teuthology.orchestra.run.smithi083.stderr: 63750K .......... .......... .......... .......... .......... 37% 33.3M 4s 2024-03-30T13:09:44.634 INFO:teuthology.orchestra.run.smithi083.stderr: 63800K .......... .......... .......... .......... .......... 37% 34.1M 4s 2024-03-30T13:09:44.634 INFO:teuthology.orchestra.run.smithi083.stderr: 63850K .......... .......... .......... .......... .......... 37% 29.0M 4s 2024-03-30T13:09:44.634 INFO:teuthology.orchestra.run.smithi083.stderr: 63900K .......... .......... .......... .......... .......... 37% 33.5M 4s 2024-03-30T13:09:44.635 INFO:teuthology.orchestra.run.smithi083.stderr: 63950K .......... .......... .......... .......... .......... 37% 33.7M 4s 2024-03-30T13:09:44.636 INFO:teuthology.orchestra.run.smithi083.stderr: 64000K .......... .......... .......... .......... .......... 37% 26.4M 4s 2024-03-30T13:09:44.638 INFO:teuthology.orchestra.run.smithi083.stderr: 64050K .......... .......... .......... .......... .......... 38% 24.3M 4s 2024-03-30T13:09:44.639 INFO:teuthology.orchestra.run.smithi083.stderr: 64100K .......... .......... .......... .......... .......... 38% 24.0M 4s 2024-03-30T13:09:44.641 INFO:teuthology.orchestra.run.smithi083.stderr: 64150K .......... .......... .......... .......... .......... 38% 25.2M 4s 2024-03-30T13:09:44.643 INFO:teuthology.orchestra.run.smithi083.stderr: 64200K .......... .......... .......... .......... .......... 38% 27.3M 4s 2024-03-30T13:09:44.645 INFO:teuthology.orchestra.run.smithi083.stderr: 64250K .......... .......... .......... .......... .......... 38% 24.0M 4s 2024-03-30T13:09:44.651 INFO:teuthology.orchestra.run.smithi083.stderr: 64300K .......... .......... .......... .......... .......... 38% 25.5M 4s 2024-03-30T13:09:44.651 INFO:teuthology.orchestra.run.smithi083.stderr: 64350K .......... .......... .......... .......... .......... 38% 25.6M 4s 2024-03-30T13:09:44.651 INFO:teuthology.orchestra.run.smithi083.stderr: 64400K .......... .......... .......... .......... .......... 38% 27.0M 4s 2024-03-30T13:09:44.653 INFO:teuthology.orchestra.run.smithi083.stderr: 64450K .......... .......... .......... .......... .......... 38% 22.3M 4s 2024-03-30T13:09:44.655 INFO:teuthology.orchestra.run.smithi083.stderr: 64500K .......... .......... .......... .......... .......... 38% 23.6M 4s 2024-03-30T13:09:44.657 INFO:teuthology.orchestra.run.smithi083.stderr: 64550K .......... .......... .......... .......... .......... 38% 21.9M 4s 2024-03-30T13:09:44.659 INFO:teuthology.orchestra.run.smithi083.stderr: 64600K .......... .......... .......... .......... .......... 38% 26.2M 4s 2024-03-30T13:09:44.661 INFO:teuthology.orchestra.run.smithi083.stderr: 64650K .......... .......... .......... .......... .......... 38% 22.9M 4s 2024-03-30T13:09:44.663 INFO:teuthology.orchestra.run.smithi083.stderr: 64700K .......... .......... .......... .......... .......... 38% 26.7M 4s 2024-03-30T13:09:44.664 INFO:teuthology.orchestra.run.smithi083.stderr: 64750K .......... .......... .......... .......... .......... 38% 27.2M 4s 2024-03-30T13:09:44.666 INFO:teuthology.orchestra.run.smithi083.stderr: 64800K .......... .......... .......... .......... .......... 38% 25.9M 4s 2024-03-30T13:09:44.673 INFO:teuthology.orchestra.run.smithi083.stderr: 64850K .......... .......... .......... .......... .......... 38% 25.8M 4s 2024-03-30T13:09:44.673 INFO:teuthology.orchestra.run.smithi083.stderr: 64900K .......... .......... .......... .......... .......... 38% 29.0M 4s 2024-03-30T13:09:44.673 INFO:teuthology.orchestra.run.smithi083.stderr: 64950K .......... .......... .......... .......... .......... 38% 28.3M 4s 2024-03-30T13:09:44.674 INFO:teuthology.orchestra.run.smithi083.stderr: 65000K .......... .......... .......... .......... .......... 38% 28.6M 4s 2024-03-30T13:09:44.676 INFO:teuthology.orchestra.run.smithi083.stderr: 65050K .......... .......... .......... .......... .......... 38% 24.0M 4s 2024-03-30T13:09:44.678 INFO:teuthology.orchestra.run.smithi083.stderr: 65100K .......... .......... .......... .......... .......... 38% 28.2M 4s 2024-03-30T13:09:44.679 INFO:teuthology.orchestra.run.smithi083.stderr: 65150K .......... .......... .......... .......... .......... 38% 28.3M 4s 2024-03-30T13:09:44.681 INFO:teuthology.orchestra.run.smithi083.stderr: 65200K .......... .......... .......... .......... .......... 38% 28.6M 4s 2024-03-30T13:09:44.683 INFO:teuthology.orchestra.run.smithi083.stderr: 65250K .......... .......... .......... .......... .......... 38% 23.9M 4s 2024-03-30T13:09:44.684 INFO:teuthology.orchestra.run.smithi083.stderr: 65300K .......... .......... .......... .......... .......... 38% 29.1M 4s 2024-03-30T13:09:44.686 INFO:teuthology.orchestra.run.smithi083.stderr: 65350K .......... .......... .......... .......... .......... 38% 32.4M 4s 2024-03-30T13:09:44.687 INFO:teuthology.orchestra.run.smithi083.stderr: 65400K .......... .......... .......... .......... .......... 38% 33.1M 4s 2024-03-30T13:09:44.690 INFO:teuthology.orchestra.run.smithi083.stderr: 65450K .......... .......... .......... .......... .......... 38% 28.4M 4s 2024-03-30T13:09:44.691 INFO:teuthology.orchestra.run.smithi083.stderr: 65500K .......... .......... .......... .......... .......... 38% 30.1M 4s 2024-03-30T13:09:44.692 INFO:teuthology.orchestra.run.smithi083.stderr: 65550K .......... .......... .......... .......... .......... 38% 34.7M 4s 2024-03-30T13:09:44.694 INFO:teuthology.orchestra.run.smithi083.stderr: 65600K .......... .......... .......... .......... .......... 38% 27.9M 4s 2024-03-30T13:09:44.696 INFO:teuthology.orchestra.run.smithi083.stderr: 65650K .......... .......... .......... .......... .......... 38% 23.7M 4s 2024-03-30T13:09:44.697 INFO:teuthology.orchestra.run.smithi083.stderr: 65700K .......... .......... .......... .......... .......... 39% 32.5M 4s 2024-03-30T13:09:44.700 INFO:teuthology.orchestra.run.smithi083.stderr: 65750K .......... .......... .......... .......... .......... 39% 21.7M 4s 2024-03-30T13:09:44.702 INFO:teuthology.orchestra.run.smithi083.stderr: 65800K .......... .......... .......... .......... .......... 39% 25.6M 4s 2024-03-30T13:09:44.704 INFO:teuthology.orchestra.run.smithi083.stderr: 65850K .......... .......... .......... .......... .......... 39% 23.3M 4s 2024-03-30T13:09:44.705 INFO:teuthology.orchestra.run.smithi083.stderr: 65900K .......... .......... .......... .......... .......... 39% 26.8M 4s 2024-03-30T13:09:44.707 INFO:teuthology.orchestra.run.smithi083.stderr: 65950K .......... .......... .......... .......... .......... 39% 31.2M 4s 2024-03-30T13:09:44.708 INFO:teuthology.orchestra.run.smithi083.stderr: 66000K .......... .......... .......... .......... .......... 39% 38.6M 4s 2024-03-30T13:09:44.711 INFO:teuthology.orchestra.run.smithi083.stderr: 66050K .......... .......... .......... .......... .......... 39% 29.5M 4s 2024-03-30T13:09:44.713 INFO:teuthology.orchestra.run.smithi083.stderr: 66100K .......... .......... .......... .......... .......... 39% 39.8M 4s 2024-03-30T13:09:44.713 INFO:teuthology.orchestra.run.smithi083.stderr: 66150K .......... .......... .......... .......... .......... 39% 36.8M 4s 2024-03-30T13:09:44.716 INFO:teuthology.orchestra.run.smithi083.stderr: 66200K .......... .......... .......... .......... .......... 39% 39.3M 4s 2024-03-30T13:09:44.716 INFO:teuthology.orchestra.run.smithi083.stderr: 66250K .......... .......... .......... .......... .......... 39% 33.8M 4s 2024-03-30T13:09:44.717 INFO:teuthology.orchestra.run.smithi083.stderr: 66300K .......... .......... .......... .......... .......... 39% 38.7M 4s 2024-03-30T13:09:44.718 INFO:teuthology.orchestra.run.smithi083.stderr: 66350K .......... .......... .......... .......... .......... 39% 37.4M 4s 2024-03-30T13:09:44.719 INFO:teuthology.orchestra.run.smithi083.stderr: 66400K .......... .......... .......... .......... .......... 39% 36.1M 4s 2024-03-30T13:09:44.721 INFO:teuthology.orchestra.run.smithi083.stderr: 66450K .......... .......... .......... .......... .......... 39% 31.1M 4s 2024-03-30T13:09:44.722 INFO:teuthology.orchestra.run.smithi083.stderr: 66500K .......... .......... .......... .......... .......... 39% 35.5M 4s 2024-03-30T13:09:44.723 INFO:teuthology.orchestra.run.smithi083.stderr: 66550K .......... .......... .......... .......... .......... 39% 36.9M 4s 2024-03-30T13:09:44.725 INFO:teuthology.orchestra.run.smithi083.stderr: 66600K .......... .......... .......... .......... .......... 39% 26.0M 4s 2024-03-30T13:09:44.727 INFO:teuthology.orchestra.run.smithi083.stderr: 66650K .......... .......... .......... .......... .......... 39% 32.7M 4s 2024-03-30T13:09:44.728 INFO:teuthology.orchestra.run.smithi083.stderr: 66700K .......... .......... .......... .......... .......... 39% 38.8M 4s 2024-03-30T13:09:44.729 INFO:teuthology.orchestra.run.smithi083.stderr: 66750K .......... .......... .......... .......... .......... 39% 39.1M 4s 2024-03-30T13:09:44.731 INFO:teuthology.orchestra.run.smithi083.stderr: 66800K .......... .......... .......... .......... .......... 39% 38.7M 4s 2024-03-30T13:09:44.732 INFO:teuthology.orchestra.run.smithi083.stderr: 66850K .......... .......... .......... .......... .......... 39% 33.3M 4s 2024-03-30T13:09:44.733 INFO:teuthology.orchestra.run.smithi083.stderr: 66900K .......... .......... .......... .......... .......... 39% 39.0M 4s 2024-03-30T13:09:44.735 INFO:teuthology.orchestra.run.smithi083.stderr: 66950K .......... .......... .......... .......... .......... 39% 37.3M 4s 2024-03-30T13:09:44.736 INFO:teuthology.orchestra.run.smithi083.stderr: 67000K .......... .......... .......... .......... .......... 39% 39.6M 4s 2024-03-30T13:09:44.737 INFO:teuthology.orchestra.run.smithi083.stderr: 67050K .......... .......... .......... .......... .......... 39% 33.2M 4s 2024-03-30T13:09:44.739 INFO:teuthology.orchestra.run.smithi083.stderr: 67100K .......... .......... .......... .......... .......... 39% 36.8M 4s 2024-03-30T13:09:44.740 INFO:teuthology.orchestra.run.smithi083.stderr: 67150K .......... .......... .......... .......... .......... 39% 37.7M 4s 2024-03-30T13:09:44.741 INFO:teuthology.orchestra.run.smithi083.stderr: 67200K .......... .......... .......... .......... .......... 39% 35.8M 4s 2024-03-30T13:09:44.743 INFO:teuthology.orchestra.run.smithi083.stderr: 67250K .......... .......... .......... .......... .......... 39% 30.4M 4s 2024-03-30T13:09:44.744 INFO:teuthology.orchestra.run.smithi083.stderr: 67300K .......... .......... .......... .......... .......... 39% 36.6M 4s 2024-03-30T13:09:44.745 INFO:teuthology.orchestra.run.smithi083.stderr: 67350K .......... .......... .......... .......... .......... 39% 35.8M 4s 2024-03-30T13:09:44.747 INFO:teuthology.orchestra.run.smithi083.stderr: 67400K .......... .......... .......... .......... .......... 40% 32.8M 4s 2024-03-30T13:09:44.748 INFO:teuthology.orchestra.run.smithi083.stderr: 67450K .......... .......... .......... .......... .......... 40% 32.2M 4s 2024-03-30T13:09:44.750 INFO:teuthology.orchestra.run.smithi083.stderr: 67500K .......... .......... .......... .......... .......... 40% 36.3M 4s 2024-03-30T13:09:44.752 INFO:teuthology.orchestra.run.smithi083.stderr: 67550K .......... .......... .......... .......... .......... 40% 31.9M 4s 2024-03-30T13:09:44.754 INFO:teuthology.orchestra.run.smithi083.stderr: 67600K .......... .......... .......... .......... .......... 40% 28.1M 4s 2024-03-30T13:09:44.756 INFO:teuthology.orchestra.run.smithi083.stderr: 67650K .......... .......... .......... .......... .......... 40% 24.4M 4s 2024-03-30T13:09:44.757 INFO:teuthology.orchestra.run.smithi083.stderr: 67700K .......... .......... .......... .......... .......... 40% 29.1M 4s 2024-03-30T13:09:44.762 INFO:teuthology.orchestra.run.smithi083.stderr: 67750K .......... .......... .......... .......... .......... 40% 15.1M 4s 2024-03-30T13:09:44.762 INFO:teuthology.orchestra.run.smithi083.stderr: 67800K .......... .......... .......... .......... .......... 40% 33.2M 4s 2024-03-30T13:09:44.763 INFO:teuthology.orchestra.run.smithi083.stderr: 67850K .......... .......... .......... .......... .......... 40% 28.3M 4s 2024-03-30T13:09:44.765 INFO:teuthology.orchestra.run.smithi083.stderr: 67900K .......... .......... .......... .......... .......... 40% 34.0M 4s 2024-03-30T13:09:44.766 INFO:teuthology.orchestra.run.smithi083.stderr: 67950K .......... .......... .......... .......... .......... 40% 32.1M 4s 2024-03-30T13:09:44.767 INFO:teuthology.orchestra.run.smithi083.stderr: 68000K .......... .......... .......... .......... .......... 40% 33.0M 4s 2024-03-30T13:09:44.769 INFO:teuthology.orchestra.run.smithi083.stderr: 68050K .......... .......... .......... .......... .......... 40% 28.4M 4s 2024-03-30T13:09:44.771 INFO:teuthology.orchestra.run.smithi083.stderr: 68100K .......... .......... .......... .......... .......... 40% 33.4M 4s 2024-03-30T13:09:44.772 INFO:teuthology.orchestra.run.smithi083.stderr: 68150K .......... .......... .......... .......... .......... 40% 33.9M 4s 2024-03-30T13:09:44.774 INFO:teuthology.orchestra.run.smithi083.stderr: 68200K .......... .......... .......... .......... .......... 40% 33.6M 4s 2024-03-30T13:09:44.775 INFO:teuthology.orchestra.run.smithi083.stderr: 68250K .......... .......... .......... .......... .......... 40% 26.8M 4s 2024-03-30T13:09:44.777 INFO:teuthology.orchestra.run.smithi083.stderr: 68300K .......... .......... .......... .......... .......... 40% 32.2M 4s 2024-03-30T13:09:44.779 INFO:teuthology.orchestra.run.smithi083.stderr: 68350K .......... .......... .......... .......... .......... 40% 31.6M 4s 2024-03-30T13:09:44.781 INFO:teuthology.orchestra.run.smithi083.stderr: 68400K .......... .......... .......... .......... .......... 40% 32.4M 4s 2024-03-30T13:09:44.782 INFO:teuthology.orchestra.run.smithi083.stderr: 68450K .......... .......... .......... .......... .......... 40% 28.4M 4s 2024-03-30T13:09:44.785 INFO:teuthology.orchestra.run.smithi083.stderr: 68500K .......... .......... .......... .......... .......... 40% 32.3M 4s 2024-03-30T13:09:44.785 INFO:teuthology.orchestra.run.smithi083.stderr: 68550K .......... .......... .......... .......... .......... 40% 32.1M 4s 2024-03-30T13:09:44.787 INFO:teuthology.orchestra.run.smithi083.stderr: 68600K .......... .......... .......... .......... .......... 40% 31.4M 4s 2024-03-30T13:09:44.788 INFO:teuthology.orchestra.run.smithi083.stderr: 68650K .......... .......... .......... .......... .......... 40% 27.6M 4s 2024-03-30T13:09:44.790 INFO:teuthology.orchestra.run.smithi083.stderr: 68700K .......... .......... .......... .......... .......... 40% 31.6M 4s 2024-03-30T13:09:44.791 INFO:teuthology.orchestra.run.smithi083.stderr: 68750K .......... .......... .......... .......... .......... 40% 31.4M 4s 2024-03-30T13:09:44.793 INFO:teuthology.orchestra.run.smithi083.stderr: 68800K .......... .......... .......... .......... .......... 40% 31.5M 4s 2024-03-30T13:09:44.795 INFO:teuthology.orchestra.run.smithi083.stderr: 68850K .......... .......... .......... .......... .......... 40% 26.0M 4s 2024-03-30T13:09:44.796 INFO:teuthology.orchestra.run.smithi083.stderr: 68900K .......... .......... .......... .......... .......... 40% 29.9M 4s 2024-03-30T13:09:44.798 INFO:teuthology.orchestra.run.smithi083.stderr: 68950K .......... .......... .......... .......... .......... 40% 30.4M 4s 2024-03-30T13:09:44.800 INFO:teuthology.orchestra.run.smithi083.stderr: 69000K .......... .......... .......... .......... .......... 40% 29.6M 4s 2024-03-30T13:09:44.801 INFO:teuthology.orchestra.run.smithi083.stderr: 69050K .......... .......... .......... .......... .......... 40% 25.8M 4s 2024-03-30T13:09:44.803 INFO:teuthology.orchestra.run.smithi083.stderr: 69100K .......... .......... .......... .......... .......... 41% 29.2M 4s 2024-03-30T13:09:44.805 INFO:teuthology.orchestra.run.smithi083.stderr: 69150K .......... .......... .......... .......... .......... 41% 29.5M 4s 2024-03-30T13:09:44.806 INFO:teuthology.orchestra.run.smithi083.stderr: 69200K .......... .......... .......... .......... .......... 41% 29.1M 4s 2024-03-30T13:09:44.808 INFO:teuthology.orchestra.run.smithi083.stderr: 69250K .......... .......... .......... .......... .......... 41% 25.3M 4s 2024-03-30T13:09:44.810 INFO:teuthology.orchestra.run.smithi083.stderr: 69300K .......... .......... .......... .......... .......... 41% 29.3M 4s 2024-03-30T13:09:44.812 INFO:teuthology.orchestra.run.smithi083.stderr: 69350K .......... .......... .......... .......... .......... 41% 29.0M 4s 2024-03-30T13:09:44.814 INFO:teuthology.orchestra.run.smithi083.stderr: 69400K .......... .......... .......... .......... .......... 41% 28.6M 4s 2024-03-30T13:09:44.815 INFO:teuthology.orchestra.run.smithi083.stderr: 69450K .......... .......... .......... .......... .......... 41% 24.0M 4s 2024-03-30T13:09:44.817 INFO:teuthology.orchestra.run.smithi083.stderr: 69500K .......... .......... .......... .......... .......... 41% 26.1M 4s 2024-03-30T13:09:44.819 INFO:teuthology.orchestra.run.smithi083.stderr: 69550K .......... .......... .......... .......... .......... 41% 26.0M 4s 2024-03-30T13:09:44.821 INFO:teuthology.orchestra.run.smithi083.stderr: 69600K .......... .......... .......... .......... .......... 41% 23.5M 4s 2024-03-30T13:09:44.823 INFO:teuthology.orchestra.run.smithi083.stderr: 69650K .......... .......... .......... .......... .......... 41% 25.6M 4s 2024-03-30T13:09:44.824 INFO:teuthology.orchestra.run.smithi083.stderr: 69700K .......... .......... .......... .......... .......... 41% 40.7M 4s 2024-03-30T13:09:44.827 INFO:teuthology.orchestra.run.smithi083.stderr: 69750K .......... .......... .......... .......... .......... 41% 24.2M 4s 2024-03-30T13:09:44.829 INFO:teuthology.orchestra.run.smithi083.stderr: 69800K .......... .......... .......... .......... .......... 41% 23.6M 4s 2024-03-30T13:09:44.831 INFO:teuthology.orchestra.run.smithi083.stderr: 69850K .......... .......... .......... .......... .......... 41% 21.4M 4s 2024-03-30T13:09:44.833 INFO:teuthology.orchestra.run.smithi083.stderr: 69900K .......... .......... .......... .......... .......... 41% 26.1M 4s 2024-03-30T13:09:44.834 INFO:teuthology.orchestra.run.smithi083.stderr: 69950K .......... .......... .......... .......... .......... 41% 27.5M 4s 2024-03-30T13:09:44.837 INFO:teuthology.orchestra.run.smithi083.stderr: 70000K .......... .......... .......... .......... .......... 41% 28.4M 4s 2024-03-30T13:09:44.839 INFO:teuthology.orchestra.run.smithi083.stderr: 70050K .......... .......... .......... .......... .......... 41% 22.5M 4s 2024-03-30T13:09:44.840 INFO:teuthology.orchestra.run.smithi083.stderr: 70100K .......... .......... .......... .......... .......... 41% 26.9M 4s 2024-03-30T13:09:44.842 INFO:teuthology.orchestra.run.smithi083.stderr: 70150K .......... .......... .......... .......... .......... 41% 23.3M 4s 2024-03-30T13:09:44.844 INFO:teuthology.orchestra.run.smithi083.stderr: 70200K .......... .......... .......... .......... .......... 41% 28.1M 4s 2024-03-30T13:09:44.846 INFO:teuthology.orchestra.run.smithi083.stderr: 70250K .......... .......... .......... .......... .......... 41% 23.7M 4s 2024-03-30T13:09:44.848 INFO:teuthology.orchestra.run.smithi083.stderr: 70300K .......... .......... .......... .......... .......... 41% 32.9M 4s 2024-03-30T13:09:44.849 INFO:teuthology.orchestra.run.smithi083.stderr: 70350K .......... .......... .......... .......... .......... 41% 38.7M 4s 2024-03-30T13:09:44.850 INFO:teuthology.orchestra.run.smithi083.stderr: 70400K .......... .......... .......... .......... .......... 41% 37.7M 3s 2024-03-30T13:09:44.852 INFO:teuthology.orchestra.run.smithi083.stderr: 70450K .......... .......... .......... .......... .......... 41% 31.8M 3s 2024-03-30T13:09:44.853 INFO:teuthology.orchestra.run.smithi083.stderr: 70500K .......... .......... .......... .......... .......... 41% 36.5M 3s 2024-03-30T13:09:44.854 INFO:teuthology.orchestra.run.smithi083.stderr: 70550K .......... .......... .......... .......... .......... 41% 36.7M 3s 2024-03-30T13:09:44.856 INFO:teuthology.orchestra.run.smithi083.stderr: 70600K .......... .......... .......... .......... .......... 41% 36.3M 3s 2024-03-30T13:09:44.857 INFO:teuthology.orchestra.run.smithi083.stderr: 70650K .......... .......... .......... .......... .......... 41% 32.2M 3s 2024-03-30T13:09:44.859 INFO:teuthology.orchestra.run.smithi083.stderr: 70700K .......... .......... .......... .......... .......... 41% 26.0M 3s 2024-03-30T13:09:44.860 INFO:teuthology.orchestra.run.smithi083.stderr: 70750K .......... .......... .......... .......... .......... 42% 39.8M 3s 2024-03-30T13:09:44.862 INFO:teuthology.orchestra.run.smithi083.stderr: 70800K .......... .......... .......... .......... .......... 42% 39.7M 3s 2024-03-30T13:09:44.863 INFO:teuthology.orchestra.run.smithi083.stderr: 70850K .......... .......... .......... .......... .......... 42% 29.4M 3s 2024-03-30T13:09:44.864 INFO:teuthology.orchestra.run.smithi083.stderr: 70900K .......... .......... .......... .......... .......... 42% 37.5M 3s 2024-03-30T13:09:44.866 INFO:teuthology.orchestra.run.smithi083.stderr: 70950K .......... .......... .......... .......... .......... 42% 32.9M 3s 2024-03-30T13:09:44.867 INFO:teuthology.orchestra.run.smithi083.stderr: 71000K .......... .......... .......... .......... .......... 42% 33.5M 3s 2024-03-30T13:09:44.869 INFO:teuthology.orchestra.run.smithi083.stderr: 71050K .......... .......... .......... .......... .......... 42% 26.3M 3s 2024-03-30T13:09:44.875 INFO:teuthology.orchestra.run.smithi083.stderr: 71100K .......... .......... .......... .......... .......... 42% 28.2M 3s 2024-03-30T13:09:44.875 INFO:teuthology.orchestra.run.smithi083.stderr: 71150K .......... .......... .......... .......... .......... 42% 25.4M 3s 2024-03-30T13:09:44.875 INFO:teuthology.orchestra.run.smithi083.stderr: 71200K .......... .......... .......... .......... .......... 42% 29.1M 3s 2024-03-30T13:09:44.877 INFO:teuthology.orchestra.run.smithi083.stderr: 71250K .......... .......... .......... .......... .......... 42% 27.2M 3s 2024-03-30T13:09:44.878 INFO:teuthology.orchestra.run.smithi083.stderr: 71300K .......... .......... .......... .......... .......... 42% 33.8M 3s 2024-03-30T13:09:44.880 INFO:teuthology.orchestra.run.smithi083.stderr: 71350K .......... .......... .......... .......... .......... 42% 23.6M 3s 2024-03-30T13:09:44.881 INFO:teuthology.orchestra.run.smithi083.stderr: 71400K .......... .......... .......... .......... .......... 42% 30.9M 3s 2024-03-30T13:09:44.884 INFO:teuthology.orchestra.run.smithi083.stderr: 71450K .......... .......... .......... .......... .......... 42% 22.5M 3s 2024-03-30T13:09:44.885 INFO:teuthology.orchestra.run.smithi083.stderr: 71500K .......... .......... .......... .......... .......... 42% 30.9M 3s 2024-03-30T13:09:44.887 INFO:teuthology.orchestra.run.smithi083.stderr: 71550K .......... .......... .......... .......... .......... 42% 30.3M 3s 2024-03-30T13:09:44.888 INFO:teuthology.orchestra.run.smithi083.stderr: 71600K .......... .......... .......... .......... .......... 42% 32.1M 3s 2024-03-30T13:09:44.890 INFO:teuthology.orchestra.run.smithi083.stderr: 71650K .......... .......... .......... .......... .......... 42% 25.6M 3s 2024-03-30T13:09:44.892 INFO:teuthology.orchestra.run.smithi083.stderr: 71700K .......... .......... .......... .......... .......... 42% 27.9M 3s 2024-03-30T13:09:44.894 INFO:teuthology.orchestra.run.smithi083.stderr: 71750K .......... .......... .......... .......... .......... 42% 30.7M 3s 2024-03-30T13:09:44.895 INFO:teuthology.orchestra.run.smithi083.stderr: 71800K .......... .......... .......... .......... .......... 42% 30.2M 3s 2024-03-30T13:09:44.898 INFO:teuthology.orchestra.run.smithi083.stderr: 71850K .......... .......... .......... .......... .......... 42% 16.5M 3s 2024-03-30T13:09:44.900 INFO:teuthology.orchestra.run.smithi083.stderr: 71900K .......... .......... .......... .......... .......... 42% 35.4M 3s 2024-03-30T13:09:44.901 INFO:teuthology.orchestra.run.smithi083.stderr: 71950K .......... .......... .......... .......... .......... 42% 34.2M 3s 2024-03-30T13:09:44.903 INFO:teuthology.orchestra.run.smithi083.stderr: 72000K .......... .......... .......... .......... .......... 42% 33.1M 3s 2024-03-30T13:09:44.904 INFO:teuthology.orchestra.run.smithi083.stderr: 72050K .......... .......... .......... .......... .......... 42% 30.0M 3s 2024-03-30T13:09:44.906 INFO:teuthology.orchestra.run.smithi083.stderr: 72100K .......... .......... .......... .......... .......... 42% 33.7M 3s 2024-03-30T13:09:44.907 INFO:teuthology.orchestra.run.smithi083.stderr: 72150K .......... .......... .......... .......... .......... 42% 32.9M 3s 2024-03-30T13:09:44.909 INFO:teuthology.orchestra.run.smithi083.stderr: 72200K .......... .......... .......... .......... .......... 42% 33.5M 3s 2024-03-30T13:09:44.910 INFO:teuthology.orchestra.run.smithi083.stderr: 72250K .......... .......... .......... .......... .......... 42% 29.2M 3s 2024-03-30T13:09:44.912 INFO:teuthology.orchestra.run.smithi083.stderr: 72300K .......... .......... .......... .......... .......... 42% 34.5M 3s 2024-03-30T13:09:44.913 INFO:teuthology.orchestra.run.smithi083.stderr: 72350K .......... .......... .......... .......... .......... 42% 34.9M 3s 2024-03-30T13:09:44.915 INFO:teuthology.orchestra.run.smithi083.stderr: 72400K .......... .......... .......... .......... .......... 42% 32.7M 3s 2024-03-30T13:09:44.916 INFO:teuthology.orchestra.run.smithi083.stderr: 72450K .......... .......... .......... .......... .......... 43% 29.3M 3s 2024-03-30T13:09:44.917 INFO:teuthology.orchestra.run.smithi083.stderr: 72500K .......... .......... .......... .......... .......... 43% 34.3M 3s 2024-03-30T13:09:44.919 INFO:teuthology.orchestra.run.smithi083.stderr: 72550K .......... .......... .......... .......... .......... 43% 30.9M 3s 2024-03-30T13:09:44.921 INFO:teuthology.orchestra.run.smithi083.stderr: 72600K .......... .......... .......... .......... .......... 43% 30.8M 3s 2024-03-30T13:09:44.922 INFO:teuthology.orchestra.run.smithi083.stderr: 72650K .......... .......... .......... .......... .......... 43% 27.2M 3s 2024-03-30T13:09:44.924 INFO:teuthology.orchestra.run.smithi083.stderr: 72700K .......... .......... .......... .......... .......... 43% 30.2M 3s 2024-03-30T13:09:44.926 INFO:teuthology.orchestra.run.smithi083.stderr: 72750K .......... .......... .......... .......... .......... 43% 31.7M 3s 2024-03-30T13:09:44.927 INFO:teuthology.orchestra.run.smithi083.stderr: 72800K .......... .......... .......... .......... .......... 43% 29.2M 3s 2024-03-30T13:09:44.929 INFO:teuthology.orchestra.run.smithi083.stderr: 72850K .......... .......... .......... .......... .......... 43% 27.0M 3s 2024-03-30T13:09:44.931 INFO:teuthology.orchestra.run.smithi083.stderr: 72900K .......... .......... .......... .......... .......... 43% 31.1M 3s 2024-03-30T13:09:44.932 INFO:teuthology.orchestra.run.smithi083.stderr: 72950K .......... .......... .......... .......... .......... 43% 31.2M 3s 2024-03-30T13:09:44.934 INFO:teuthology.orchestra.run.smithi083.stderr: 73000K .......... .......... .......... .......... .......... 43% 30.9M 3s 2024-03-30T13:09:44.936 INFO:teuthology.orchestra.run.smithi083.stderr: 73050K .......... .......... .......... .......... .......... 43% 24.6M 3s 2024-03-30T13:09:44.937 INFO:teuthology.orchestra.run.smithi083.stderr: 73100K .......... .......... .......... .......... .......... 43% 29.5M 3s 2024-03-30T13:09:44.939 INFO:teuthology.orchestra.run.smithi083.stderr: 73150K .......... .......... .......... .......... .......... 43% 27.5M 3s 2024-03-30T13:09:44.941 INFO:teuthology.orchestra.run.smithi083.stderr: 73200K .......... .......... .......... .......... .......... 43% 29.2M 3s 2024-03-30T13:09:44.943 INFO:teuthology.orchestra.run.smithi083.stderr: 73250K .......... .......... .......... .......... .......... 43% 26.7M 3s 2024-03-30T13:09:44.944 INFO:teuthology.orchestra.run.smithi083.stderr: 73300K .......... .......... .......... .......... .......... 43% 32.1M 3s 2024-03-30T13:09:44.946 INFO:teuthology.orchestra.run.smithi083.stderr: 73350K .......... .......... .......... .......... .......... 43% 33.4M 3s 2024-03-30T13:09:44.947 INFO:teuthology.orchestra.run.smithi083.stderr: 73400K .......... .......... .......... .......... .......... 43% 33.4M 3s 2024-03-30T13:09:44.949 INFO:teuthology.orchestra.run.smithi083.stderr: 73450K .......... .......... .......... .......... .......... 43% 29.1M 3s 2024-03-30T13:09:44.951 INFO:teuthology.orchestra.run.smithi083.stderr: 73500K .......... .......... .......... .......... .......... 43% 31.6M 3s 2024-03-30T13:09:44.952 INFO:teuthology.orchestra.run.smithi083.stderr: 73550K .......... .......... .......... .......... .......... 43% 32.3M 3s 2024-03-30T13:09:44.953 INFO:teuthology.orchestra.run.smithi083.stderr: 73600K .......... .......... .......... .......... .......... 43% 34.1M 3s 2024-03-30T13:09:44.956 INFO:teuthology.orchestra.run.smithi083.stderr: 73650K .......... .......... .......... .......... .......... 43% 28.6M 3s 2024-03-30T13:09:44.957 INFO:teuthology.orchestra.run.smithi083.stderr: 73700K .......... .......... .......... .......... .......... 43% 28.6M 3s 2024-03-30T13:09:44.959 INFO:teuthology.orchestra.run.smithi083.stderr: 73750K .......... .......... .......... .......... .......... 43% 29.6M 3s 2024-03-30T13:09:44.960 INFO:teuthology.orchestra.run.smithi083.stderr: 73800K .......... .......... .......... .......... .......... 43% 31.1M 3s 2024-03-30T13:09:44.962 INFO:teuthology.orchestra.run.smithi083.stderr: 73850K .......... .......... .......... .......... .......... 43% 27.9M 3s 2024-03-30T13:09:44.963 INFO:teuthology.orchestra.run.smithi083.stderr: 73900K .......... .......... .......... .......... .......... 43% 35.2M 3s 2024-03-30T13:09:44.965 INFO:teuthology.orchestra.run.smithi083.stderr: 73950K .......... .......... .......... .......... .......... 43% 31.3M 3s 2024-03-30T13:09:44.966 INFO:teuthology.orchestra.run.smithi083.stderr: 74000K .......... .......... .......... .......... .......... 43% 31.2M 3s 2024-03-30T13:09:44.968 INFO:teuthology.orchestra.run.smithi083.stderr: 74050K .......... .......... .......... .......... .......... 43% 23.6M 3s 2024-03-30T13:09:44.970 INFO:teuthology.orchestra.run.smithi083.stderr: 74100K .......... .......... .......... .......... .......... 43% 25.6M 3s 2024-03-30T13:09:44.972 INFO:teuthology.orchestra.run.smithi083.stderr: 74150K .......... .......... .......... .......... .......... 44% 26.8M 3s 2024-03-30T13:09:44.974 INFO:teuthology.orchestra.run.smithi083.stderr: 74200K .......... .......... .......... .......... .......... 44% 29.3M 3s 2024-03-30T13:09:44.976 INFO:teuthology.orchestra.run.smithi083.stderr: 74250K .......... .......... .......... .......... .......... 44% 20.8M 3s 2024-03-30T13:09:44.978 INFO:teuthology.orchestra.run.smithi083.stderr: 74300K .......... .......... .......... .......... .......... 44% 29.9M 3s 2024-03-30T13:09:44.979 INFO:teuthology.orchestra.run.smithi083.stderr: 74350K .......... .......... .......... .......... .......... 44% 29.4M 3s 2024-03-30T13:09:44.981 INFO:teuthology.orchestra.run.smithi083.stderr: 74400K .......... .......... .......... .......... .......... 44% 29.9M 3s 2024-03-30T13:09:44.983 INFO:teuthology.orchestra.run.smithi083.stderr: 74450K .......... .......... .......... .......... .......... 44% 25.3M 3s 2024-03-30T13:09:44.985 INFO:teuthology.orchestra.run.smithi083.stderr: 74500K .......... .......... .......... .......... .......... 44% 28.6M 3s 2024-03-30T13:09:44.986 INFO:teuthology.orchestra.run.smithi083.stderr: 74550K .......... .......... .......... .......... .......... 44% 29.5M 3s 2024-03-30T13:09:44.988 INFO:teuthology.orchestra.run.smithi083.stderr: 74600K .......... .......... .......... .......... .......... 44% 28.7M 3s 2024-03-30T13:09:44.990 INFO:teuthology.orchestra.run.smithi083.stderr: 74650K .......... .......... .......... .......... .......... 44% 25.0M 3s 2024-03-30T13:09:44.992 INFO:teuthology.orchestra.run.smithi083.stderr: 74700K .......... .......... .......... .......... .......... 44% 30.1M 3s 2024-03-30T13:09:44.993 INFO:teuthology.orchestra.run.smithi083.stderr: 74750K .......... .......... .......... .......... .......... 44% 28.3M 3s 2024-03-30T13:09:44.995 INFO:teuthology.orchestra.run.smithi083.stderr: 74800K .......... .......... .......... .......... .......... 44% 22.1M 3s 2024-03-30T13:09:44.997 INFO:teuthology.orchestra.run.smithi083.stderr: 74850K .......... .......... .......... .......... .......... 44% 25.5M 3s 2024-03-30T13:09:44.999 INFO:teuthology.orchestra.run.smithi083.stderr: 74900K .......... .......... .......... .......... .......... 44% 30.3M 3s 2024-03-30T13:09:45.001 INFO:teuthology.orchestra.run.smithi083.stderr: 74950K .......... .......... .......... .......... .......... 44% 30.1M 3s 2024-03-30T13:09:45.002 INFO:teuthology.orchestra.run.smithi083.stderr: 75000K .......... .......... .......... .......... .......... 44% 30.1M 3s 2024-03-30T13:09:45.004 INFO:teuthology.orchestra.run.smithi083.stderr: 75050K .......... .......... .......... .......... .......... 44% 25.5M 3s 2024-03-30T13:09:45.006 INFO:teuthology.orchestra.run.smithi083.stderr: 75100K .......... .......... .......... .......... .......... 44% 29.9M 3s 2024-03-30T13:09:45.007 INFO:teuthology.orchestra.run.smithi083.stderr: 75150K .......... .......... .......... .......... .......... 44% 30.2M 3s 2024-03-30T13:09:45.009 INFO:teuthology.orchestra.run.smithi083.stderr: 75200K .......... .......... .......... .......... .......... 44% 29.9M 3s 2024-03-30T13:09:45.011 INFO:teuthology.orchestra.run.smithi083.stderr: 75250K .......... .......... .......... .......... .......... 44% 25.1M 3s 2024-03-30T13:09:45.013 INFO:teuthology.orchestra.run.smithi083.stderr: 75300K .......... .......... .......... .......... .......... 44% 29.9M 3s 2024-03-30T13:09:45.014 INFO:teuthology.orchestra.run.smithi083.stderr: 75350K .......... .......... .......... .......... .......... 44% 30.2M 3s 2024-03-30T13:09:45.016 INFO:teuthology.orchestra.run.smithi083.stderr: 75400K .......... .......... .......... .......... .......... 44% 29.6M 3s 2024-03-30T13:09:45.018 INFO:teuthology.orchestra.run.smithi083.stderr: 75450K .......... .......... .......... .......... .......... 44% 25.5M 3s 2024-03-30T13:09:45.020 INFO:teuthology.orchestra.run.smithi083.stderr: 75500K .......... .......... .......... .......... .......... 44% 27.2M 3s 2024-03-30T13:09:45.021 INFO:teuthology.orchestra.run.smithi083.stderr: 75550K .......... .......... .......... .......... .......... 44% 29.6M 3s 2024-03-30T13:09:45.023 INFO:teuthology.orchestra.run.smithi083.stderr: 75600K .......... .......... .......... .......... .......... 44% 28.3M 3s 2024-03-30T13:09:45.025 INFO:teuthology.orchestra.run.smithi083.stderr: 75650K .......... .......... .......... .......... .......... 44% 23.6M 3s 2024-03-30T13:09:45.027 INFO:teuthology.orchestra.run.smithi083.stderr: 75700K .......... .......... .......... .......... .......... 44% 28.1M 3s 2024-03-30T13:09:45.028 INFO:teuthology.orchestra.run.smithi083.stderr: 75750K .......... .......... .......... .......... .......... 44% 28.7M 3s 2024-03-30T13:09:45.030 INFO:teuthology.orchestra.run.smithi083.stderr: 75800K .......... .......... .......... .......... .......... 44% 28.5M 3s 2024-03-30T13:09:45.032 INFO:teuthology.orchestra.run.smithi083.stderr: 75850K .......... .......... .......... .......... .......... 45% 23.8M 3s 2024-03-30T13:09:45.034 INFO:teuthology.orchestra.run.smithi083.stderr: 75900K .......... .......... .......... .......... .......... 45% 27.7M 3s 2024-03-30T13:09:45.037 INFO:teuthology.orchestra.run.smithi083.stderr: 75950K .......... .......... .......... .......... .......... 45% 15.4M 3s 2024-03-30T13:09:45.039 INFO:teuthology.orchestra.run.smithi083.stderr: 76000K .......... .......... .......... .......... .......... 45% 26.5M 3s 2024-03-30T13:09:45.041 INFO:teuthology.orchestra.run.smithi083.stderr: 76050K .......... .......... .......... .......... .......... 45% 22.9M 3s 2024-03-30T13:09:45.043 INFO:teuthology.orchestra.run.smithi083.stderr: 76100K .......... .......... .......... .......... .......... 45% 26.0M 3s 2024-03-30T13:09:45.045 INFO:teuthology.orchestra.run.smithi083.stderr: 76150K .......... .......... .......... .......... .......... 45% 27.0M 3s 2024-03-30T13:09:45.047 INFO:teuthology.orchestra.run.smithi083.stderr: 76200K .......... .......... .......... .......... .......... 45% 26.1M 3s 2024-03-30T13:09:45.049 INFO:teuthology.orchestra.run.smithi083.stderr: 76250K .......... .......... .......... .......... .......... 45% 22.7M 3s 2024-03-30T13:09:45.051 INFO:teuthology.orchestra.run.smithi083.stderr: 76300K .......... .......... .......... .......... .......... 45% 24.7M 3s 2024-03-30T13:09:45.053 INFO:teuthology.orchestra.run.smithi083.stderr: 76350K .......... .......... .......... .......... .......... 45% 30.0M 3s 2024-03-30T13:09:45.054 INFO:teuthology.orchestra.run.smithi083.stderr: 76400K .......... .......... .......... .......... .......... 45% 30.1M 3s 2024-03-30T13:09:45.056 INFO:teuthology.orchestra.run.smithi083.stderr: 76450K .......... .......... .......... .......... .......... 45% 25.3M 3s 2024-03-30T13:09:45.058 INFO:teuthology.orchestra.run.smithi083.stderr: 76500K .......... .......... .......... .......... .......... 45% 30.2M 3s 2024-03-30T13:09:45.060 INFO:teuthology.orchestra.run.smithi083.stderr: 76550K .......... .......... .......... .......... .......... 45% 29.6M 3s 2024-03-30T13:09:45.061 INFO:teuthology.orchestra.run.smithi083.stderr: 76600K .......... .......... .......... .......... .......... 45% 30.4M 3s 2024-03-30T13:09:45.063 INFO:teuthology.orchestra.run.smithi083.stderr: 76650K .......... .......... .......... .......... .......... 45% 25.0M 3s 2024-03-30T13:09:45.065 INFO:teuthology.orchestra.run.smithi083.stderr: 76700K .......... .......... .......... .......... .......... 45% 29.3M 3s 2024-03-30T13:09:45.066 INFO:teuthology.orchestra.run.smithi083.stderr: 76750K .......... .......... .......... .......... .......... 45% 29.7M 3s 2024-03-30T13:09:45.068 INFO:teuthology.orchestra.run.smithi083.stderr: 76800K .......... .......... .......... .......... .......... 45% 29.6M 3s 2024-03-30T13:09:45.070 INFO:teuthology.orchestra.run.smithi083.stderr: 76850K .......... .......... .......... .......... .......... 45% 24.4M 3s 2024-03-30T13:09:45.072 INFO:teuthology.orchestra.run.smithi083.stderr: 76900K .......... .......... .......... .......... .......... 45% 28.3M 3s 2024-03-30T13:09:45.073 INFO:teuthology.orchestra.run.smithi083.stderr: 76950K .......... .......... .......... .......... .......... 45% 24.8M 3s 2024-03-30T13:09:45.075 INFO:teuthology.orchestra.run.smithi083.stderr: 77000K .......... .......... .......... .......... .......... 45% 29.5M 3s 2024-03-30T13:09:45.078 INFO:teuthology.orchestra.run.smithi083.stderr: 77050K .......... .......... .......... .......... .......... 45% 25.3M 3s 2024-03-30T13:09:45.084 INFO:teuthology.orchestra.run.smithi083.stderr: 77100K .......... .......... .......... .......... .......... 45% 27.7M 3s 2024-03-30T13:09:45.084 INFO:teuthology.orchestra.run.smithi083.stderr: 77150K .......... .......... .......... .......... .......... 45% 28.5M 3s 2024-03-30T13:09:45.084 INFO:teuthology.orchestra.run.smithi083.stderr: 77200K .......... .......... .......... .......... .......... 45% 28.1M 3s 2024-03-30T13:09:45.085 INFO:teuthology.orchestra.run.smithi083.stderr: 77250K .......... .......... .......... .......... .......... 45% 23.4M 3s 2024-03-30T13:09:45.086 INFO:teuthology.orchestra.run.smithi083.stderr: 77300K .......... .......... .......... .......... .......... 45% 27.0M 3s 2024-03-30T13:09:45.088 INFO:teuthology.orchestra.run.smithi083.stderr: 77350K .......... .......... .......... .......... .......... 45% 26.9M 3s 2024-03-30T13:09:45.090 INFO:teuthology.orchestra.run.smithi083.stderr: 77400K .......... .......... .......... .......... .......... 45% 26.9M 3s 2024-03-30T13:09:45.092 INFO:teuthology.orchestra.run.smithi083.stderr: 77450K .......... .......... .......... .......... .......... 45% 23.1M 3s 2024-03-30T13:09:45.094 INFO:teuthology.orchestra.run.smithi083.stderr: 77500K .......... .......... .......... .......... .......... 46% 27.1M 3s 2024-03-30T13:09:45.096 INFO:teuthology.orchestra.run.smithi083.stderr: 77550K .......... .......... .......... .......... .......... 46% 26.3M 3s 2024-03-30T13:09:45.097 INFO:teuthology.orchestra.run.smithi083.stderr: 77600K .......... .......... .......... .......... .......... 46% 26.9M 3s 2024-03-30T13:09:45.100 INFO:teuthology.orchestra.run.smithi083.stderr: 77650K .......... .......... .......... .......... .......... 46% 22.6M 3s 2024-03-30T13:09:45.101 INFO:teuthology.orchestra.run.smithi083.stderr: 77700K .......... .......... .......... .......... .......... 46% 26.6M 3s 2024-03-30T13:09:45.103 INFO:teuthology.orchestra.run.smithi083.stderr: 77750K .......... .......... .......... .......... .......... 46% 25.8M 3s 2024-03-30T13:09:45.105 INFO:teuthology.orchestra.run.smithi083.stderr: 77800K .......... .......... .......... .......... .......... 46% 24.4M 3s 2024-03-30T13:09:45.108 INFO:teuthology.orchestra.run.smithi083.stderr: 77850K .......... .......... .......... .......... .......... 46% 21.5M 3s 2024-03-30T13:09:45.110 INFO:teuthology.orchestra.run.smithi083.stderr: 77900K .......... .......... .......... .......... .......... 46% 25.9M 3s 2024-03-30T13:09:45.112 INFO:teuthology.orchestra.run.smithi083.stderr: 77950K .......... .......... .......... .......... .......... 46% 26.6M 3s 2024-03-30T13:09:45.113 INFO:teuthology.orchestra.run.smithi083.stderr: 78000K .......... .......... .......... .......... .......... 46% 25.4M 3s 2024-03-30T13:09:45.116 INFO:teuthology.orchestra.run.smithi083.stderr: 78050K .......... .......... .......... .......... .......... 46% 21.8M 3s 2024-03-30T13:09:45.117 INFO:teuthology.orchestra.run.smithi083.stderr: 78100K .......... .......... .......... .......... .......... 46% 26.4M 3s 2024-03-30T13:09:45.119 INFO:teuthology.orchestra.run.smithi083.stderr: 78150K .......... .......... .......... .......... .......... 46% 26.1M 3s 2024-03-30T13:09:45.121 INFO:teuthology.orchestra.run.smithi083.stderr: 78200K .......... .......... .......... .......... .......... 46% 26.4M 3s 2024-03-30T13:09:45.124 INFO:teuthology.orchestra.run.smithi083.stderr: 78250K .......... .......... .......... .......... .......... 46% 20.0M 3s 2024-03-30T13:09:45.125 INFO:teuthology.orchestra.run.smithi083.stderr: 78300K .......... .......... .......... .......... .......... 46% 30.9M 3s 2024-03-30T13:09:45.127 INFO:teuthology.orchestra.run.smithi083.stderr: 78350K .......... .......... .......... .......... .......... 46% 25.8M 3s 2024-03-30T13:09:45.129 INFO:teuthology.orchestra.run.smithi083.stderr: 78400K .......... .......... .......... .......... .......... 46% 26.5M 3s 2024-03-30T13:09:45.131 INFO:teuthology.orchestra.run.smithi083.stderr: 78450K .......... .......... .......... .......... .......... 46% 23.8M 3s 2024-03-30T13:09:45.133 INFO:teuthology.orchestra.run.smithi083.stderr: 78500K .......... .......... .......... .......... .......... 46% 26.9M 3s 2024-03-30T13:09:45.135 INFO:teuthology.orchestra.run.smithi083.stderr: 78550K .......... .......... .......... .......... .......... 46% 26.4M 3s 2024-03-30T13:09:45.136 INFO:teuthology.orchestra.run.smithi083.stderr: 78600K .......... .......... .......... .......... .......... 46% 28.0M 3s 2024-03-30T13:09:45.138 INFO:teuthology.orchestra.run.smithi083.stderr: 78650K .......... .......... .......... .......... .......... 46% 25.9M 3s 2024-03-30T13:09:45.140 INFO:teuthology.orchestra.run.smithi083.stderr: 78700K .......... .......... .......... .......... .......... 46% 30.0M 3s 2024-03-30T13:09:45.141 INFO:teuthology.orchestra.run.smithi083.stderr: 78750K .......... .......... .......... .......... .......... 46% 29.8M 3s 2024-03-30T13:09:45.143 INFO:teuthology.orchestra.run.smithi083.stderr: 78800K .......... .......... .......... .......... .......... 46% 29.7M 3s 2024-03-30T13:09:45.145 INFO:teuthology.orchestra.run.smithi083.stderr: 78850K .......... .......... .......... .......... .......... 46% 25.4M 3s 2024-03-30T13:09:45.147 INFO:teuthology.orchestra.run.smithi083.stderr: 78900K .......... .......... .......... .......... .......... 46% 23.1M 3s 2024-03-30T13:09:45.149 INFO:teuthology.orchestra.run.smithi083.stderr: 78950K .......... .......... .......... .......... .......... 46% 32.6M 3s 2024-03-30T13:09:45.150 INFO:teuthology.orchestra.run.smithi083.stderr: 79000K .......... .......... .......... .......... .......... 46% 31.7M 3s 2024-03-30T13:09:45.152 INFO:teuthology.orchestra.run.smithi083.stderr: 79050K .......... .......... .......... .......... .......... 46% 27.6M 3s 2024-03-30T13:09:45.154 INFO:teuthology.orchestra.run.smithi083.stderr: 79100K .......... .......... .......... .......... .......... 46% 32.5M 3s 2024-03-30T13:09:45.155 INFO:teuthology.orchestra.run.smithi083.stderr: 79150K .......... .......... .......... .......... .......... 46% 31.0M 3s 2024-03-30T13:09:45.157 INFO:teuthology.orchestra.run.smithi083.stderr: 79200K .......... .......... .......... .......... .......... 47% 29.2M 3s 2024-03-30T13:09:45.159 INFO:teuthology.orchestra.run.smithi083.stderr: 79250K .......... .......... .......... .......... .......... 47% 24.6M 3s 2024-03-30T13:09:45.161 INFO:teuthology.orchestra.run.smithi083.stderr: 79300K .......... .......... .......... .......... .......... 47% 29.2M 3s 2024-03-30T13:09:45.162 INFO:teuthology.orchestra.run.smithi083.stderr: 79350K .......... .......... .......... .......... .......... 47% 28.9M 3s 2024-03-30T13:09:45.164 INFO:teuthology.orchestra.run.smithi083.stderr: 79400K .......... .......... .......... .......... .......... 47% 29.0M 3s 2024-03-30T13:09:45.166 INFO:teuthology.orchestra.run.smithi083.stderr: 79450K .......... .......... .......... .......... .......... 47% 24.4M 3s 2024-03-30T13:09:45.167 INFO:teuthology.orchestra.run.smithi083.stderr: 79500K .......... .......... .......... .......... .......... 47% 28.0M 3s 2024-03-30T13:09:45.169 INFO:teuthology.orchestra.run.smithi083.stderr: 79550K .......... .......... .......... .......... .......... 47% 28.4M 3s 2024-03-30T13:09:45.171 INFO:teuthology.orchestra.run.smithi083.stderr: 79600K .......... .......... .......... .......... .......... 47% 26.9M 3s 2024-03-30T13:09:45.173 INFO:teuthology.orchestra.run.smithi083.stderr: 79650K .......... .......... .......... .......... .......... 47% 23.2M 3s 2024-03-30T13:09:45.175 INFO:teuthology.orchestra.run.smithi083.stderr: 79700K .......... .......... .......... .......... .......... 47% 26.6M 3s 2024-03-30T13:09:45.177 INFO:teuthology.orchestra.run.smithi083.stderr: 79750K .......... .......... .......... .......... .......... 47% 25.2M 3s 2024-03-30T13:09:45.179 INFO:teuthology.orchestra.run.smithi083.stderr: 79800K .......... .......... .......... .......... .......... 47% 23.9M 3s 2024-03-30T13:09:45.181 INFO:teuthology.orchestra.run.smithi083.stderr: 79850K .......... .......... .......... .......... .......... 47% 20.8M 3s 2024-03-30T13:09:45.183 INFO:teuthology.orchestra.run.smithi083.stderr: 79900K .......... .......... .......... .......... .......... 47% 23.9M 3s 2024-03-30T13:09:45.185 INFO:teuthology.orchestra.run.smithi083.stderr: 79950K .......... .......... .......... .......... .......... 47% 23.9M 3s 2024-03-30T13:09:45.188 INFO:teuthology.orchestra.run.smithi083.stderr: 80000K .......... .......... .......... .......... .......... 47% 22.8M 3s 2024-03-30T13:09:45.191 INFO:teuthology.orchestra.run.smithi083.stderr: 80050K .......... .......... .......... .......... .......... 47% 14.1M 3s 2024-03-30T13:09:45.193 INFO:teuthology.orchestra.run.smithi083.stderr: 80100K .......... .......... .......... .......... .......... 47% 25.6M 3s 2024-03-30T13:09:45.195 INFO:teuthology.orchestra.run.smithi083.stderr: 80150K .......... .......... .......... .......... .......... 47% 24.8M 3s 2024-03-30T13:09:45.197 INFO:teuthology.orchestra.run.smithi083.stderr: 80200K .......... .......... .......... .......... .......... 47% 23.2M 3s 2024-03-30T13:09:45.200 INFO:teuthology.orchestra.run.smithi083.stderr: 80250K .......... .......... .......... .......... .......... 47% 19.8M 3s 2024-03-30T13:09:45.202 INFO:teuthology.orchestra.run.smithi083.stderr: 80300K .......... .......... .......... .......... .......... 47% 23.3M 3s 2024-03-30T13:09:45.204 INFO:teuthology.orchestra.run.smithi083.stderr: 80350K .......... .......... .......... .......... .......... 47% 23.4M 3s 2024-03-30T13:09:45.206 INFO:teuthology.orchestra.run.smithi083.stderr: 80400K .......... .......... .......... .......... .......... 47% 23.8M 3s 2024-03-30T13:09:45.208 INFO:teuthology.orchestra.run.smithi083.stderr: 80450K .......... .......... .......... .......... .......... 47% 19.9M 3s 2024-03-30T13:09:45.210 INFO:teuthology.orchestra.run.smithi083.stderr: 80500K .......... .......... .......... .......... .......... 47% 23.2M 3s 2024-03-30T13:09:45.212 INFO:teuthology.orchestra.run.smithi083.stderr: 80550K .......... .......... .......... .......... .......... 47% 23.2M 3s 2024-03-30T13:09:45.214 INFO:teuthology.orchestra.run.smithi083.stderr: 80600K .......... .......... .......... .......... .......... 47% 23.1M 3s 2024-03-30T13:09:45.217 INFO:teuthology.orchestra.run.smithi083.stderr: 80650K .......... .......... .......... .......... .......... 47% 19.7M 3s 2024-03-30T13:09:45.219 INFO:teuthology.orchestra.run.smithi083.stderr: 80700K .......... .......... .......... .......... .......... 47% 23.0M 3s 2024-03-30T13:09:45.221 INFO:teuthology.orchestra.run.smithi083.stderr: 80750K .......... .......... .......... .......... .......... 47% 21.6M 3s 2024-03-30T13:09:45.223 INFO:teuthology.orchestra.run.smithi083.stderr: 80800K .......... .......... .......... .......... .......... 47% 22.8M 3s 2024-03-30T13:09:45.226 INFO:teuthology.orchestra.run.smithi083.stderr: 80850K .......... .......... .......... .......... .......... 47% 19.8M 3s 2024-03-30T13:09:45.228 INFO:teuthology.orchestra.run.smithi083.stderr: 80900K .......... .......... .......... .......... .......... 48% 22.7M 3s 2024-03-30T13:09:45.231 INFO:teuthology.orchestra.run.smithi083.stderr: 80950K .......... .......... .......... .......... .......... 48% 21.1M 3s 2024-03-30T13:09:45.232 INFO:teuthology.orchestra.run.smithi083.stderr: 81000K .......... .......... .......... .......... .......... 48% 30.7M 3s 2024-03-30T13:09:45.234 INFO:teuthology.orchestra.run.smithi083.stderr: 81050K .......... .......... .......... .......... .......... 48% 22.2M 3s 2024-03-30T13:09:45.236 INFO:teuthology.orchestra.run.smithi083.stderr: 81100K .......... .......... .......... .......... .......... 48% 26.1M 3s 2024-03-30T13:09:45.238 INFO:teuthology.orchestra.run.smithi083.stderr: 81150K .......... .......... .......... .......... .......... 48% 28.5M 3s 2024-03-30T13:09:45.241 INFO:teuthology.orchestra.run.smithi083.stderr: 81200K .......... .......... .......... .......... .......... 48% 28.2M 3s 2024-03-30T13:09:45.242 INFO:teuthology.orchestra.run.smithi083.stderr: 81250K .......... .......... .......... .......... .......... 48% 23.8M 3s 2024-03-30T13:09:45.243 INFO:teuthology.orchestra.run.smithi083.stderr: 81300K .......... .......... .......... .......... .......... 48% 28.1M 3s 2024-03-30T13:09:45.245 INFO:teuthology.orchestra.run.smithi083.stderr: 81350K .......... .......... .......... .......... .......... 48% 26.9M 3s 2024-03-30T13:09:45.247 INFO:teuthology.orchestra.run.smithi083.stderr: 81400K .......... .......... .......... .......... .......... 48% 27.3M 3s 2024-03-30T13:09:45.249 INFO:teuthology.orchestra.run.smithi083.stderr: 81450K .......... .......... .......... .......... .......... 48% 23.2M 3s 2024-03-30T13:09:45.251 INFO:teuthology.orchestra.run.smithi083.stderr: 81500K .......... .......... .......... .......... .......... 48% 27.2M 3s 2024-03-30T13:09:45.252 INFO:teuthology.orchestra.run.smithi083.stderr: 81550K .......... .......... .......... .......... .......... 48% 27.9M 3s 2024-03-30T13:09:45.254 INFO:teuthology.orchestra.run.smithi083.stderr: 81600K .......... .......... .......... .......... .......... 48% 28.1M 3s 2024-03-30T13:09:45.256 INFO:teuthology.orchestra.run.smithi083.stderr: 81650K .......... .......... .......... .......... .......... 48% 27.1M 3s 2024-03-30T13:09:45.257 INFO:teuthology.orchestra.run.smithi083.stderr: 81700K .......... .......... .......... .......... .......... 48% 33.7M 3s 2024-03-30T13:09:45.259 INFO:teuthology.orchestra.run.smithi083.stderr: 81750K .......... .......... .......... .......... .......... 48% 32.7M 3s 2024-03-30T13:09:45.261 INFO:teuthology.orchestra.run.smithi083.stderr: 81800K .......... .......... .......... .......... .......... 48% 33.3M 3s 2024-03-30T13:09:45.262 INFO:teuthology.orchestra.run.smithi083.stderr: 81850K .......... .......... .......... .......... .......... 48% 29.0M 3s 2024-03-30T13:09:45.264 INFO:teuthology.orchestra.run.smithi083.stderr: 81900K .......... .......... .......... .......... .......... 48% 24.6M 3s 2024-03-30T13:09:45.266 INFO:teuthology.orchestra.run.smithi083.stderr: 81950K .......... .......... .......... .......... .......... 48% 26.0M 3s 2024-03-30T13:09:45.268 INFO:teuthology.orchestra.run.smithi083.stderr: 82000K .......... .......... .......... .......... .......... 48% 26.7M 3s 2024-03-30T13:09:45.270 INFO:teuthology.orchestra.run.smithi083.stderr: 82050K .......... .......... .......... .......... .......... 48% 22.8M 3s 2024-03-30T13:09:45.272 INFO:teuthology.orchestra.run.smithi083.stderr: 82100K .......... .......... .......... .......... .......... 48% 25.6M 3s 2024-03-30T13:09:45.274 INFO:teuthology.orchestra.run.smithi083.stderr: 82150K .......... .......... .......... .......... .......... 48% 27.7M 3s 2024-03-30T13:09:45.275 INFO:teuthology.orchestra.run.smithi083.stderr: 82200K .......... .......... .......... .......... .......... 48% 30.7M 3s 2024-03-30T13:09:45.277 INFO:teuthology.orchestra.run.smithi083.stderr: 82250K .......... .......... .......... .......... .......... 48% 26.0M 3s 2024-03-30T13:09:45.279 INFO:teuthology.orchestra.run.smithi083.stderr: 82300K .......... .......... .......... .......... .......... 48% 32.8M 3s 2024-03-30T13:09:45.280 INFO:teuthology.orchestra.run.smithi083.stderr: 82350K .......... .......... .......... .......... .......... 48% 33.3M 3s 2024-03-30T13:09:45.281 INFO:teuthology.orchestra.run.smithi083.stderr: 82400K .......... .......... .......... .......... .......... 48% 42.1M 3s 2024-03-30T13:09:45.283 INFO:teuthology.orchestra.run.smithi083.stderr: 82450K .......... .......... .......... .......... .......... 48% 34.3M 3s 2024-03-30T13:09:45.287 INFO:teuthology.orchestra.run.smithi083.stderr: 82500K .......... .......... .......... .......... .......... 48% 44.4M 3s 2024-03-30T13:09:45.287 INFO:teuthology.orchestra.run.smithi083.stderr: 82550K .......... .......... .......... .......... .......... 49% 44.8M 3s 2024-03-30T13:09:45.288 INFO:teuthology.orchestra.run.smithi083.stderr: 82600K .......... .......... .......... .......... .......... 49% 39.8M 3s 2024-03-30T13:09:45.288 INFO:teuthology.orchestra.run.smithi083.stderr: 82650K .......... .......... .......... .......... .......... 49% 28.9M 3s 2024-03-30T13:09:45.289 INFO:teuthology.orchestra.run.smithi083.stderr: 82700K .......... .......... .......... .......... .......... 49% 33.4M 3s 2024-03-30T13:09:45.291 INFO:teuthology.orchestra.run.smithi083.stderr: 82750K .......... .......... .......... .......... .......... 49% 33.3M 3s 2024-03-30T13:09:45.292 INFO:teuthology.orchestra.run.smithi083.stderr: 82800K .......... .......... .......... .......... .......... 49% 32.8M 3s 2024-03-30T13:09:45.295 INFO:teuthology.orchestra.run.smithi083.stderr: 82850K .......... .......... .......... .......... .......... 49% 21.1M 3s 2024-03-30T13:09:45.296 INFO:teuthology.orchestra.run.smithi083.stderr: 82900K .......... .......... .......... .......... .......... 49% 35.4M 3s 2024-03-30T13:09:45.297 INFO:teuthology.orchestra.run.smithi083.stderr: 82950K .......... .......... .......... .......... .......... 49% 39.2M 3s 2024-03-30T13:09:45.299 INFO:teuthology.orchestra.run.smithi083.stderr: 83000K .......... .......... .......... .......... .......... 49% 28.1M 3s 2024-03-30T13:09:45.300 INFO:teuthology.orchestra.run.smithi083.stderr: 83050K .......... .......... .......... .......... .......... 49% 37.1M 3s 2024-03-30T13:09:45.301 INFO:teuthology.orchestra.run.smithi083.stderr: 83100K .......... .......... .......... .......... .......... 49% 42.7M 3s 2024-03-30T13:09:45.303 INFO:teuthology.orchestra.run.smithi083.stderr: 83150K .......... .......... .......... .......... .......... 49% 41.3M 3s 2024-03-30T13:09:45.304 INFO:teuthology.orchestra.run.smithi083.stderr: 83200K .......... .......... .......... .......... .......... 49% 42.4M 3s 2024-03-30T13:09:45.305 INFO:teuthology.orchestra.run.smithi083.stderr: 83250K .......... .......... .......... .......... .......... 49% 36.1M 3s 2024-03-30T13:09:45.306 INFO:teuthology.orchestra.run.smithi083.stderr: 83300K .......... .......... .......... .......... .......... 49% 42.5M 3s 2024-03-30T13:09:45.307 INFO:teuthology.orchestra.run.smithi083.stderr: 83350K .......... .......... .......... .......... .......... 49% 41.5M 3s 2024-03-30T13:09:45.309 INFO:teuthology.orchestra.run.smithi083.stderr: 83400K .......... .......... .......... .......... .......... 49% 41.3M 3s 2024-03-30T13:09:45.310 INFO:teuthology.orchestra.run.smithi083.stderr: 83450K .......... .......... .......... .......... .......... 49% 33.4M 3s 2024-03-30T13:09:45.311 INFO:teuthology.orchestra.run.smithi083.stderr: 83500K .......... .......... .......... .......... .......... 49% 39.5M 3s 2024-03-30T13:09:45.312 INFO:teuthology.orchestra.run.smithi083.stderr: 83550K .......... .......... .......... .......... .......... 49% 42.6M 3s 2024-03-30T13:09:45.313 INFO:teuthology.orchestra.run.smithi083.stderr: 83600K .......... .......... .......... .......... .......... 49% 41.9M 3s 2024-03-30T13:09:45.315 INFO:teuthology.orchestra.run.smithi083.stderr: 83650K .......... .......... .......... .......... .......... 49% 36.5M 3s 2024-03-30T13:09:45.316 INFO:teuthology.orchestra.run.smithi083.stderr: 83700K .......... .......... .......... .......... .......... 49% 42.5M 3s 2024-03-30T13:09:45.317 INFO:teuthology.orchestra.run.smithi083.stderr: 83750K .......... .......... .......... .......... .......... 49% 41.6M 3s 2024-03-30T13:09:45.319 INFO:teuthology.orchestra.run.smithi083.stderr: 83800K .......... .......... .......... .......... .......... 49% 40.5M 3s 2024-03-30T13:09:45.320 INFO:teuthology.orchestra.run.smithi083.stderr: 83850K .......... .......... .......... .......... .......... 49% 35.8M 3s 2024-03-30T13:09:45.321 INFO:teuthology.orchestra.run.smithi083.stderr: 83900K .......... .......... .......... .......... .......... 49% 42.0M 3s 2024-03-30T13:09:45.322 INFO:teuthology.orchestra.run.smithi083.stderr: 83950K .......... .......... .......... .......... .......... 49% 39.9M 3s 2024-03-30T13:09:45.324 INFO:teuthology.orchestra.run.smithi083.stderr: 84000K .......... .......... .......... .......... .......... 49% 40.2M 3s 2024-03-30T13:09:45.325 INFO:teuthology.orchestra.run.smithi083.stderr: 84050K .......... .......... .......... .......... .......... 49% 33.8M 3s 2024-03-30T13:09:45.326 INFO:teuthology.orchestra.run.smithi083.stderr: 84100K .......... .......... .......... .......... .......... 49% 37.9M 3s 2024-03-30T13:09:45.328 INFO:teuthology.orchestra.run.smithi083.stderr: 84150K .......... .......... .......... .......... .......... 49% 22.5M 3s 2024-03-30T13:09:45.329 INFO:teuthology.orchestra.run.smithi083.stderr: 84200K .......... .......... .......... .......... .......... 49% 46.1M 3s 2024-03-30T13:09:45.331 INFO:teuthology.orchestra.run.smithi083.stderr: 84250K .......... .......... .......... .......... .......... 50% 36.6M 3s 2024-03-30T13:09:45.332 INFO:teuthology.orchestra.run.smithi083.stderr: 84300K .......... .......... .......... .......... .......... 50% 44.1M 3s 2024-03-30T13:09:45.333 INFO:teuthology.orchestra.run.smithi083.stderr: 84350K .......... .......... .......... .......... .......... 50% 44.4M 3s 2024-03-30T13:09:45.334 INFO:teuthology.orchestra.run.smithi083.stderr: 84400K .......... .......... .......... .......... .......... 50% 41.9M 3s 2024-03-30T13:09:45.335 INFO:teuthology.orchestra.run.smithi083.stderr: 84450K .......... .......... .......... .......... .......... 50% 31.4M 3s 2024-03-30T13:09:45.337 INFO:teuthology.orchestra.run.smithi083.stderr: 84500K .......... .......... .......... .......... .......... 50% 36.4M 3s 2024-03-30T13:09:45.338 INFO:teuthology.orchestra.run.smithi083.stderr: 84550K .......... .......... .......... .......... .......... 50% 35.9M 3s 2024-03-30T13:09:45.340 INFO:teuthology.orchestra.run.smithi083.stderr: 84600K .......... .......... .......... .......... .......... 50% 36.8M 3s 2024-03-30T13:09:45.341 INFO:teuthology.orchestra.run.smithi083.stderr: 84650K .......... .......... .......... .......... .......... 50% 30.7M 3s 2024-03-30T13:09:45.343 INFO:teuthology.orchestra.run.smithi083.stderr: 84700K .......... .......... .......... .......... .......... 50% 35.4M 3s 2024-03-30T13:09:45.344 INFO:teuthology.orchestra.run.smithi083.stderr: 84750K .......... .......... .......... .......... .......... 50% 35.9M 3s 2024-03-30T13:09:45.345 INFO:teuthology.orchestra.run.smithi083.stderr: 84800K .......... .......... .......... .......... .......... 50% 36.2M 3s 2024-03-30T13:09:45.347 INFO:teuthology.orchestra.run.smithi083.stderr: 84850K .......... .......... .......... .......... .......... 50% 30.3M 3s 2024-03-30T13:09:45.348 INFO:teuthology.orchestra.run.smithi083.stderr: 84900K .......... .......... .......... .......... .......... 50% 36.3M 3s 2024-03-30T13:09:45.350 INFO:teuthology.orchestra.run.smithi083.stderr: 84950K .......... .......... .......... .......... .......... 50% 35.0M 3s 2024-03-30T13:09:45.351 INFO:teuthology.orchestra.run.smithi083.stderr: 85000K .......... .......... .......... .......... .......... 50% 34.4M 3s 2024-03-30T13:09:45.353 INFO:teuthology.orchestra.run.smithi083.stderr: 85050K .......... .......... .......... .......... .......... 50% 30.2M 3s 2024-03-30T13:09:45.354 INFO:teuthology.orchestra.run.smithi083.stderr: 85100K .......... .......... .......... .......... .......... 50% 34.7M 3s 2024-03-30T13:09:45.356 INFO:teuthology.orchestra.run.smithi083.stderr: 85150K .......... .......... .......... .......... .......... 50% 33.4M 3s 2024-03-30T13:09:45.357 INFO:teuthology.orchestra.run.smithi083.stderr: 85200K .......... .......... .......... .......... .......... 50% 35.0M 3s 2024-03-30T13:09:45.359 INFO:teuthology.orchestra.run.smithi083.stderr: 85250K .......... .......... .......... .......... .......... 50% 29.2M 3s 2024-03-30T13:09:45.360 INFO:teuthology.orchestra.run.smithi083.stderr: 85300K .......... .......... .......... .......... .......... 50% 33.2M 3s 2024-03-30T13:09:45.362 INFO:teuthology.orchestra.run.smithi083.stderr: 85350K .......... .......... .......... .......... .......... 50% 33.1M 3s 2024-03-30T13:09:45.363 INFO:teuthology.orchestra.run.smithi083.stderr: 85400K .......... .......... .......... .......... .......... 50% 32.7M 3s 2024-03-30T13:09:45.365 INFO:teuthology.orchestra.run.smithi083.stderr: 85450K .......... .......... .......... .......... .......... 50% 28.6M 3s 2024-03-30T13:09:45.366 INFO:teuthology.orchestra.run.smithi083.stderr: 85500K .......... .......... .......... .......... .......... 50% 32.4M 3s 2024-03-30T13:09:45.368 INFO:teuthology.orchestra.run.smithi083.stderr: 85550K .......... .......... .......... .......... .......... 50% 32.1M 3s 2024-03-30T13:09:45.369 INFO:teuthology.orchestra.run.smithi083.stderr: 85600K .......... .......... .......... .......... .......... 50% 32.4M 3s 2024-03-30T13:09:45.371 INFO:teuthology.orchestra.run.smithi083.stderr: 85650K .......... .......... .......... .......... .......... 50% 27.4M 3s 2024-03-30T13:09:45.373 INFO:teuthology.orchestra.run.smithi083.stderr: 85700K .......... .......... .......... .......... .......... 50% 32.2M 3s 2024-03-30T13:09:45.374 INFO:teuthology.orchestra.run.smithi083.stderr: 85750K .......... .......... .......... .......... .......... 50% 31.9M 3s 2024-03-30T13:09:45.376 INFO:teuthology.orchestra.run.smithi083.stderr: 85800K .......... .......... .......... .......... .......... 50% 31.6M 3s 2024-03-30T13:09:45.378 INFO:teuthology.orchestra.run.smithi083.stderr: 85850K .......... .......... .......... .......... .......... 50% 27.8M 3s 2024-03-30T13:09:45.379 INFO:teuthology.orchestra.run.smithi083.stderr: 85900K .......... .......... .......... .......... .......... 50% 31.3M 3s 2024-03-30T13:09:45.381 INFO:teuthology.orchestra.run.smithi083.stderr: 85950K .......... .......... .......... .......... .......... 51% 31.8M 3s 2024-03-30T13:09:45.382 INFO:teuthology.orchestra.run.smithi083.stderr: 86000K .......... .......... .......... .......... .......... 51% 31.2M 3s 2024-03-30T13:09:45.384 INFO:teuthology.orchestra.run.smithi083.stderr: 86050K .......... .......... .......... .......... .......... 51% 31.6M 3s 2024-03-30T13:09:45.386 INFO:teuthology.orchestra.run.smithi083.stderr: 86100K .......... .......... .......... .......... .......... 51% 31.5M 3s 2024-03-30T13:09:45.387 INFO:teuthology.orchestra.run.smithi083.stderr: 86150K .......... .......... .......... .......... .......... 51% 37.7M 3s 2024-03-30T13:09:45.388 INFO:teuthology.orchestra.run.smithi083.stderr: 86200K .......... .......... .......... .......... .......... 51% 41.5M 3s 2024-03-30T13:09:45.390 INFO:teuthology.orchestra.run.smithi083.stderr: 86250K .......... .......... .......... .......... .......... 51% 28.5M 3s 2024-03-30T13:09:45.391 INFO:teuthology.orchestra.run.smithi083.stderr: 86300K .......... .......... .......... .......... .......... 51% 39.5M 3s 2024-03-30T13:09:45.392 INFO:teuthology.orchestra.run.smithi083.stderr: 86350K .......... .......... .......... .......... .......... 51% 42.8M 3s 2024-03-30T13:09:45.393 INFO:teuthology.orchestra.run.smithi083.stderr: 86400K .......... .......... .......... .......... .......... 51% 40.1M 3s 2024-03-30T13:09:45.394 INFO:teuthology.orchestra.run.smithi083.stderr: 86450K .......... .......... .......... .......... .......... 51% 34.7M 3s 2024-03-30T13:09:45.396 INFO:teuthology.orchestra.run.smithi083.stderr: 86500K .......... .......... .......... .......... .......... 51% 39.1M 3s 2024-03-30T13:09:45.397 INFO:teuthology.orchestra.run.smithi083.stderr: 86550K .......... .......... .......... .......... .......... 51% 38.8M 3s 2024-03-30T13:09:45.398 INFO:teuthology.orchestra.run.smithi083.stderr: 86600K .......... .......... .......... .......... .......... 51% 42.6M 3s 2024-03-30T13:09:45.399 INFO:teuthology.orchestra.run.smithi083.stderr: 86650K .......... .......... .......... .......... .......... 51% 36.1M 3s 2024-03-30T13:09:45.401 INFO:teuthology.orchestra.run.smithi083.stderr: 86700K .......... .......... .......... .......... .......... 51% 42.6M 3s 2024-03-30T13:09:45.402 INFO:teuthology.orchestra.run.smithi083.stderr: 86750K .......... .......... .......... .......... .......... 51% 41.0M 3s 2024-03-30T13:09:45.403 INFO:teuthology.orchestra.run.smithi083.stderr: 86800K .......... .......... .......... .......... .......... 51% 39.2M 3s 2024-03-30T13:09:45.404 INFO:teuthology.orchestra.run.smithi083.stderr: 86850K .......... .......... .......... .......... .......... 51% 34.2M 3s 2024-03-30T13:09:45.406 INFO:teuthology.orchestra.run.smithi083.stderr: 86900K .......... .......... .......... .......... .......... 51% 39.2M 3s 2024-03-30T13:09:45.407 INFO:teuthology.orchestra.run.smithi083.stderr: 86950K .......... .......... .......... .......... .......... 51% 40.2M 3s 2024-03-30T13:09:45.408 INFO:teuthology.orchestra.run.smithi083.stderr: 87000K .......... .......... .......... .......... .......... 51% 38.8M 3s 2024-03-30T13:09:45.409 INFO:teuthology.orchestra.run.smithi083.stderr: 87050K .......... .......... .......... .......... .......... 51% 32.9M 3s 2024-03-30T13:09:45.411 INFO:teuthology.orchestra.run.smithi083.stderr: 87100K .......... .......... .......... .......... .......... 51% 29.5M 3s 2024-03-30T13:09:45.413 INFO:teuthology.orchestra.run.smithi083.stderr: 87150K .......... .......... .......... .......... .......... 51% 42.0M 3s 2024-03-30T13:09:45.414 INFO:teuthology.orchestra.run.smithi083.stderr: 87200K .......... .......... .......... .......... .......... 51% 41.9M 3s 2024-03-30T13:09:45.415 INFO:teuthology.orchestra.run.smithi083.stderr: 87250K .......... .......... .......... .......... .......... 51% 35.8M 3s 2024-03-30T13:09:45.416 INFO:teuthology.orchestra.run.smithi083.stderr: 87300K .......... .......... .......... .......... .......... 51% 41.5M 3s 2024-03-30T13:09:45.417 INFO:teuthology.orchestra.run.smithi083.stderr: 87350K .......... .......... .......... .......... .......... 51% 42.3M 3s 2024-03-30T13:09:45.419 INFO:teuthology.orchestra.run.smithi083.stderr: 87400K .......... .......... .......... .......... .......... 51% 33.0M 3s 2024-03-30T13:09:45.420 INFO:teuthology.orchestra.run.smithi083.stderr: 87450K .......... .......... .......... .......... .......... 51% 29.2M 3s 2024-03-30T13:09:45.422 INFO:teuthology.orchestra.run.smithi083.stderr: 87500K .......... .......... .......... .......... .......... 51% 34.3M 3s 2024-03-30T13:09:45.423 INFO:teuthology.orchestra.run.smithi083.stderr: 87550K .......... .......... .......... .......... .......... 51% 32.7M 3s 2024-03-30T13:09:45.425 INFO:teuthology.orchestra.run.smithi083.stderr: 87600K .......... .......... .......... .......... .......... 51% 33.0M 3s 2024-03-30T13:09:45.427 INFO:teuthology.orchestra.run.smithi083.stderr: 87650K .......... .......... .......... .......... .......... 52% 27.9M 3s 2024-03-30T13:09:45.428 INFO:teuthology.orchestra.run.smithi083.stderr: 87700K .......... .......... .......... .......... .......... 52% 33.1M 3s 2024-03-30T13:09:45.430 INFO:teuthology.orchestra.run.smithi083.stderr: 87750K .......... .......... .......... .......... .......... 52% 33.6M 3s 2024-03-30T13:09:45.431 INFO:teuthology.orchestra.run.smithi083.stderr: 87800K .......... .......... .......... .......... .......... 52% 31.1M 3s 2024-03-30T13:09:45.433 INFO:teuthology.orchestra.run.smithi083.stderr: 87850K .......... .......... .......... .......... .......... 52% 25.6M 3s 2024-03-30T13:09:45.435 INFO:teuthology.orchestra.run.smithi083.stderr: 87900K .......... .......... .......... .......... .......... 52% 29.5M 3s 2024-03-30T13:09:45.437 INFO:teuthology.orchestra.run.smithi083.stderr: 87950K .......... .......... .......... .......... .......... 52% 29.6M 3s 2024-03-30T13:09:45.438 INFO:teuthology.orchestra.run.smithi083.stderr: 88000K .......... .......... .......... .......... .......... 52% 27.8M 3s 2024-03-30T13:09:45.440 INFO:teuthology.orchestra.run.smithi083.stderr: 88050K .......... .......... .......... .......... .......... 52% 24.1M 3s 2024-03-30T13:09:45.442 INFO:teuthology.orchestra.run.smithi083.stderr: 88100K .......... .......... .......... .......... .......... 52% 27.9M 3s 2024-03-30T13:09:45.443 INFO:teuthology.orchestra.run.smithi083.stderr: 88150K .......... .......... .......... .......... .......... 52% 27.3M 3s 2024-03-30T13:09:45.445 INFO:teuthology.orchestra.run.smithi083.stderr: 88200K .......... .......... .......... .......... .......... 52% 28.5M 3s 2024-03-30T13:09:45.448 INFO:teuthology.orchestra.run.smithi083.stderr: 88250K .......... .......... .......... .......... .......... 52% 16.9M 3s 2024-03-30T13:09:45.450 INFO:teuthology.orchestra.run.smithi083.stderr: 88300K .......... .......... .......... .......... .......... 52% 31.7M 3s 2024-03-30T13:09:45.451 INFO:teuthology.orchestra.run.smithi083.stderr: 88350K .......... .......... .......... .......... .......... 52% 31.2M 3s 2024-03-30T13:09:45.453 INFO:teuthology.orchestra.run.smithi083.stderr: 88400K .......... .......... .......... .......... .......... 52% 31.3M 3s 2024-03-30T13:09:45.455 INFO:teuthology.orchestra.run.smithi083.stderr: 88450K .......... .......... .......... .......... .......... 52% 26.7M 3s 2024-03-30T13:09:45.456 INFO:teuthology.orchestra.run.smithi083.stderr: 88500K .......... .......... .......... .......... .......... 52% 30.3M 3s 2024-03-30T13:09:45.458 INFO:teuthology.orchestra.run.smithi083.stderr: 88550K .......... .......... .......... .......... .......... 52% 29.3M 3s 2024-03-30T13:09:45.459 INFO:teuthology.orchestra.run.smithi083.stderr: 88600K .......... .......... .......... .......... .......... 52% 30.9M 3s 2024-03-30T13:09:45.461 INFO:teuthology.orchestra.run.smithi083.stderr: 88650K .......... .......... .......... .......... .......... 52% 26.1M 3s 2024-03-30T13:09:45.463 INFO:teuthology.orchestra.run.smithi083.stderr: 88700K .......... .......... .......... .......... .......... 52% 30.2M 3s 2024-03-30T13:09:45.465 INFO:teuthology.orchestra.run.smithi083.stderr: 88750K .......... .......... .......... .......... .......... 52% 30.2M 3s 2024-03-30T13:09:45.466 INFO:teuthology.orchestra.run.smithi083.stderr: 88800K .......... .......... .......... .......... .......... 52% 29.8M 3s 2024-03-30T13:09:45.468 INFO:teuthology.orchestra.run.smithi083.stderr: 88850K .......... .......... .......... .......... .......... 52% 25.6M 3s 2024-03-30T13:09:45.470 INFO:teuthology.orchestra.run.smithi083.stderr: 88900K .......... .......... .......... .......... .......... 52% 30.5M 3s 2024-03-30T13:09:45.471 INFO:teuthology.orchestra.run.smithi083.stderr: 88950K .......... .......... .......... .......... .......... 52% 29.6M 3s 2024-03-30T13:09:45.473 INFO:teuthology.orchestra.run.smithi083.stderr: 89000K .......... .......... .......... .......... .......... 52% 29.8M 3s 2024-03-30T13:09:45.475 INFO:teuthology.orchestra.run.smithi083.stderr: 89050K .......... .......... .......... .......... .......... 52% 25.7M 3s 2024-03-30T13:09:45.477 INFO:teuthology.orchestra.run.smithi083.stderr: 89100K .......... .......... .......... .......... .......... 52% 30.6M 3s 2024-03-30T13:09:45.478 INFO:teuthology.orchestra.run.smithi083.stderr: 89150K .......... .......... .......... .......... .......... 52% 30.5M 3s 2024-03-30T13:09:45.480 INFO:teuthology.orchestra.run.smithi083.stderr: 89200K .......... .......... .......... .......... .......... 52% 29.8M 3s 2024-03-30T13:09:45.483 INFO:teuthology.orchestra.run.smithi083.stderr: 89250K .......... .......... .......... .......... .......... 52% 26.1M 3s 2024-03-30T13:09:45.484 INFO:teuthology.orchestra.run.smithi083.stderr: 89300K .......... .......... .......... .......... .......... 53% 29.4M 3s 2024-03-30T13:09:45.485 INFO:teuthology.orchestra.run.smithi083.stderr: 89350K .......... .......... .......... .......... .......... 53% 29.7M 3s 2024-03-30T13:09:45.489 INFO:teuthology.orchestra.run.smithi083.stderr: 89400K .......... .......... .......... .......... .......... 53% 29.0M 3s 2024-03-30T13:09:45.491 INFO:teuthology.orchestra.run.smithi083.stderr: 89450K .......... .......... .......... .......... .......... 53% 27.8M 3s 2024-03-30T13:09:45.491 INFO:teuthology.orchestra.run.smithi083.stderr: 89500K .......... .......... .......... .......... .......... 53% 31.6M 3s 2024-03-30T13:09:45.492 INFO:teuthology.orchestra.run.smithi083.stderr: 89550K .......... .......... .......... .......... .......... 53% 31.6M 3s 2024-03-30T13:09:45.493 INFO:teuthology.orchestra.run.smithi083.stderr: 89600K .......... .......... .......... .......... .......... 53% 31.8M 3s 2024-03-30T13:09:45.495 INFO:teuthology.orchestra.run.smithi083.stderr: 89650K .......... .......... .......... .......... .......... 53% 26.8M 3s 2024-03-30T13:09:45.497 INFO:teuthology.orchestra.run.smithi083.stderr: 89700K .......... .......... .......... .......... .......... 53% 31.1M 3s 2024-03-30T13:09:45.498 INFO:teuthology.orchestra.run.smithi083.stderr: 89750K .......... .......... .......... .......... .......... 53% 31.4M 3s 2024-03-30T13:09:45.500 INFO:teuthology.orchestra.run.smithi083.stderr: 89800K .......... .......... .......... .......... .......... 53% 25.3M 3s 2024-03-30T13:09:45.502 INFO:teuthology.orchestra.run.smithi083.stderr: 89850K .......... .......... .......... .......... .......... 53% 20.0M 3s 2024-03-30T13:09:45.505 INFO:teuthology.orchestra.run.smithi083.stderr: 89900K .......... .......... .......... .......... .......... 53% 23.7M 3s 2024-03-30T13:09:45.507 INFO:teuthology.orchestra.run.smithi083.stderr: 89950K .......... .......... .......... .......... .......... 53% 22.4M 3s 2024-03-30T13:09:45.509 INFO:teuthology.orchestra.run.smithi083.stderr: 90000K .......... .......... .......... .......... .......... 53% 24.6M 3s 2024-03-30T13:09:45.511 INFO:teuthology.orchestra.run.smithi083.stderr: 90050K .......... .......... .......... .......... .......... 53% 19.9M 3s 2024-03-30T13:09:45.513 INFO:teuthology.orchestra.run.smithi083.stderr: 90100K .......... .......... .......... .......... .......... 53% 23.4M 3s 2024-03-30T13:09:45.516 INFO:teuthology.orchestra.run.smithi083.stderr: 90150K .......... .......... .......... .......... .......... 53% 26.8M 3s 2024-03-30T13:09:45.517 INFO:teuthology.orchestra.run.smithi083.stderr: 90200K .......... .......... .......... .......... .......... 53% 26.5M 3s 2024-03-30T13:09:45.519 INFO:teuthology.orchestra.run.smithi083.stderr: 90250K .......... .......... .......... .......... .......... 53% 23.3M 3s 2024-03-30T13:09:45.521 INFO:teuthology.orchestra.run.smithi083.stderr: 90300K .......... .......... .......... .......... .......... 53% 26.3M 3s 2024-03-30T13:09:45.523 INFO:teuthology.orchestra.run.smithi083.stderr: 90350K .......... .......... .......... .......... .......... 53% 25.6M 3s 2024-03-30T13:09:45.525 INFO:teuthology.orchestra.run.smithi083.stderr: 90400K .......... .......... .......... .......... .......... 53% 24.5M 3s 2024-03-30T13:09:45.527 INFO:teuthology.orchestra.run.smithi083.stderr: 90450K .......... .......... .......... .......... .......... 53% 20.5M 3s 2024-03-30T13:09:45.529 INFO:teuthology.orchestra.run.smithi083.stderr: 90500K .......... .......... .......... .......... .......... 53% 31.9M 3s 2024-03-30T13:09:45.530 INFO:teuthology.orchestra.run.smithi083.stderr: 90550K .......... .......... .......... .......... .......... 53% 32.6M 3s 2024-03-30T13:09:45.532 INFO:teuthology.orchestra.run.smithi083.stderr: 90600K .......... .......... .......... .......... .......... 53% 28.5M 3s 2024-03-30T13:09:45.533 INFO:teuthology.orchestra.run.smithi083.stderr: 90650K .......... .......... .......... .......... .......... 53% 33.6M 3s 2024-03-30T13:09:45.535 INFO:teuthology.orchestra.run.smithi083.stderr: 90700K .......... .......... .......... .......... .......... 53% 33.7M 3s 2024-03-30T13:09:45.537 INFO:teuthology.orchestra.run.smithi083.stderr: 90750K .......... .......... .......... .......... .......... 53% 34.0M 3s 2024-03-30T13:09:45.538 INFO:teuthology.orchestra.run.smithi083.stderr: 90800K .......... .......... .......... .......... .......... 53% 34.6M 3s 2024-03-30T13:09:45.539 INFO:teuthology.orchestra.run.smithi083.stderr: 90850K .......... .......... .......... .......... .......... 53% 33.7M 3s 2024-03-30T13:09:45.540 INFO:teuthology.orchestra.run.smithi083.stderr: 90900K .......... .......... .......... .......... .......... 53% 37.2M 3s 2024-03-30T13:09:45.542 INFO:teuthology.orchestra.run.smithi083.stderr: 90950K .......... .......... .......... .......... .......... 53% 37.4M 3s 2024-03-30T13:09:45.543 INFO:teuthology.orchestra.run.smithi083.stderr: 91000K .......... .......... .......... .......... .......... 54% 37.0M 3s 2024-03-30T13:09:45.545 INFO:teuthology.orchestra.run.smithi083.stderr: 91050K .......... .......... .......... .......... .......... 54% 31.7M 3s 2024-03-30T13:09:45.546 INFO:teuthology.orchestra.run.smithi083.stderr: 91100K .......... .......... .......... .......... .......... 54% 35.6M 3s 2024-03-30T13:09:45.547 INFO:teuthology.orchestra.run.smithi083.stderr: 91150K .......... .......... .......... .......... .......... 54% 35.5M 3s 2024-03-30T13:09:45.549 INFO:teuthology.orchestra.run.smithi083.stderr: 91200K .......... .......... .......... .......... .......... 54% 28.6M 3s 2024-03-30T13:09:45.550 INFO:teuthology.orchestra.run.smithi083.stderr: 91250K .......... .......... .......... .......... .......... 54% 33.8M 3s 2024-03-30T13:09:45.552 INFO:teuthology.orchestra.run.smithi083.stderr: 91300K .......... .......... .......... .......... .......... 54% 40.5M 3s 2024-03-30T13:09:45.553 INFO:teuthology.orchestra.run.smithi083.stderr: 91350K .......... .......... .......... .......... .......... 54% 41.3M 3s 2024-03-30T13:09:45.554 INFO:teuthology.orchestra.run.smithi083.stderr: 91400K .......... .......... .......... .......... .......... 54% 39.7M 3s 2024-03-30T13:09:45.555 INFO:teuthology.orchestra.run.smithi083.stderr: 91450K .......... .......... .......... .......... .......... 54% 33.9M 3s 2024-03-30T13:09:45.557 INFO:teuthology.orchestra.run.smithi083.stderr: 91500K .......... .......... .......... .......... .......... 54% 40.3M 3s 2024-03-30T13:09:45.558 INFO:teuthology.orchestra.run.smithi083.stderr: 91550K .......... .......... .......... .......... .......... 54% 35.9M 3s 2024-03-30T13:09:45.559 INFO:teuthology.orchestra.run.smithi083.stderr: 91600K .......... .......... .......... .......... .......... 54% 39.4M 3s 2024-03-30T13:09:45.561 INFO:teuthology.orchestra.run.smithi083.stderr: 91650K .......... .......... .......... .......... .......... 54% 32.9M 3s 2024-03-30T13:09:45.562 INFO:teuthology.orchestra.run.smithi083.stderr: 91700K .......... .......... .......... .......... .......... 54% 38.2M 3s 2024-03-30T13:09:45.563 INFO:teuthology.orchestra.run.smithi083.stderr: 91750K .......... .......... .......... .......... .......... 54% 37.0M 3s 2024-03-30T13:09:45.565 INFO:teuthology.orchestra.run.smithi083.stderr: 91800K .......... .......... .......... .......... .......... 54% 36.9M 3s 2024-03-30T13:09:45.566 INFO:teuthology.orchestra.run.smithi083.stderr: 91850K .......... .......... .......... .......... .......... 54% 31.5M 3s 2024-03-30T13:09:45.568 INFO:teuthology.orchestra.run.smithi083.stderr: 91900K .......... .......... .......... .......... .......... 54% 36.9M 3s 2024-03-30T13:09:45.569 INFO:teuthology.orchestra.run.smithi083.stderr: 91950K .......... .......... .......... .......... .......... 54% 36.3M 3s 2024-03-30T13:09:45.570 INFO:teuthology.orchestra.run.smithi083.stderr: 92000K .......... .......... .......... .......... .......... 54% 38.8M 3s 2024-03-30T13:09:45.572 INFO:teuthology.orchestra.run.smithi083.stderr: 92050K .......... .......... .......... .......... .......... 54% 33.2M 3s 2024-03-30T13:09:45.573 INFO:teuthology.orchestra.run.smithi083.stderr: 92100K .......... .......... .......... .......... .......... 54% 38.9M 3s 2024-03-30T13:09:45.574 INFO:teuthology.orchestra.run.smithi083.stderr: 92150K .......... .......... .......... .......... .......... 54% 37.6M 3s 2024-03-30T13:09:45.575 INFO:teuthology.orchestra.run.smithi083.stderr: 92200K .......... .......... .......... .......... .......... 54% 38.6M 3s 2024-03-30T13:09:45.577 INFO:teuthology.orchestra.run.smithi083.stderr: 92250K .......... .......... .......... .......... .......... 54% 31.0M 3s 2024-03-30T13:09:45.580 INFO:teuthology.orchestra.run.smithi083.stderr: 92300K .......... .......... .......... .......... .......... 54% 33.4M 3s 2024-03-30T13:09:45.581 INFO:teuthology.orchestra.run.smithi083.stderr: 92350K .......... .......... .......... .......... .......... 54% 22.8M 3s 2024-03-30T13:09:45.582 INFO:teuthology.orchestra.run.smithi083.stderr: 92400K .......... .......... .......... .......... .......... 54% 43.6M 3s 2024-03-30T13:09:45.583 INFO:teuthology.orchestra.run.smithi083.stderr: 92450K .......... .......... .......... .......... .......... 54% 35.7M 3s 2024-03-30T13:09:45.584 INFO:teuthology.orchestra.run.smithi083.stderr: 92500K .......... .......... .......... .......... .......... 54% 43.2M 3s 2024-03-30T13:09:45.585 INFO:teuthology.orchestra.run.smithi083.stderr: 92550K .......... .......... .......... .......... .......... 54% 42.6M 3s 2024-03-30T13:09:45.587 INFO:teuthology.orchestra.run.smithi083.stderr: 92600K .......... .......... .......... .......... .......... 54% 41.7M 3s 2024-03-30T13:09:45.588 INFO:teuthology.orchestra.run.smithi083.stderr: 92650K .......... .......... .......... .......... .......... 54% 36.3M 3s 2024-03-30T13:09:45.589 INFO:teuthology.orchestra.run.smithi083.stderr: 92700K .......... .......... .......... .......... .......... 55% 42.3M 3s 2024-03-30T13:09:45.590 INFO:teuthology.orchestra.run.smithi083.stderr: 92750K .......... .......... .......... .......... .......... 55% 41.7M 3s 2024-03-30T13:09:45.591 INFO:teuthology.orchestra.run.smithi083.stderr: 92800K .......... .......... .......... .......... .......... 55% 42.3M 3s 2024-03-30T13:09:45.593 INFO:teuthology.orchestra.run.smithi083.stderr: 92850K .......... .......... .......... .......... .......... 55% 35.7M 3s 2024-03-30T13:09:45.594 INFO:teuthology.orchestra.run.smithi083.stderr: 92900K .......... .......... .......... .......... .......... 55% 42.3M 3s 2024-03-30T13:09:45.595 INFO:teuthology.orchestra.run.smithi083.stderr: 92950K .......... .......... .......... .......... .......... 55% 41.4M 3s 2024-03-30T13:09:45.596 INFO:teuthology.orchestra.run.smithi083.stderr: 93000K .......... .......... .......... .......... .......... 55% 42.5M 3s 2024-03-30T13:09:45.598 INFO:teuthology.orchestra.run.smithi083.stderr: 93050K .......... .......... .......... .......... .......... 55% 35.8M 3s 2024-03-30T13:09:45.599 INFO:teuthology.orchestra.run.smithi083.stderr: 93100K .......... .......... .......... .......... .......... 55% 40.3M 3s 2024-03-30T13:09:45.600 INFO:teuthology.orchestra.run.smithi083.stderr: 93150K .......... .......... .......... .......... .......... 55% 41.5M 3s 2024-03-30T13:09:45.601 INFO:teuthology.orchestra.run.smithi083.stderr: 93200K .......... .......... .......... .......... .......... 55% 40.9M 3s 2024-03-30T13:09:45.603 INFO:teuthology.orchestra.run.smithi083.stderr: 93250K .......... .......... .......... .......... .......... 55% 34.3M 3s 2024-03-30T13:09:45.604 INFO:teuthology.orchestra.run.smithi083.stderr: 93300K .......... .......... .......... .......... .......... 55% 41.4M 3s 2024-03-30T13:09:45.605 INFO:teuthology.orchestra.run.smithi083.stderr: 93350K .......... .......... .......... .......... .......... 55% 40.7M 3s 2024-03-30T13:09:45.606 INFO:teuthology.orchestra.run.smithi083.stderr: 93400K .......... .......... .......... .......... .......... 55% 39.4M 3s 2024-03-30T13:09:45.608 INFO:teuthology.orchestra.run.smithi083.stderr: 93450K .......... .......... .......... .......... .......... 55% 34.5M 3s 2024-03-30T13:09:45.609 INFO:teuthology.orchestra.run.smithi083.stderr: 93500K .......... .......... .......... .......... .......... 55% 38.9M 3s 2024-03-30T13:09:45.610 INFO:teuthology.orchestra.run.smithi083.stderr: 93550K .......... .......... .......... .......... .......... 55% 38.4M 3s 2024-03-30T13:09:45.611 INFO:teuthology.orchestra.run.smithi083.stderr: 93600K .......... .......... .......... .......... .......... 55% 38.2M 3s 2024-03-30T13:09:45.613 INFO:teuthology.orchestra.run.smithi083.stderr: 93650K .......... .......... .......... .......... .......... 55% 32.7M 3s 2024-03-30T13:09:45.614 INFO:teuthology.orchestra.run.smithi083.stderr: 93700K .......... .......... .......... .......... .......... 55% 37.9M 3s 2024-03-30T13:09:45.616 INFO:teuthology.orchestra.run.smithi083.stderr: 93750K .......... .......... .......... .......... .......... 55% 38.0M 3s 2024-03-30T13:09:45.617 INFO:teuthology.orchestra.run.smithi083.stderr: 93800K .......... .......... .......... .......... .......... 55% 38.4M 3s 2024-03-30T13:09:45.618 INFO:teuthology.orchestra.run.smithi083.stderr: 93850K .......... .......... .......... .......... .......... 55% 30.7M 3s 2024-03-30T13:09:45.620 INFO:teuthology.orchestra.run.smithi083.stderr: 93900K .......... .......... .......... .......... .......... 55% 35.2M 3s 2024-03-30T13:09:45.621 INFO:teuthology.orchestra.run.smithi083.stderr: 93950K .......... .......... .......... .......... .......... 55% 34.9M 3s 2024-03-30T13:09:45.623 INFO:teuthology.orchestra.run.smithi083.stderr: 94000K .......... .......... .......... .......... .......... 55% 34.6M 3s 2024-03-30T13:09:45.624 INFO:teuthology.orchestra.run.smithi083.stderr: 94050K .......... .......... .......... .......... .......... 55% 32.0M 3s 2024-03-30T13:09:45.625 INFO:teuthology.orchestra.run.smithi083.stderr: 94100K .......... .......... .......... .......... .......... 55% 37.8M 3s 2024-03-30T13:09:45.627 INFO:teuthology.orchestra.run.smithi083.stderr: 94150K .......... .......... .......... .......... .......... 55% 37.6M 3s 2024-03-30T13:09:45.628 INFO:teuthology.orchestra.run.smithi083.stderr: 94200K .......... .......... .......... .......... .......... 55% 33.2M 3s 2024-03-30T13:09:45.630 INFO:teuthology.orchestra.run.smithi083.stderr: 94250K .......... .......... .......... .......... .......... 55% 29.4M 3s 2024-03-30T13:09:45.631 INFO:teuthology.orchestra.run.smithi083.stderr: 94300K .......... .......... .......... .......... .......... 55% 33.5M 3s 2024-03-30T13:09:45.633 INFO:teuthology.orchestra.run.smithi083.stderr: 94350K .......... .......... .......... .......... .......... 56% 36.4M 3s 2024-03-30T13:09:45.634 INFO:teuthology.orchestra.run.smithi083.stderr: 94400K .......... .......... .......... .......... .......... 56% 35.1M 3s 2024-03-30T13:09:45.636 INFO:teuthology.orchestra.run.smithi083.stderr: 94450K .......... .......... .......... .......... .......... 56% 30.8M 3s 2024-03-30T13:09:45.637 INFO:teuthology.orchestra.run.smithi083.stderr: 94500K .......... .......... .......... .......... .......... 56% 35.4M 3s 2024-03-30T13:09:45.638 INFO:teuthology.orchestra.run.smithi083.stderr: 94550K .......... .......... .......... .......... .......... 56% 32.3M 3s 2024-03-30T13:09:45.640 INFO:teuthology.orchestra.run.smithi083.stderr: 94600K .......... .......... .......... .......... .......... 56% 32.6M 3s 2024-03-30T13:09:45.642 INFO:teuthology.orchestra.run.smithi083.stderr: 94650K .......... .......... .......... .......... .......... 56% 28.4M 3s 2024-03-30T13:09:45.643 INFO:teuthology.orchestra.run.smithi083.stderr: 94700K .......... .......... .......... .......... .......... 56% 30.8M 3s 2024-03-30T13:09:45.645 INFO:teuthology.orchestra.run.smithi083.stderr: 94750K .......... .......... .......... .......... .......... 56% 34.6M 3s 2024-03-30T13:09:45.646 INFO:teuthology.orchestra.run.smithi083.stderr: 94800K .......... .......... .......... .......... .......... 56% 36.7M 3s 2024-03-30T13:09:45.648 INFO:teuthology.orchestra.run.smithi083.stderr: 94850K .......... .......... .......... .......... .......... 56% 29.4M 3s 2024-03-30T13:09:45.649 INFO:teuthology.orchestra.run.smithi083.stderr: 94900K .......... .......... .......... .......... .......... 56% 34.2M 3s 2024-03-30T13:09:45.650 INFO:teuthology.orchestra.run.smithi083.stderr: 94950K .......... .......... .......... .......... .......... 56% 36.0M 3s 2024-03-30T13:09:45.652 INFO:teuthology.orchestra.run.smithi083.stderr: 95000K .......... .......... .......... .......... .......... 56% 35.0M 3s 2024-03-30T13:09:45.653 INFO:teuthology.orchestra.run.smithi083.stderr: 95050K .......... .......... .......... .......... .......... 56% 28.5M 3s 2024-03-30T13:09:45.655 INFO:teuthology.orchestra.run.smithi083.stderr: 95100K .......... .......... .......... .......... .......... 56% 31.8M 3s 2024-03-30T13:09:45.657 INFO:teuthology.orchestra.run.smithi083.stderr: 95150K .......... .......... .......... .......... .......... 56% 32.7M 3s 2024-03-30T13:09:45.658 INFO:teuthology.orchestra.run.smithi083.stderr: 95200K .......... .......... .......... .......... .......... 56% 32.9M 3s 2024-03-30T13:09:45.660 INFO:teuthology.orchestra.run.smithi083.stderr: 95250K .......... .......... .......... .......... .......... 56% 27.1M 3s 2024-03-30T13:09:45.662 INFO:teuthology.orchestra.run.smithi083.stderr: 95300K .......... .......... .......... .......... .......... 56% 25.2M 3s 2024-03-30T13:09:45.663 INFO:teuthology.orchestra.run.smithi083.stderr: 95350K .......... .......... .......... .......... .......... 56% 35.4M 3s 2024-03-30T13:09:45.664 INFO:teuthology.orchestra.run.smithi083.stderr: 95400K .......... .......... .......... .......... .......... 56% 34.3M 3s 2024-03-30T13:09:45.666 INFO:teuthology.orchestra.run.smithi083.stderr: 95450K .......... .......... .......... .......... .......... 56% 30.0M 3s 2024-03-30T13:09:45.668 INFO:teuthology.orchestra.run.smithi083.stderr: 95500K .......... .......... .......... .......... .......... 56% 35.3M 3s 2024-03-30T13:09:45.669 INFO:teuthology.orchestra.run.smithi083.stderr: 95550K .......... .......... .......... .......... .......... 56% 33.1M 3s 2024-03-30T13:09:45.671 INFO:teuthology.orchestra.run.smithi083.stderr: 95600K .......... .......... .......... .......... .......... 56% 34.6M 3s 2024-03-30T13:09:45.672 INFO:teuthology.orchestra.run.smithi083.stderr: 95650K .......... .......... .......... .......... .......... 56% 28.8M 3s 2024-03-30T13:09:45.673 INFO:teuthology.orchestra.run.smithi083.stderr: 95700K .......... .......... .......... .......... .......... 56% 34.9M 3s 2024-03-30T13:09:45.675 INFO:teuthology.orchestra.run.smithi083.stderr: 95750K .......... .......... .......... .......... .......... 56% 31.7M 3s 2024-03-30T13:09:45.677 INFO:teuthology.orchestra.run.smithi083.stderr: 95800K .......... .......... .......... .......... .......... 56% 32.7M 3s 2024-03-30T13:09:45.678 INFO:teuthology.orchestra.run.smithi083.stderr: 95850K .......... .......... .......... .......... .......... 56% 27.3M 3s 2024-03-30T13:09:45.680 INFO:teuthology.orchestra.run.smithi083.stderr: 95900K .......... .......... .......... .......... .......... 56% 32.4M 3s 2024-03-30T13:09:45.681 INFO:teuthology.orchestra.run.smithi083.stderr: 95950K .......... .......... .......... .......... .......... 56% 33.7M 3s 2024-03-30T13:09:45.683 INFO:teuthology.orchestra.run.smithi083.stderr: 96000K .......... .......... .......... .......... .......... 56% 30.9M 3s 2024-03-30T13:09:45.685 INFO:teuthology.orchestra.run.smithi083.stderr: 96050K .......... .......... .......... .......... .......... 57% 26.8M 3s 2024-03-30T13:09:45.686 INFO:teuthology.orchestra.run.smithi083.stderr: 96100K .......... .......... .......... .......... .......... 57% 32.9M 3s 2024-03-30T13:09:45.688 INFO:teuthology.orchestra.run.smithi083.stderr: 96150K .......... .......... .......... .......... .......... 57% 32.6M 3s 2024-03-30T13:09:45.689 INFO:teuthology.orchestra.run.smithi083.stderr: 96200K .......... .......... .......... .......... .......... 57% 31.7M 3s 2024-03-30T13:09:45.691 INFO:teuthology.orchestra.run.smithi083.stderr: 96250K .......... .......... .......... .......... .......... 57% 28.0M 3s 2024-03-30T13:09:45.693 INFO:teuthology.orchestra.run.smithi083.stderr: 96300K .......... .......... .......... .......... .......... 57% 34.8M 3s 2024-03-30T13:09:45.694 INFO:teuthology.orchestra.run.smithi083.stderr: 96350K .......... .......... .......... .......... .......... 57% 37.4M 3s 2024-03-30T13:09:45.700 INFO:teuthology.orchestra.run.smithi083.stderr: 96400K .......... .......... .......... .......... .......... 57% 37.3M 3s 2024-03-30T13:09:45.700 INFO:teuthology.orchestra.run.smithi083.stderr: 96450K .......... .......... .......... .......... .......... 57% 21.3M 3s 2024-03-30T13:09:45.700 INFO:teuthology.orchestra.run.smithi083.stderr: 96500K .......... .......... .......... .......... .......... 57% 42.1M 3s 2024-03-30T13:09:45.700 INFO:teuthology.orchestra.run.smithi083.stderr: 96550K .......... .......... .......... .......... .......... 57% 43.9M 3s 2024-03-30T13:09:45.701 INFO:teuthology.orchestra.run.smithi083.stderr: 96600K .......... .......... .......... .......... .......... 57% 43.2M 3s 2024-03-30T13:09:45.702 INFO:teuthology.orchestra.run.smithi083.stderr: 96650K .......... .......... .......... .......... .......... 57% 36.6M 3s 2024-03-30T13:09:45.703 INFO:teuthology.orchestra.run.smithi083.stderr: 96700K .......... .......... .......... .......... .......... 57% 43.3M 2s 2024-03-30T13:09:45.704 INFO:teuthology.orchestra.run.smithi083.stderr: 96750K .......... .......... .......... .......... .......... 57% 42.5M 2s 2024-03-30T13:09:45.706 INFO:teuthology.orchestra.run.smithi083.stderr: 96800K .......... .......... .......... .......... .......... 57% 41.0M 2s 2024-03-30T13:09:45.707 INFO:teuthology.orchestra.run.smithi083.stderr: 96850K .......... .......... .......... .......... .......... 57% 35.0M 2s 2024-03-30T13:09:45.708 INFO:teuthology.orchestra.run.smithi083.stderr: 96900K .......... .......... .......... .......... .......... 57% 40.0M 2s 2024-03-30T13:09:45.710 INFO:teuthology.orchestra.run.smithi083.stderr: 96950K .......... .......... .......... .......... .......... 57% 29.1M 2s 2024-03-30T13:09:45.712 INFO:teuthology.orchestra.run.smithi083.stderr: 97000K .......... .......... .......... .......... .......... 57% 31.6M 2s 2024-03-30T13:09:45.713 INFO:teuthology.orchestra.run.smithi083.stderr: 97050K .......... .......... .......... .......... .......... 57% 23.9M 2s 2024-03-30T13:09:45.715 INFO:teuthology.orchestra.run.smithi083.stderr: 97100K .......... .......... .......... .......... .......... 57% 30.3M 2s 2024-03-30T13:09:45.716 INFO:teuthology.orchestra.run.smithi083.stderr: 97150K .......... .......... .......... .......... .......... 57% 31.5M 2s 2024-03-30T13:09:45.718 INFO:teuthology.orchestra.run.smithi083.stderr: 97200K .......... .......... .......... .......... .......... 57% 30.3M 2s 2024-03-30T13:09:45.720 INFO:teuthology.orchestra.run.smithi083.stderr: 97250K .......... .......... .......... .......... .......... 57% 26.5M 2s 2024-03-30T13:09:45.722 INFO:teuthology.orchestra.run.smithi083.stderr: 97300K .......... .......... .......... .......... .......... 57% 30.9M 2s 2024-03-30T13:09:45.723 INFO:teuthology.orchestra.run.smithi083.stderr: 97350K .......... .......... .......... .......... .......... 57% 29.6M 2s 2024-03-30T13:09:45.725 INFO:teuthology.orchestra.run.smithi083.stderr: 97400K .......... .......... .......... .......... .......... 57% 30.8M 2s 2024-03-30T13:09:45.727 INFO:teuthology.orchestra.run.smithi083.stderr: 97450K .......... .......... .......... .......... .......... 57% 25.0M 2s 2024-03-30T13:09:45.728 INFO:teuthology.orchestra.run.smithi083.stderr: 97500K .......... .......... .......... .......... .......... 57% 30.9M 2s 2024-03-30T13:09:45.730 INFO:teuthology.orchestra.run.smithi083.stderr: 97550K .......... .......... .......... .......... .......... 57% 29.8M 2s 2024-03-30T13:09:45.732 INFO:teuthology.orchestra.run.smithi083.stderr: 97600K .......... .......... .......... .......... .......... 57% 30.1M 2s 2024-03-30T13:09:45.734 INFO:teuthology.orchestra.run.smithi083.stderr: 97650K .......... .......... .......... .......... .......... 57% 24.0M 2s 2024-03-30T13:09:45.735 INFO:teuthology.orchestra.run.smithi083.stderr: 97700K .......... .......... .......... .......... .......... 57% 29.7M 2s 2024-03-30T13:09:45.737 INFO:teuthology.orchestra.run.smithi083.stderr: 97750K .......... .......... .......... .......... .......... 58% 28.7M 2s 2024-03-30T13:09:45.739 INFO:teuthology.orchestra.run.smithi083.stderr: 97800K .......... .......... .......... .......... .......... 58% 29.3M 2s 2024-03-30T13:09:45.741 INFO:teuthology.orchestra.run.smithi083.stderr: 97850K .......... .......... .......... .......... .......... 58% 24.0M 2s 2024-03-30T13:09:45.742 INFO:teuthology.orchestra.run.smithi083.stderr: 97900K .......... .......... .......... .......... .......... 58% 27.9M 2s 2024-03-30T13:09:45.744 INFO:teuthology.orchestra.run.smithi083.stderr: 97950K .......... .......... .......... .......... .......... 58% 27.5M 2s 2024-03-30T13:09:45.746 INFO:teuthology.orchestra.run.smithi083.stderr: 98000K .......... .......... .......... .......... .......... 58% 26.4M 2s 2024-03-30T13:09:45.748 INFO:teuthology.orchestra.run.smithi083.stderr: 98050K .......... .......... .......... .......... .......... 58% 22.9M 2s 2024-03-30T13:09:45.750 INFO:teuthology.orchestra.run.smithi083.stderr: 98100K .......... .......... .......... .......... .......... 58% 26.7M 2s 2024-03-30T13:09:45.752 INFO:teuthology.orchestra.run.smithi083.stderr: 98150K .......... .......... .......... .......... .......... 58% 26.6M 2s 2024-03-30T13:09:45.754 INFO:teuthology.orchestra.run.smithi083.stderr: 98200K .......... .......... .......... .......... .......... 58% 26.4M 2s 2024-03-30T13:09:45.756 INFO:teuthology.orchestra.run.smithi083.stderr: 98250K .......... .......... .......... .......... .......... 58% 22.3M 2s 2024-03-30T13:09:45.758 INFO:teuthology.orchestra.run.smithi083.stderr: 98300K .......... .......... .......... .......... .......... 58% 31.0M 2s 2024-03-30T13:09:45.759 INFO:teuthology.orchestra.run.smithi083.stderr: 98350K .......... .......... .......... .......... .......... 58% 36.8M 2s 2024-03-30T13:09:45.761 INFO:teuthology.orchestra.run.smithi083.stderr: 98400K .......... .......... .......... .......... .......... 58% 32.0M 2s 2024-03-30T13:09:45.763 INFO:teuthology.orchestra.run.smithi083.stderr: 98450K .......... .......... .......... .......... .......... 58% 32.3M 2s 2024-03-30T13:09:45.763 INFO:teuthology.orchestra.run.smithi083.stderr: 98500K .......... .......... .......... .......... .......... 58% 38.3M 2s 2024-03-30T13:09:45.764 INFO:teuthology.orchestra.run.smithi083.stderr: 98550K .......... .......... .......... .......... .......... 58% 36.0M 2s 2024-03-30T13:09:45.766 INFO:teuthology.orchestra.run.smithi083.stderr: 98600K .......... .......... .......... .......... .......... 58% 39.4M 2s 2024-03-30T13:09:45.767 INFO:teuthology.orchestra.run.smithi083.stderr: 98650K .......... .......... .......... .......... .......... 58% 33.2M 2s 2024-03-30T13:09:45.769 INFO:teuthology.orchestra.run.smithi083.stderr: 98700K .......... .......... .......... .......... .......... 58% 38.9M 2s 2024-03-30T13:09:45.770 INFO:teuthology.orchestra.run.smithi083.stderr: 98750K .......... .......... .......... .......... .......... 58% 38.9M 2s 2024-03-30T13:09:45.772 INFO:teuthology.orchestra.run.smithi083.stderr: 98800K .......... .......... .......... .......... .......... 58% 32.9M 2s 2024-03-30T13:09:45.773 INFO:teuthology.orchestra.run.smithi083.stderr: 98850K .......... .......... .......... .......... .......... 58% 33.5M 2s 2024-03-30T13:09:45.774 INFO:teuthology.orchestra.run.smithi083.stderr: 98900K .......... .......... .......... .......... .......... 58% 39.4M 2s 2024-03-30T13:09:45.775 INFO:teuthology.orchestra.run.smithi083.stderr: 98950K .......... .......... .......... .......... .......... 58% 39.7M 2s 2024-03-30T13:09:45.777 INFO:teuthology.orchestra.run.smithi083.stderr: 99000K .......... .......... .......... .......... .......... 58% 38.9M 2s 2024-03-30T13:09:45.778 INFO:teuthology.orchestra.run.smithi083.stderr: 99050K .......... .......... .......... .......... .......... 58% 33.4M 2s 2024-03-30T13:09:45.779 INFO:teuthology.orchestra.run.smithi083.stderr: 99100K .......... .......... .......... .......... .......... 58% 33.9M 2s 2024-03-30T13:09:45.781 INFO:teuthology.orchestra.run.smithi083.stderr: 99150K .......... .......... .......... .......... .......... 58% 39.5M 2s 2024-03-30T13:09:45.782 INFO:teuthology.orchestra.run.smithi083.stderr: 99200K .......... .......... .......... .......... .......... 58% 39.5M 2s 2024-03-30T13:09:45.783 INFO:teuthology.orchestra.run.smithi083.stderr: 99250K .......... .......... .......... .......... .......... 58% 33.9M 2s 2024-03-30T13:09:45.784 INFO:teuthology.orchestra.run.smithi083.stderr: 99300K .......... .......... .......... .......... .......... 58% 39.6M 2s 2024-03-30T13:09:45.786 INFO:teuthology.orchestra.run.smithi083.stderr: 99350K .......... .......... .......... .......... .......... 58% 39.3M 2s 2024-03-30T13:09:45.787 INFO:teuthology.orchestra.run.smithi083.stderr: 99400K .......... .......... .......... .......... .......... 58% 29.4M 2s 2024-03-30T13:09:45.789 INFO:teuthology.orchestra.run.smithi083.stderr: 99450K .......... .......... .......... .......... .......... 59% 35.0M 2s 2024-03-30T13:09:45.790 INFO:teuthology.orchestra.run.smithi083.stderr: 99500K .......... .......... .......... .......... .......... 59% 40.4M 2s 2024-03-30T13:09:45.791 INFO:teuthology.orchestra.run.smithi083.stderr: 99550K .......... .......... .......... .......... .......... 59% 40.8M 2s 2024-03-30T13:09:45.793 INFO:teuthology.orchestra.run.smithi083.stderr: 99600K .......... .......... .......... .......... .......... 59% 40.1M 2s 2024-03-30T13:09:45.871 INFO:teuthology.orchestra.run.smithi083.stderr: 99650K .......... .......... .......... .......... .......... 59% 638K 2s 2024-03-30T13:09:45.873 INFO:teuthology.orchestra.run.smithi083.stderr: 99700K .......... .......... .......... .......... .......... 59% 25.4M 2s 2024-03-30T13:09:45.874 INFO:teuthology.orchestra.run.smithi083.stderr: 99750K .......... .......... .......... .......... .......... 59% 29.6M 2s 2024-03-30T13:09:45.876 INFO:teuthology.orchestra.run.smithi083.stderr: 99800K .......... .......... .......... .......... .......... 59% 26.6M 2s 2024-03-30T13:09:45.878 INFO:teuthology.orchestra.run.smithi083.stderr: 99850K .......... .......... .......... .......... .......... 59% 27.9M 2s 2024-03-30T13:09:45.880 INFO:teuthology.orchestra.run.smithi083.stderr: 99900K .......... .......... .......... .......... .......... 59% 29.2M 2s 2024-03-30T13:09:45.881 INFO:teuthology.orchestra.run.smithi083.stderr: 99950K .......... .......... .......... .......... .......... 59% 30.9M 2s 2024-03-30T13:09:45.883 INFO:teuthology.orchestra.run.smithi083.stderr:100000K .......... .......... .......... .......... .......... 59% 27.5M 2s 2024-03-30T13:09:45.885 INFO:teuthology.orchestra.run.smithi083.stderr:100050K .......... .......... .......... .......... .......... 59% 27.7M 2s 2024-03-30T13:09:45.887 INFO:teuthology.orchestra.run.smithi083.stderr:100100K .......... .......... .......... .......... .......... 59% 22.8M 2s 2024-03-30T13:09:45.888 INFO:teuthology.orchestra.run.smithi083.stderr:100150K .......... .......... .......... .......... .......... 59% 31.9M 2s 2024-03-30T13:09:45.890 INFO:teuthology.orchestra.run.smithi083.stderr:100200K .......... .......... .......... .......... .......... 59% 34.4M 2s 2024-03-30T13:09:45.891 INFO:teuthology.orchestra.run.smithi083.stderr:100250K .......... .......... .......... .......... .......... 59% 31.1M 2s 2024-03-30T13:09:45.893 INFO:teuthology.orchestra.run.smithi083.stderr:100300K .......... .......... .......... .......... .......... 59% 23.0M 2s 2024-03-30T13:09:45.895 INFO:teuthology.orchestra.run.smithi083.stderr:100350K .......... .......... .......... .......... .......... 59% 26.8M 2s 2024-03-30T13:09:45.897 INFO:teuthology.orchestra.run.smithi083.stderr:100400K .......... .......... .......... .......... .......... 59% 26.8M 2s 2024-03-30T13:09:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:100450K .......... .......... .......... .......... .......... 59% 26.5M 2s 2024-03-30T13:09:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:100500K .......... .......... .......... .......... .......... 59% 23.3M 2s 2024-03-30T13:09:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:100550K .......... .......... .......... .......... .......... 59% 26.8M 2s 2024-03-30T13:09:45.905 INFO:teuthology.orchestra.run.smithi083.stderr:100600K .......... .......... .......... .......... .......... 59% 25.5M 2s 2024-03-30T13:09:45.907 INFO:teuthology.orchestra.run.smithi083.stderr:100650K .......... .......... .......... .......... .......... 59% 27.2M 2s 2024-03-30T13:09:45.909 INFO:teuthology.orchestra.run.smithi083.stderr:100700K .......... .......... .......... .......... .......... 59% 24.3M 2s 2024-03-30T13:09:45.910 INFO:teuthology.orchestra.run.smithi083.stderr:100750K .......... .......... .......... .......... .......... 59% 28.5M 2s 2024-03-30T13:09:45.912 INFO:teuthology.orchestra.run.smithi083.stderr:100800K .......... .......... .......... .......... .......... 59% 28.2M 2s 2024-03-30T13:09:45.914 INFO:teuthology.orchestra.run.smithi083.stderr:100850K .......... .......... .......... .......... .......... 59% 25.8M 2s 2024-03-30T13:09:45.916 INFO:teuthology.orchestra.run.smithi083.stderr:100900K .......... .......... .......... .......... .......... 59% 23.1M 2s 2024-03-30T13:09:45.918 INFO:teuthology.orchestra.run.smithi083.stderr:100950K .......... .......... .......... .......... .......... 59% 30.9M 2s 2024-03-30T13:09:45.919 INFO:teuthology.orchestra.run.smithi083.stderr:101000K .......... .......... .......... .......... .......... 59% 30.7M 2s 2024-03-30T13:09:45.921 INFO:teuthology.orchestra.run.smithi083.stderr:101050K .......... .......... .......... .......... .......... 59% 32.0M 2s 2024-03-30T13:09:45.923 INFO:teuthology.orchestra.run.smithi083.stderr:101100K .......... .......... .......... .......... .......... 60% 27.4M 2s 2024-03-30T13:09:45.924 INFO:teuthology.orchestra.run.smithi083.stderr:101150K .......... .......... .......... .......... .......... 60% 31.2M 2s 2024-03-30T13:09:45.926 INFO:teuthology.orchestra.run.smithi083.stderr:101200K .......... .......... .......... .......... .......... 60% 31.7M 2s 2024-03-30T13:09:45.927 INFO:teuthology.orchestra.run.smithi083.stderr:101250K .......... .......... .......... .......... .......... 60% 31.4M 2s 2024-03-30T13:09:45.929 INFO:teuthology.orchestra.run.smithi083.stderr:101300K .......... .......... .......... .......... .......... 60% 27.1M 2s 2024-03-30T13:09:45.931 INFO:teuthology.orchestra.run.smithi083.stderr:101350K .......... .......... .......... .......... .......... 60% 30.8M 2s 2024-03-30T13:09:45.933 INFO:teuthology.orchestra.run.smithi083.stderr:101400K .......... .......... .......... .......... .......... 60% 31.6M 2s 2024-03-30T13:09:45.934 INFO:teuthology.orchestra.run.smithi083.stderr:101450K .......... .......... .......... .......... .......... 60% 31.1M 2s 2024-03-30T13:09:45.936 INFO:teuthology.orchestra.run.smithi083.stderr:101500K .......... .......... .......... .......... .......... 60% 26.1M 2s 2024-03-30T13:09:45.937 INFO:teuthology.orchestra.run.smithi083.stderr:101550K .......... .......... .......... .......... .......... 60% 31.6M 2s 2024-03-30T13:09:45.939 INFO:teuthology.orchestra.run.smithi083.stderr:101600K .......... .......... .......... .......... .......... 60% 28.8M 2s 2024-03-30T13:09:45.941 INFO:teuthology.orchestra.run.smithi083.stderr:101650K .......... .......... .......... .......... .......... 60% 29.2M 2s 2024-03-30T13:09:45.943 INFO:teuthology.orchestra.run.smithi083.stderr:101700K .......... .......... .......... .......... .......... 60% 25.0M 2s 2024-03-30T13:09:45.944 INFO:teuthology.orchestra.run.smithi083.stderr:101750K .......... .......... .......... .......... .......... 60% 29.4M 2s 2024-03-30T13:09:45.946 INFO:teuthology.orchestra.run.smithi083.stderr:101800K .......... .......... .......... .......... .......... 60% 30.0M 2s 2024-03-30T13:09:45.947 INFO:teuthology.orchestra.run.smithi083.stderr:101850K .......... .......... .......... .......... .......... 60% 29.3M 2s 2024-03-30T13:09:45.949 INFO:teuthology.orchestra.run.smithi083.stderr:101900K .......... .......... .......... .......... .......... 60% 25.4M 2s 2024-03-30T13:09:45.951 INFO:teuthology.orchestra.run.smithi083.stderr:101950K .......... .......... .......... .......... .......... 60% 29.1M 2s 2024-03-30T13:09:45.953 INFO:teuthology.orchestra.run.smithi083.stderr:102000K .......... .......... .......... .......... .......... 60% 28.5M 2s 2024-03-30T13:09:45.954 INFO:teuthology.orchestra.run.smithi083.stderr:102050K .......... .......... .......... .......... .......... 60% 27.1M 2s 2024-03-30T13:09:45.956 INFO:teuthology.orchestra.run.smithi083.stderr:102100K .......... .......... .......... .......... .......... 60% 24.5M 2s 2024-03-30T13:09:45.958 INFO:teuthology.orchestra.run.smithi083.stderr:102150K .......... .......... .......... .......... .......... 60% 28.1M 2s 2024-03-30T13:09:45.960 INFO:teuthology.orchestra.run.smithi083.stderr:102200K .......... .......... .......... .......... .......... 60% 28.1M 2s 2024-03-30T13:09:45.962 INFO:teuthology.orchestra.run.smithi083.stderr:102250K .......... .......... .......... .......... .......... 60% 28.2M 2s 2024-03-30T13:09:45.964 INFO:teuthology.orchestra.run.smithi083.stderr:102300K .......... .......... .......... .......... .......... 60% 24.2M 2s 2024-03-30T13:09:45.965 INFO:teuthology.orchestra.run.smithi083.stderr:102350K .......... .......... .......... .......... .......... 60% 28.0M 2s 2024-03-30T13:09:45.968 INFO:teuthology.orchestra.run.smithi083.stderr:102400K .......... .......... .......... .......... .......... 60% 21.5M 2s 2024-03-30T13:09:45.970 INFO:teuthology.orchestra.run.smithi083.stderr:102450K .......... .......... .......... .......... .......... 60% 23.1M 2s 2024-03-30T13:09:45.973 INFO:teuthology.orchestra.run.smithi083.stderr:102500K .......... .......... .......... .......... .......... 60% 20.5M 2s 2024-03-30T13:09:45.975 INFO:teuthology.orchestra.run.smithi083.stderr:102550K .......... .......... .......... .......... .......... 60% 23.8M 2s 2024-03-30T13:09:45.977 INFO:teuthology.orchestra.run.smithi083.stderr:102600K .......... .......... .......... .......... .......... 60% 22.9M 2s 2024-03-30T13:09:45.979 INFO:teuthology.orchestra.run.smithi083.stderr:102650K .......... .......... .......... .......... .......... 60% 24.9M 2s 2024-03-30T13:09:45.980 INFO:teuthology.orchestra.run.smithi083.stderr:102700K .......... .......... .......... .......... .......... 60% 23.2M 2s 2024-03-30T13:09:45.982 INFO:teuthology.orchestra.run.smithi083.stderr:102750K .......... .......... .......... .......... .......... 60% 25.6M 2s 2024-03-30T13:09:45.984 INFO:teuthology.orchestra.run.smithi083.stderr:102800K .......... .......... .......... .......... .......... 61% 26.5M 2s 2024-03-30T13:09:45.986 INFO:teuthology.orchestra.run.smithi083.stderr:102850K .......... .......... .......... .......... .......... 61% 32.9M 2s 2024-03-30T13:09:45.988 INFO:teuthology.orchestra.run.smithi083.stderr:102900K .......... .......... .......... .......... .......... 61% 24.1M 2s 2024-03-30T13:09:45.990 INFO:teuthology.orchestra.run.smithi083.stderr:102950K .......... .......... .......... .......... .......... 61% 26.7M 2s 2024-03-30T13:09:45.992 INFO:teuthology.orchestra.run.smithi083.stderr:103000K .......... .......... .......... .......... .......... 61% 27.8M 2s 2024-03-30T13:09:45.993 INFO:teuthology.orchestra.run.smithi083.stderr:103050K .......... .......... .......... .......... .......... 61% 28.4M 2s 2024-03-30T13:09:45.995 INFO:teuthology.orchestra.run.smithi083.stderr:103100K .......... .......... .......... .......... .......... 61% 23.5M 2s 2024-03-30T13:09:45.997 INFO:teuthology.orchestra.run.smithi083.stderr:103150K .......... .......... .......... .......... .......... 61% 27.5M 2s 2024-03-30T13:09:45.999 INFO:teuthology.orchestra.run.smithi083.stderr:103200K .......... .......... .......... .......... .......... 61% 27.7M 2s 2024-03-30T13:09:46.000 INFO:teuthology.orchestra.run.smithi083.stderr:103250K .......... .......... .......... .......... .......... 61% 27.7M 2s 2024-03-30T13:09:46.002 INFO:teuthology.orchestra.run.smithi083.stderr:103300K .......... .......... .......... .......... .......... 61% 23.6M 2s 2024-03-30T13:09:46.004 INFO:teuthology.orchestra.run.smithi083.stderr:103350K .......... .......... .......... .......... .......... 61% 27.3M 2s 2024-03-30T13:09:46.006 INFO:teuthology.orchestra.run.smithi083.stderr:103400K .......... .......... .......... .......... .......... 61% 27.3M 2s 2024-03-30T13:09:46.008 INFO:teuthology.orchestra.run.smithi083.stderr:103450K .......... .......... .......... .......... .......... 61% 27.6M 2s 2024-03-30T13:09:46.010 INFO:teuthology.orchestra.run.smithi083.stderr:103500K .......... .......... .......... .......... .......... 61% 23.2M 2s 2024-03-30T13:09:46.012 INFO:teuthology.orchestra.run.smithi083.stderr:103550K .......... .......... .......... .......... .......... 61% 26.8M 2s 2024-03-30T13:09:46.014 INFO:teuthology.orchestra.run.smithi083.stderr:103600K .......... .......... .......... .......... .......... 61% 27.4M 2s 2024-03-30T13:09:46.015 INFO:teuthology.orchestra.run.smithi083.stderr:103650K .......... .......... .......... .......... .......... 61% 26.5M 2s 2024-03-30T13:09:46.017 INFO:teuthology.orchestra.run.smithi083.stderr:103700K .......... .......... .......... .......... .......... 61% 23.2M 2s 2024-03-30T13:09:46.020 INFO:teuthology.orchestra.run.smithi083.stderr:103750K .......... .......... .......... .......... .......... 61% 26.8M 2s 2024-03-30T13:09:46.021 INFO:teuthology.orchestra.run.smithi083.stderr:103800K .......... .......... .......... .......... .......... 61% 26.0M 2s 2024-03-30T13:09:46.023 INFO:teuthology.orchestra.run.smithi083.stderr:103850K .......... .......... .......... .......... .......... 61% 25.9M 2s 2024-03-30T13:09:46.025 INFO:teuthology.orchestra.run.smithi083.stderr:103900K .......... .......... .......... .......... .......... 61% 22.4M 2s 2024-03-30T13:09:46.027 INFO:teuthology.orchestra.run.smithi083.stderr:103950K .......... .......... .......... .......... .......... 61% 25.3M 2s 2024-03-30T13:09:46.029 INFO:teuthology.orchestra.run.smithi083.stderr:104000K .......... .......... .......... .......... .......... 61% 27.1M 2s 2024-03-30T13:09:46.031 INFO:teuthology.orchestra.run.smithi083.stderr:104050K .......... .......... .......... .......... .......... 61% 26.7M 2s 2024-03-30T13:09:46.033 INFO:teuthology.orchestra.run.smithi083.stderr:104100K .......... .......... .......... .......... .......... 61% 24.9M 2s 2024-03-30T13:09:46.034 INFO:teuthology.orchestra.run.smithi083.stderr:104150K .......... .......... .......... .......... .......... 61% 30.2M 2s 2024-03-30T13:09:46.036 INFO:teuthology.orchestra.run.smithi083.stderr:104200K .......... .......... .......... .......... .......... 61% 30.3M 2s 2024-03-30T13:09:46.038 INFO:teuthology.orchestra.run.smithi083.stderr:104250K .......... .......... .......... .......... .......... 61% 29.0M 2s 2024-03-30T13:09:46.039 INFO:teuthology.orchestra.run.smithi083.stderr:104300K .......... .......... .......... .......... .......... 61% 25.7M 2s 2024-03-30T13:09:46.041 INFO:teuthology.orchestra.run.smithi083.stderr:104350K .......... .......... .......... .......... .......... 61% 30.8M 2s 2024-03-30T13:09:46.043 INFO:teuthology.orchestra.run.smithi083.stderr:104400K .......... .......... .......... .......... .......... 61% 29.8M 2s 2024-03-30T13:09:46.045 INFO:teuthology.orchestra.run.smithi083.stderr:104450K .......... .......... .......... .......... .......... 61% 28.1M 2s 2024-03-30T13:09:46.047 INFO:teuthology.orchestra.run.smithi083.stderr:104500K .......... .......... .......... .......... .......... 62% 22.1M 2s 2024-03-30T13:09:46.049 INFO:teuthology.orchestra.run.smithi083.stderr:104550K .......... .......... .......... .......... .......... 62% 25.1M 2s 2024-03-30T13:09:46.051 INFO:teuthology.orchestra.run.smithi083.stderr:104600K .......... .......... .......... .......... .......... 62% 24.6M 2s 2024-03-30T13:09:46.053 INFO:teuthology.orchestra.run.smithi083.stderr:104650K .......... .......... .......... .......... .......... 62% 25.4M 2s 2024-03-30T13:09:46.055 INFO:teuthology.orchestra.run.smithi083.stderr:104700K .......... .......... .......... .......... .......... 62% 21.8M 2s 2024-03-30T13:09:46.057 INFO:teuthology.orchestra.run.smithi083.stderr:104750K .......... .......... .......... .......... .......... 62% 24.9M 2s 2024-03-30T13:09:46.059 INFO:teuthology.orchestra.run.smithi083.stderr:104800K .......... .......... .......... .......... .......... 62% 25.7M 2s 2024-03-30T13:09:46.061 INFO:teuthology.orchestra.run.smithi083.stderr:104850K .......... .......... .......... .......... .......... 62% 25.4M 2s 2024-03-30T13:09:46.063 INFO:teuthology.orchestra.run.smithi083.stderr:104900K .......... .......... .......... .......... .......... 62% 21.3M 2s 2024-03-30T13:09:46.065 INFO:teuthology.orchestra.run.smithi083.stderr:104950K .......... .......... .......... .......... .......... 62% 25.2M 2s 2024-03-30T13:09:46.067 INFO:teuthology.orchestra.run.smithi083.stderr:105000K .......... .......... .......... .......... .......... 62% 24.0M 2s 2024-03-30T13:09:46.069 INFO:teuthology.orchestra.run.smithi083.stderr:105050K .......... .......... .......... .......... .......... 62% 24.4M 2s 2024-03-30T13:09:46.071 INFO:teuthology.orchestra.run.smithi083.stderr:105100K .......... .......... .......... .......... .......... 62% 20.9M 2s 2024-03-30T13:09:46.073 INFO:teuthology.orchestra.run.smithi083.stderr:105150K .......... .......... .......... .......... .......... 62% 24.8M 2s 2024-03-30T13:09:46.075 INFO:teuthology.orchestra.run.smithi083.stderr:105200K .......... .......... .......... .......... .......... 62% 23.4M 2s 2024-03-30T13:09:46.077 INFO:teuthology.orchestra.run.smithi083.stderr:105250K .......... .......... .......... .......... .......... 62% 24.3M 2s 2024-03-30T13:09:46.080 INFO:teuthology.orchestra.run.smithi083.stderr:105300K .......... .......... .......... .......... .......... 62% 20.9M 2s 2024-03-30T13:09:46.082 INFO:teuthology.orchestra.run.smithi083.stderr:105350K .......... .......... .......... .......... .......... 62% 24.9M 2s 2024-03-30T13:09:46.084 INFO:teuthology.orchestra.run.smithi083.stderr:105400K .......... .......... .......... .......... .......... 62% 24.3M 2s 2024-03-30T13:09:46.086 INFO:teuthology.orchestra.run.smithi083.stderr:105450K .......... .......... .......... .......... .......... 62% 25.1M 2s 2024-03-30T13:09:46.088 INFO:teuthology.orchestra.run.smithi083.stderr:105500K .......... .......... .......... .......... .......... 62% 23.0M 2s 2024-03-30T13:09:46.089 INFO:teuthology.orchestra.run.smithi083.stderr:105550K .......... .......... .......... .......... .......... 62% 28.9M 2s 2024-03-30T13:09:46.093 INFO:teuthology.orchestra.run.smithi083.stderr:105600K .......... .......... .......... .......... .......... 62% 28.2M 2s 2024-03-30T13:09:46.093 INFO:teuthology.orchestra.run.smithi083.stderr:105650K .......... .......... .......... .......... .......... 62% 28.6M 2s 2024-03-30T13:09:46.095 INFO:teuthology.orchestra.run.smithi083.stderr:105700K .......... .......... .......... .......... .......... 62% 24.0M 2s 2024-03-30T13:09:46.097 INFO:teuthology.orchestra.run.smithi083.stderr:105750K .......... .......... .......... .......... .......... 62% 27.6M 2s 2024-03-30T13:09:46.098 INFO:teuthology.orchestra.run.smithi083.stderr:105800K .......... .......... .......... .......... .......... 62% 27.4M 2s 2024-03-30T13:09:46.100 INFO:teuthology.orchestra.run.smithi083.stderr:105850K .......... .......... .......... .......... .......... 62% 27.8M 2s 2024-03-30T13:09:46.102 INFO:teuthology.orchestra.run.smithi083.stderr:105900K .......... .......... .......... .......... .......... 62% 23.1M 2s 2024-03-30T13:09:46.104 INFO:teuthology.orchestra.run.smithi083.stderr:105950K .......... .......... .......... .......... .......... 62% 27.8M 2s 2024-03-30T13:09:46.106 INFO:teuthology.orchestra.run.smithi083.stderr:106000K .......... .......... .......... .......... .......... 62% 27.4M 2s 2024-03-30T13:09:46.112 INFO:teuthology.orchestra.run.smithi083.stderr:106050K .......... .......... .......... .......... .......... 62% 26.8M 2s 2024-03-30T13:09:46.112 INFO:teuthology.orchestra.run.smithi083.stderr:106100K .......... .......... .......... .......... .......... 62% 24.0M 2s 2024-03-30T13:09:46.112 INFO:teuthology.orchestra.run.smithi083.stderr:106150K .......... .......... .......... .......... .......... 63% 27.1M 2s 2024-03-30T13:09:46.113 INFO:teuthology.orchestra.run.smithi083.stderr:106200K .......... .......... .......... .......... .......... 63% 27.7M 2s 2024-03-30T13:09:46.116 INFO:teuthology.orchestra.run.smithi083.stderr:106250K .......... .......... .......... .......... .......... 63% 26.5M 2s 2024-03-30T13:09:46.117 INFO:teuthology.orchestra.run.smithi083.stderr:106300K .......... .......... .......... .......... .......... 63% 23.4M 2s 2024-03-30T13:09:46.119 INFO:teuthology.orchestra.run.smithi083.stderr:106350K .......... .......... .......... .......... .......... 63% 26.8M 2s 2024-03-30T13:09:46.121 INFO:teuthology.orchestra.run.smithi083.stderr:106400K .......... .......... .......... .......... .......... 63% 26.9M 2s 2024-03-30T13:09:46.123 INFO:teuthology.orchestra.run.smithi083.stderr:106450K .......... .......... .......... .......... .......... 63% 27.4M 2s 2024-03-30T13:09:46.124 INFO:teuthology.orchestra.run.smithi083.stderr:106500K .......... .......... .......... .......... .......... 63% 28.5M 2s 2024-03-30T13:09:46.126 INFO:teuthology.orchestra.run.smithi083.stderr:106550K .......... .......... .......... .......... .......... 63% 37.0M 2s 2024-03-30T13:09:46.127 INFO:teuthology.orchestra.run.smithi083.stderr:106600K .......... .......... .......... .......... .......... 63% 35.9M 2s 2024-03-30T13:09:46.128 INFO:teuthology.orchestra.run.smithi083.stderr:106650K .......... .......... .......... .......... .......... 63% 36.1M 2s 2024-03-30T13:09:46.130 INFO:teuthology.orchestra.run.smithi083.stderr:106700K .......... .......... .......... .......... .......... 63% 31.3M 2s 2024-03-30T13:09:46.131 INFO:teuthology.orchestra.run.smithi083.stderr:106750K .......... .......... .......... .......... .......... 63% 35.0M 2s 2024-03-30T13:09:46.133 INFO:teuthology.orchestra.run.smithi083.stderr:106800K .......... .......... .......... .......... .......... 63% 36.1M 2s 2024-03-30T13:09:46.134 INFO:teuthology.orchestra.run.smithi083.stderr:106850K .......... .......... .......... .......... .......... 63% 30.5M 2s 2024-03-30T13:09:46.136 INFO:teuthology.orchestra.run.smithi083.stderr:106900K .......... .......... .......... .......... .......... 63% 24.1M 2s 2024-03-30T13:09:46.138 INFO:teuthology.orchestra.run.smithi083.stderr:106950K .......... .......... .......... .......... .......... 63% 28.3M 2s 2024-03-30T13:09:46.140 INFO:teuthology.orchestra.run.smithi083.stderr:107000K .......... .......... .......... .......... .......... 63% 28.7M 2s 2024-03-30T13:09:46.141 INFO:teuthology.orchestra.run.smithi083.stderr:107050K .......... .......... .......... .......... .......... 63% 28.8M 2s 2024-03-30T13:09:46.143 INFO:teuthology.orchestra.run.smithi083.stderr:107100K .......... .......... .......... .......... .......... 63% 23.7M 2s 2024-03-30T13:09:46.145 INFO:teuthology.orchestra.run.smithi083.stderr:107150K .......... .......... .......... .......... .......... 63% 31.2M 2s 2024-03-30T13:09:46.147 INFO:teuthology.orchestra.run.smithi083.stderr:107200K .......... .......... .......... .......... .......... 63% 31.3M 2s 2024-03-30T13:09:46.148 INFO:teuthology.orchestra.run.smithi083.stderr:107250K .......... .......... .......... .......... .......... 63% 28.3M 2s 2024-03-30T13:09:46.150 INFO:teuthology.orchestra.run.smithi083.stderr:107300K .......... .......... .......... .......... .......... 63% 22.7M 2s 2024-03-30T13:09:46.152 INFO:teuthology.orchestra.run.smithi083.stderr:107350K .......... .......... .......... .......... .......... 63% 26.6M 2s 2024-03-30T13:09:46.154 INFO:teuthology.orchestra.run.smithi083.stderr:107400K .......... .......... .......... .......... .......... 63% 26.7M 2s 2024-03-30T13:09:46.156 INFO:teuthology.orchestra.run.smithi083.stderr:107450K .......... .......... .......... .......... .......... 63% 25.8M 2s 2024-03-30T13:09:46.158 INFO:teuthology.orchestra.run.smithi083.stderr:107500K .......... .......... .......... .......... .......... 63% 21.5M 2s 2024-03-30T13:09:46.160 INFO:teuthology.orchestra.run.smithi083.stderr:107550K .......... .......... .......... .......... .......... 63% 25.8M 2s 2024-03-30T13:09:46.162 INFO:teuthology.orchestra.run.smithi083.stderr:107600K .......... .......... .......... .......... .......... 63% 25.9M 2s 2024-03-30T13:09:46.164 INFO:teuthology.orchestra.run.smithi083.stderr:107650K .......... .......... .......... .......... .......... 63% 25.7M 2s 2024-03-30T13:09:46.166 INFO:teuthology.orchestra.run.smithi083.stderr:107700K .......... .......... .......... .......... .......... 63% 22.1M 2s 2024-03-30T13:09:46.168 INFO:teuthology.orchestra.run.smithi083.stderr:107750K .......... .......... .......... .......... .......... 63% 28.1M 2s 2024-03-30T13:09:46.170 INFO:teuthology.orchestra.run.smithi083.stderr:107800K .......... .......... .......... .......... .......... 63% 28.2M 2s 2024-03-30T13:09:46.172 INFO:teuthology.orchestra.run.smithi083.stderr:107850K .......... .......... .......... .......... .......... 64% 27.6M 2s 2024-03-30T13:09:46.173 INFO:teuthology.orchestra.run.smithi083.stderr:107900K .......... .......... .......... .......... .......... 64% 23.7M 2s 2024-03-30T13:09:46.175 INFO:teuthology.orchestra.run.smithi083.stderr:107950K .......... .......... .......... .......... .......... 64% 27.5M 2s 2024-03-30T13:09:46.177 INFO:teuthology.orchestra.run.smithi083.stderr:108000K .......... .......... .......... .......... .......... 64% 27.6M 2s 2024-03-30T13:09:46.179 INFO:teuthology.orchestra.run.smithi083.stderr:108050K .......... .......... .......... .......... .......... 64% 24.3M 2s 2024-03-30T13:09:46.182 INFO:teuthology.orchestra.run.smithi083.stderr:108100K .......... .......... .......... .......... .......... 64% 20.8M 2s 2024-03-30T13:09:46.184 INFO:teuthology.orchestra.run.smithi083.stderr:108150K .......... .......... .......... .......... .......... 64% 23.9M 2s 2024-03-30T13:09:46.186 INFO:teuthology.orchestra.run.smithi083.stderr:108200K .......... .......... .......... .......... .......... 64% 23.7M 2s 2024-03-30T13:09:46.188 INFO:teuthology.orchestra.run.smithi083.stderr:108250K .......... .......... .......... .......... .......... 64% 25.9M 2s 2024-03-30T13:09:46.190 INFO:teuthology.orchestra.run.smithi083.stderr:108300K .......... .......... .......... .......... .......... 64% 23.6M 2s 2024-03-30T13:09:46.191 INFO:teuthology.orchestra.run.smithi083.stderr:108350K .......... .......... .......... .......... .......... 64% 27.8M 2s 2024-03-30T13:09:46.193 INFO:teuthology.orchestra.run.smithi083.stderr:108400K .......... .......... .......... .......... .......... 64% 27.9M 2s 2024-03-30T13:09:46.195 INFO:teuthology.orchestra.run.smithi083.stderr:108450K .......... .......... .......... .......... .......... 64% 27.6M 2s 2024-03-30T13:09:46.197 INFO:teuthology.orchestra.run.smithi083.stderr:108500K .......... .......... .......... .......... .......... 64% 22.8M 2s 2024-03-30T13:09:46.199 INFO:teuthology.orchestra.run.smithi083.stderr:108550K .......... .......... .......... .......... .......... 64% 26.6M 2s 2024-03-30T13:09:46.201 INFO:teuthology.orchestra.run.smithi083.stderr:108600K .......... .......... .......... .......... .......... 64% 27.1M 2s 2024-03-30T13:09:46.202 INFO:teuthology.orchestra.run.smithi083.stderr:108650K .......... .......... .......... .......... .......... 64% 26.6M 2s 2024-03-30T13:09:46.205 INFO:teuthology.orchestra.run.smithi083.stderr:108700K .......... .......... .......... .......... .......... 64% 22.4M 2s 2024-03-30T13:09:46.207 INFO:teuthology.orchestra.run.smithi083.stderr:108750K .......... .......... .......... .......... .......... 64% 23.0M 2s 2024-03-30T13:09:46.209 INFO:teuthology.orchestra.run.smithi083.stderr:108800K .......... .......... .......... .......... .......... 64% 22.3M 2s 2024-03-30T13:09:46.211 INFO:teuthology.orchestra.run.smithi083.stderr:108850K .......... .......... .......... .......... .......... 64% 23.6M 2s 2024-03-30T13:09:46.213 INFO:teuthology.orchestra.run.smithi083.stderr:108900K .......... .......... .......... .......... .......... 64% 22.1M 2s 2024-03-30T13:09:46.215 INFO:teuthology.orchestra.run.smithi083.stderr:108950K .......... .......... .......... .......... .......... 64% 26.0M 2s 2024-03-30T13:09:46.217 INFO:teuthology.orchestra.run.smithi083.stderr:109000K .......... .......... .......... .......... .......... 64% 25.7M 2s 2024-03-30T13:09:46.219 INFO:teuthology.orchestra.run.smithi083.stderr:109050K .......... .......... .......... .......... .......... 64% 25.3M 2s 2024-03-30T13:09:46.221 INFO:teuthology.orchestra.run.smithi083.stderr:109100K .......... .......... .......... .......... .......... 64% 22.0M 2s 2024-03-30T13:09:46.223 INFO:teuthology.orchestra.run.smithi083.stderr:109150K .......... .......... .......... .......... .......... 64% 24.9M 2s 2024-03-30T13:09:46.225 INFO:teuthology.orchestra.run.smithi083.stderr:109200K .......... .......... .......... .......... .......... 64% 25.7M 2s 2024-03-30T13:09:46.227 INFO:teuthology.orchestra.run.smithi083.stderr:109250K .......... .......... .......... .......... .......... 64% 25.2M 2s 2024-03-30T13:09:46.229 INFO:teuthology.orchestra.run.smithi083.stderr:109300K .......... .......... .......... .......... .......... 64% 21.1M 2s 2024-03-30T13:09:46.232 INFO:teuthology.orchestra.run.smithi083.stderr:109350K .......... .......... .......... .......... .......... 64% 18.3M 2s 2024-03-30T13:09:46.234 INFO:teuthology.orchestra.run.smithi083.stderr:109400K .......... .......... .......... .......... .......... 64% 21.0M 2s 2024-03-30T13:09:46.236 INFO:teuthology.orchestra.run.smithi083.stderr:109450K .......... .......... .......... .......... .......... 64% 25.8M 2s 2024-03-30T13:09:46.238 INFO:teuthology.orchestra.run.smithi083.stderr:109500K .......... .......... .......... .......... .......... 64% 21.3M 2s 2024-03-30T13:09:46.240 INFO:teuthology.orchestra.run.smithi083.stderr:109550K .......... .......... .......... .......... .......... 65% 23.6M 2s 2024-03-30T13:09:46.242 INFO:teuthology.orchestra.run.smithi083.stderr:109600K .......... .......... .......... .......... .......... 65% 25.8M 2s 2024-03-30T13:09:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:109650K .......... .......... .......... .......... .......... 65% 23.8M 2s 2024-03-30T13:09:46.247 INFO:teuthology.orchestra.run.smithi083.stderr:109700K .......... .......... .......... .......... .......... 65% 21.7M 2s 2024-03-30T13:09:46.249 INFO:teuthology.orchestra.run.smithi083.stderr:109750K .......... .......... .......... .......... .......... 65% 26.3M 2s 2024-03-30T13:09:46.251 INFO:teuthology.orchestra.run.smithi083.stderr:109800K .......... .......... .......... .......... .......... 65% 25.5M 2s 2024-03-30T13:09:46.252 INFO:teuthology.orchestra.run.smithi083.stderr:109850K .......... .......... .......... .......... .......... 65% 26.6M 2s 2024-03-30T13:09:46.254 INFO:teuthology.orchestra.run.smithi083.stderr:109900K .......... .......... .......... .......... .......... 65% 21.3M 2s 2024-03-30T13:09:46.256 INFO:teuthology.orchestra.run.smithi083.stderr:109950K .......... .......... .......... .......... .......... 65% 25.4M 2s 2024-03-30T13:09:46.258 INFO:teuthology.orchestra.run.smithi083.stderr:110000K .......... .......... .......... .......... .......... 65% 24.6M 2s 2024-03-30T13:09:46.260 INFO:teuthology.orchestra.run.smithi083.stderr:110050K .......... .......... .......... .......... .......... 65% 27.9M 2s 2024-03-30T13:09:46.262 INFO:teuthology.orchestra.run.smithi083.stderr:110100K .......... .......... .......... .......... .......... 65% 23.2M 2s 2024-03-30T13:09:46.264 INFO:teuthology.orchestra.run.smithi083.stderr:110150K .......... .......... .......... .......... .......... 65% 27.8M 2s 2024-03-30T13:09:46.266 INFO:teuthology.orchestra.run.smithi083.stderr:110200K .......... .......... .......... .......... .......... 65% 27.9M 2s 2024-03-30T13:09:46.268 INFO:teuthology.orchestra.run.smithi083.stderr:110250K .......... .......... .......... .......... .......... 65% 28.2M 2s 2024-03-30T13:09:46.270 INFO:teuthology.orchestra.run.smithi083.stderr:110300K .......... .......... .......... .......... .......... 65% 24.2M 2s 2024-03-30T13:09:46.272 INFO:teuthology.orchestra.run.smithi083.stderr:110350K .......... .......... .......... .......... .......... 65% 22.1M 2s 2024-03-30T13:09:46.274 INFO:teuthology.orchestra.run.smithi083.stderr:110400K .......... .......... .......... .......... .......... 65% 22.5M 2s 2024-03-30T13:09:46.276 INFO:teuthology.orchestra.run.smithi083.stderr:110450K .......... .......... .......... .......... .......... 65% 22.7M 2s 2024-03-30T13:09:46.278 INFO:teuthology.orchestra.run.smithi083.stderr:110500K .......... .......... .......... .......... .......... 65% 19.5M 2s 2024-03-30T13:09:46.281 INFO:teuthology.orchestra.run.smithi083.stderr:110550K .......... .......... .......... .......... .......... 65% 21.7M 2s 2024-03-30T13:09:46.283 INFO:teuthology.orchestra.run.smithi083.stderr:110600K .......... .......... .......... .......... .......... 65% 20.7M 2s 2024-03-30T13:09:46.285 INFO:teuthology.orchestra.run.smithi083.stderr:110650K .......... .......... .......... .......... .......... 65% 24.0M 2s 2024-03-30T13:09:46.288 INFO:teuthology.orchestra.run.smithi083.stderr:110700K .......... .......... .......... .......... .......... 65% 17.5M 2s 2024-03-30T13:09:46.290 INFO:teuthology.orchestra.run.smithi083.stderr:110750K .......... .......... .......... .......... .......... 65% 22.5M 2s 2024-03-30T13:09:46.292 INFO:teuthology.orchestra.run.smithi083.stderr:110800K .......... .......... .......... .......... .......... 65% 27.4M 2s 2024-03-30T13:09:46.294 INFO:teuthology.orchestra.run.smithi083.stderr:110850K .......... .......... .......... .......... .......... 65% 28.5M 2s 2024-03-30T13:09:46.296 INFO:teuthology.orchestra.run.smithi083.stderr:110900K .......... .......... .......... .......... .......... 65% 23.2M 2s 2024-03-30T13:09:46.297 INFO:teuthology.orchestra.run.smithi083.stderr:110950K .......... .......... .......... .......... .......... 65% 32.1M 2s 2024-03-30T13:09:46.299 INFO:teuthology.orchestra.run.smithi083.stderr:111000K .......... .......... .......... .......... .......... 65% 30.5M 2s 2024-03-30T13:09:46.301 INFO:teuthology.orchestra.run.smithi083.stderr:111050K .......... .......... .......... .......... .......... 65% 31.8M 2s 2024-03-30T13:09:46.302 INFO:teuthology.orchestra.run.smithi083.stderr:111100K .......... .......... .......... .......... .......... 65% 24.9M 2s 2024-03-30T13:09:46.304 INFO:teuthology.orchestra.run.smithi083.stderr:111150K .......... .......... .......... .......... .......... 65% 23.7M 2s 2024-03-30T13:09:46.306 INFO:teuthology.orchestra.run.smithi083.stderr:111200K .......... .......... .......... .......... .......... 65% 23.9M 2s 2024-03-30T13:09:46.309 INFO:teuthology.orchestra.run.smithi083.stderr:111250K .......... .......... .......... .......... .......... 66% 24.0M 2s 2024-03-30T13:09:46.316 INFO:teuthology.orchestra.run.smithi083.stderr:111300K .......... .......... .......... .......... .......... 66% 20.0M 2s 2024-03-30T13:09:46.316 INFO:teuthology.orchestra.run.smithi083.stderr:111350K .......... .......... .......... .......... .......... 66% 25.7M 2s 2024-03-30T13:09:46.316 INFO:teuthology.orchestra.run.smithi083.stderr:111400K .......... .......... .......... .......... .......... 66% 24.3M 2s 2024-03-30T13:09:46.317 INFO:teuthology.orchestra.run.smithi083.stderr:111450K .......... .......... .......... .......... .......... 66% 25.1M 2s 2024-03-30T13:09:46.319 INFO:teuthology.orchestra.run.smithi083.stderr:111500K .......... .......... .......... .......... .......... 66% 18.9M 2s 2024-03-30T13:09:46.322 INFO:teuthology.orchestra.run.smithi083.stderr:111550K .......... .......... .......... .......... .......... 66% 21.9M 2s 2024-03-30T13:09:46.324 INFO:teuthology.orchestra.run.smithi083.stderr:111600K .......... .......... .......... .......... .......... 66% 24.1M 2s 2024-03-30T13:09:46.326 INFO:teuthology.orchestra.run.smithi083.stderr:111650K .......... .......... .......... .......... .......... 66% 24.2M 2s 2024-03-30T13:09:46.328 INFO:teuthology.orchestra.run.smithi083.stderr:111700K .......... .......... .......... .......... .......... 66% 20.5M 2s 2024-03-30T13:09:46.330 INFO:teuthology.orchestra.run.smithi083.stderr:111750K .......... .......... .......... .......... .......... 66% 23.7M 2s 2024-03-30T13:09:46.332 INFO:teuthology.orchestra.run.smithi083.stderr:111800K .......... .......... .......... .......... .......... 66% 23.4M 2s 2024-03-30T13:09:46.334 INFO:teuthology.orchestra.run.smithi083.stderr:111850K .......... .......... .......... .......... .......... 66% 23.4M 2s 2024-03-30T13:09:46.337 INFO:teuthology.orchestra.run.smithi083.stderr:111900K .......... .......... .......... .......... .......... 66% 20.3M 2s 2024-03-30T13:09:46.339 INFO:teuthology.orchestra.run.smithi083.stderr:111950K .......... .......... .......... .......... .......... 66% 23.2M 2s 2024-03-30T13:09:46.341 INFO:teuthology.orchestra.run.smithi083.stderr:112000K .......... .......... .......... .......... .......... 66% 23.2M 2s 2024-03-30T13:09:46.343 INFO:teuthology.orchestra.run.smithi083.stderr:112050K .......... .......... .......... .......... .......... 66% 23.1M 2s 2024-03-30T13:09:46.346 INFO:teuthology.orchestra.run.smithi083.stderr:112100K .......... .......... .......... .......... .......... 66% 19.9M 2s 2024-03-30T13:09:46.348 INFO:teuthology.orchestra.run.smithi083.stderr:112150K .......... .......... .......... .......... .......... 66% 22.7M 2s 2024-03-30T13:09:46.350 INFO:teuthology.orchestra.run.smithi083.stderr:112200K .......... .......... .......... .......... .......... 66% 23.3M 2s 2024-03-30T13:09:46.352 INFO:teuthology.orchestra.run.smithi083.stderr:112250K .......... .......... .......... .......... .......... 66% 20.0M 2s 2024-03-30T13:09:46.355 INFO:teuthology.orchestra.run.smithi083.stderr:112300K .......... .......... .......... .......... .......... 66% 15.6M 2s 2024-03-30T13:09:46.358 INFO:teuthology.orchestra.run.smithi083.stderr:112350K .......... .......... .......... .......... .......... 66% 19.2M 2s 2024-03-30T13:09:46.360 INFO:teuthology.orchestra.run.smithi083.stderr:112400K .......... .......... .......... .......... .......... 66% 19.2M 2s 2024-03-30T13:09:46.363 INFO:teuthology.orchestra.run.smithi083.stderr:112450K .......... .......... .......... .......... .......... 66% 19.9M 2s 2024-03-30T13:09:46.366 INFO:teuthology.orchestra.run.smithi083.stderr:112500K .......... .......... .......... .......... .......... 66% 17.6M 2s 2024-03-30T13:09:46.368 INFO:teuthology.orchestra.run.smithi083.stderr:112550K .......... .......... .......... .......... .......... 66% 18.9M 2s 2024-03-30T13:09:46.371 INFO:teuthology.orchestra.run.smithi083.stderr:112600K .......... .......... .......... .......... .......... 66% 20.0M 2s 2024-03-30T13:09:46.373 INFO:teuthology.orchestra.run.smithi083.stderr:112650K .......... .......... .......... .......... .......... 66% 20.1M 2s 2024-03-30T13:09:46.376 INFO:teuthology.orchestra.run.smithi083.stderr:112700K .......... .......... .......... .......... .......... 66% 17.0M 2s 2024-03-30T13:09:46.378 INFO:teuthology.orchestra.run.smithi083.stderr:112750K .......... .......... .......... .......... .......... 66% 20.0M 2s 2024-03-30T13:09:46.381 INFO:teuthology.orchestra.run.smithi083.stderr:112800K .......... .......... .......... .......... .......... 66% 22.0M 2s 2024-03-30T13:09:46.383 INFO:teuthology.orchestra.run.smithi083.stderr:112850K .......... .......... .......... .......... .......... 66% 23.8M 2s 2024-03-30T13:09:46.385 INFO:teuthology.orchestra.run.smithi083.stderr:112900K .......... .......... .......... .......... .......... 67% 22.7M 2s 2024-03-30T13:09:46.387 INFO:teuthology.orchestra.run.smithi083.stderr:112950K .......... .......... .......... .......... .......... 67% 25.3M 2s 2024-03-30T13:09:46.389 INFO:teuthology.orchestra.run.smithi083.stderr:113000K .......... .......... .......... .......... .......... 67% 19.5M 2s 2024-03-30T13:09:46.391 INFO:teuthology.orchestra.run.smithi083.stderr:113050K .......... .......... .......... .......... .......... 67% 27.8M 2s 2024-03-30T13:09:46.393 INFO:teuthology.orchestra.run.smithi083.stderr:113100K .......... .......... .......... .......... .......... 67% 21.3M 2s 2024-03-30T13:09:46.395 INFO:teuthology.orchestra.run.smithi083.stderr:113150K .......... .......... .......... .......... .......... 67% 25.0M 2s 2024-03-30T13:09:46.397 INFO:teuthology.orchestra.run.smithi083.stderr:113200K .......... .......... .......... .......... .......... 67% 22.9M 2s 2024-03-30T13:09:46.400 INFO:teuthology.orchestra.run.smithi083.stderr:113250K .......... .......... .......... .......... .......... 67% 21.4M 2s 2024-03-30T13:09:46.403 INFO:teuthology.orchestra.run.smithi083.stderr:113300K .......... .......... .......... .......... .......... 67% 18.3M 2s 2024-03-30T13:09:46.405 INFO:teuthology.orchestra.run.smithi083.stderr:113350K .......... .......... .......... .......... .......... 67% 20.6M 2s 2024-03-30T13:09:46.407 INFO:teuthology.orchestra.run.smithi083.stderr:113400K .......... .......... .......... .......... .......... 67% 19.7M 2s 2024-03-30T13:09:46.410 INFO:teuthology.orchestra.run.smithi083.stderr:113450K .......... .......... .......... .......... .......... 67% 20.2M 2s 2024-03-30T13:09:46.412 INFO:teuthology.orchestra.run.smithi083.stderr:113500K .......... .......... .......... .......... .......... 67% 17.8M 2s 2024-03-30T13:09:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:113550K .......... .......... .......... .......... .......... 67% 20.8M 2s 2024-03-30T13:09:46.417 INFO:teuthology.orchestra.run.smithi083.stderr:113600K .......... .......... .......... .......... .......... 67% 20.5M 2s 2024-03-30T13:09:46.419 INFO:teuthology.orchestra.run.smithi083.stderr:113650K .......... .......... .......... .......... .......... 67% 21.6M 2s 2024-03-30T13:09:46.422 INFO:teuthology.orchestra.run.smithi083.stderr:113700K .......... .......... .......... .......... .......... 67% 18.7M 2s 2024-03-30T13:09:46.425 INFO:teuthology.orchestra.run.smithi083.stderr:113750K .......... .......... .......... .......... .......... 67% 22.1M 2s 2024-03-30T13:09:46.426 INFO:teuthology.orchestra.run.smithi083.stderr:113800K .......... .......... .......... .......... .......... 67% 21.7M 2s 2024-03-30T13:09:46.429 INFO:teuthology.orchestra.run.smithi083.stderr:113850K .......... .......... .......... .......... .......... 67% 21.5M 2s 2024-03-30T13:09:46.431 INFO:teuthology.orchestra.run.smithi083.stderr:113900K .......... .......... .......... .......... .......... 67% 18.3M 2s 2024-03-30T13:09:46.434 INFO:teuthology.orchestra.run.smithi083.stderr:113950K .......... .......... .......... .......... .......... 67% 21.7M 2s 2024-03-30T13:09:46.436 INFO:teuthology.orchestra.run.smithi083.stderr:114000K .......... .......... .......... .......... .......... 67% 21.4M 2s 2024-03-30T13:09:46.438 INFO:teuthology.orchestra.run.smithi083.stderr:114050K .......... .......... .......... .......... .......... 67% 21.6M 2s 2024-03-30T13:09:46.441 INFO:teuthology.orchestra.run.smithi083.stderr:114100K .......... .......... .......... .......... .......... 67% 16.9M 2s 2024-03-30T13:09:46.444 INFO:teuthology.orchestra.run.smithi083.stderr:114150K .......... .......... .......... .......... .......... 67% 18.6M 2s 2024-03-30T13:09:46.446 INFO:teuthology.orchestra.run.smithi083.stderr:114200K .......... .......... .......... .......... .......... 67% 18.9M 2s 2024-03-30T13:09:46.449 INFO:teuthology.orchestra.run.smithi083.stderr:114250K .......... .......... .......... .......... .......... 67% 16.8M 2s 2024-03-30T13:09:46.453 INFO:teuthology.orchestra.run.smithi083.stderr:114300K .......... .......... .......... .......... .......... 67% 13.0M 2s 2024-03-30T13:09:46.456 INFO:teuthology.orchestra.run.smithi083.stderr:114350K .......... .......... .......... .......... .......... 67% 15.4M 2s 2024-03-30T13:09:46.461 INFO:teuthology.orchestra.run.smithi083.stderr:114400K .......... .......... .......... .......... .......... 67% 12.3M 2s 2024-03-30T13:09:46.466 INFO:teuthology.orchestra.run.smithi083.stderr:114450K .......... .......... .......... .......... .......... 67% 9.25M 2s 2024-03-30T13:09:46.472 INFO:teuthology.orchestra.run.smithi083.stderr:114500K .......... .......... .......... .......... .......... 67% 8.24M 2s 2024-03-30T13:09:46.477 INFO:teuthology.orchestra.run.smithi083.stderr:114550K .......... .......... .......... .......... .......... 67% 9.78M 2s 2024-03-30T13:09:46.481 INFO:teuthology.orchestra.run.smithi083.stderr:114600K .......... .......... .......... .......... .......... 68% 11.7M 2s 2024-03-30T13:09:46.484 INFO:teuthology.orchestra.run.smithi083.stderr:114650K .......... .......... .......... .......... .......... 68% 13.8M 2s 2024-03-30T13:09:46.488 INFO:teuthology.orchestra.run.smithi083.stderr:114700K .......... .......... .......... .......... .......... 68% 13.0M 2s 2024-03-30T13:09:46.491 INFO:teuthology.orchestra.run.smithi083.stderr:114750K .......... .......... .......... .......... .......... 68% 16.4M 2s 2024-03-30T13:09:46.493 INFO:teuthology.orchestra.run.smithi083.stderr:114800K .......... .......... .......... .......... .......... 68% 23.4M 2s 2024-03-30T13:09:46.495 INFO:teuthology.orchestra.run.smithi083.stderr:114850K .......... .......... .......... .......... .......... 68% 25.9M 2s 2024-03-30T13:09:46.499 INFO:teuthology.orchestra.run.smithi083.stderr:114900K .......... .......... .......... .......... .......... 68% 12.2M 2s 2024-03-30T13:09:46.501 INFO:teuthology.orchestra.run.smithi083.stderr:114950K .......... .......... .......... .......... .......... 68% 17.3M 2s 2024-03-30T13:09:46.504 INFO:teuthology.orchestra.run.smithi083.stderr:115000K .......... .......... .......... .......... .......... 68% 22.8M 2s 2024-03-30T13:09:46.506 INFO:teuthology.orchestra.run.smithi083.stderr:115050K .......... .......... .......... .......... .......... 68% 29.1M 2s 2024-03-30T13:09:46.507 INFO:teuthology.orchestra.run.smithi083.stderr:115100K .......... .......... .......... .......... .......... 68% 24.9M 2s 2024-03-30T13:09:46.509 INFO:teuthology.orchestra.run.smithi083.stderr:115150K .......... .......... .......... .......... .......... 68% 29.3M 2s 2024-03-30T13:09:46.511 INFO:teuthology.orchestra.run.smithi083.stderr:115200K .......... .......... .......... .......... .......... 68% 28.4M 2s 2024-03-30T13:09:46.513 INFO:teuthology.orchestra.run.smithi083.stderr:115250K .......... .......... .......... .......... .......... 68% 27.7M 2s 2024-03-30T13:09:46.514 INFO:teuthology.orchestra.run.smithi083.stderr:115300K .......... .......... .......... .......... .......... 68% 26.1M 2s 2024-03-30T13:09:46.516 INFO:teuthology.orchestra.run.smithi083.stderr:115350K .......... .......... .......... .......... .......... 68% 31.6M 2s 2024-03-30T13:09:46.517 INFO:teuthology.orchestra.run.smithi083.stderr:115400K .......... .......... .......... .......... .......... 68% 33.9M 2s 2024-03-30T13:09:46.519 INFO:teuthology.orchestra.run.smithi083.stderr:115450K .......... .......... .......... .......... .......... 68% 32.3M 2s 2024-03-30T13:09:46.525 INFO:teuthology.orchestra.run.smithi083.stderr:115500K .......... .......... .......... .......... .......... 68% 29.9M 2s 2024-03-30T13:09:46.526 INFO:teuthology.orchestra.run.smithi083.stderr:115550K .......... .......... .......... .......... .......... 68% 33.7M 2s 2024-03-30T13:09:46.526 INFO:teuthology.orchestra.run.smithi083.stderr:115600K .......... .......... .......... .......... .......... 68% 33.1M 2s 2024-03-30T13:09:46.526 INFO:teuthology.orchestra.run.smithi083.stderr:115650K .......... .......... .......... .......... .......... 68% 34.2M 2s 2024-03-30T13:09:46.527 INFO:teuthology.orchestra.run.smithi083.stderr:115700K .......... .......... .......... .......... .......... 68% 29.5M 2s 2024-03-30T13:09:46.528 INFO:teuthology.orchestra.run.smithi083.stderr:115750K .......... .......... .......... .......... .......... 68% 33.7M 2s 2024-03-30T13:09:46.529 INFO:teuthology.orchestra.run.smithi083.stderr:115800K .......... .......... .......... .......... .......... 68% 33.7M 2s 2024-03-30T13:09:46.531 INFO:teuthology.orchestra.run.smithi083.stderr:115850K .......... .......... .......... .......... .......... 68% 33.2M 2s 2024-03-30T13:09:46.532 INFO:teuthology.orchestra.run.smithi083.stderr:115900K .......... .......... .......... .......... .......... 68% 29.1M 2s 2024-03-30T13:09:46.534 INFO:teuthology.orchestra.run.smithi083.stderr:115950K .......... .......... .......... .......... .......... 68% 33.3M 2s 2024-03-30T13:09:46.535 INFO:teuthology.orchestra.run.smithi083.stderr:116000K .......... .......... .......... .......... .......... 68% 32.6M 2s 2024-03-30T13:09:46.537 INFO:teuthology.orchestra.run.smithi083.stderr:116050K .......... .......... .......... .......... .......... 68% 32.6M 2s 2024-03-30T13:09:46.539 INFO:teuthology.orchestra.run.smithi083.stderr:116100K .......... .......... .......... .......... .......... 68% 26.6M 2s 2024-03-30T13:09:46.540 INFO:teuthology.orchestra.run.smithi083.stderr:116150K .......... .......... .......... .......... .......... 68% 32.7M 2s 2024-03-30T13:09:46.542 INFO:teuthology.orchestra.run.smithi083.stderr:116200K .......... .......... .......... .......... .......... 68% 32.6M 2s 2024-03-30T13:09:46.543 INFO:teuthology.orchestra.run.smithi083.stderr:116250K .......... .......... .......... .......... .......... 68% 29.6M 2s 2024-03-30T13:09:46.545 INFO:teuthology.orchestra.run.smithi083.stderr:116300K .......... .......... .......... .......... .......... 69% 26.6M 2s 2024-03-30T13:09:46.547 INFO:teuthology.orchestra.run.smithi083.stderr:116350K .......... .......... .......... .......... .......... 69% 23.9M 2s 2024-03-30T13:09:46.549 INFO:teuthology.orchestra.run.smithi083.stderr:116400K .......... .......... .......... .......... .......... 69% 28.8M 2s 2024-03-30T13:09:46.551 INFO:teuthology.orchestra.run.smithi083.stderr:116450K .......... .......... .......... .......... .......... 69% 28.3M 2s 2024-03-30T13:09:46.553 INFO:teuthology.orchestra.run.smithi083.stderr:116500K .......... .......... .......... .......... .......... 69% 25.1M 2s 2024-03-30T13:09:46.554 INFO:teuthology.orchestra.run.smithi083.stderr:116550K .......... .......... .......... .......... .......... 69% 28.3M 2s 2024-03-30T13:09:46.557 INFO:teuthology.orchestra.run.smithi083.stderr:116600K .......... .......... .......... .......... .......... 69% 24.4M 2s 2024-03-30T13:09:46.558 INFO:teuthology.orchestra.run.smithi083.stderr:116650K .......... .......... .......... .......... .......... 69% 27.6M 2s 2024-03-30T13:09:46.560 INFO:teuthology.orchestra.run.smithi083.stderr:116700K .......... .......... .......... .......... .......... 69% 24.7M 2s 2024-03-30T13:09:46.562 INFO:teuthology.orchestra.run.smithi083.stderr:116750K .......... .......... .......... .......... .......... 69% 28.9M 2s 2024-03-30T13:09:46.563 INFO:teuthology.orchestra.run.smithi083.stderr:116800K .......... .......... .......... .......... .......... 69% 26.5M 2s 2024-03-30T13:09:46.565 INFO:teuthology.orchestra.run.smithi083.stderr:116850K .......... .......... .......... .......... .......... 69% 28.3M 2s 2024-03-30T13:09:46.568 INFO:teuthology.orchestra.run.smithi083.stderr:116900K .......... .......... .......... .......... .......... 69% 24.4M 2s 2024-03-30T13:09:46.569 INFO:teuthology.orchestra.run.smithi083.stderr:116950K .......... .......... .......... .......... .......... 69% 25.6M 2s 2024-03-30T13:09:46.571 INFO:teuthology.orchestra.run.smithi083.stderr:117000K .......... .......... .......... .......... .......... 69% 26.2M 2s 2024-03-30T13:09:46.573 INFO:teuthology.orchestra.run.smithi083.stderr:117050K .......... .......... .......... .......... .......... 69% 28.0M 2s 2024-03-30T13:09:46.575 INFO:teuthology.orchestra.run.smithi083.stderr:117100K .......... .......... .......... .......... .......... 69% 23.3M 2s 2024-03-30T13:09:46.577 INFO:teuthology.orchestra.run.smithi083.stderr:117150K .......... .......... .......... .......... .......... 69% 26.9M 2s 2024-03-30T13:09:46.579 INFO:teuthology.orchestra.run.smithi083.stderr:117200K .......... .......... .......... .......... .......... 69% 26.7M 2s 2024-03-30T13:09:46.581 INFO:teuthology.orchestra.run.smithi083.stderr:117250K .......... .......... .......... .......... .......... 69% 20.0M 2s 2024-03-30T13:09:46.584 INFO:teuthology.orchestra.run.smithi083.stderr:117300K .......... .......... .......... .......... .......... 69% 15.5M 2s 2024-03-30T13:09:46.587 INFO:teuthology.orchestra.run.smithi083.stderr:117350K .......... .......... .......... .......... .......... 69% 17.8M 2s 2024-03-30T13:09:46.590 INFO:teuthology.orchestra.run.smithi083.stderr:117400K .......... .......... .......... .......... .......... 69% 16.8M 2s 2024-03-30T13:09:46.593 INFO:teuthology.orchestra.run.smithi083.stderr:117450K .......... .......... .......... .......... .......... 69% 16.9M 2s 2024-03-30T13:09:46.596 INFO:teuthology.orchestra.run.smithi083.stderr:117500K .......... .......... .......... .......... .......... 69% 13.7M 2s 2024-03-30T13:09:46.600 INFO:teuthology.orchestra.run.smithi083.stderr:117550K .......... .......... .......... .......... .......... 69% 16.4M 2s 2024-03-30T13:09:46.602 INFO:teuthology.orchestra.run.smithi083.stderr:117600K .......... .......... .......... .......... .......... 69% 17.0M 2s 2024-03-30T13:09:46.605 INFO:teuthology.orchestra.run.smithi083.stderr:117650K .......... .......... .......... .......... .......... 69% 15.7M 2s 2024-03-30T13:09:46.609 INFO:teuthology.orchestra.run.smithi083.stderr:117700K .......... .......... .......... .......... .......... 69% 14.2M 2s 2024-03-30T13:09:46.612 INFO:teuthology.orchestra.run.smithi083.stderr:117750K .......... .......... .......... .......... .......... 69% 16.9M 2s 2024-03-30T13:09:46.614 INFO:teuthology.orchestra.run.smithi083.stderr:117800K .......... .......... .......... .......... .......... 69% 18.4M 2s 2024-03-30T13:09:46.617 INFO:teuthology.orchestra.run.smithi083.stderr:117850K .......... .......... .......... .......... .......... 69% 18.1M 2s 2024-03-30T13:09:46.620 INFO:teuthology.orchestra.run.smithi083.stderr:117900K .......... .......... .......... .......... .......... 69% 16.8M 2s 2024-03-30T13:09:46.623 INFO:teuthology.orchestra.run.smithi083.stderr:117950K .......... .......... .......... .......... .......... 70% 20.0M 2s 2024-03-30T13:09:46.625 INFO:teuthology.orchestra.run.smithi083.stderr:118000K .......... .......... .......... .......... .......... 70% 20.3M 2s 2024-03-30T13:09:46.627 INFO:teuthology.orchestra.run.smithi083.stderr:118050K .......... .......... .......... .......... .......... 70% 20.3M 2s 2024-03-30T13:09:46.630 INFO:teuthology.orchestra.run.smithi083.stderr:118100K .......... .......... .......... .......... .......... 70% 17.6M 2s 2024-03-30T13:09:46.633 INFO:teuthology.orchestra.run.smithi083.stderr:118150K .......... .......... .......... .......... .......... 70% 19.1M 2s 2024-03-30T13:09:46.636 INFO:teuthology.orchestra.run.smithi083.stderr:118200K .......... .......... .......... .......... .......... 70% 16.7M 2s 2024-03-30T13:09:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:118250K .......... .......... .......... .......... .......... 70% 17.7M 2s 2024-03-30T13:09:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:118300K .......... .......... .......... .......... .......... 70% 16.1M 2s 2024-03-30T13:09:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:118350K .......... .......... .......... .......... .......... 70% 19.0M 2s 2024-03-30T13:09:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:118400K .......... .......... .......... .......... .......... 70% 17.8M 2s 2024-03-30T13:09:46.650 INFO:teuthology.orchestra.run.smithi083.stderr:118450K .......... .......... .......... .......... .......... 70% 15.3M 2s 2024-03-30T13:09:46.653 INFO:teuthology.orchestra.run.smithi083.stderr:118500K .......... .......... .......... .......... .......... 70% 15.7M 2s 2024-03-30T13:09:46.656 INFO:teuthology.orchestra.run.smithi083.stderr:118550K .......... .......... .......... .......... .......... 70% 17.3M 2s 2024-03-30T13:09:46.659 INFO:teuthology.orchestra.run.smithi083.stderr:118600K .......... .......... .......... .......... .......... 70% 17.4M 2s 2024-03-30T13:09:46.661 INFO:teuthology.orchestra.run.smithi083.stderr:118650K .......... .......... .......... .......... .......... 70% 17.7M 2s 2024-03-30T13:09:46.665 INFO:teuthology.orchestra.run.smithi083.stderr:118700K .......... .......... .......... .......... .......... 70% 15.3M 2s 2024-03-30T13:09:46.668 INFO:teuthology.orchestra.run.smithi083.stderr:118750K .......... .......... .......... .......... .......... 70% 14.5M 2s 2024-03-30T13:09:46.670 INFO:teuthology.orchestra.run.smithi083.stderr:118800K .......... .......... .......... .......... .......... 70% 21.3M 2s 2024-03-30T13:09:46.672 INFO:teuthology.orchestra.run.smithi083.stderr:118850K .......... .......... .......... .......... .......... 70% 27.8M 2s 2024-03-30T13:09:46.674 INFO:teuthology.orchestra.run.smithi083.stderr:118900K .......... .......... .......... .......... .......... 70% 21.8M 2s 2024-03-30T13:09:46.676 INFO:teuthology.orchestra.run.smithi083.stderr:118950K .......... .......... .......... .......... .......... 70% 25.4M 2s 2024-03-30T13:09:46.679 INFO:teuthology.orchestra.run.smithi083.stderr:119000K .......... .......... .......... .......... .......... 70% 20.4M 2s 2024-03-30T13:09:46.680 INFO:teuthology.orchestra.run.smithi083.stderr:119050K .......... .......... .......... .......... .......... 70% 27.0M 2s 2024-03-30T13:09:46.682 INFO:teuthology.orchestra.run.smithi083.stderr:119100K .......... .......... .......... .......... .......... 70% 23.0M 2s 2024-03-30T13:09:46.684 INFO:teuthology.orchestra.run.smithi083.stderr:119150K .......... .......... .......... .......... .......... 70% 26.8M 2s 2024-03-30T13:09:46.687 INFO:teuthology.orchestra.run.smithi083.stderr:119200K .......... .......... .......... .......... .......... 70% 22.9M 2s 2024-03-30T13:09:46.688 INFO:teuthology.orchestra.run.smithi083.stderr:119250K .......... .......... .......... .......... .......... 70% 26.9M 2s 2024-03-30T13:09:46.691 INFO:teuthology.orchestra.run.smithi083.stderr:119300K .......... .......... .......... .......... .......... 70% 25.8M 2s 2024-03-30T13:09:46.693 INFO:teuthology.orchestra.run.smithi083.stderr:119350K .......... .......... .......... .......... .......... 70% 29.6M 2s 2024-03-30T13:09:46.694 INFO:teuthology.orchestra.run.smithi083.stderr:119400K .......... .......... .......... .......... .......... 70% 30.6M 2s 2024-03-30T13:09:46.695 INFO:teuthology.orchestra.run.smithi083.stderr:119450K .......... .......... .......... .......... .......... 70% 28.7M 2s 2024-03-30T13:09:46.697 INFO:teuthology.orchestra.run.smithi083.stderr:119500K .......... .......... .......... .......... .......... 70% 25.6M 2s 2024-03-30T13:09:46.698 INFO:teuthology.orchestra.run.smithi083.stderr:119550K .......... .......... .......... .......... .......... 70% 33.9M 2s 2024-03-30T13:09:46.700 INFO:teuthology.orchestra.run.smithi083.stderr:119600K .......... .......... .......... .......... .......... 70% 30.1M 2s 2024-03-30T13:09:46.702 INFO:teuthology.orchestra.run.smithi083.stderr:119650K .......... .......... .......... .......... .......... 71% 28.7M 2s 2024-03-30T13:09:46.704 INFO:teuthology.orchestra.run.smithi083.stderr:119700K .......... .......... .......... .......... .......... 71% 21.4M 2s 2024-03-30T13:09:46.706 INFO:teuthology.orchestra.run.smithi083.stderr:119750K .......... .......... .......... .......... .......... 71% 24.7M 2s 2024-03-30T13:09:46.708 INFO:teuthology.orchestra.run.smithi083.stderr:119800K .......... .......... .......... .......... .......... 71% 24.2M 2s 2024-03-30T13:09:46.710 INFO:teuthology.orchestra.run.smithi083.stderr:119850K .......... .......... .......... .......... .......... 71% 23.5M 2s 2024-03-30T13:09:46.712 INFO:teuthology.orchestra.run.smithi083.stderr:119900K .......... .......... .......... .......... .......... 71% 20.1M 2s 2024-03-30T13:09:46.714 INFO:teuthology.orchestra.run.smithi083.stderr:119950K .......... .......... .......... .......... .......... 71% 23.3M 2s 2024-03-30T13:09:46.717 INFO:teuthology.orchestra.run.smithi083.stderr:120000K .......... .......... .......... .......... .......... 71% 21.7M 2s 2024-03-30T13:09:46.719 INFO:teuthology.orchestra.run.smithi083.stderr:120050K .......... .......... .......... .......... .......... 71% 23.2M 2s 2024-03-30T13:09:46.721 INFO:teuthology.orchestra.run.smithi083.stderr:120100K .......... .......... .......... .......... .......... 71% 19.2M 2s 2024-03-30T13:09:46.724 INFO:teuthology.orchestra.run.smithi083.stderr:120150K .......... .......... .......... .......... .......... 71% 21.3M 2s 2024-03-30T13:09:46.726 INFO:teuthology.orchestra.run.smithi083.stderr:120200K .......... .......... .......... .......... .......... 71% 25.7M 2s 2024-03-30T13:09:46.727 INFO:teuthology.orchestra.run.smithi083.stderr:120250K .......... .......... .......... .......... .......... 71% 24.4M 2s 2024-03-30T13:09:46.730 INFO:teuthology.orchestra.run.smithi083.stderr:120300K .......... .......... .......... .......... .......... 71% 23.5M 2s 2024-03-30T13:09:46.731 INFO:teuthology.orchestra.run.smithi083.stderr:120350K .......... .......... .......... .......... .......... 71% 30.1M 2s 2024-03-30T13:09:46.733 INFO:teuthology.orchestra.run.smithi083.stderr:120400K .......... .......... .......... .......... .......... 71% 31.0M 2s 2024-03-30T13:09:46.734 INFO:teuthology.orchestra.run.smithi083.stderr:120450K .......... .......... .......... .......... .......... 71% 30.5M 2s 2024-03-30T13:09:46.736 INFO:teuthology.orchestra.run.smithi083.stderr:120500K .......... .......... .......... .......... .......... 71% 26.3M 2s 2024-03-30T13:09:46.738 INFO:teuthology.orchestra.run.smithi083.stderr:120550K .......... .......... .......... .......... .......... 71% 30.6M 2s 2024-03-30T13:09:46.740 INFO:teuthology.orchestra.run.smithi083.stderr:120600K .......... .......... .......... .......... .......... 71% 22.8M 2s 2024-03-30T13:09:46.742 INFO:teuthology.orchestra.run.smithi083.stderr:120650K .......... .......... .......... .......... .......... 71% 23.8M 2s 2024-03-30T13:09:46.744 INFO:teuthology.orchestra.run.smithi083.stderr:120700K .......... .......... .......... .......... .......... 71% 21.0M 2s 2024-03-30T13:09:46.747 INFO:teuthology.orchestra.run.smithi083.stderr:120750K .......... .......... .......... .......... .......... 71% 22.2M 2s 2024-03-30T13:09:46.749 INFO:teuthology.orchestra.run.smithi083.stderr:120800K .......... .......... .......... .......... .......... 71% 20.6M 2s 2024-03-30T13:09:46.751 INFO:teuthology.orchestra.run.smithi083.stderr:120850K .......... .......... .......... .......... .......... 71% 20.5M 2s 2024-03-30T13:09:46.754 INFO:teuthology.orchestra.run.smithi083.stderr:120900K .......... .......... .......... .......... .......... 71% 18.3M 2s 2024-03-30T13:09:46.756 INFO:teuthology.orchestra.run.smithi083.stderr:120950K .......... .......... .......... .......... .......... 71% 20.3M 2s 2024-03-30T13:09:46.759 INFO:teuthology.orchestra.run.smithi083.stderr:121000K .......... .......... .......... .......... .......... 71% 19.7M 2s 2024-03-30T13:09:46.761 INFO:teuthology.orchestra.run.smithi083.stderr:121050K .......... .......... .......... .......... .......... 71% 19.2M 2s 2024-03-30T13:09:46.764 INFO:teuthology.orchestra.run.smithi083.stderr:121100K .......... .......... .......... .......... .......... 71% 16.9M 2s 2024-03-30T13:09:46.767 INFO:teuthology.orchestra.run.smithi083.stderr:121150K .......... .......... .......... .......... .......... 71% 20.1M 2s 2024-03-30T13:09:46.770 INFO:teuthology.orchestra.run.smithi083.stderr:121200K .......... .......... .......... .......... .......... 71% 20.8M 2s 2024-03-30T13:09:46.772 INFO:teuthology.orchestra.run.smithi083.stderr:121250K .......... .......... .......... .......... .......... 71% 21.6M 2s 2024-03-30T13:09:46.774 INFO:teuthology.orchestra.run.smithi083.stderr:121300K .......... .......... .......... .......... .......... 71% 20.2M 2s 2024-03-30T13:09:46.776 INFO:teuthology.orchestra.run.smithi083.stderr:121350K .......... .......... .......... .......... .......... 72% 21.5M 2s 2024-03-30T13:09:46.778 INFO:teuthology.orchestra.run.smithi083.stderr:121400K .......... .......... .......... .......... .......... 72% 23.3M 2s 2024-03-30T13:09:46.780 INFO:teuthology.orchestra.run.smithi083.stderr:121450K .......... .......... .......... .......... .......... 72% 23.1M 2s 2024-03-30T13:09:46.783 INFO:teuthology.orchestra.run.smithi083.stderr:121500K .......... .......... .......... .......... .......... 72% 18.7M 2s 2024-03-30T13:09:46.785 INFO:teuthology.orchestra.run.smithi083.stderr:121550K .......... .......... .......... .......... .......... 72% 24.0M 2s 2024-03-30T13:09:46.787 INFO:teuthology.orchestra.run.smithi083.stderr:121600K .......... .......... .......... .......... .......... 72% 23.2M 2s 2024-03-30T13:09:46.789 INFO:teuthology.orchestra.run.smithi083.stderr:121650K .......... .......... .......... .......... .......... 72% 22.7M 2s 2024-03-30T13:09:46.792 INFO:teuthology.orchestra.run.smithi083.stderr:121700K .......... .......... .......... .......... .......... 72% 17.6M 2s 2024-03-30T13:09:46.795 INFO:teuthology.orchestra.run.smithi083.stderr:121750K .......... .......... .......... .......... .......... 72% 19.1M 2s 2024-03-30T13:09:46.797 INFO:teuthology.orchestra.run.smithi083.stderr:121800K .......... .......... .......... .......... .......... 72% 22.5M 2s 2024-03-30T13:09:46.799 INFO:teuthology.orchestra.run.smithi083.stderr:121850K .......... .......... .......... .......... .......... 72% 21.6M 2s 2024-03-30T13:09:46.802 INFO:teuthology.orchestra.run.smithi083.stderr:121900K .......... .......... .......... .......... .......... 72% 20.0M 2s 2024-03-30T13:09:46.803 INFO:teuthology.orchestra.run.smithi083.stderr:121950K .......... .......... .......... .......... .......... 72% 24.1M 2s 2024-03-30T13:09:46.805 INFO:teuthology.orchestra.run.smithi083.stderr:122000K .......... .......... .......... .......... .......... 72% 24.6M 2s 2024-03-30T13:09:46.808 INFO:teuthology.orchestra.run.smithi083.stderr:122050K .......... .......... .......... .......... .......... 72% 23.3M 2s 2024-03-30T13:09:46.810 INFO:teuthology.orchestra.run.smithi083.stderr:122100K .......... .......... .......... .......... .......... 72% 20.6M 2s 2024-03-30T13:09:46.812 INFO:teuthology.orchestra.run.smithi083.stderr:122150K .......... .......... .......... .......... .......... 72% 23.9M 2s 2024-03-30T13:09:46.815 INFO:teuthology.orchestra.run.smithi083.stderr:122200K .......... .......... .......... .......... .......... 72% 24.2M 2s 2024-03-30T13:09:46.816 INFO:teuthology.orchestra.run.smithi083.stderr:122250K .......... .......... .......... .......... .......... 72% 23.5M 2s 2024-03-30T13:09:46.819 INFO:teuthology.orchestra.run.smithi083.stderr:122300K .......... .......... .......... .......... .......... 72% 20.2M 2s 2024-03-30T13:09:46.821 INFO:teuthology.orchestra.run.smithi083.stderr:122350K .......... .......... .......... .......... .......... 72% 23.0M 2s 2024-03-30T13:09:46.823 INFO:teuthology.orchestra.run.smithi083.stderr:122400K .......... .......... .......... .......... .......... 72% 23.4M 2s 2024-03-30T13:09:46.826 INFO:teuthology.orchestra.run.smithi083.stderr:122450K .......... .......... .......... .......... .......... 72% 23.2M 2s 2024-03-30T13:09:46.828 INFO:teuthology.orchestra.run.smithi083.stderr:122500K .......... .......... .......... .......... .......... 72% 19.6M 2s 2024-03-30T13:09:46.829 INFO:teuthology.orchestra.run.smithi083.stderr:122550K .......... .......... .......... .......... .......... 72% 22.6M 2s 2024-03-30T13:09:46.832 INFO:teuthology.orchestra.run.smithi083.stderr:122600K .......... .......... .......... .......... .......... 72% 23.2M 2s 2024-03-30T13:09:46.834 INFO:teuthology.orchestra.run.smithi083.stderr:122650K .......... .......... .......... .......... .......... 72% 23.3M 2s 2024-03-30T13:09:46.836 INFO:teuthology.orchestra.run.smithi083.stderr:122700K .......... .......... .......... .......... .......... 72% 19.7M 2s 2024-03-30T13:09:46.839 INFO:teuthology.orchestra.run.smithi083.stderr:122750K .......... .......... .......... .......... .......... 72% 22.8M 2s 2024-03-30T13:09:46.840 INFO:teuthology.orchestra.run.smithi083.stderr:122800K .......... .......... .......... .......... .......... 72% 24.7M 2s 2024-03-30T13:09:46.842 INFO:teuthology.orchestra.run.smithi083.stderr:122850K .......... .......... .......... .......... .......... 72% 21.3M 2s 2024-03-30T13:09:46.845 INFO:teuthology.orchestra.run.smithi083.stderr:122900K .......... .......... .......... .......... .......... 72% 18.6M 2s 2024-03-30T13:09:46.847 INFO:teuthology.orchestra.run.smithi083.stderr:122950K .......... .......... .......... .......... .......... 72% 24.1M 2s 2024-03-30T13:09:46.850 INFO:teuthology.orchestra.run.smithi083.stderr:123000K .......... .......... .......... .......... .......... 72% 19.8M 2s 2024-03-30T13:09:46.852 INFO:teuthology.orchestra.run.smithi083.stderr:123050K .......... .......... .......... .......... .......... 73% 24.5M 2s 2024-03-30T13:09:46.854 INFO:teuthology.orchestra.run.smithi083.stderr:123100K .......... .......... .......... .......... .......... 73% 23.8M 2s 2024-03-30T13:09:46.856 INFO:teuthology.orchestra.run.smithi083.stderr:123150K .......... .......... .......... .......... .......... 73% 26.3M 2s 2024-03-30T13:09:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:123200K .......... .......... .......... .......... .......... 73% 27.5M 2s 2024-03-30T13:09:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:123250K .......... .......... .......... .......... .......... 73% 29.0M 2s 2024-03-30T13:09:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:123300K .......... .......... .......... .......... .......... 73% 31.4M 2s 2024-03-30T13:09:46.862 INFO:teuthology.orchestra.run.smithi083.stderr:123350K .......... .......... .......... .......... .......... 73% 36.2M 2s 2024-03-30T13:09:46.863 INFO:teuthology.orchestra.run.smithi083.stderr:123400K .......... .......... .......... .......... .......... 73% 37.0M 2s 2024-03-30T13:09:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:123450K .......... .......... .......... .......... .......... 73% 37.9M 2s 2024-03-30T13:09:46.866 INFO:teuthology.orchestra.run.smithi083.stderr:123500K .......... .......... .......... .......... .......... 73% 31.8M 2s 2024-03-30T13:09:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:123550K .......... .......... .......... .......... .......... 73% 37.1M 2s 2024-03-30T13:09:46.869 INFO:teuthology.orchestra.run.smithi083.stderr:123600K .......... .......... .......... .......... .......... 73% 37.1M 2s 2024-03-30T13:09:46.870 INFO:teuthology.orchestra.run.smithi083.stderr:123650K .......... .......... .......... .......... .......... 73% 36.8M 2s 2024-03-30T13:09:46.872 INFO:teuthology.orchestra.run.smithi083.stderr:123700K .......... .......... .......... .......... .......... 73% 31.6M 2s 2024-03-30T13:09:46.873 INFO:teuthology.orchestra.run.smithi083.stderr:123750K .......... .......... .......... .......... .......... 73% 36.6M 2s 2024-03-30T13:09:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:123800K .......... .......... .......... .......... .......... 73% 36.3M 2s 2024-03-30T13:09:46.876 INFO:teuthology.orchestra.run.smithi083.stderr:123850K .......... .......... .......... .......... .......... 73% 34.1M 2s 2024-03-30T13:09:46.877 INFO:teuthology.orchestra.run.smithi083.stderr:123900K .......... .......... .......... .......... .......... 73% 28.3M 2s 2024-03-30T13:09:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:123950K .......... .......... .......... .......... .......... 73% 33.2M 2s 2024-03-30T13:09:46.880 INFO:teuthology.orchestra.run.smithi083.stderr:124000K .......... .......... .......... .......... .......... 73% 34.3M 2s 2024-03-30T13:09:46.881 INFO:teuthology.orchestra.run.smithi083.stderr:124050K .......... .......... .......... .......... .......... 73% 34.3M 2s 2024-03-30T13:09:46.883 INFO:teuthology.orchestra.run.smithi083.stderr:124100K .......... .......... .......... .......... .......... 73% 29.2M 2s 2024-03-30T13:09:46.885 INFO:teuthology.orchestra.run.smithi083.stderr:124150K .......... .......... .......... .......... .......... 73% 34.0M 2s 2024-03-30T13:09:46.886 INFO:teuthology.orchestra.run.smithi083.stderr:124200K .......... .......... .......... .......... .......... 73% 33.0M 2s 2024-03-30T13:09:46.888 INFO:teuthology.orchestra.run.smithi083.stderr:124250K .......... .......... .......... .......... .......... 73% 33.1M 2s 2024-03-30T13:09:46.889 INFO:teuthology.orchestra.run.smithi083.stderr:124300K .......... .......... .......... .......... .......... 73% 28.1M 2s 2024-03-30T13:09:46.891 INFO:teuthology.orchestra.run.smithi083.stderr:124350K .......... .......... .......... .......... .......... 73% 33.3M 2s 2024-03-30T13:09:46.892 INFO:teuthology.orchestra.run.smithi083.stderr:124400K .......... .......... .......... .......... .......... 73% 33.5M 2s 2024-03-30T13:09:46.894 INFO:teuthology.orchestra.run.smithi083.stderr:124450K .......... .......... .......... .......... .......... 73% 33.4M 2s 2024-03-30T13:09:46.896 INFO:teuthology.orchestra.run.smithi083.stderr:124500K .......... .......... .......... .......... .......... 73% 28.7M 2s 2024-03-30T13:09:46.897 INFO:teuthology.orchestra.run.smithi083.stderr:124550K .......... .......... .......... .......... .......... 73% 31.5M 2s 2024-03-30T13:09:46.899 INFO:teuthology.orchestra.run.smithi083.stderr:124600K .......... .......... .......... .......... .......... 73% 31.7M 2s 2024-03-30T13:09:46.900 INFO:teuthology.orchestra.run.smithi083.stderr:124650K .......... .......... .......... .......... .......... 73% 32.6M 2s 2024-03-30T13:09:46.902 INFO:teuthology.orchestra.run.smithi083.stderr:124700K .......... .......... .......... .......... .......... 74% 27.8M 2s 2024-03-30T13:09:46.903 INFO:teuthology.orchestra.run.smithi083.stderr:124750K .......... .......... .......... .......... .......... 74% 32.5M 2s 2024-03-30T13:09:46.905 INFO:teuthology.orchestra.run.smithi083.stderr:124800K .......... .......... .......... .......... .......... 74% 33.1M 2s 2024-03-30T13:09:46.906 INFO:teuthology.orchestra.run.smithi083.stderr:124850K .......... .......... .......... .......... .......... 74% 32.6M 2s 2024-03-30T13:09:46.908 INFO:teuthology.orchestra.run.smithi083.stderr:124900K .......... .......... .......... .......... .......... 74% 28.0M 2s 2024-03-30T13:09:46.910 INFO:teuthology.orchestra.run.smithi083.stderr:124950K .......... .......... .......... .......... .......... 74% 31.5M 2s 2024-03-30T13:09:46.911 INFO:teuthology.orchestra.run.smithi083.stderr:125000K .......... .......... .......... .......... .......... 74% 30.7M 2s 2024-03-30T13:09:46.913 INFO:teuthology.orchestra.run.smithi083.stderr:125050K .......... .......... .......... .......... .......... 74% 31.7M 2s 2024-03-30T13:09:46.914 INFO:teuthology.orchestra.run.smithi083.stderr:125100K .......... .......... .......... .......... .......... 74% 26.6M 2s 2024-03-30T13:09:46.916 INFO:teuthology.orchestra.run.smithi083.stderr:125150K .......... .......... .......... .......... .......... 74% 31.3M 2s 2024-03-30T13:09:46.918 INFO:teuthology.orchestra.run.smithi083.stderr:125200K .......... .......... .......... .......... .......... 74% 31.3M 2s 2024-03-30T13:09:46.919 INFO:teuthology.orchestra.run.smithi083.stderr:125250K .......... .......... .......... .......... .......... 74% 30.8M 2s 2024-03-30T13:09:46.921 INFO:teuthology.orchestra.run.smithi083.stderr:125300K .......... .......... .......... .......... .......... 74% 26.0M 2s 2024-03-30T13:09:46.923 INFO:teuthology.orchestra.run.smithi083.stderr:125350K .......... .......... .......... .......... .......... 74% 27.1M 2s 2024-03-30T13:09:46.925 INFO:teuthology.orchestra.run.smithi083.stderr:125400K .......... .......... .......... .......... .......... 74% 21.3M 2s 2024-03-30T13:09:46.933 INFO:teuthology.orchestra.run.smithi083.stderr:125450K .......... .......... .......... .......... .......... 74% 28.2M 2s 2024-03-30T13:09:46.933 INFO:teuthology.orchestra.run.smithi083.stderr:125500K .......... .......... .......... .......... .......... 74% 25.4M 2s 2024-03-30T13:09:46.933 INFO:teuthology.orchestra.run.smithi083.stderr:125550K .......... .......... .......... .......... .......... 74% 27.1M 2s 2024-03-30T13:09:46.933 INFO:teuthology.orchestra.run.smithi083.stderr:125600K .......... .......... .......... .......... .......... 74% 26.4M 2s 2024-03-30T13:09:46.935 INFO:teuthology.orchestra.run.smithi083.stderr:125650K .......... .......... .......... .......... .......... 74% 25.7M 2s 2024-03-30T13:09:46.937 INFO:teuthology.orchestra.run.smithi083.stderr:125700K .......... .......... .......... .......... .......... 74% 22.8M 2s 2024-03-30T13:09:46.938 INFO:teuthology.orchestra.run.smithi083.stderr:125750K .......... .......... .......... .......... .......... 74% 25.6M 2s 2024-03-30T13:09:46.940 INFO:teuthology.orchestra.run.smithi083.stderr:125800K .......... .......... .......... .......... .......... 74% 25.1M 2s 2024-03-30T13:09:46.942 INFO:teuthology.orchestra.run.smithi083.stderr:125850K .......... .......... .......... .......... .......... 74% 25.1M 2s 2024-03-30T13:09:46.945 INFO:teuthology.orchestra.run.smithi083.stderr:125900K .......... .......... .......... .......... .......... 74% 22.1M 2s 2024-03-30T13:09:46.947 INFO:teuthology.orchestra.run.smithi083.stderr:125950K .......... .......... .......... .......... .......... 74% 25.7M 2s 2024-03-30T13:09:46.949 INFO:teuthology.orchestra.run.smithi083.stderr:126000K .......... .......... .......... .......... .......... 74% 26.1M 2s 2024-03-30T13:09:46.950 INFO:teuthology.orchestra.run.smithi083.stderr:126050K .......... .......... .......... .......... .......... 74% 24.5M 2s 2024-03-30T13:09:46.953 INFO:teuthology.orchestra.run.smithi083.stderr:126100K .......... .......... .......... .......... .......... 74% 21.7M 2s 2024-03-30T13:09:46.955 INFO:teuthology.orchestra.run.smithi083.stderr:126150K .......... .......... .......... .......... .......... 74% 25.2M 2s 2024-03-30T13:09:46.957 INFO:teuthology.orchestra.run.smithi083.stderr:126200K .......... .......... .......... .......... .......... 74% 25.2M 2s 2024-03-30T13:09:46.958 INFO:teuthology.orchestra.run.smithi083.stderr:126250K .......... .......... .......... .......... .......... 74% 25.5M 2s 2024-03-30T13:09:46.961 INFO:teuthology.orchestra.run.smithi083.stderr:126300K .......... .......... .......... .......... .......... 74% 22.0M 2s 2024-03-30T13:09:46.963 INFO:teuthology.orchestra.run.smithi083.stderr:126350K .......... .......... .......... .......... .......... 74% 24.8M 2s 2024-03-30T13:09:46.965 INFO:teuthology.orchestra.run.smithi083.stderr:126400K .......... .......... .......... .......... .......... 75% 25.6M 2s 2024-03-30T13:09:46.966 INFO:teuthology.orchestra.run.smithi083.stderr:126450K .......... .......... .......... .......... .......... 75% 24.7M 2s 2024-03-30T13:09:46.969 INFO:teuthology.orchestra.run.smithi083.stderr:126500K .......... .......... .......... .......... .......... 75% 22.0M 2s 2024-03-30T13:09:46.971 INFO:teuthology.orchestra.run.smithi083.stderr:126550K .......... .......... .......... .......... .......... 75% 24.3M 2s 2024-03-30T13:09:46.973 INFO:teuthology.orchestra.run.smithi083.stderr:126600K .......... .......... .......... .......... .......... 75% 24.2M 2s 2024-03-30T13:09:46.975 INFO:teuthology.orchestra.run.smithi083.stderr:126650K .......... .......... .......... .......... .......... 75% 23.9M 2s 2024-03-30T13:09:46.977 INFO:teuthology.orchestra.run.smithi083.stderr:126700K .......... .......... .......... .......... .......... 75% 21.3M 2s 2024-03-30T13:09:46.979 INFO:teuthology.orchestra.run.smithi083.stderr:126750K .......... .......... .......... .......... .......... 75% 24.8M 2s 2024-03-30T13:09:46.981 INFO:teuthology.orchestra.run.smithi083.stderr:126800K .......... .......... .......... .......... .......... 75% 24.4M 2s 2024-03-30T13:09:46.984 INFO:teuthology.orchestra.run.smithi083.stderr:126850K .......... .......... .......... .......... .......... 75% 26.7M 2s 2024-03-30T13:09:46.985 INFO:teuthology.orchestra.run.smithi083.stderr:126900K .......... .......... .......... .......... .......... 75% 23.9M 2s 2024-03-30T13:09:46.987 INFO:teuthology.orchestra.run.smithi083.stderr:126950K .......... .......... .......... .......... .......... 75% 26.6M 2s 2024-03-30T13:09:46.989 INFO:teuthology.orchestra.run.smithi083.stderr:127000K .......... .......... .......... .......... .......... 75% 35.2M 2s 2024-03-30T13:09:46.990 INFO:teuthology.orchestra.run.smithi083.stderr:127050K .......... .......... .......... .......... .......... 75% 32.3M 2s 2024-03-30T13:09:46.991 INFO:teuthology.orchestra.run.smithi083.stderr:127100K .......... .......... .......... .......... .......... 75% 25.9M 2s 2024-03-30T13:09:46.994 INFO:teuthology.orchestra.run.smithi083.stderr:127150K .......... .......... .......... .......... .......... 75% 30.0M 2s 2024-03-30T13:09:46.995 INFO:teuthology.orchestra.run.smithi083.stderr:127200K .......... .......... .......... .......... .......... 75% 31.7M 2s 2024-03-30T13:09:46.997 INFO:teuthology.orchestra.run.smithi083.stderr:127250K .......... .......... .......... .......... .......... 75% 24.8M 2s 2024-03-30T13:09:47.000 INFO:teuthology.orchestra.run.smithi083.stderr:127300K .......... .......... .......... .......... .......... 75% 17.4M 2s 2024-03-30T13:09:47.002 INFO:teuthology.orchestra.run.smithi083.stderr:127350K .......... .......... .......... .......... .......... 75% 23.5M 2s 2024-03-30T13:09:47.004 INFO:teuthology.orchestra.run.smithi083.stderr:127400K .......... .......... .......... .......... .......... 75% 27.0M 2s 2024-03-30T13:09:47.005 INFO:teuthology.orchestra.run.smithi083.stderr:127450K .......... .......... .......... .......... .......... 75% 33.0M 2s 2024-03-30T13:09:47.007 INFO:teuthology.orchestra.run.smithi083.stderr:127500K .......... .......... .......... .......... .......... 75% 29.0M 2s 2024-03-30T13:09:47.008 INFO:teuthology.orchestra.run.smithi083.stderr:127550K .......... .......... .......... .......... .......... 75% 32.0M 1s 2024-03-30T13:09:47.010 INFO:teuthology.orchestra.run.smithi083.stderr:127600K .......... .......... .......... .......... .......... 75% 32.4M 1s 2024-03-30T13:09:47.011 INFO:teuthology.orchestra.run.smithi083.stderr:127650K .......... .......... .......... .......... .......... 75% 34.1M 1s 2024-03-30T13:09:47.013 INFO:teuthology.orchestra.run.smithi083.stderr:127700K .......... .......... .......... .......... .......... 75% 30.9M 1s 2024-03-30T13:09:47.014 INFO:teuthology.orchestra.run.smithi083.stderr:127750K .......... .......... .......... .......... .......... 75% 35.4M 1s 2024-03-30T13:09:47.016 INFO:teuthology.orchestra.run.smithi083.stderr:127800K .......... .......... .......... .......... .......... 75% 34.4M 1s 2024-03-30T13:09:47.017 INFO:teuthology.orchestra.run.smithi083.stderr:127850K .......... .......... .......... .......... .......... 75% 36.2M 1s 2024-03-30T13:09:47.018 INFO:teuthology.orchestra.run.smithi083.stderr:127900K .......... .......... .......... .......... .......... 75% 29.2M 1s 2024-03-30T13:09:47.020 INFO:teuthology.orchestra.run.smithi083.stderr:127950K .......... .......... .......... .......... .......... 75% 30.7M 1s 2024-03-30T13:09:47.022 INFO:teuthology.orchestra.run.smithi083.stderr:128000K .......... .......... .......... .......... .......... 75% 24.9M 1s 2024-03-30T13:09:47.024 INFO:teuthology.orchestra.run.smithi083.stderr:128050K .......... .......... .......... .......... .......... 75% 24.5M 1s 2024-03-30T13:09:47.026 INFO:teuthology.orchestra.run.smithi083.stderr:128100K .......... .......... .......... .......... .......... 76% 20.9M 1s 2024-03-30T13:09:47.028 INFO:teuthology.orchestra.run.smithi083.stderr:128150K .......... .......... .......... .......... .......... 76% 24.7M 1s 2024-03-30T13:09:47.030 INFO:teuthology.orchestra.run.smithi083.stderr:128200K .......... .......... .......... .......... .......... 76% 24.7M 1s 2024-03-30T13:09:47.032 INFO:teuthology.orchestra.run.smithi083.stderr:128250K .......... .......... .......... .......... .......... 76% 25.1M 1s 2024-03-30T13:09:47.035 INFO:teuthology.orchestra.run.smithi083.stderr:128300K .......... .......... .......... .......... .......... 76% 20.8M 1s 2024-03-30T13:09:47.037 INFO:teuthology.orchestra.run.smithi083.stderr:128350K .......... .......... .......... .......... .......... 76% 25.4M 1s 2024-03-30T13:09:47.039 INFO:teuthology.orchestra.run.smithi083.stderr:128400K .......... .......... .......... .......... .......... 76% 23.4M 1s 2024-03-30T13:09:47.041 INFO:teuthology.orchestra.run.smithi083.stderr:128450K .......... .......... .......... .......... .......... 76% 19.7M 1s 2024-03-30T13:09:47.044 INFO:teuthology.orchestra.run.smithi083.stderr:128500K .......... .......... .......... .......... .......... 76% 16.7M 1s 2024-03-30T13:09:47.047 INFO:teuthology.orchestra.run.smithi083.stderr:128550K .......... .......... .......... .......... .......... 76% 20.8M 1s 2024-03-30T13:09:47.049 INFO:teuthology.orchestra.run.smithi083.stderr:128600K .......... .......... .......... .......... .......... 76% 20.7M 1s 2024-03-30T13:09:47.052 INFO:teuthology.orchestra.run.smithi083.stderr:128650K .......... .......... .......... .......... .......... 76% 18.6M 1s 2024-03-30T13:09:47.055 INFO:teuthology.orchestra.run.smithi083.stderr:128700K .......... .......... .......... .......... .......... 76% 16.4M 1s 2024-03-30T13:09:47.057 INFO:teuthology.orchestra.run.smithi083.stderr:128750K .......... .......... .......... .......... .......... 76% 19.1M 1s 2024-03-30T13:09:47.060 INFO:teuthology.orchestra.run.smithi083.stderr:128800K .......... .......... .......... .......... .......... 76% 19.9M 1s 2024-03-30T13:09:47.062 INFO:teuthology.orchestra.run.smithi083.stderr:128850K .......... .......... .......... .......... .......... 76% 20.5M 1s 2024-03-30T13:09:47.065 INFO:teuthology.orchestra.run.smithi083.stderr:128900K .......... .......... .......... .......... .......... 76% 17.2M 1s 2024-03-30T13:09:47.067 INFO:teuthology.orchestra.run.smithi083.stderr:128950K .......... .......... .......... .......... .......... 76% 20.6M 1s 2024-03-30T13:09:47.070 INFO:teuthology.orchestra.run.smithi083.stderr:129000K .......... .......... .......... .......... .......... 76% 20.5M 1s 2024-03-30T13:09:47.072 INFO:teuthology.orchestra.run.smithi083.stderr:129050K .......... .......... .......... .......... .......... 76% 18.8M 1s 2024-03-30T13:09:47.075 INFO:teuthology.orchestra.run.smithi083.stderr:129100K .......... .......... .......... .......... .......... 76% 16.2M 1s 2024-03-30T13:09:47.078 INFO:teuthology.orchestra.run.smithi083.stderr:129150K .......... .......... .......... .......... .......... 76% 18.5M 1s 2024-03-30T13:09:47.080 INFO:teuthology.orchestra.run.smithi083.stderr:129200K .......... .......... .......... .......... .......... 76% 18.1M 1s 2024-03-30T13:09:47.083 INFO:teuthology.orchestra.run.smithi083.stderr:129250K .......... .......... .......... .......... .......... 76% 18.8M 1s 2024-03-30T13:09:47.086 INFO:teuthology.orchestra.run.smithi083.stderr:129300K .......... .......... .......... .......... .......... 76% 15.7M 1s 2024-03-30T13:09:47.089 INFO:teuthology.orchestra.run.smithi083.stderr:129350K .......... .......... .......... .......... .......... 76% 18.9M 1s 2024-03-30T13:09:47.091 INFO:teuthology.orchestra.run.smithi083.stderr:129400K .......... .......... .......... .......... .......... 76% 19.5M 1s 2024-03-30T13:09:47.093 INFO:teuthology.orchestra.run.smithi083.stderr:129450K .......... .......... .......... .......... .......... 76% 19.7M 1s 2024-03-30T13:09:47.097 INFO:teuthology.orchestra.run.smithi083.stderr:129500K .......... .......... .......... .......... .......... 76% 14.7M 1s 2024-03-30T13:09:47.099 INFO:teuthology.orchestra.run.smithi083.stderr:129550K .......... .......... .......... .......... .......... 76% 21.4M 1s 2024-03-30T13:09:47.101 INFO:teuthology.orchestra.run.smithi083.stderr:129600K .......... .......... .......... .......... .......... 76% 22.0M 1s 2024-03-30T13:09:47.104 INFO:teuthology.orchestra.run.smithi083.stderr:129650K .......... .......... .......... .......... .......... 76% 20.8M 1s 2024-03-30T13:09:47.106 INFO:teuthology.orchestra.run.smithi083.stderr:129700K .......... .......... .......... .......... .......... 76% 18.8M 1s 2024-03-30T13:09:47.108 INFO:teuthology.orchestra.run.smithi083.stderr:129750K .......... .......... .......... .......... .......... 77% 22.5M 1s 2024-03-30T13:09:47.111 INFO:teuthology.orchestra.run.smithi083.stderr:129800K .......... .......... .......... .......... .......... 77% 22.7M 1s 2024-03-30T13:09:47.113 INFO:teuthology.orchestra.run.smithi083.stderr:129850K .......... .......... .......... .......... .......... 77% 20.9M 1s 2024-03-30T13:09:47.115 INFO:teuthology.orchestra.run.smithi083.stderr:129900K .......... .......... .......... .......... .......... 77% 18.4M 1s 2024-03-30T13:09:47.118 INFO:teuthology.orchestra.run.smithi083.stderr:129950K .......... .......... .......... .......... .......... 77% 21.3M 1s 2024-03-30T13:09:47.120 INFO:teuthology.orchestra.run.smithi083.stderr:130000K .......... .......... .......... .......... .......... 77% 23.2M 1s 2024-03-30T13:09:47.123 INFO:teuthology.orchestra.run.smithi083.stderr:130050K .......... .......... .......... .......... .......... 77% 19.7M 1s 2024-03-30T13:09:47.125 INFO:teuthology.orchestra.run.smithi083.stderr:130100K .......... .......... .......... .......... .......... 77% 16.8M 1s 2024-03-30T13:09:47.128 INFO:teuthology.orchestra.run.smithi083.stderr:130150K .......... .......... .......... .......... .......... 77% 19.4M 1s 2024-03-30T13:09:47.130 INFO:teuthology.orchestra.run.smithi083.stderr:130200K .......... .......... .......... .......... .......... 77% 19.2M 1s 2024-03-30T13:09:47.133 INFO:teuthology.orchestra.run.smithi083.stderr:130250K .......... .......... .......... .......... .......... 77% 17.9M 1s 2024-03-30T13:09:47.140 INFO:teuthology.orchestra.run.smithi083.stderr:130300K .......... .......... .......... .......... .......... 77% 15.9M 1s 2024-03-30T13:09:47.140 INFO:teuthology.orchestra.run.smithi083.stderr:130350K .......... .......... .......... .......... .......... 77% 18.0M 1s 2024-03-30T13:09:47.142 INFO:teuthology.orchestra.run.smithi083.stderr:130400K .......... .......... .......... .......... .......... 77% 18.3M 1s 2024-03-30T13:09:47.144 INFO:teuthology.orchestra.run.smithi083.stderr:130450K .......... .......... .......... .......... .......... 77% 18.4M 1s 2024-03-30T13:09:47.148 INFO:teuthology.orchestra.run.smithi083.stderr:130500K .......... .......... .......... .......... .......... 77% 14.8M 1s 2024-03-30T13:09:47.150 INFO:teuthology.orchestra.run.smithi083.stderr:130550K .......... .......... .......... .......... .......... 77% 17.6M 1s 2024-03-30T13:09:47.153 INFO:teuthology.orchestra.run.smithi083.stderr:130600K .......... .......... .......... .......... .......... 77% 18.4M 1s 2024-03-30T13:09:47.156 INFO:teuthology.orchestra.run.smithi083.stderr:130650K .......... .......... .......... .......... .......... 77% 17.3M 1s 2024-03-30T13:09:47.159 INFO:teuthology.orchestra.run.smithi083.stderr:130700K .......... .......... .......... .......... .......... 77% 14.8M 1s 2024-03-30T13:09:47.162 INFO:teuthology.orchestra.run.smithi083.stderr:130750K .......... .......... .......... .......... .......... 77% 18.3M 1s 2024-03-30T13:09:47.164 INFO:teuthology.orchestra.run.smithi083.stderr:130800K .......... .......... .......... .......... .......... 77% 18.6M 1s 2024-03-30T13:09:47.167 INFO:teuthology.orchestra.run.smithi083.stderr:130850K .......... .......... .......... .......... .......... 77% 17.6M 1s 2024-03-30T13:09:47.170 INFO:teuthology.orchestra.run.smithi083.stderr:130900K .......... .......... .......... .......... .......... 77% 16.1M 1s 2024-03-30T13:09:47.173 INFO:teuthology.orchestra.run.smithi083.stderr:130950K .......... .......... .......... .......... .......... 77% 17.4M 1s 2024-03-30T13:09:47.176 INFO:teuthology.orchestra.run.smithi083.stderr:131000K .......... .......... .......... .......... .......... 77% 18.5M 1s 2024-03-30T13:09:47.179 INFO:teuthology.orchestra.run.smithi083.stderr:131050K .......... .......... .......... .......... .......... 77% 18.7M 1s 2024-03-30T13:09:47.181 INFO:teuthology.orchestra.run.smithi083.stderr:131100K .......... .......... .......... .......... .......... 77% 15.6M 1s 2024-03-30T13:09:47.184 INFO:teuthology.orchestra.run.smithi083.stderr:131150K .......... .......... .......... .......... .......... 77% 18.6M 1s 2024-03-30T13:09:47.186 INFO:teuthology.orchestra.run.smithi083.stderr:131200K .......... .......... .......... .......... .......... 77% 23.9M 1s 2024-03-30T13:09:47.188 INFO:teuthology.orchestra.run.smithi083.stderr:131250K .......... .......... .......... .......... .......... 77% 22.6M 1s 2024-03-30T13:09:47.190 INFO:teuthology.orchestra.run.smithi083.stderr:131300K .......... .......... .......... .......... .......... 77% 22.0M 1s 2024-03-30T13:09:47.193 INFO:teuthology.orchestra.run.smithi083.stderr:131350K .......... .......... .......... .......... .......... 77% 25.7M 1s 2024-03-30T13:09:47.194 INFO:teuthology.orchestra.run.smithi083.stderr:131400K .......... .......... .......... .......... .......... 77% 25.4M 1s 2024-03-30T13:09:47.196 INFO:teuthology.orchestra.run.smithi083.stderr:131450K .......... .......... .......... .......... .......... 78% 30.2M 1s 2024-03-30T13:09:47.198 INFO:teuthology.orchestra.run.smithi083.stderr:131500K .......... .......... .......... .......... .......... 78% 25.4M 1s 2024-03-30T13:09:47.199 INFO:teuthology.orchestra.run.smithi083.stderr:131550K .......... .......... .......... .......... .......... 78% 29.8M 1s 2024-03-30T13:09:47.201 INFO:teuthology.orchestra.run.smithi083.stderr:131600K .......... .......... .......... .......... .......... 78% 28.3M 1s 2024-03-30T13:09:47.203 INFO:teuthology.orchestra.run.smithi083.stderr:131650K .......... .......... .......... .......... .......... 78% 28.9M 1s 2024-03-30T13:09:47.205 INFO:teuthology.orchestra.run.smithi083.stderr:131700K .......... .......... .......... .......... .......... 78% 25.9M 1s 2024-03-30T13:09:47.207 INFO:teuthology.orchestra.run.smithi083.stderr:131750K .......... .......... .......... .......... .......... 78% 28.9M 1s 2024-03-30T13:09:47.208 INFO:teuthology.orchestra.run.smithi083.stderr:131800K .......... .......... .......... .......... .......... 78% 29.4M 1s 2024-03-30T13:09:47.209 INFO:teuthology.orchestra.run.smithi083.stderr:131850K .......... .......... .......... .......... .......... 78% 29.9M 1s 2024-03-30T13:09:47.212 INFO:teuthology.orchestra.run.smithi083.stderr:131900K .......... .......... .......... .......... .......... 78% 25.4M 1s 2024-03-30T13:09:47.213 INFO:teuthology.orchestra.run.smithi083.stderr:131950K .......... .......... .......... .......... .......... 78% 29.4M 1s 2024-03-30T13:09:47.215 INFO:teuthology.orchestra.run.smithi083.stderr:132000K .......... .......... .......... .......... .......... 78% 29.4M 1s 2024-03-30T13:09:47.217 INFO:teuthology.orchestra.run.smithi083.stderr:132050K .......... .......... .......... .......... .......... 78% 29.9M 1s 2024-03-30T13:09:47.219 INFO:teuthology.orchestra.run.smithi083.stderr:132100K .......... .......... .......... .......... .......... 78% 24.8M 1s 2024-03-30T13:09:47.220 INFO:teuthology.orchestra.run.smithi083.stderr:132150K .......... .......... .......... .......... .......... 78% 28.8M 1s 2024-03-30T13:09:47.222 INFO:teuthology.orchestra.run.smithi083.stderr:132200K .......... .......... .......... .......... .......... 78% 27.1M 1s 2024-03-30T13:09:47.224 INFO:teuthology.orchestra.run.smithi083.stderr:132250K .......... .......... .......... .......... .......... 78% 24.3M 1s 2024-03-30T13:09:47.226 INFO:teuthology.orchestra.run.smithi083.stderr:132300K .......... .......... .......... .......... .......... 78% 20.8M 1s 2024-03-30T13:09:47.228 INFO:teuthology.orchestra.run.smithi083.stderr:132350K .......... .......... .......... .......... .......... 78% 24.6M 1s 2024-03-30T13:09:47.230 INFO:teuthology.orchestra.run.smithi083.stderr:132400K .......... .......... .......... .......... .......... 78% 23.3M 1s 2024-03-30T13:09:47.233 INFO:teuthology.orchestra.run.smithi083.stderr:132450K .......... .......... .......... .......... .......... 78% 23.3M 1s 2024-03-30T13:09:47.236 INFO:teuthology.orchestra.run.smithi083.stderr:132500K .......... .......... .......... .......... .......... 78% 17.9M 1s 2024-03-30T13:09:47.237 INFO:teuthology.orchestra.run.smithi083.stderr:132550K .......... .......... .......... .......... .......... 78% 23.8M 1s 2024-03-30T13:09:47.239 INFO:teuthology.orchestra.run.smithi083.stderr:132600K .......... .......... .......... .......... .......... 78% 22.6M 1s 2024-03-30T13:09:47.241 INFO:teuthology.orchestra.run.smithi083.stderr:132650K .......... .......... .......... .......... .......... 78% 23.1M 1s 2024-03-30T13:09:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:132700K .......... .......... .......... .......... .......... 78% 21.9M 1s 2024-03-30T13:09:47.246 INFO:teuthology.orchestra.run.smithi083.stderr:132750K .......... .......... .......... .......... .......... 78% 25.4M 1s 2024-03-30T13:09:47.248 INFO:teuthology.orchestra.run.smithi083.stderr:132800K .......... .......... .......... .......... .......... 78% 22.7M 1s 2024-03-30T13:09:47.250 INFO:teuthology.orchestra.run.smithi083.stderr:132850K .......... .......... .......... .......... .......... 78% 23.4M 1s 2024-03-30T13:09:47.253 INFO:teuthology.orchestra.run.smithi083.stderr:132900K .......... .......... .......... .......... .......... 78% 19.6M 1s 2024-03-30T13:09:47.255 INFO:teuthology.orchestra.run.smithi083.stderr:132950K .......... .......... .......... .......... .......... 78% 22.8M 1s 2024-03-30T13:09:47.257 INFO:teuthology.orchestra.run.smithi083.stderr:133000K .......... .......... .......... .......... .......... 78% 22.2M 1s 2024-03-30T13:09:47.259 INFO:teuthology.orchestra.run.smithi083.stderr:133050K .......... .......... .......... .......... .......... 78% 22.9M 1s 2024-03-30T13:09:47.262 INFO:teuthology.orchestra.run.smithi083.stderr:133100K .......... .......... .......... .......... .......... 78% 19.3M 1s 2024-03-30T13:09:47.264 INFO:teuthology.orchestra.run.smithi083.stderr:133150K .......... .......... .......... .......... .......... 79% 22.8M 1s 2024-03-30T13:09:47.266 INFO:teuthology.orchestra.run.smithi083.stderr:133200K .......... .......... .......... .......... .......... 79% 23.1M 1s 2024-03-30T13:09:47.268 INFO:teuthology.orchestra.run.smithi083.stderr:133250K .......... .......... .......... .......... .......... 79% 21.9M 1s 2024-03-30T13:09:47.270 INFO:teuthology.orchestra.run.smithi083.stderr:133300K .......... .......... .......... .......... .......... 79% 19.6M 1s 2024-03-30T13:09:47.273 INFO:teuthology.orchestra.run.smithi083.stderr:133350K .......... .......... .......... .......... .......... 79% 23.1M 1s 2024-03-30T13:09:47.274 INFO:teuthology.orchestra.run.smithi083.stderr:133400K .......... .......... .......... .......... .......... 79% 25.2M 1s 2024-03-30T13:09:47.276 INFO:teuthology.orchestra.run.smithi083.stderr:133450K .......... .......... .......... .......... .......... 79% 26.2M 1s 2024-03-30T13:09:47.279 INFO:teuthology.orchestra.run.smithi083.stderr:133500K .......... .......... .......... .......... .......... 79% 22.2M 1s 2024-03-30T13:09:47.281 INFO:teuthology.orchestra.run.smithi083.stderr:133550K .......... .......... .......... .......... .......... 79% 20.5M 1s 2024-03-30T13:09:47.283 INFO:teuthology.orchestra.run.smithi083.stderr:133600K .......... .......... .......... .......... .......... 79% 20.7M 1s 2024-03-30T13:09:47.286 INFO:teuthology.orchestra.run.smithi083.stderr:133650K .......... .......... .......... .......... .......... 79% 20.8M 1s 2024-03-30T13:09:47.289 INFO:teuthology.orchestra.run.smithi083.stderr:133700K .......... .......... .......... .......... .......... 79% 17.3M 1s 2024-03-30T13:09:47.291 INFO:teuthology.orchestra.run.smithi083.stderr:133750K .......... .......... .......... .......... .......... 79% 20.8M 1s 2024-03-30T13:09:47.293 INFO:teuthology.orchestra.run.smithi083.stderr:133800K .......... .......... .......... .......... .......... 79% 20.9M 1s 2024-03-30T13:09:47.296 INFO:teuthology.orchestra.run.smithi083.stderr:133850K .......... .......... .......... .......... .......... 79% 20.7M 1s 2024-03-30T13:09:47.298 INFO:teuthology.orchestra.run.smithi083.stderr:133900K .......... .......... .......... .......... .......... 79% 17.7M 1s 2024-03-30T13:09:47.301 INFO:teuthology.orchestra.run.smithi083.stderr:133950K .......... .......... .......... .......... .......... 79% 20.5M 1s 2024-03-30T13:09:47.303 INFO:teuthology.orchestra.run.smithi083.stderr:134000K .......... .......... .......... .......... .......... 79% 20.1M 1s 2024-03-30T13:09:47.306 INFO:teuthology.orchestra.run.smithi083.stderr:134050K .......... .......... .......... .......... .......... 79% 20.5M 1s 2024-03-30T13:09:47.308 INFO:teuthology.orchestra.run.smithi083.stderr:134100K .......... .......... .......... .......... .......... 79% 17.2M 1s 2024-03-30T13:09:47.311 INFO:teuthology.orchestra.run.smithi083.stderr:134150K .......... .......... .......... .......... .......... 79% 19.9M 1s 2024-03-30T13:09:47.313 INFO:teuthology.orchestra.run.smithi083.stderr:134200K .......... .......... .......... .......... .......... 79% 19.4M 1s 2024-03-30T13:09:47.316 INFO:teuthology.orchestra.run.smithi083.stderr:134250K .......... .......... .......... .......... .......... 79% 19.8M 1s 2024-03-30T13:09:47.319 INFO:teuthology.orchestra.run.smithi083.stderr:134300K .......... .......... .......... .......... .......... 79% 17.0M 1s 2024-03-30T13:09:47.321 INFO:teuthology.orchestra.run.smithi083.stderr:134350K .......... .......... .......... .......... .......... 79% 20.0M 1s 2024-03-30T13:09:47.324 INFO:teuthology.orchestra.run.smithi083.stderr:134400K .......... .......... .......... .......... .......... 79% 19.8M 1s 2024-03-30T13:09:47.326 INFO:teuthology.orchestra.run.smithi083.stderr:134450K .......... .......... .......... .......... .......... 79% 19.9M 1s 2024-03-30T13:09:47.329 INFO:teuthology.orchestra.run.smithi083.stderr:134500K .......... .......... .......... .......... .......... 79% 16.6M 1s 2024-03-30T13:09:47.331 INFO:teuthology.orchestra.run.smithi083.stderr:134550K .......... .......... .......... .......... .......... 79% 19.4M 1s 2024-03-30T13:09:47.334 INFO:teuthology.orchestra.run.smithi083.stderr:134600K .......... .......... .......... .......... .......... 79% 19.9M 1s 2024-03-30T13:09:47.336 INFO:teuthology.orchestra.run.smithi083.stderr:134650K .......... .......... .......... .......... .......... 79% 19.6M 1s 2024-03-30T13:09:47.342 INFO:teuthology.orchestra.run.smithi083.stderr:134700K .......... .......... .......... .......... .......... 79% 16.8M 1s 2024-03-30T13:09:47.342 INFO:teuthology.orchestra.run.smithi083.stderr:134750K .......... .......... .......... .......... .......... 79% 19.6M 1s 2024-03-30T13:09:47.344 INFO:teuthology.orchestra.run.smithi083.stderr:134800K .......... .......... .......... .......... .......... 79% 18.6M 1s 2024-03-30T13:09:47.347 INFO:teuthology.orchestra.run.smithi083.stderr:134850K .......... .......... .......... .......... .......... 80% 19.2M 1s 2024-03-30T13:09:47.350 INFO:teuthology.orchestra.run.smithi083.stderr:134900K .......... .......... .......... .......... .......... 80% 16.3M 1s 2024-03-30T13:09:47.353 INFO:teuthology.orchestra.run.smithi083.stderr:134950K .......... .......... .......... .......... .......... 80% 19.1M 1s 2024-03-30T13:09:47.355 INFO:teuthology.orchestra.run.smithi083.stderr:135000K .......... .......... .......... .......... .......... 80% 19.0M 1s 2024-03-30T13:09:47.358 INFO:teuthology.orchestra.run.smithi083.stderr:135050K .......... .......... .......... .......... .......... 80% 19.0M 1s 2024-03-30T13:09:47.361 INFO:teuthology.orchestra.run.smithi083.stderr:135100K .......... .......... .......... .......... .......... 80% 15.7M 1s 2024-03-30T13:09:47.363 INFO:teuthology.orchestra.run.smithi083.stderr:135150K .......... .......... .......... .......... .......... 80% 18.4M 1s 2024-03-30T13:09:47.365 INFO:teuthology.orchestra.run.smithi083.stderr:135200K .......... .......... .......... .......... .......... 80% 23.6M 1s 2024-03-30T13:09:47.367 INFO:teuthology.orchestra.run.smithi083.stderr:135250K .......... .......... .......... .......... .......... 80% 26.3M 1s 2024-03-30T13:09:47.369 INFO:teuthology.orchestra.run.smithi083.stderr:135300K .......... .......... .......... .......... .......... 80% 21.8M 1s 2024-03-30T13:09:47.371 INFO:teuthology.orchestra.run.smithi083.stderr:135350K .......... .......... .......... .......... .......... 80% 27.6M 1s 2024-03-30T13:09:47.373 INFO:teuthology.orchestra.run.smithi083.stderr:135400K .......... .......... .......... .......... .......... 80% 26.9M 1s 2024-03-30T13:09:47.375 INFO:teuthology.orchestra.run.smithi083.stderr:135450K .......... .......... .......... .......... .......... 80% 27.1M 1s 2024-03-30T13:09:47.377 INFO:teuthology.orchestra.run.smithi083.stderr:135500K .......... .......... .......... .......... .......... 80% 22.8M 1s 2024-03-30T13:09:47.379 INFO:teuthology.orchestra.run.smithi083.stderr:135550K .......... .......... .......... .......... .......... 80% 26.0M 1s 2024-03-30T13:09:47.381 INFO:teuthology.orchestra.run.smithi083.stderr:135600K .......... .......... .......... .......... .......... 80% 26.4M 1s 2024-03-30T13:09:47.383 INFO:teuthology.orchestra.run.smithi083.stderr:135650K .......... .......... .......... .......... .......... 80% 22.3M 1s 2024-03-30T13:09:47.385 INFO:teuthology.orchestra.run.smithi083.stderr:135700K .......... .......... .......... .......... .......... 80% 20.1M 1s 2024-03-30T13:09:47.388 INFO:teuthology.orchestra.run.smithi083.stderr:135750K .......... .......... .......... .......... .......... 80% 22.8M 1s 2024-03-30T13:09:47.390 INFO:teuthology.orchestra.run.smithi083.stderr:135800K .......... .......... .......... .......... .......... 80% 22.3M 1s 2024-03-30T13:09:47.391 INFO:teuthology.orchestra.run.smithi083.stderr:135850K .......... .......... .......... .......... .......... 80% 31.4M 1s 2024-03-30T13:09:47.393 INFO:teuthology.orchestra.run.smithi083.stderr:135900K .......... .......... .......... .......... .......... 80% 31.2M 1s 2024-03-30T13:09:47.394 INFO:teuthology.orchestra.run.smithi083.stderr:135950K .......... .......... .......... .......... .......... 80% 35.3M 1s 2024-03-30T13:09:47.396 INFO:teuthology.orchestra.run.smithi083.stderr:136000K .......... .......... .......... .......... .......... 80% 37.1M 1s 2024-03-30T13:09:47.397 INFO:teuthology.orchestra.run.smithi083.stderr:136050K .......... .......... .......... .......... .......... 80% 37.0M 1s 2024-03-30T13:09:47.398 INFO:teuthology.orchestra.run.smithi083.stderr:136100K .......... .......... .......... .......... .......... 80% 31.0M 1s 2024-03-30T13:09:47.400 INFO:teuthology.orchestra.run.smithi083.stderr:136150K .......... .......... .......... .......... .......... 80% 35.3M 1s 2024-03-30T13:09:47.401 INFO:teuthology.orchestra.run.smithi083.stderr:136200K .......... .......... .......... .......... .......... 80% 35.4M 1s 2024-03-30T13:09:47.403 INFO:teuthology.orchestra.run.smithi083.stderr:136250K .......... .......... .......... .......... .......... 80% 34.6M 1s 2024-03-30T13:09:47.404 INFO:teuthology.orchestra.run.smithi083.stderr:136300K .......... .......... .......... .......... .......... 80% 30.4M 1s 2024-03-30T13:09:47.405 INFO:teuthology.orchestra.run.smithi083.stderr:136350K .......... .......... .......... .......... .......... 80% 34.9M 1s 2024-03-30T13:09:47.407 INFO:teuthology.orchestra.run.smithi083.stderr:136400K .......... .......... .......... .......... .......... 80% 33.7M 1s 2024-03-30T13:09:47.409 INFO:teuthology.orchestra.run.smithi083.stderr:136450K .......... .......... .......... .......... .......... 80% 32.5M 1s 2024-03-30T13:09:47.410 INFO:teuthology.orchestra.run.smithi083.stderr:136500K .......... .......... .......... .......... .......... 81% 28.1M 1s 2024-03-30T13:09:47.412 INFO:teuthology.orchestra.run.smithi083.stderr:136550K .......... .......... .......... .......... .......... 81% 30.4M 1s 2024-03-30T13:09:47.413 INFO:teuthology.orchestra.run.smithi083.stderr:136600K .......... .......... .......... .......... .......... 81% 31.3M 1s 2024-03-30T13:09:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:136650K .......... .......... .......... .......... .......... 81% 31.5M 1s 2024-03-30T13:09:47.417 INFO:teuthology.orchestra.run.smithi083.stderr:136700K .......... .......... .......... .......... .......... 81% 27.7M 1s 2024-03-30T13:09:47.418 INFO:teuthology.orchestra.run.smithi083.stderr:136750K .......... .......... .......... .......... .......... 81% 31.5M 1s 2024-03-30T13:09:47.420 INFO:teuthology.orchestra.run.smithi083.stderr:136800K .......... .......... .......... .......... .......... 81% 32.4M 1s 2024-03-30T13:09:47.421 INFO:teuthology.orchestra.run.smithi083.stderr:136850K .......... .......... .......... .......... .......... 81% 32.1M 1s 2024-03-30T13:09:47.423 INFO:teuthology.orchestra.run.smithi083.stderr:136900K .......... .......... .......... .......... .......... 81% 25.6M 1s 2024-03-30T13:09:47.425 INFO:teuthology.orchestra.run.smithi083.stderr:136950K .......... .......... .......... .......... .......... 81% 24.5M 1s 2024-03-30T13:09:47.427 INFO:teuthology.orchestra.run.smithi083.stderr:137000K .......... .......... .......... .......... .......... 81% 27.1M 1s 2024-03-30T13:09:47.429 INFO:teuthology.orchestra.run.smithi083.stderr:137050K .......... .......... .......... .......... .......... 81% 26.6M 1s 2024-03-30T13:09:47.431 INFO:teuthology.orchestra.run.smithi083.stderr:137100K .......... .......... .......... .......... .......... 81% 22.5M 1s 2024-03-30T13:09:47.433 INFO:teuthology.orchestra.run.smithi083.stderr:137150K .......... .......... .......... .......... .......... 81% 25.6M 1s 2024-03-30T13:09:47.435 INFO:teuthology.orchestra.run.smithi083.stderr:137200K .......... .......... .......... .......... .......... 81% 26.4M 1s 2024-03-30T13:09:47.437 INFO:teuthology.orchestra.run.smithi083.stderr:137250K .......... .......... .......... .......... .......... 81% 27.6M 1s 2024-03-30T13:09:47.439 INFO:teuthology.orchestra.run.smithi083.stderr:137300K .......... .......... .......... .......... .......... 81% 22.6M 1s 2024-03-30T13:09:47.441 INFO:teuthology.orchestra.run.smithi083.stderr:137350K .......... .......... .......... .......... .......... 81% 24.2M 1s 2024-03-30T13:09:47.443 INFO:teuthology.orchestra.run.smithi083.stderr:137400K .......... .......... .......... .......... .......... 81% 23.8M 1s 2024-03-30T13:09:47.445 INFO:teuthology.orchestra.run.smithi083.stderr:137450K .......... .......... .......... .......... .......... 81% 24.9M 1s 2024-03-30T13:09:47.447 INFO:teuthology.orchestra.run.smithi083.stderr:137500K .......... .......... .......... .......... .......... 81% 21.3M 1s 2024-03-30T13:09:47.449 INFO:teuthology.orchestra.run.smithi083.stderr:137550K .......... .......... .......... .......... .......... 81% 23.1M 1s 2024-03-30T13:09:47.451 INFO:teuthology.orchestra.run.smithi083.stderr:137600K .......... .......... .......... .......... .......... 81% 23.6M 1s 2024-03-30T13:09:47.453 INFO:teuthology.orchestra.run.smithi083.stderr:137650K .......... .......... .......... .......... .......... 81% 28.4M 1s 2024-03-30T13:09:47.455 INFO:teuthology.orchestra.run.smithi083.stderr:137700K .......... .......... .......... .......... .......... 81% 23.9M 1s 2024-03-30T13:09:47.457 INFO:teuthology.orchestra.run.smithi083.stderr:137750K .......... .......... .......... .......... .......... 81% 28.3M 1s 2024-03-30T13:09:47.459 INFO:teuthology.orchestra.run.smithi083.stderr:137800K .......... .......... .......... .......... .......... 81% 27.8M 1s 2024-03-30T13:09:47.460 INFO:teuthology.orchestra.run.smithi083.stderr:137850K .......... .......... .......... .......... .......... 81% 28.1M 1s 2024-03-30T13:09:47.462 INFO:teuthology.orchestra.run.smithi083.stderr:137900K .......... .......... .......... .......... .......... 81% 24.0M 1s 2024-03-30T13:09:47.464 INFO:teuthology.orchestra.run.smithi083.stderr:137950K .......... .......... .......... .......... .......... 81% 24.5M 1s 2024-03-30T13:09:47.467 INFO:teuthology.orchestra.run.smithi083.stderr:138000K .......... .......... .......... .......... .......... 81% 26.7M 1s 2024-03-30T13:09:47.468 INFO:teuthology.orchestra.run.smithi083.stderr:138050K .......... .......... .......... .......... .......... 81% 27.2M 1s 2024-03-30T13:09:47.470 INFO:teuthology.orchestra.run.smithi083.stderr:138100K .......... .......... .......... .......... .......... 81% 22.8M 1s 2024-03-30T13:09:47.472 INFO:teuthology.orchestra.run.smithi083.stderr:138150K .......... .......... .......... .......... .......... 81% 27.1M 1s 2024-03-30T13:09:47.474 INFO:teuthology.orchestra.run.smithi083.stderr:138200K .......... .......... .......... .......... .......... 82% 27.3M 1s 2024-03-30T13:09:47.475 INFO:teuthology.orchestra.run.smithi083.stderr:138250K .......... .......... .......... .......... .......... 82% 26.7M 1s 2024-03-30T13:09:47.478 INFO:teuthology.orchestra.run.smithi083.stderr:138300K .......... .......... .......... .......... .......... 82% 22.9M 1s 2024-03-30T13:09:47.479 INFO:teuthology.orchestra.run.smithi083.stderr:138350K .......... .......... .......... .......... .......... 82% 26.5M 1s 2024-03-30T13:09:47.481 INFO:teuthology.orchestra.run.smithi083.stderr:138400K .......... .......... .......... .......... .......... 82% 26.6M 1s 2024-03-30T13:09:47.483 INFO:teuthology.orchestra.run.smithi083.stderr:138450K .......... .......... .......... .......... .......... 82% 26.2M 1s 2024-03-30T13:09:47.485 INFO:teuthology.orchestra.run.smithi083.stderr:138500K .......... .......... .......... .......... .......... 82% 22.0M 1s 2024-03-30T13:09:47.488 INFO:teuthology.orchestra.run.smithi083.stderr:138550K .......... .......... .......... .......... .......... 82% 24.5M 1s 2024-03-30T13:09:47.489 INFO:teuthology.orchestra.run.smithi083.stderr:138600K .......... .......... .......... .......... .......... 82% 25.5M 1s 2024-03-30T13:09:47.492 INFO:teuthology.orchestra.run.smithi083.stderr:138650K .......... .......... .......... .......... .......... 82% 19.2M 1s 2024-03-30T13:09:47.496 INFO:teuthology.orchestra.run.smithi083.stderr:138700K .......... .......... .......... .......... .......... 82% 13.9M 1s 2024-03-30T13:09:47.499 INFO:teuthology.orchestra.run.smithi083.stderr:138750K .......... .......... .......... .......... .......... 82% 16.4M 1s 2024-03-30T13:09:47.501 INFO:teuthology.orchestra.run.smithi083.stderr:138800K .......... .......... .......... .......... .......... 82% 17.6M 1s 2024-03-30T13:09:47.505 INFO:teuthology.orchestra.run.smithi083.stderr:138850K .......... .......... .......... .......... .......... 82% 15.9M 1s 2024-03-30T13:09:47.509 INFO:teuthology.orchestra.run.smithi083.stderr:138900K .......... .......... .......... .......... .......... 82% 12.9M 1s 2024-03-30T13:09:47.511 INFO:teuthology.orchestra.run.smithi083.stderr:138950K .......... .......... .......... .......... .......... 82% 16.2M 1s 2024-03-30T13:09:47.515 INFO:teuthology.orchestra.run.smithi083.stderr:139000K .......... .......... .......... .......... .......... 82% 13.7M 1s 2024-03-30T13:09:47.519 INFO:teuthology.orchestra.run.smithi083.stderr:139050K .......... .......... .......... .......... .......... 82% 12.6M 1s 2024-03-30T13:09:47.522 INFO:teuthology.orchestra.run.smithi083.stderr:139100K .......... .......... .......... .......... .......... 82% 12.9M 1s 2024-03-30T13:09:47.526 INFO:teuthology.orchestra.run.smithi083.stderr:139150K .......... .......... .......... .......... .......... 82% 16.0M 1s 2024-03-30T13:09:47.529 INFO:teuthology.orchestra.run.smithi083.stderr:139200K .......... .......... .......... .......... .......... 82% 13.7M 1s 2024-03-30T13:09:47.532 INFO:teuthology.orchestra.run.smithi083.stderr:139250K .......... .......... .......... .......... .......... 82% 17.0M 1s 2024-03-30T13:09:47.534 INFO:teuthology.orchestra.run.smithi083.stderr:139300K .......... .......... .......... .......... .......... 82% 22.5M 1s 2024-03-30T13:09:47.535 INFO:teuthology.orchestra.run.smithi083.stderr:139350K .......... .......... .......... .......... .......... 82% 28.4M 1s 2024-03-30T13:09:47.537 INFO:teuthology.orchestra.run.smithi083.stderr:139400K .......... .......... .......... .......... .......... 82% 28.5M 1s 2024-03-30T13:09:47.546 INFO:teuthology.orchestra.run.smithi083.stderr:139450K .......... .......... .......... .......... .......... 82% 24.4M 1s 2024-03-30T13:09:47.546 INFO:teuthology.orchestra.run.smithi083.stderr:139500K .......... .......... .......... .......... .......... 82% 25.2M 1s 2024-03-30T13:09:47.546 INFO:teuthology.orchestra.run.smithi083.stderr:139550K .......... .......... .......... .......... .......... 82% 29.2M 1s 2024-03-30T13:09:47.546 INFO:teuthology.orchestra.run.smithi083.stderr:139600K .......... .......... .......... .......... .......... 82% 29.0M 1s 2024-03-30T13:09:47.547 INFO:teuthology.orchestra.run.smithi083.stderr:139650K .......... .......... .......... .......... .......... 82% 28.6M 1s 2024-03-30T13:09:47.548 INFO:teuthology.orchestra.run.smithi083.stderr:139700K .......... .......... .......... .......... .......... 82% 24.7M 1s 2024-03-30T13:09:47.550 INFO:teuthology.orchestra.run.smithi083.stderr:139750K .......... .......... .......... .......... .......... 82% 27.6M 1s 2024-03-30T13:09:47.552 INFO:teuthology.orchestra.run.smithi083.stderr:139800K .......... .......... .......... .......... .......... 82% 28.0M 1s 2024-03-30T13:09:47.553 INFO:teuthology.orchestra.run.smithi083.stderr:139850K .......... .......... .......... .......... .......... 82% 27.9M 1s 2024-03-30T13:09:47.556 INFO:teuthology.orchestra.run.smithi083.stderr:139900K .......... .......... .......... .......... .......... 83% 22.6M 1s 2024-03-30T13:09:47.558 INFO:teuthology.orchestra.run.smithi083.stderr:139950K .......... .......... .......... .......... .......... 83% 25.2M 1s 2024-03-30T13:09:47.559 INFO:teuthology.orchestra.run.smithi083.stderr:140000K .......... .......... .......... .......... .......... 83% 27.4M 1s 2024-03-30T13:09:47.561 INFO:teuthology.orchestra.run.smithi083.stderr:140050K .......... .......... .......... .......... .......... 83% 27.7M 1s 2024-03-30T13:09:47.566 INFO:teuthology.orchestra.run.smithi083.stderr:140100K .......... .......... .......... .......... .......... 83% 23.6M 1s 2024-03-30T13:09:47.566 INFO:teuthology.orchestra.run.smithi083.stderr:140150K .......... .......... .......... .......... .......... 83% 27.3M 1s 2024-03-30T13:09:47.567 INFO:teuthology.orchestra.run.smithi083.stderr:140200K .......... .......... .......... .......... .......... 83% 26.5M 1s 2024-03-30T13:09:47.569 INFO:teuthology.orchestra.run.smithi083.stderr:140250K .......... .......... .......... .......... .......... 83% 28.0M 1s 2024-03-30T13:09:47.571 INFO:teuthology.orchestra.run.smithi083.stderr:140300K .......... .......... .......... .......... .......... 83% 22.3M 1s 2024-03-30T13:09:47.573 INFO:teuthology.orchestra.run.smithi083.stderr:140350K .......... .......... .......... .......... .......... 83% 27.1M 1s 2024-03-30T13:09:47.574 INFO:teuthology.orchestra.run.smithi083.stderr:140400K .......... .......... .......... .......... .......... 83% 26.2M 1s 2024-03-30T13:09:47.576 INFO:teuthology.orchestra.run.smithi083.stderr:140450K .......... .......... .......... .......... .......... 83% 27.0M 1s 2024-03-30T13:09:47.578 INFO:teuthology.orchestra.run.smithi083.stderr:140500K .......... .......... .......... .......... .......... 83% 22.8M 1s 2024-03-30T13:09:47.580 INFO:teuthology.orchestra.run.smithi083.stderr:140550K .......... .......... .......... .......... .......... 83% 26.9M 1s 2024-03-30T13:09:47.582 INFO:teuthology.orchestra.run.smithi083.stderr:140600K .......... .......... .......... .......... .......... 83% 26.3M 1s 2024-03-30T13:09:47.585 INFO:teuthology.orchestra.run.smithi083.stderr:140650K .......... .......... .......... .......... .......... 83% 26.5M 1s 2024-03-30T13:09:47.586 INFO:teuthology.orchestra.run.smithi083.stderr:140700K .......... .......... .......... .......... .......... 83% 22.4M 1s 2024-03-30T13:09:47.588 INFO:teuthology.orchestra.run.smithi083.stderr:140750K .......... .......... .......... .......... .......... 83% 26.1M 1s 2024-03-30T13:09:47.590 INFO:teuthology.orchestra.run.smithi083.stderr:140800K .......... .......... .......... .......... .......... 83% 26.1M 1s 2024-03-30T13:09:47.592 INFO:teuthology.orchestra.run.smithi083.stderr:140850K .......... .......... .......... .......... .......... 83% 25.7M 1s 2024-03-30T13:09:47.594 INFO:teuthology.orchestra.run.smithi083.stderr:140900K .......... .......... .......... .......... .......... 83% 22.0M 1s 2024-03-30T13:09:47.596 INFO:teuthology.orchestra.run.smithi083.stderr:140950K .......... .......... .......... .......... .......... 83% 26.1M 1s 2024-03-30T13:09:47.598 INFO:teuthology.orchestra.run.smithi083.stderr:141000K .......... .......... .......... .......... .......... 83% 25.4M 1s 2024-03-30T13:09:47.600 INFO:teuthology.orchestra.run.smithi083.stderr:141050K .......... .......... .......... .......... .......... 83% 25.4M 1s 2024-03-30T13:09:47.602 INFO:teuthology.orchestra.run.smithi083.stderr:141100K .......... .......... .......... .......... .......... 83% 21.9M 1s 2024-03-30T13:09:47.604 INFO:teuthology.orchestra.run.smithi083.stderr:141150K .......... .......... .......... .......... .......... 83% 25.4M 1s 2024-03-30T13:09:47.606 INFO:teuthology.orchestra.run.smithi083.stderr:141200K .......... .......... .......... .......... .......... 83% 24.6M 1s 2024-03-30T13:09:47.608 INFO:teuthology.orchestra.run.smithi083.stderr:141250K .......... .......... .......... .......... .......... 83% 23.7M 1s 2024-03-30T13:09:47.610 INFO:teuthology.orchestra.run.smithi083.stderr:141300K .......... .......... .......... .......... .......... 83% 21.3M 1s 2024-03-30T13:09:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:141350K .......... .......... .......... .......... .......... 83% 24.5M 1s 2024-03-30T13:09:47.614 INFO:teuthology.orchestra.run.smithi083.stderr:141400K .......... .......... .......... .......... .......... 83% 24.3M 1s 2024-03-30T13:09:47.616 INFO:teuthology.orchestra.run.smithi083.stderr:141450K .......... .......... .......... .......... .......... 83% 24.9M 1s 2024-03-30T13:09:47.618 INFO:teuthology.orchestra.run.smithi083.stderr:141500K .......... .......... .......... .......... .......... 83% 20.2M 1s 2024-03-30T13:09:47.620 INFO:teuthology.orchestra.run.smithi083.stderr:141550K .......... .......... .......... .......... .......... 84% 24.6M 1s 2024-03-30T13:09:47.623 INFO:teuthology.orchestra.run.smithi083.stderr:141600K .......... .......... .......... .......... .......... 84% 23.7M 1s 2024-03-30T13:09:47.624 INFO:teuthology.orchestra.run.smithi083.stderr:141650K .......... .......... .......... .......... .......... 84% 24.6M 1s 2024-03-30T13:09:47.627 INFO:teuthology.orchestra.run.smithi083.stderr:141700K .......... .......... .......... .......... .......... 84% 19.5M 1s 2024-03-30T13:09:47.629 INFO:teuthology.orchestra.run.smithi083.stderr:141750K .......... .......... .......... .......... .......... 84% 23.4M 1s 2024-03-30T13:09:47.631 INFO:teuthology.orchestra.run.smithi083.stderr:141800K .......... .......... .......... .......... .......... 84% 22.6M 1s 2024-03-30T13:09:47.633 INFO:teuthology.orchestra.run.smithi083.stderr:141850K .......... .......... .......... .......... .......... 84% 24.1M 1s 2024-03-30T13:09:47.636 INFO:teuthology.orchestra.run.smithi083.stderr:141900K .......... .......... .......... .......... .......... 84% 20.3M 1s 2024-03-30T13:09:47.638 INFO:teuthology.orchestra.run.smithi083.stderr:141950K .......... .......... .......... .......... .......... 84% 23.5M 1s 2024-03-30T13:09:47.640 INFO:teuthology.orchestra.run.smithi083.stderr:142000K .......... .......... .......... .......... .......... 84% 22.8M 1s 2024-03-30T13:09:47.642 INFO:teuthology.orchestra.run.smithi083.stderr:142050K .......... .......... .......... .......... .......... 84% 23.8M 1s 2024-03-30T13:09:47.644 INFO:teuthology.orchestra.run.smithi083.stderr:142100K .......... .......... .......... .......... .......... 84% 20.2M 1s 2024-03-30T13:09:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:142150K .......... .......... .......... .......... .......... 84% 22.3M 1s 2024-03-30T13:09:47.649 INFO:teuthology.orchestra.run.smithi083.stderr:142200K .......... .......... .......... .......... .......... 84% 22.6M 1s 2024-03-30T13:09:47.651 INFO:teuthology.orchestra.run.smithi083.stderr:142250K .......... .......... .......... .......... .......... 84% 22.9M 1s 2024-03-30T13:09:47.653 INFO:teuthology.orchestra.run.smithi083.stderr:142300K .......... .......... .......... .......... .......... 84% 19.9M 1s 2024-03-30T13:09:47.656 INFO:teuthology.orchestra.run.smithi083.stderr:142350K .......... .......... .......... .......... .......... 84% 22.7M 1s 2024-03-30T13:09:47.658 INFO:teuthology.orchestra.run.smithi083.stderr:142400K .......... .......... .......... .......... .......... 84% 22.5M 1s 2024-03-30T13:09:47.660 INFO:teuthology.orchestra.run.smithi083.stderr:142450K .......... .......... .......... .......... .......... 84% 22.3M 1s 2024-03-30T13:09:47.662 INFO:teuthology.orchestra.run.smithi083.stderr:142500K .......... .......... .......... .......... .......... 84% 19.1M 1s 2024-03-30T13:09:47.665 INFO:teuthology.orchestra.run.smithi083.stderr:142550K .......... .......... .......... .......... .......... 84% 22.6M 1s 2024-03-30T13:09:47.667 INFO:teuthology.orchestra.run.smithi083.stderr:142600K .......... .......... .......... .......... .......... 84% 21.9M 1s 2024-03-30T13:09:47.669 INFO:teuthology.orchestra.run.smithi083.stderr:142650K .......... .......... .......... .......... .......... 84% 21.7M 1s 2024-03-30T13:09:47.672 INFO:teuthology.orchestra.run.smithi083.stderr:142700K .......... .......... .......... .......... .......... 84% 18.7M 1s 2024-03-30T13:09:47.674 INFO:teuthology.orchestra.run.smithi083.stderr:142750K .......... .......... .......... .......... .......... 84% 22.0M 1s 2024-03-30T13:09:47.676 INFO:teuthology.orchestra.run.smithi083.stderr:142800K .......... .......... .......... .......... .......... 84% 21.7M 1s 2024-03-30T13:09:47.678 INFO:teuthology.orchestra.run.smithi083.stderr:142850K .......... .......... .......... .......... .......... 84% 21.3M 1s 2024-03-30T13:09:47.681 INFO:teuthology.orchestra.run.smithi083.stderr:142900K .......... .......... .......... .......... .......... 84% 18.6M 1s 2024-03-30T13:09:47.683 INFO:teuthology.orchestra.run.smithi083.stderr:142950K .......... .......... .......... .......... .......... 84% 21.6M 1s 2024-03-30T13:09:47.686 INFO:teuthology.orchestra.run.smithi083.stderr:143000K .......... .......... .......... .......... .......... 84% 19.7M 1s 2024-03-30T13:09:47.688 INFO:teuthology.orchestra.run.smithi083.stderr:143050K .......... .......... .......... .......... .......... 84% 19.5M 1s 2024-03-30T13:09:47.692 INFO:teuthology.orchestra.run.smithi083.stderr:143100K .......... .......... .......... .......... .......... 84% 15.8M 1s 2024-03-30T13:09:47.694 INFO:teuthology.orchestra.run.smithi083.stderr:143150K .......... .......... .......... .......... .......... 84% 18.8M 1s 2024-03-30T13:09:47.697 INFO:teuthology.orchestra.run.smithi083.stderr:143200K .......... .......... .......... .......... .......... 84% 18.8M 1s 2024-03-30T13:09:47.700 INFO:teuthology.orchestra.run.smithi083.stderr:143250K .......... .......... .......... .......... .......... 85% 17.5M 1s 2024-03-30T13:09:47.703 INFO:teuthology.orchestra.run.smithi083.stderr:143300K .......... .......... .......... .......... .......... 85% 15.9M 1s 2024-03-30T13:09:47.705 INFO:teuthology.orchestra.run.smithi083.stderr:143350K .......... .......... .......... .......... .......... 85% 22.5M 1s 2024-03-30T13:09:47.706 INFO:teuthology.orchestra.run.smithi083.stderr:143400K .......... .......... .......... .......... .......... 85% 29.1M 1s 2024-03-30T13:09:47.708 INFO:teuthology.orchestra.run.smithi083.stderr:143450K .......... .......... .......... .......... .......... 85% 26.8M 1s 2024-03-30T13:09:47.710 INFO:teuthology.orchestra.run.smithi083.stderr:143500K .......... .......... .......... .......... .......... 85% 23.1M 1s 2024-03-30T13:09:47.712 INFO:teuthology.orchestra.run.smithi083.stderr:143550K .......... .......... .......... .......... .......... 85% 37.7M 1s 2024-03-30T13:09:47.713 INFO:teuthology.orchestra.run.smithi083.stderr:143600K .......... .......... .......... .......... .......... 85% 36.5M 1s 2024-03-30T13:09:47.714 INFO:teuthology.orchestra.run.smithi083.stderr:143650K .......... .......... .......... .......... .......... 85% 35.4M 1s 2024-03-30T13:09:47.716 INFO:teuthology.orchestra.run.smithi083.stderr:143700K .......... .......... .......... .......... .......... 85% 31.4M 1s 2024-03-30T13:09:47.717 INFO:teuthology.orchestra.run.smithi083.stderr:143750K .......... .......... .......... .......... .......... 85% 37.3M 1s 2024-03-30T13:09:47.719 INFO:teuthology.orchestra.run.smithi083.stderr:143800K .......... .......... .......... .......... .......... 85% 31.3M 1s 2024-03-30T13:09:47.720 INFO:teuthology.orchestra.run.smithi083.stderr:143850K .......... .......... .......... .......... .......... 85% 31.4M 1s 2024-03-30T13:09:47.722 INFO:teuthology.orchestra.run.smithi083.stderr:143900K .......... .......... .......... .......... .......... 85% 26.2M 1s 2024-03-30T13:09:47.724 INFO:teuthology.orchestra.run.smithi083.stderr:143950K .......... .......... .......... .......... .......... 85% 31.0M 1s 2024-03-30T13:09:47.725 INFO:teuthology.orchestra.run.smithi083.stderr:144000K .......... .......... .......... .......... .......... 85% 31.5M 1s 2024-03-30T13:09:47.727 INFO:teuthology.orchestra.run.smithi083.stderr:144050K .......... .......... .......... .......... .......... 85% 30.3M 1s 2024-03-30T13:09:47.730 INFO:teuthology.orchestra.run.smithi083.stderr:144100K .......... .......... .......... .......... .......... 85% 23.8M 1s 2024-03-30T13:09:47.731 INFO:teuthology.orchestra.run.smithi083.stderr:144150K .......... .......... .......... .......... .......... 85% 23.3M 1s 2024-03-30T13:09:47.733 INFO:teuthology.orchestra.run.smithi083.stderr:144200K .......... .......... .......... .......... .......... 85% 26.3M 1s 2024-03-30T13:09:47.735 INFO:teuthology.orchestra.run.smithi083.stderr:144250K .......... .......... .......... .......... .......... 85% 25.5M 1s 2024-03-30T13:09:47.737 INFO:teuthology.orchestra.run.smithi083.stderr:144300K .......... .......... .......... .......... .......... 85% 23.3M 1s 2024-03-30T13:09:47.739 INFO:teuthology.orchestra.run.smithi083.stderr:144350K .......... .......... .......... .......... .......... 85% 25.1M 1s 2024-03-30T13:09:47.741 INFO:teuthology.orchestra.run.smithi083.stderr:144400K .......... .......... .......... .......... .......... 85% 25.8M 1s 2024-03-30T13:09:47.745 INFO:teuthology.orchestra.run.smithi083.stderr:144450K .......... .......... .......... .......... .......... 85% 27.2M 1s 2024-03-30T13:09:47.749 INFO:teuthology.orchestra.run.smithi083.stderr:144500K .......... .......... .......... .......... .......... 85% 23.5M 1s 2024-03-30T13:09:47.749 INFO:teuthology.orchestra.run.smithi083.stderr:144550K .......... .......... .......... .......... .......... 85% 27.0M 1s 2024-03-30T13:09:47.749 INFO:teuthology.orchestra.run.smithi083.stderr:144600K .......... .......... .......... .......... .......... 85% 27.4M 1s 2024-03-30T13:09:47.750 INFO:teuthology.orchestra.run.smithi083.stderr:144650K .......... .......... .......... .......... .......... 85% 26.0M 1s 2024-03-30T13:09:47.752 INFO:teuthology.orchestra.run.smithi083.stderr:144700K .......... .......... .......... .......... .......... 85% 22.0M 1s 2024-03-30T13:09:47.754 INFO:teuthology.orchestra.run.smithi083.stderr:144750K .......... .......... .......... .......... .......... 85% 26.2M 1s 2024-03-30T13:09:47.756 INFO:teuthology.orchestra.run.smithi083.stderr:144800K .......... .......... .......... .......... .......... 85% 26.2M 1s 2024-03-30T13:09:47.758 INFO:teuthology.orchestra.run.smithi083.stderr:144850K .......... .......... .......... .......... .......... 85% 26.2M 1s 2024-03-30T13:09:47.760 INFO:teuthology.orchestra.run.smithi083.stderr:144900K .......... .......... .......... .......... .......... 85% 21.7M 1s 2024-03-30T13:09:47.762 INFO:teuthology.orchestra.run.smithi083.stderr:144950K .......... .......... .......... .......... .......... 86% 26.9M 1s 2024-03-30T13:09:47.764 INFO:teuthology.orchestra.run.smithi083.stderr:145000K .......... .......... .......... .......... .......... 86% 20.5M 1s 2024-03-30T13:09:47.766 INFO:teuthology.orchestra.run.smithi083.stderr:145050K .......... .......... .......... .......... .......... 86% 23.0M 1s 2024-03-30T13:09:47.769 INFO:teuthology.orchestra.run.smithi083.stderr:145100K .......... .......... .......... .......... .......... 86% 18.6M 1s 2024-03-30T13:09:47.771 INFO:teuthology.orchestra.run.smithi083.stderr:145150K .......... .......... .......... .......... .......... 86% 21.7M 1s 2024-03-30T13:09:47.774 INFO:teuthology.orchestra.run.smithi083.stderr:145200K .......... .......... .......... .......... .......... 86% 22.1M 1s 2024-03-30T13:09:47.776 INFO:teuthology.orchestra.run.smithi083.stderr:145250K .......... .......... .......... .......... .......... 86% 22.1M 1s 2024-03-30T13:09:47.778 INFO:teuthology.orchestra.run.smithi083.stderr:145300K .......... .......... .......... .......... .......... 86% 19.1M 1s 2024-03-30T13:09:47.781 INFO:teuthology.orchestra.run.smithi083.stderr:145350K .......... .......... .......... .......... .......... 86% 20.7M 1s 2024-03-30T13:09:47.783 INFO:teuthology.orchestra.run.smithi083.stderr:145400K .......... .......... .......... .......... .......... 86% 21.8M 1s 2024-03-30T13:09:47.785 INFO:teuthology.orchestra.run.smithi083.stderr:145450K .......... .......... .......... .......... .......... 86% 21.6M 1s 2024-03-30T13:09:47.788 INFO:teuthology.orchestra.run.smithi083.stderr:145500K .......... .......... .......... .......... .......... 86% 18.7M 1s 2024-03-30T13:09:47.790 INFO:teuthology.orchestra.run.smithi083.stderr:145550K .......... .......... .......... .......... .......... 86% 21.2M 1s 2024-03-30T13:09:47.792 INFO:teuthology.orchestra.run.smithi083.stderr:145600K .......... .......... .......... .......... .......... 86% 21.1M 1s 2024-03-30T13:09:47.795 INFO:teuthology.orchestra.run.smithi083.stderr:145650K .......... .......... .......... .......... .......... 86% 21.1M 1s 2024-03-30T13:09:47.797 INFO:teuthology.orchestra.run.smithi083.stderr:145700K .......... .......... .......... .......... .......... 86% 18.6M 1s 2024-03-30T13:09:47.800 INFO:teuthology.orchestra.run.smithi083.stderr:145750K .......... .......... .......... .......... .......... 86% 21.4M 1s 2024-03-30T13:09:47.802 INFO:teuthology.orchestra.run.smithi083.stderr:145800K .......... .......... .......... .......... .......... 86% 20.8M 1s 2024-03-30T13:09:47.804 INFO:teuthology.orchestra.run.smithi083.stderr:145850K .......... .......... .......... .......... .......... 86% 21.4M 1s 2024-03-30T13:09:47.807 INFO:teuthology.orchestra.run.smithi083.stderr:145900K .......... .......... .......... .......... .......... 86% 18.0M 1s 2024-03-30T13:09:47.809 INFO:teuthology.orchestra.run.smithi083.stderr:145950K .......... .......... .......... .......... .......... 86% 21.3M 1s 2024-03-30T13:09:47.812 INFO:teuthology.orchestra.run.smithi083.stderr:146000K .......... .......... .......... .......... .......... 86% 20.3M 1s 2024-03-30T13:09:47.814 INFO:teuthology.orchestra.run.smithi083.stderr:146050K .......... .......... .......... .......... .......... 86% 20.3M 1s 2024-03-30T13:09:47.817 INFO:teuthology.orchestra.run.smithi083.stderr:146100K .......... .......... .......... .......... .......... 86% 17.3M 1s 2024-03-30T13:09:47.820 INFO:teuthology.orchestra.run.smithi083.stderr:146150K .......... .......... .......... .......... .......... 86% 16.7M 1s 2024-03-30T13:09:47.823 INFO:teuthology.orchestra.run.smithi083.stderr:146200K .......... .......... .......... .......... .......... 86% 17.9M 1s 2024-03-30T13:09:47.825 INFO:teuthology.orchestra.run.smithi083.stderr:146250K .......... .......... .......... .......... .......... 86% 18.2M 1s 2024-03-30T13:09:47.829 INFO:teuthology.orchestra.run.smithi083.stderr:146300K .......... .......... .......... .......... .......... 86% 15.2M 1s 2024-03-30T13:09:47.831 INFO:teuthology.orchestra.run.smithi083.stderr:146350K .......... .......... .......... .......... .......... 86% 17.6M 1s 2024-03-30T13:09:47.834 INFO:teuthology.orchestra.run.smithi083.stderr:146400K .......... .......... .......... .......... .......... 86% 17.8M 1s 2024-03-30T13:09:47.837 INFO:teuthology.orchestra.run.smithi083.stderr:146450K .......... .......... .......... .......... .......... 86% 17.5M 1s 2024-03-30T13:09:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:146500K .......... .......... .......... .......... .......... 86% 15.0M 1s 2024-03-30T13:09:47.843 INFO:teuthology.orchestra.run.smithi083.stderr:146550K .......... .......... .......... .......... .......... 86% 16.9M 1s 2024-03-30T13:09:47.846 INFO:teuthology.orchestra.run.smithi083.stderr:146600K .......... .......... .......... .......... .......... 86% 18.2M 1s 2024-03-30T13:09:47.848 INFO:teuthology.orchestra.run.smithi083.stderr:146650K .......... .......... .......... .......... .......... 87% 21.6M 1s 2024-03-30T13:09:47.850 INFO:teuthology.orchestra.run.smithi083.stderr:146700K .......... .......... .......... .......... .......... 87% 19.8M 1s 2024-03-30T13:09:47.852 INFO:teuthology.orchestra.run.smithi083.stderr:146750K .......... .......... .......... .......... .......... 87% 24.0M 1s 2024-03-30T13:09:47.855 INFO:teuthology.orchestra.run.smithi083.stderr:146800K .......... .......... .......... .......... .......... 87% 23.6M 1s 2024-03-30T13:09:47.858 INFO:teuthology.orchestra.run.smithi083.stderr:146850K .......... .......... .......... .......... .......... 87% 17.2M 1s 2024-03-30T13:09:47.861 INFO:teuthology.orchestra.run.smithi083.stderr:146900K .......... .......... .......... .......... .......... 87% 13.4M 1s 2024-03-30T13:09:47.864 INFO:teuthology.orchestra.run.smithi083.stderr:146950K .......... .......... .......... .......... .......... 87% 15.7M 1s 2024-03-30T13:09:47.867 INFO:teuthology.orchestra.run.smithi083.stderr:147000K .......... .......... .......... .......... .......... 87% 16.7M 1s 2024-03-30T13:09:47.869 INFO:teuthology.orchestra.run.smithi083.stderr:147050K .......... .......... .......... .......... .......... 87% 23.6M 1s 2024-03-30T13:09:47.871 INFO:teuthology.orchestra.run.smithi083.stderr:147100K .......... .......... .......... .......... .......... 87% 19.6M 1s 2024-03-30T13:09:47.874 INFO:teuthology.orchestra.run.smithi083.stderr:147150K .......... .......... .......... .......... .......... 87% 22.1M 1s 2024-03-30T13:09:47.876 INFO:teuthology.orchestra.run.smithi083.stderr:147200K .......... .......... .......... .......... .......... 87% 22.6M 1s 2024-03-30T13:09:47.878 INFO:teuthology.orchestra.run.smithi083.stderr:147250K .......... .......... .......... .......... .......... 87% 22.4M 1s 2024-03-30T13:09:47.881 INFO:teuthology.orchestra.run.smithi083.stderr:147300K .......... .......... .......... .......... .......... 87% 18.0M 1s 2024-03-30T13:09:47.883 INFO:teuthology.orchestra.run.smithi083.stderr:147350K .......... .......... .......... .......... .......... 87% 20.6M 1s 2024-03-30T13:09:47.885 INFO:teuthology.orchestra.run.smithi083.stderr:147400K .......... .......... .......... .......... .......... 87% 21.0M 1s 2024-03-30T13:09:47.888 INFO:teuthology.orchestra.run.smithi083.stderr:147450K .......... .......... .......... .......... .......... 87% 21.0M 1s 2024-03-30T13:09:47.890 INFO:teuthology.orchestra.run.smithi083.stderr:147500K .......... .......... .......... .......... .......... 87% 20.0M 1s 2024-03-30T13:09:47.892 INFO:teuthology.orchestra.run.smithi083.stderr:147550K .......... .......... .......... .......... .......... 87% 26.4M 1s 2024-03-30T13:09:47.894 INFO:teuthology.orchestra.run.smithi083.stderr:147600K .......... .......... .......... .......... .......... 87% 27.1M 1s 2024-03-30T13:09:47.895 INFO:teuthology.orchestra.run.smithi083.stderr:147650K .......... .......... .......... .......... .......... 87% 27.0M 1s 2024-03-30T13:09:47.898 INFO:teuthology.orchestra.run.smithi083.stderr:147700K .......... .......... .......... .......... .......... 87% 24.3M 1s 2024-03-30T13:09:47.900 INFO:teuthology.orchestra.run.smithi083.stderr:147750K .......... .......... .......... .......... .......... 87% 26.1M 1s 2024-03-30T13:09:47.902 INFO:teuthology.orchestra.run.smithi083.stderr:147800K .......... .......... .......... .......... .......... 87% 23.9M 1s 2024-03-30T13:09:47.904 INFO:teuthology.orchestra.run.smithi083.stderr:147850K .......... .......... .......... .......... .......... 87% 24.4M 1s 2024-03-30T13:09:47.906 INFO:teuthology.orchestra.run.smithi083.stderr:147900K .......... .......... .......... .......... .......... 87% 21.5M 1s 2024-03-30T13:09:47.908 INFO:teuthology.orchestra.run.smithi083.stderr:147950K .......... .......... .......... .......... .......... 87% 24.7M 1s 2024-03-30T13:09:47.910 INFO:teuthology.orchestra.run.smithi083.stderr:148000K .......... .......... .......... .......... .......... 87% 24.8M 1s 2024-03-30T13:09:47.912 INFO:teuthology.orchestra.run.smithi083.stderr:148050K .......... .......... .......... .......... .......... 87% 24.7M 1s 2024-03-30T13:09:47.914 INFO:teuthology.orchestra.run.smithi083.stderr:148100K .......... .......... .......... .......... .......... 87% 19.4M 1s 2024-03-30T13:09:47.916 INFO:teuthology.orchestra.run.smithi083.stderr:148150K .......... .......... .......... .......... .......... 87% 22.7M 1s 2024-03-30T13:09:47.919 INFO:teuthology.orchestra.run.smithi083.stderr:148200K .......... .......... .......... .......... .......... 87% 22.3M 1s 2024-03-30T13:09:47.921 INFO:teuthology.orchestra.run.smithi083.stderr:148250K .......... .......... .......... .......... .......... 87% 23.1M 1s 2024-03-30T13:09:47.923 INFO:teuthology.orchestra.run.smithi083.stderr:148300K .......... .......... .......... .......... .......... 88% 19.9M 1s 2024-03-30T13:09:47.925 INFO:teuthology.orchestra.run.smithi083.stderr:148350K .......... .......... .......... .......... .......... 88% 23.7M 1s 2024-03-30T13:09:47.927 INFO:teuthology.orchestra.run.smithi083.stderr:148400K .......... .......... .......... .......... .......... 88% 22.7M 1s 2024-03-30T13:09:47.930 INFO:teuthology.orchestra.run.smithi083.stderr:148450K .......... .......... .......... .......... .......... 88% 23.2M 1s 2024-03-30T13:09:47.932 INFO:teuthology.orchestra.run.smithi083.stderr:148500K .......... .......... .......... .......... .......... 88% 19.1M 1s 2024-03-30T13:09:47.934 INFO:teuthology.orchestra.run.smithi083.stderr:148550K .......... .......... .......... .......... .......... 88% 22.1M 1s 2024-03-30T13:09:47.937 INFO:teuthology.orchestra.run.smithi083.stderr:148600K .......... .......... .......... .......... .......... 88% 22.2M 1s 2024-03-30T13:09:47.939 INFO:teuthology.orchestra.run.smithi083.stderr:148650K .......... .......... .......... .......... .......... 88% 21.6M 1s 2024-03-30T13:09:47.941 INFO:teuthology.orchestra.run.smithi083.stderr:148700K .......... .......... .......... .......... .......... 88% 18.9M 1s 2024-03-30T13:09:47.944 INFO:teuthology.orchestra.run.smithi083.stderr:148750K .......... .......... .......... .......... .......... 88% 21.5M 1s 2024-03-30T13:09:47.946 INFO:teuthology.orchestra.run.smithi083.stderr:148800K .......... .......... .......... .......... .......... 88% 22.4M 1s 2024-03-30T13:09:47.948 INFO:teuthology.orchestra.run.smithi083.stderr:148850K .......... .......... .......... .......... .......... 88% 21.9M 1s 2024-03-30T13:09:47.951 INFO:teuthology.orchestra.run.smithi083.stderr:148900K .......... .......... .......... .......... .......... 88% 18.7M 1s 2024-03-30T13:09:47.953 INFO:teuthology.orchestra.run.smithi083.stderr:148950K .......... .......... .......... .......... .......... 88% 19.6M 1s 2024-03-30T13:09:47.956 INFO:teuthology.orchestra.run.smithi083.stderr:149000K .......... .......... .......... .......... .......... 88% 20.7M 1s 2024-03-30T13:09:47.958 INFO:teuthology.orchestra.run.smithi083.stderr:149050K .......... .......... .......... .......... .......... 88% 21.3M 1s 2024-03-30T13:09:47.961 INFO:teuthology.orchestra.run.smithi083.stderr:149100K .......... .......... .......... .......... .......... 88% 17.4M 1s 2024-03-30T13:09:47.963 INFO:teuthology.orchestra.run.smithi083.stderr:149150K .......... .......... .......... .......... .......... 88% 20.6M 1s 2024-03-30T13:09:47.965 INFO:teuthology.orchestra.run.smithi083.stderr:149200K .......... .......... .......... .......... .......... 88% 20.7M 1s 2024-03-30T13:09:47.968 INFO:teuthology.orchestra.run.smithi083.stderr:149250K .......... .......... .......... .......... .......... 88% 20.7M 1s 2024-03-30T13:09:47.970 INFO:teuthology.orchestra.run.smithi083.stderr:149300K .......... .......... .......... .......... .......... 88% 18.0M 1s 2024-03-30T13:09:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:149350K .......... .......... .......... .......... .......... 88% 19.0M 1s 2024-03-30T13:09:47.976 INFO:teuthology.orchestra.run.smithi083.stderr:149400K .......... .......... .......... .......... .......... 88% 19.6M 1s 2024-03-30T13:09:47.978 INFO:teuthology.orchestra.run.smithi083.stderr:149450K .......... .......... .......... .......... .......... 88% 19.7M 1s 2024-03-30T13:09:47.981 INFO:teuthology.orchestra.run.smithi083.stderr:149500K .......... .......... .......... .......... .......... 88% 16.6M 1s 2024-03-30T13:09:47.984 INFO:teuthology.orchestra.run.smithi083.stderr:149550K .......... .......... .......... .......... .......... 88% 19.4M 1s 2024-03-30T13:09:47.986 INFO:teuthology.orchestra.run.smithi083.stderr:149600K .......... .......... .......... .......... .......... 88% 19.4M 1s 2024-03-30T13:09:47.988 INFO:teuthology.orchestra.run.smithi083.stderr:149650K .......... .......... .......... .......... .......... 88% 20.0M 1s 2024-03-30T13:09:47.991 INFO:teuthology.orchestra.run.smithi083.stderr:149700K .......... .......... .......... .......... .......... 88% 17.0M 1s 2024-03-30T13:09:47.994 INFO:teuthology.orchestra.run.smithi083.stderr:149750K .......... .......... .......... .......... .......... 88% 19.5M 1s 2024-03-30T13:09:47.996 INFO:teuthology.orchestra.run.smithi083.stderr:149800K .......... .......... .......... .......... .......... 88% 18.9M 1s 2024-03-30T13:09:47.999 INFO:teuthology.orchestra.run.smithi083.stderr:149850K .......... .......... .......... .......... .......... 88% 19.4M 1s 2024-03-30T13:09:48.002 INFO:teuthology.orchestra.run.smithi083.stderr:149900K .......... .......... .......... .......... .......... 88% 16.4M 1s 2024-03-30T13:09:48.004 INFO:teuthology.orchestra.run.smithi083.stderr:149950K .......... .......... .......... .......... .......... 88% 19.2M 1s 2024-03-30T13:09:48.007 INFO:teuthology.orchestra.run.smithi083.stderr:150000K .......... .......... .......... .......... .......... 89% 19.1M 1s 2024-03-30T13:09:48.010 INFO:teuthology.orchestra.run.smithi083.stderr:150050K .......... .......... .......... .......... .......... 89% 19.4M 1s 2024-03-30T13:09:48.013 INFO:teuthology.orchestra.run.smithi083.stderr:150100K .......... .......... .......... .......... .......... 89% 16.7M 1s 2024-03-30T13:09:48.016 INFO:teuthology.orchestra.run.smithi083.stderr:150150K .......... .......... .......... .......... .......... 89% 17.3M 1s 2024-03-30T13:09:48.018 INFO:teuthology.orchestra.run.smithi083.stderr:150200K .......... .......... .......... .......... .......... 89% 18.7M 1s 2024-03-30T13:09:48.020 INFO:teuthology.orchestra.run.smithi083.stderr:150250K .......... .......... .......... .......... .......... 89% 18.8M 1s 2024-03-30T13:09:48.024 INFO:teuthology.orchestra.run.smithi083.stderr:150300K .......... .......... .......... .......... .......... 89% 15.9M 1s 2024-03-30T13:09:48.026 INFO:teuthology.orchestra.run.smithi083.stderr:150350K .......... .......... .......... .......... .......... 89% 18.2M 1s 2024-03-30T13:09:48.028 INFO:teuthology.orchestra.run.smithi083.stderr:150400K .......... .......... .......... .......... .......... 89% 21.8M 1s 2024-03-30T13:09:48.031 INFO:teuthology.orchestra.run.smithi083.stderr:150450K .......... .......... .......... .......... .......... 89% 21.7M 1s 2024-03-30T13:09:48.034 INFO:teuthology.orchestra.run.smithi083.stderr:150500K .......... .......... .......... .......... .......... 89% 16.6M 1s 2024-03-30T13:09:48.036 INFO:teuthology.orchestra.run.smithi083.stderr:150550K .......... .......... .......... .......... .......... 89% 19.3M 1s 2024-03-30T13:09:48.038 INFO:teuthology.orchestra.run.smithi083.stderr:150600K .......... .......... .......... .......... .......... 89% 20.5M 1s 2024-03-30T13:09:48.041 INFO:teuthology.orchestra.run.smithi083.stderr:150650K .......... .......... .......... .......... .......... 89% 21.5M 1s 2024-03-30T13:09:48.044 INFO:teuthology.orchestra.run.smithi083.stderr:150700K .......... .......... .......... .......... .......... 89% 17.4M 1s 2024-03-30T13:09:48.046 INFO:teuthology.orchestra.run.smithi083.stderr:150750K .......... .......... .......... .......... .......... 89% 19.7M 1s 2024-03-30T13:09:48.049 INFO:teuthology.orchestra.run.smithi083.stderr:150800K .......... .......... .......... .......... .......... 89% 19.7M 1s 2024-03-30T13:09:48.051 INFO:teuthology.orchestra.run.smithi083.stderr:150850K .......... .......... .......... .......... .......... 89% 19.7M 1s 2024-03-30T13:09:48.054 INFO:teuthology.orchestra.run.smithi083.stderr:150900K .......... .......... .......... .......... .......... 89% 17.2M 1s 2024-03-30T13:09:48.056 INFO:teuthology.orchestra.run.smithi083.stderr:150950K .......... .......... .......... .......... .......... 89% 19.4M 1s 2024-03-30T13:09:48.059 INFO:teuthology.orchestra.run.smithi083.stderr:151000K .......... .......... .......... .......... .......... 89% 18.6M 1s 2024-03-30T13:09:48.062 INFO:teuthology.orchestra.run.smithi083.stderr:151050K .......... .......... .......... .......... .......... 89% 19.5M 1s 2024-03-30T13:09:48.065 INFO:teuthology.orchestra.run.smithi083.stderr:151100K .......... .......... .......... .......... .......... 89% 16.3M 1s 2024-03-30T13:09:48.068 INFO:teuthology.orchestra.run.smithi083.stderr:151150K .......... .......... .......... .......... .......... 89% 17.3M 1s 2024-03-30T13:09:48.071 INFO:teuthology.orchestra.run.smithi083.stderr:151200K .......... .......... .......... .......... .......... 89% 14.6M 1s 2024-03-30T13:09:48.074 INFO:teuthology.orchestra.run.smithi083.stderr:151250K .......... .......... .......... .......... .......... 89% 14.4M 1s 2024-03-30T13:09:48.078 INFO:teuthology.orchestra.run.smithi083.stderr:151300K .......... .......... .......... .......... .......... 89% 12.2M 1s 2024-03-30T13:09:48.082 INFO:teuthology.orchestra.run.smithi083.stderr:151350K .......... .......... .......... .......... .......... 89% 14.3M 1s 2024-03-30T13:09:48.085 INFO:teuthology.orchestra.run.smithi083.stderr:151400K .......... .......... .......... .......... .......... 89% 13.6M 1s 2024-03-30T13:09:48.089 INFO:teuthology.orchestra.run.smithi083.stderr:151450K .......... .......... .......... .......... .......... 89% 14.6M 1s 2024-03-30T13:09:48.093 INFO:teuthology.orchestra.run.smithi083.stderr:151500K .......... .......... .......... .......... .......... 89% 10.6M 1s 2024-03-30T13:09:48.097 INFO:teuthology.orchestra.run.smithi083.stderr:151550K .......... .......... .......... .......... .......... 89% 11.6M 1s 2024-03-30T13:09:48.100 INFO:teuthology.orchestra.run.smithi083.stderr:151600K .......... .......... .......... .......... .......... 89% 20.0M 1s 2024-03-30T13:09:48.102 INFO:teuthology.orchestra.run.smithi083.stderr:151650K .......... .......... .......... .......... .......... 89% 17.4M 1s 2024-03-30T13:09:48.104 INFO:teuthology.orchestra.run.smithi083.stderr:151700K .......... .......... .......... .......... .......... 90% 27.2M 1s 2024-03-30T13:09:48.106 INFO:teuthology.orchestra.run.smithi083.stderr:151750K .......... .......... .......... .......... .......... 90% 30.8M 1s 2024-03-30T13:09:48.108 INFO:teuthology.orchestra.run.smithi083.stderr:151800K .......... .......... .......... .......... .......... 90% 28.6M 1s 2024-03-30T13:09:48.109 INFO:teuthology.orchestra.run.smithi083.stderr:151850K .......... .......... .......... .......... .......... 90% 31.7M 1s 2024-03-30T13:09:48.111 INFO:teuthology.orchestra.run.smithi083.stderr:151900K .......... .......... .......... .......... .......... 90% 26.0M 1s 2024-03-30T13:09:48.113 INFO:teuthology.orchestra.run.smithi083.stderr:151950K .......... .......... .......... .......... .......... 90% 29.5M 1s 2024-03-30T13:09:48.114 INFO:teuthology.orchestra.run.smithi083.stderr:152000K .......... .......... .......... .......... .......... 90% 30.2M 1s 2024-03-30T13:09:48.116 INFO:teuthology.orchestra.run.smithi083.stderr:152050K .......... .......... .......... .......... .......... 90% 29.6M 1s 2024-03-30T13:09:48.118 INFO:teuthology.orchestra.run.smithi083.stderr:152100K .......... .......... .......... .......... .......... 90% 25.7M 1s 2024-03-30T13:09:48.120 INFO:teuthology.orchestra.run.smithi083.stderr:152150K .......... .......... .......... .......... .......... 90% 26.9M 1s 2024-03-30T13:09:48.121 INFO:teuthology.orchestra.run.smithi083.stderr:152200K .......... .......... .......... .......... .......... 90% 31.2M 1s 2024-03-30T13:09:48.123 INFO:teuthology.orchestra.run.smithi083.stderr:152250K .......... .......... .......... .......... .......... 90% 31.0M 1s 2024-03-30T13:09:48.125 INFO:teuthology.orchestra.run.smithi083.stderr:152300K .......... .......... .......... .......... .......... 90% 26.8M 1s 2024-03-30T13:09:48.126 INFO:teuthology.orchestra.run.smithi083.stderr:152350K .......... .......... .......... .......... .......... 90% 31.0M 1s 2024-03-30T13:09:48.128 INFO:teuthology.orchestra.run.smithi083.stderr:152400K .......... .......... .......... .......... .......... 90% 31.8M 1s 2024-03-30T13:09:48.129 INFO:teuthology.orchestra.run.smithi083.stderr:152450K .......... .......... .......... .......... .......... 90% 31.7M 1s 2024-03-30T13:09:48.131 INFO:teuthology.orchestra.run.smithi083.stderr:152500K .......... .......... .......... .......... .......... 90% 26.5M 1s 2024-03-30T13:09:48.133 INFO:teuthology.orchestra.run.smithi083.stderr:152550K .......... .......... .......... .......... .......... 90% 31.2M 1s 2024-03-30T13:09:48.134 INFO:teuthology.orchestra.run.smithi083.stderr:152600K .......... .......... .......... .......... .......... 90% 31.1M 1s 2024-03-30T13:09:48.136 INFO:teuthology.orchestra.run.smithi083.stderr:152650K .......... .......... .......... .......... .......... 90% 30.7M 1s 2024-03-30T13:09:48.138 INFO:teuthology.orchestra.run.smithi083.stderr:152700K .......... .......... .......... .......... .......... 90% 26.2M 1s 2024-03-30T13:09:48.139 INFO:teuthology.orchestra.run.smithi083.stderr:152750K .......... .......... .......... .......... .......... 90% 30.2M 1s 2024-03-30T13:09:48.141 INFO:teuthology.orchestra.run.smithi083.stderr:152800K .......... .......... .......... .......... .......... 90% 30.5M 1s 2024-03-30T13:09:48.143 INFO:teuthology.orchestra.run.smithi083.stderr:152850K .......... .......... .......... .......... .......... 90% 29.5M 1s 2024-03-30T13:09:48.144 INFO:teuthology.orchestra.run.smithi083.stderr:152900K .......... .......... .......... .......... .......... 90% 25.7M 1s 2024-03-30T13:09:48.146 INFO:teuthology.orchestra.run.smithi083.stderr:152950K .......... .......... .......... .......... .......... 90% 30.4M 1s 2024-03-30T13:09:48.148 INFO:teuthology.orchestra.run.smithi083.stderr:153000K .......... .......... .......... .......... .......... 90% 29.6M 1s 2024-03-30T13:09:48.149 INFO:teuthology.orchestra.run.smithi083.stderr:153050K .......... .......... .......... .......... .......... 90% 30.1M 1s 2024-03-30T13:09:48.152 INFO:teuthology.orchestra.run.smithi083.stderr:153100K .......... .......... .......... .......... .......... 90% 19.8M 1s 2024-03-30T13:09:48.155 INFO:teuthology.orchestra.run.smithi083.stderr:153150K .......... .......... .......... .......... .......... 90% 19.8M 1s 2024-03-30T13:09:48.157 INFO:teuthology.orchestra.run.smithi083.stderr:153200K .......... .......... .......... .......... .......... 90% 16.3M 1s 2024-03-30T13:09:48.159 INFO:teuthology.orchestra.run.smithi083.stderr:153250K .......... .......... .......... .......... .......... 90% 31.8M 1s 2024-03-30T13:09:48.160 INFO:teuthology.orchestra.run.smithi083.stderr:153300K .......... .......... .......... .......... .......... 90% 28.7M 1s 2024-03-30T13:09:48.162 INFO:teuthology.orchestra.run.smithi083.stderr:153350K .......... .......... .......... .......... .......... 91% 33.7M 1s 2024-03-30T13:09:48.164 INFO:teuthology.orchestra.run.smithi083.stderr:153400K .......... .......... .......... .......... .......... 91% 32.4M 1s 2024-03-30T13:09:48.165 INFO:teuthology.orchestra.run.smithi083.stderr:153450K .......... .......... .......... .......... .......... 91% 32.7M 1s 2024-03-30T13:09:48.167 INFO:teuthology.orchestra.run.smithi083.stderr:153500K .......... .......... .......... .......... .......... 91% 26.8M 1s 2024-03-30T13:09:48.168 INFO:teuthology.orchestra.run.smithi083.stderr:153550K .......... .......... .......... .......... .......... 91% 29.6M 1s 2024-03-30T13:09:48.170 INFO:teuthology.orchestra.run.smithi083.stderr:153600K .......... .......... .......... .......... .......... 91% 34.5M 1s 2024-03-30T13:09:48.171 INFO:teuthology.orchestra.run.smithi083.stderr:153650K .......... .......... .......... .......... .......... 91% 33.9M 1s 2024-03-30T13:09:48.173 INFO:teuthology.orchestra.run.smithi083.stderr:153700K .......... .......... .......... .......... .......... 91% 29.7M 1s 2024-03-30T13:09:48.174 INFO:teuthology.orchestra.run.smithi083.stderr:153750K .......... .......... .......... .......... .......... 91% 32.9M 1s 2024-03-30T13:09:48.177 INFO:teuthology.orchestra.run.smithi083.stderr:153800K .......... .......... .......... .......... .......... 91% 30.7M 1s 2024-03-30T13:09:48.178 INFO:teuthology.orchestra.run.smithi083.stderr:153850K .......... .......... .......... .......... .......... 91% 27.1M 1s 2024-03-30T13:09:48.179 INFO:teuthology.orchestra.run.smithi083.stderr:153900K .......... .......... .......... .......... .......... 91% 28.5M 1s 2024-03-30T13:09:48.181 INFO:teuthology.orchestra.run.smithi083.stderr:153950K .......... .......... .......... .......... .......... 91% 33.8M 1s 2024-03-30T13:09:48.183 INFO:teuthology.orchestra.run.smithi083.stderr:154000K .......... .......... .......... .......... .......... 91% 28.2M 1s 2024-03-30T13:09:48.184 INFO:teuthology.orchestra.run.smithi083.stderr:154050K .......... .......... .......... .......... .......... 91% 27.5M 1s 2024-03-30T13:09:48.186 INFO:teuthology.orchestra.run.smithi083.stderr:154100K .......... .......... .......... .......... .......... 91% 25.3M 1s 2024-03-30T13:09:48.188 INFO:teuthology.orchestra.run.smithi083.stderr:154150K .......... .......... .......... .......... .......... 91% 28.3M 1s 2024-03-30T13:09:48.190 INFO:teuthology.orchestra.run.smithi083.stderr:154200K .......... .......... .......... .......... .......... 91% 29.7M 1s 2024-03-30T13:09:48.191 INFO:teuthology.orchestra.run.smithi083.stderr:154250K .......... .......... .......... .......... .......... 91% 29.0M 1s 2024-03-30T13:09:48.194 INFO:teuthology.orchestra.run.smithi083.stderr:154300K .......... .......... .......... .......... .......... 91% 24.2M 1s 2024-03-30T13:09:48.195 INFO:teuthology.orchestra.run.smithi083.stderr:154350K .......... .......... .......... .......... .......... 91% 28.0M 1s 2024-03-30T13:09:48.197 INFO:teuthology.orchestra.run.smithi083.stderr:154400K .......... .......... .......... .......... .......... 91% 26.7M 1s 2024-03-30T13:09:48.199 INFO:teuthology.orchestra.run.smithi083.stderr:154450K .......... .......... .......... .......... .......... 91% 27.1M 1s 2024-03-30T13:09:48.201 INFO:teuthology.orchestra.run.smithi083.stderr:154500K .......... .......... .......... .......... .......... 91% 23.2M 1s 2024-03-30T13:09:48.203 INFO:teuthology.orchestra.run.smithi083.stderr:154550K .......... .......... .......... .......... .......... 91% 28.1M 1s 2024-03-30T13:09:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:154600K .......... .......... .......... .......... .......... 91% 27.7M 1s 2024-03-30T13:09:48.206 INFO:teuthology.orchestra.run.smithi083.stderr:154650K .......... .......... .......... .......... .......... 91% 26.6M 1s 2024-03-30T13:09:48.208 INFO:teuthology.orchestra.run.smithi083.stderr:154700K .......... .......... .......... .......... .......... 91% 23.1M 1s 2024-03-30T13:09:48.210 INFO:teuthology.orchestra.run.smithi083.stderr:154750K .......... .......... .......... .......... .......... 91% 27.6M 1s 2024-03-30T13:09:48.212 INFO:teuthology.orchestra.run.smithi083.stderr:154800K .......... .......... .......... .......... .......... 91% 28.6M 1s 2024-03-30T13:09:48.213 INFO:teuthology.orchestra.run.smithi083.stderr:154850K .......... .......... .......... .......... .......... 91% 28.6M 1s 2024-03-30T13:09:48.216 INFO:teuthology.orchestra.run.smithi083.stderr:154900K .......... .......... .......... .......... .......... 91% 25.1M 1s 2024-03-30T13:09:48.217 INFO:teuthology.orchestra.run.smithi083.stderr:154950K .......... .......... .......... .......... .......... 91% 26.9M 1s 2024-03-30T13:09:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:155000K .......... .......... .......... .......... .......... 91% 26.8M 1s 2024-03-30T13:09:48.221 INFO:teuthology.orchestra.run.smithi083.stderr:155050K .......... .......... .......... .......... .......... 92% 28.1M 1s 2024-03-30T13:09:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:155100K .......... .......... .......... .......... .......... 92% 24.6M 1s 2024-03-30T13:09:48.224 INFO:teuthology.orchestra.run.smithi083.stderr:155150K .......... .......... .......... .......... .......... 92% 29.0M 1s 2024-03-30T13:09:48.226 INFO:teuthology.orchestra.run.smithi083.stderr:155200K .......... .......... .......... .......... .......... 92% 28.0M 1s 2024-03-30T13:09:48.228 INFO:teuthology.orchestra.run.smithi083.stderr:155250K .......... .......... .......... .......... .......... 92% 28.0M 1s 2024-03-30T13:09:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:155300K .......... .......... .......... .......... .......... 92% 24.7M 1s 2024-03-30T13:09:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:155350K .......... .......... .......... .......... .......... 92% 28.3M 0s 2024-03-30T13:09:48.233 INFO:teuthology.orchestra.run.smithi083.stderr:155400K .......... .......... .......... .......... .......... 92% 27.6M 0s 2024-03-30T13:09:48.236 INFO:teuthology.orchestra.run.smithi083.stderr:155450K .......... .......... .......... .......... .......... 92% 24.2M 0s 2024-03-30T13:09:48.239 INFO:teuthology.orchestra.run.smithi083.stderr:155500K .......... .......... .......... .......... .......... 92% 19.8M 0s 2024-03-30T13:09:48.241 INFO:teuthology.orchestra.run.smithi083.stderr:155550K .......... .......... .......... .......... .......... 92% 20.0M 0s 2024-03-30T13:09:48.243 INFO:teuthology.orchestra.run.smithi083.stderr:155600K .......... .......... .......... .......... .......... 92% 19.2M 0s 2024-03-30T13:09:48.245 INFO:teuthology.orchestra.run.smithi083.stderr:155650K .......... .......... .......... .......... .......... 92% 22.6M 0s 2024-03-30T13:09:48.248 INFO:teuthology.orchestra.run.smithi083.stderr:155700K .......... .......... .......... .......... .......... 92% 18.2M 0s 2024-03-30T13:09:48.250 INFO:teuthology.orchestra.run.smithi083.stderr:155750K .......... .......... .......... .......... .......... 92% 22.2M 0s 2024-03-30T13:09:48.252 INFO:teuthology.orchestra.run.smithi083.stderr:155800K .......... .......... .......... .......... .......... 92% 26.2M 0s 2024-03-30T13:09:48.254 INFO:teuthology.orchestra.run.smithi083.stderr:155850K .......... .......... .......... .......... .......... 92% 23.8M 0s 2024-03-30T13:09:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:155900K .......... .......... .......... .......... .......... 92% 19.2M 0s 2024-03-30T13:09:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:155950K .......... .......... .......... .......... .......... 92% 21.6M 0s 2024-03-30T13:09:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:156000K .......... .......... .......... .......... .......... 92% 26.6M 0s 2024-03-30T13:09:48.262 INFO:teuthology.orchestra.run.smithi083.stderr:156050K .......... .......... .......... .......... .......... 92% 29.6M 0s 2024-03-30T13:09:48.264 INFO:teuthology.orchestra.run.smithi083.stderr:156100K .......... .......... .......... .......... .......... 92% 26.8M 0s 2024-03-30T13:09:48.266 INFO:teuthology.orchestra.run.smithi083.stderr:156150K .......... .......... .......... .......... .......... 92% 31.2M 0s 2024-03-30T13:09:48.267 INFO:teuthology.orchestra.run.smithi083.stderr:156200K .......... .......... .......... .......... .......... 92% 29.7M 0s 2024-03-30T13:09:48.270 INFO:teuthology.orchestra.run.smithi083.stderr:156250K .......... .......... .......... .......... .......... 92% 27.3M 0s 2024-03-30T13:09:48.271 INFO:teuthology.orchestra.run.smithi083.stderr:156300K .......... .......... .......... .......... .......... 92% 21.6M 0s 2024-03-30T13:09:48.273 INFO:teuthology.orchestra.run.smithi083.stderr:156350K .......... .......... .......... .......... .......... 92% 26.5M 0s 2024-03-30T13:09:48.276 INFO:teuthology.orchestra.run.smithi083.stderr:156400K .......... .......... .......... .......... .......... 92% 25.7M 0s 2024-03-30T13:09:48.277 INFO:teuthology.orchestra.run.smithi083.stderr:156450K .......... .......... .......... .......... .......... 92% 26.3M 0s 2024-03-30T13:09:48.279 INFO:teuthology.orchestra.run.smithi083.stderr:156500K .......... .......... .......... .......... .......... 92% 21.5M 0s 2024-03-30T13:09:48.283 INFO:teuthology.orchestra.run.smithi083.stderr:156550K .......... .......... .......... .......... .......... 92% 25.5M 0s 2024-03-30T13:09:48.283 INFO:teuthology.orchestra.run.smithi083.stderr:156600K .......... .......... .......... .......... .......... 92% 25.8M 0s 2024-03-30T13:09:48.285 INFO:teuthology.orchestra.run.smithi083.stderr:156650K .......... .......... .......... .......... .......... 92% 25.3M 0s 2024-03-30T13:09:48.287 INFO:teuthology.orchestra.run.smithi083.stderr:156700K .......... .......... .......... .......... .......... 92% 21.3M 0s 2024-03-30T13:09:48.289 INFO:teuthology.orchestra.run.smithi083.stderr:156750K .......... .......... .......... .......... .......... 93% 24.8M 0s 2024-03-30T13:09:48.291 INFO:teuthology.orchestra.run.smithi083.stderr:156800K .......... .......... .......... .......... .......... 93% 23.2M 0s 2024-03-30T13:09:48.294 INFO:teuthology.orchestra.run.smithi083.stderr:156850K .......... .......... .......... .......... .......... 93% 27.9M 0s 2024-03-30T13:09:48.295 INFO:teuthology.orchestra.run.smithi083.stderr:156900K .......... .......... .......... .......... .......... 93% 23.8M 0s 2024-03-30T13:09:48.297 INFO:teuthology.orchestra.run.smithi083.stderr:156950K .......... .......... .......... .......... .......... 93% 27.4M 0s 2024-03-30T13:09:48.299 INFO:teuthology.orchestra.run.smithi083.stderr:157000K .......... .......... .......... .......... .......... 93% 24.1M 0s 2024-03-30T13:09:48.301 INFO:teuthology.orchestra.run.smithi083.stderr:157050K .......... .......... .......... .......... .......... 93% 24.9M 0s 2024-03-30T13:09:48.303 INFO:teuthology.orchestra.run.smithi083.stderr:157100K .......... .......... .......... .......... .......... 93% 23.9M 0s 2024-03-30T13:09:48.304 INFO:teuthology.orchestra.run.smithi083.stderr:157150K .......... .......... .......... .......... .......... 93% 31.9M 0s 2024-03-30T13:09:48.306 INFO:teuthology.orchestra.run.smithi083.stderr:157200K .......... .......... .......... .......... .......... 93% 32.1M 0s 2024-03-30T13:09:48.308 INFO:teuthology.orchestra.run.smithi083.stderr:157250K .......... .......... .......... .......... .......... 93% 30.7M 0s 2024-03-30T13:09:48.309 INFO:teuthology.orchestra.run.smithi083.stderr:157300K .......... .......... .......... .......... .......... 93% 27.0M 0s 2024-03-30T13:09:48.311 INFO:teuthology.orchestra.run.smithi083.stderr:157350K .......... .......... .......... .......... .......... 93% 30.3M 0s 2024-03-30T13:09:48.313 INFO:teuthology.orchestra.run.smithi083.stderr:157400K .......... .......... .......... .......... .......... 93% 30.8M 0s 2024-03-30T13:09:48.314 INFO:teuthology.orchestra.run.smithi083.stderr:157450K .......... .......... .......... .......... .......... 93% 32.1M 0s 2024-03-30T13:09:48.316 INFO:teuthology.orchestra.run.smithi083.stderr:157500K .......... .......... .......... .......... .......... 93% 27.2M 0s 2024-03-30T13:09:48.317 INFO:teuthology.orchestra.run.smithi083.stderr:157550K .......... .......... .......... .......... .......... 93% 31.9M 0s 2024-03-30T13:09:48.319 INFO:teuthology.orchestra.run.smithi083.stderr:157600K .......... .......... .......... .......... .......... 93% 29.4M 0s 2024-03-30T13:09:48.321 INFO:teuthology.orchestra.run.smithi083.stderr:157650K .......... .......... .......... .......... .......... 93% 30.5M 0s 2024-03-30T13:09:48.322 INFO:teuthology.orchestra.run.smithi083.stderr:157700K .......... .......... .......... .......... .......... 93% 26.4M 0s 2024-03-30T13:09:48.324 INFO:teuthology.orchestra.run.smithi083.stderr:157750K .......... .......... .......... .......... .......... 93% 30.9M 0s 2024-03-30T13:09:48.325 INFO:teuthology.orchestra.run.smithi083.stderr:157800K .......... .......... .......... .......... .......... 93% 30.9M 0s 2024-03-30T13:09:48.327 INFO:teuthology.orchestra.run.smithi083.stderr:157850K .......... .......... .......... .......... .......... 93% 30.9M 0s 2024-03-30T13:09:48.329 INFO:teuthology.orchestra.run.smithi083.stderr:157900K .......... .......... .......... .......... .......... 93% 26.6M 0s 2024-03-30T13:09:48.331 INFO:teuthology.orchestra.run.smithi083.stderr:157950K .......... .......... .......... .......... .......... 93% 29.8M 0s 2024-03-30T13:09:48.332 INFO:teuthology.orchestra.run.smithi083.stderr:158000K .......... .......... .......... .......... .......... 93% 30.7M 0s 2024-03-30T13:09:48.334 INFO:teuthology.orchestra.run.smithi083.stderr:158050K .......... .......... .......... .......... .......... 93% 29.0M 0s 2024-03-30T13:09:48.336 INFO:teuthology.orchestra.run.smithi083.stderr:158100K .......... .......... .......... .......... .......... 93% 25.7M 0s 2024-03-30T13:09:48.338 INFO:teuthology.orchestra.run.smithi083.stderr:158150K .......... .......... .......... .......... .......... 93% 30.3M 0s 2024-03-30T13:09:48.339 INFO:teuthology.orchestra.run.smithi083.stderr:158200K .......... .......... .......... .......... .......... 93% 29.6M 0s 2024-03-30T13:09:48.341 INFO:teuthology.orchestra.run.smithi083.stderr:158250K .......... .......... .......... .......... .......... 93% 29.1M 0s 2024-03-30T13:09:48.343 INFO:teuthology.orchestra.run.smithi083.stderr:158300K .......... .......... .......... .......... .......... 93% 25.7M 0s 2024-03-30T13:09:48.344 INFO:teuthology.orchestra.run.smithi083.stderr:158350K .......... .......... .......... .......... .......... 93% 30.6M 0s 2024-03-30T13:09:48.346 INFO:teuthology.orchestra.run.smithi083.stderr:158400K .......... .......... .......... .......... .......... 93% 27.8M 0s 2024-03-30T13:09:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:158450K .......... .......... .......... .......... .......... 94% 29.9M 0s 2024-03-30T13:09:48.350 INFO:teuthology.orchestra.run.smithi083.stderr:158500K .......... .......... .......... .......... .......... 94% 25.2M 0s 2024-03-30T13:09:48.351 INFO:teuthology.orchestra.run.smithi083.stderr:158550K .......... .......... .......... .......... .......... 94% 28.4M 0s 2024-03-30T13:09:48.353 INFO:teuthology.orchestra.run.smithi083.stderr:158600K .......... .......... .......... .......... .......... 94% 29.4M 0s 2024-03-30T13:09:48.355 INFO:teuthology.orchestra.run.smithi083.stderr:158650K .......... .......... .......... .......... .......... 94% 26.2M 0s 2024-03-30T13:09:48.359 INFO:teuthology.orchestra.run.smithi083.stderr:158700K .......... .......... .......... .......... .......... 94% 21.7M 0s 2024-03-30T13:09:48.359 INFO:teuthology.orchestra.run.smithi083.stderr:158750K .......... .......... .......... .......... .......... 94% 23.2M 0s 2024-03-30T13:09:48.361 INFO:teuthology.orchestra.run.smithi083.stderr:158800K .......... .......... .......... .......... .......... 94% 23.2M 0s 2024-03-30T13:09:48.364 INFO:teuthology.orchestra.run.smithi083.stderr:158850K .......... .......... .......... .......... .......... 94% 23.8M 0s 2024-03-30T13:09:48.366 INFO:teuthology.orchestra.run.smithi083.stderr:158900K .......... .......... .......... .......... .......... 94% 20.0M 0s 2024-03-30T13:09:48.368 INFO:teuthology.orchestra.run.smithi083.stderr:158950K .......... .......... .......... .......... .......... 94% 23.3M 0s 2024-03-30T13:09:48.370 INFO:teuthology.orchestra.run.smithi083.stderr:159000K .......... .......... .......... .......... .......... 94% 23.6M 0s 2024-03-30T13:09:48.372 INFO:teuthology.orchestra.run.smithi083.stderr:159050K .......... .......... .......... .......... .......... 94% 20.6M 0s 2024-03-30T13:09:48.375 INFO:teuthology.orchestra.run.smithi083.stderr:159100K .......... .......... .......... .......... .......... 94% 17.8M 0s 2024-03-30T13:09:48.377 INFO:teuthology.orchestra.run.smithi083.stderr:159150K .......... .......... .......... .......... .......... 94% 20.8M 0s 2024-03-30T13:09:48.380 INFO:teuthology.orchestra.run.smithi083.stderr:159200K .......... .......... .......... .......... .......... 94% 19.0M 0s 2024-03-30T13:09:48.383 INFO:teuthology.orchestra.run.smithi083.stderr:159250K .......... .......... .......... .......... .......... 94% 19.5M 0s 2024-03-30T13:09:48.385 INFO:teuthology.orchestra.run.smithi083.stderr:159300K .......... .......... .......... .......... .......... 94% 20.7M 0s 2024-03-30T13:09:48.387 INFO:teuthology.orchestra.run.smithi083.stderr:159350K .......... .......... .......... .......... .......... 94% 20.6M 0s 2024-03-30T13:09:48.390 INFO:teuthology.orchestra.run.smithi083.stderr:159400K .......... .......... .......... .......... .......... 94% 16.9M 0s 2024-03-30T13:09:48.393 INFO:teuthology.orchestra.run.smithi083.stderr:159450K .......... .......... .......... .......... .......... 94% 16.3M 0s 2024-03-30T13:09:48.397 INFO:teuthology.orchestra.run.smithi083.stderr:159500K .......... .......... .......... .......... .......... 94% 13.0M 0s 2024-03-30T13:09:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:159550K .......... .......... .......... .......... .......... 94% 14.8M 0s 2024-03-30T13:09:48.404 INFO:teuthology.orchestra.run.smithi083.stderr:159600K .......... .......... .......... .......... .......... 94% 14.7M 0s 2024-03-30T13:09:48.408 INFO:teuthology.orchestra.run.smithi083.stderr:159650K .......... .......... .......... .......... .......... 94% 12.5M 0s 2024-03-30T13:09:48.412 INFO:teuthology.orchestra.run.smithi083.stderr:159700K .......... .......... .......... .......... .......... 94% 10.6M 0s 2024-03-30T13:09:48.415 INFO:teuthology.orchestra.run.smithi083.stderr:159750K .......... .......... .......... .......... .......... 94% 19.3M 0s 2024-03-30T13:09:48.417 INFO:teuthology.orchestra.run.smithi083.stderr:159800K .......... .......... .......... .......... .......... 94% 21.0M 0s 2024-03-30T13:09:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:159850K .......... .......... .......... .......... .......... 94% 16.9M 0s 2024-03-30T13:09:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:159900K .......... .......... .......... .......... .......... 94% 18.7M 0s 2024-03-30T13:09:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:159950K .......... .......... .......... .......... .......... 94% 23.9M 0s 2024-03-30T13:09:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:160000K .......... .......... .......... .......... .......... 94% 33.1M 0s 2024-03-30T13:09:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:160050K .......... .......... .......... .......... .......... 94% 32.8M 0s 2024-03-30T13:09:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:160100K .......... .......... .......... .......... .......... 95% 26.9M 0s 2024-03-30T13:09:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:160150K .......... .......... .......... .......... .......... 95% 33.9M 0s 2024-03-30T13:09:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:160200K .......... .......... .......... .......... .......... 95% 23.1M 0s 2024-03-30T13:09:48.434 INFO:teuthology.orchestra.run.smithi083.stderr:160250K .......... .......... .......... .......... .......... 95% 29.6M 0s 2024-03-30T13:09:48.436 INFO:teuthology.orchestra.run.smithi083.stderr:160300K .......... .......... .......... .......... .......... 95% 25.7M 0s 2024-03-30T13:09:48.438 INFO:teuthology.orchestra.run.smithi083.stderr:160350K .......... .......... .......... .......... .......... 95% 29.8M 0s 2024-03-30T13:09:48.440 INFO:teuthology.orchestra.run.smithi083.stderr:160400K .......... .......... .......... .......... .......... 95% 29.2M 0s 2024-03-30T13:09:48.441 INFO:teuthology.orchestra.run.smithi083.stderr:160450K .......... .......... .......... .......... .......... 95% 29.4M 0s 2024-03-30T13:09:48.444 INFO:teuthology.orchestra.run.smithi083.stderr:160500K .......... .......... .......... .......... .......... 95% 21.3M 0s 2024-03-30T13:09:48.445 INFO:teuthology.orchestra.run.smithi083.stderr:160550K .......... .......... .......... .......... .......... 95% 25.2M 0s 2024-03-30T13:09:48.447 INFO:teuthology.orchestra.run.smithi083.stderr:160600K .......... .......... .......... .......... .......... 95% 24.2M 0s 2024-03-30T13:09:48.450 INFO:teuthology.orchestra.run.smithi083.stderr:160650K .......... .......... .......... .......... .......... 95% 24.9M 0s 2024-03-30T13:09:48.452 INFO:teuthology.orchestra.run.smithi083.stderr:160700K .......... .......... .......... .......... .......... 95% 20.3M 0s 2024-03-30T13:09:48.454 INFO:teuthology.orchestra.run.smithi083.stderr:160750K .......... .......... .......... .......... .......... 95% 25.4M 0s 2024-03-30T13:09:48.456 INFO:teuthology.orchestra.run.smithi083.stderr:160800K .......... .......... .......... .......... .......... 95% 24.7M 0s 2024-03-30T13:09:48.458 INFO:teuthology.orchestra.run.smithi083.stderr:160850K .......... .......... .......... .......... .......... 95% 25.1M 0s 2024-03-30T13:09:48.460 INFO:teuthology.orchestra.run.smithi083.stderr:160900K .......... .......... .......... .......... .......... 95% 24.7M 0s 2024-03-30T13:09:48.462 INFO:teuthology.orchestra.run.smithi083.stderr:160950K .......... .......... .......... .......... .......... 95% 27.4M 0s 2024-03-30T13:09:48.463 INFO:teuthology.orchestra.run.smithi083.stderr:161000K .......... .......... .......... .......... .......... 95% 29.2M 0s 2024-03-30T13:09:48.465 INFO:teuthology.orchestra.run.smithi083.stderr:161050K .......... .......... .......... .......... .......... 95% 28.6M 0s 2024-03-30T13:09:48.467 INFO:teuthology.orchestra.run.smithi083.stderr:161100K .......... .......... .......... .......... .......... 95% 24.4M 0s 2024-03-30T13:09:48.469 INFO:teuthology.orchestra.run.smithi083.stderr:161150K .......... .......... .......... .......... .......... 95% 29.4M 0s 2024-03-30T13:09:48.470 INFO:teuthology.orchestra.run.smithi083.stderr:161200K .......... .......... .......... .......... .......... 95% 27.5M 0s 2024-03-30T13:09:48.472 INFO:teuthology.orchestra.run.smithi083.stderr:161250K .......... .......... .......... .......... .......... 95% 27.1M 0s 2024-03-30T13:09:48.474 INFO:teuthology.orchestra.run.smithi083.stderr:161300K .......... .......... .......... .......... .......... 95% 24.4M 0s 2024-03-30T13:09:48.476 INFO:teuthology.orchestra.run.smithi083.stderr:161350K .......... .......... .......... .......... .......... 95% 28.2M 0s 2024-03-30T13:09:48.477 INFO:teuthology.orchestra.run.smithi083.stderr:161400K .......... .......... .......... .......... .......... 95% 27.9M 0s 2024-03-30T13:09:48.479 INFO:teuthology.orchestra.run.smithi083.stderr:161450K .......... .......... .......... .......... .......... 95% 27.8M 0s 2024-03-30T13:09:48.481 INFO:teuthology.orchestra.run.smithi083.stderr:161500K .......... .......... .......... .......... .......... 95% 22.7M 0s 2024-03-30T13:09:48.483 INFO:teuthology.orchestra.run.smithi083.stderr:161550K .......... .......... .......... .......... .......... 95% 26.1M 0s 2024-03-30T13:09:48.485 INFO:teuthology.orchestra.run.smithi083.stderr:161600K .......... .......... .......... .......... .......... 95% 26.5M 0s 2024-03-30T13:09:48.487 INFO:teuthology.orchestra.run.smithi083.stderr:161650K .......... .......... .......... .......... .......... 95% 27.3M 0s 2024-03-30T13:09:48.490 INFO:teuthology.orchestra.run.smithi083.stderr:161700K .......... .......... .......... .......... .......... 95% 23.0M 0s 2024-03-30T13:09:48.491 INFO:teuthology.orchestra.run.smithi083.stderr:161750K .......... .......... .......... .......... .......... 95% 27.3M 0s 2024-03-30T13:09:48.493 INFO:teuthology.orchestra.run.smithi083.stderr:161800K .......... .......... .......... .......... .......... 96% 26.5M 0s 2024-03-30T13:09:48.494 INFO:teuthology.orchestra.run.smithi083.stderr:161850K .......... .......... .......... .......... .......... 96% 28.7M 0s 2024-03-30T13:09:48.497 INFO:teuthology.orchestra.run.smithi083.stderr:161900K .......... .......... .......... .......... .......... 96% 23.8M 0s 2024-03-30T13:09:48.498 INFO:teuthology.orchestra.run.smithi083.stderr:161950K .......... .......... .......... .......... .......... 96% 30.0M 0s 2024-03-30T13:09:48.500 INFO:teuthology.orchestra.run.smithi083.stderr:162000K .......... .......... .......... .......... .......... 96% 30.3M 0s 2024-03-30T13:09:48.501 INFO:teuthology.orchestra.run.smithi083.stderr:162050K .......... .......... .......... .......... .......... 96% 30.5M 0s 2024-03-30T13:09:48.503 INFO:teuthology.orchestra.run.smithi083.stderr:162100K .......... .......... .......... .......... .......... 96% 21.9M 0s 2024-03-30T13:09:48.505 INFO:teuthology.orchestra.run.smithi083.stderr:162150K .......... .......... .......... .......... .......... 96% 26.9M 0s 2024-03-30T13:09:48.507 INFO:teuthology.orchestra.run.smithi083.stderr:162200K .......... .......... .......... .......... .......... 96% 25.8M 0s 2024-03-30T13:09:48.509 INFO:teuthology.orchestra.run.smithi083.stderr:162250K .......... .......... .......... .......... .......... 96% 25.1M 0s 2024-03-30T13:09:48.512 INFO:teuthology.orchestra.run.smithi083.stderr:162300K .......... .......... .......... .......... .......... 96% 21.8M 0s 2024-03-30T13:09:48.513 INFO:teuthology.orchestra.run.smithi083.stderr:162350K .......... .......... .......... .......... .......... 96% 24.5M 0s 2024-03-30T13:09:48.516 INFO:teuthology.orchestra.run.smithi083.stderr:162400K .......... .......... .......... .......... .......... 96% 25.4M 0s 2024-03-30T13:09:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:162450K .......... .......... .......... .......... .......... 96% 25.7M 0s 2024-03-30T13:09:48.520 INFO:teuthology.orchestra.run.smithi083.stderr:162500K .......... .......... .......... .......... .......... 96% 21.2M 0s 2024-03-30T13:09:48.521 INFO:teuthology.orchestra.run.smithi083.stderr:162550K .......... .......... .......... .......... .......... 96% 25.5M 0s 2024-03-30T13:09:48.524 INFO:teuthology.orchestra.run.smithi083.stderr:162600K .......... .......... .......... .......... .......... 96% 22.7M 0s 2024-03-30T13:09:48.526 INFO:teuthology.orchestra.run.smithi083.stderr:162650K .......... .......... .......... .......... .......... 96% 24.9M 0s 2024-03-30T13:09:48.528 INFO:teuthology.orchestra.run.smithi083.stderr:162700K .......... .......... .......... .......... .......... 96% 19.8M 0s 2024-03-30T13:09:48.530 INFO:teuthology.orchestra.run.smithi083.stderr:162750K .......... .......... .......... .......... .......... 96% 24.7M 0s 2024-03-30T13:09:48.532 INFO:teuthology.orchestra.run.smithi083.stderr:162800K .......... .......... .......... .......... .......... 96% 23.3M 0s 2024-03-30T13:09:48.534 INFO:teuthology.orchestra.run.smithi083.stderr:162850K .......... .......... .......... .......... .......... 96% 23.7M 0s 2024-03-30T13:09:48.536 INFO:teuthology.orchestra.run.smithi083.stderr:162900K .......... .......... .......... .......... .......... 96% 21.1M 0s 2024-03-30T13:09:48.538 INFO:teuthology.orchestra.run.smithi083.stderr:162950K .......... .......... .......... .......... .......... 96% 24.6M 0s 2024-03-30T13:09:48.541 INFO:teuthology.orchestra.run.smithi083.stderr:163000K .......... .......... .......... .......... .......... 96% 24.7M 0s 2024-03-30T13:09:48.543 INFO:teuthology.orchestra.run.smithi083.stderr:163050K .......... .......... .......... .......... .......... 96% 23.5M 0s 2024-03-30T13:09:48.545 INFO:teuthology.orchestra.run.smithi083.stderr:163100K .......... .......... .......... .......... .......... 96% 19.8M 0s 2024-03-30T13:09:48.547 INFO:teuthology.orchestra.run.smithi083.stderr:163150K .......... .......... .......... .......... .......... 96% 23.7M 0s 2024-03-30T13:09:48.549 INFO:teuthology.orchestra.run.smithi083.stderr:163200K .......... .......... .......... .......... .......... 96% 24.5M 0s 2024-03-30T13:09:48.551 INFO:teuthology.orchestra.run.smithi083.stderr:163250K .......... .......... .......... .......... .......... 96% 24.7M 0s 2024-03-30T13:09:48.553 INFO:teuthology.orchestra.run.smithi083.stderr:163300K .......... .......... .......... .......... .......... 96% 21.1M 0s 2024-03-30T13:09:48.555 INFO:teuthology.orchestra.run.smithi083.stderr:163350K .......... .......... .......... .......... .......... 96% 24.5M 0s 2024-03-30T13:09:48.557 INFO:teuthology.orchestra.run.smithi083.stderr:163400K .......... .......... .......... .......... .......... 96% 24.3M 0s 2024-03-30T13:09:48.559 INFO:teuthology.orchestra.run.smithi083.stderr:163450K .......... .......... .......... .......... .......... 96% 24.5M 0s 2024-03-30T13:09:48.561 INFO:teuthology.orchestra.run.smithi083.stderr:163500K .......... .......... .......... .......... .......... 97% 21.3M 0s 2024-03-30T13:09:48.564 INFO:teuthology.orchestra.run.smithi083.stderr:163550K .......... .......... .......... .......... .......... 97% 23.1M 0s 2024-03-30T13:09:48.566 INFO:teuthology.orchestra.run.smithi083.stderr:163600K .......... .......... .......... .......... .......... 97% 23.5M 0s 2024-03-30T13:09:48.568 INFO:teuthology.orchestra.run.smithi083.stderr:163650K .......... .......... .......... .......... .......... 97% 23.6M 0s 2024-03-30T13:09:48.570 INFO:teuthology.orchestra.run.smithi083.stderr:163700K .......... .......... .......... .......... .......... 97% 19.6M 0s 2024-03-30T13:09:48.572 INFO:teuthology.orchestra.run.smithi083.stderr:163750K .......... .......... .......... .......... .......... 97% 22.6M 0s 2024-03-30T13:09:48.575 INFO:teuthology.orchestra.run.smithi083.stderr:163800K .......... .......... .......... .......... .......... 97% 21.9M 0s 2024-03-30T13:09:48.577 INFO:teuthology.orchestra.run.smithi083.stderr:163850K .......... .......... .......... .......... .......... 97% 25.7M 0s 2024-03-30T13:09:48.579 INFO:teuthology.orchestra.run.smithi083.stderr:163900K .......... .......... .......... .......... .......... 97% 24.5M 0s 2024-03-30T13:09:48.581 INFO:teuthology.orchestra.run.smithi083.stderr:163950K .......... .......... .......... .......... .......... 97% 29.9M 0s 2024-03-30T13:09:48.582 INFO:teuthology.orchestra.run.smithi083.stderr:164000K .......... .......... .......... .......... .......... 97% 29.5M 0s 2024-03-30T13:09:48.584 INFO:teuthology.orchestra.run.smithi083.stderr:164050K .......... .......... .......... .......... .......... 97% 27.7M 0s 2024-03-30T13:09:48.586 INFO:teuthology.orchestra.run.smithi083.stderr:164100K .......... .......... .......... .......... .......... 97% 20.8M 0s 2024-03-30T13:09:48.589 INFO:teuthology.orchestra.run.smithi083.stderr:164150K .......... .......... .......... .......... .......... 97% 22.7M 0s 2024-03-30T13:09:48.591 INFO:teuthology.orchestra.run.smithi083.stderr:164200K .......... .......... .......... .......... .......... 97% 20.1M 0s 2024-03-30T13:09:48.594 INFO:teuthology.orchestra.run.smithi083.stderr:164250K .......... .......... .......... .......... .......... 97% 23.6M 0s 2024-03-30T13:09:48.595 INFO:teuthology.orchestra.run.smithi083.stderr:164300K .......... .......... .......... .......... .......... 97% 30.8M 0s 2024-03-30T13:09:48.596 INFO:teuthology.orchestra.run.smithi083.stderr:164350K .......... .......... .......... .......... .......... 97% 35.1M 0s 2024-03-30T13:09:48.598 INFO:teuthology.orchestra.run.smithi083.stderr:164400K .......... .......... .......... .......... .......... 97% 32.5M 0s 2024-03-30T13:09:48.599 INFO:teuthology.orchestra.run.smithi083.stderr:164450K .......... .......... .......... .......... .......... 97% 34.1M 0s 2024-03-30T13:09:48.601 INFO:teuthology.orchestra.run.smithi083.stderr:164500K .......... .......... .......... .......... .......... 97% 25.9M 0s 2024-03-30T13:09:48.602 INFO:teuthology.orchestra.run.smithi083.stderr:164550K .......... .......... .......... .......... .......... 97% 30.0M 0s 2024-03-30T13:09:48.603 INFO:teuthology.orchestra.run.smithi083.stderr:164600K .......... .......... .......... .......... .......... 97% 37.1M 0s 2024-03-30T13:09:48.605 INFO:teuthology.orchestra.run.smithi083.stderr:164650K .......... .......... .......... .......... .......... 97% 37.0M 0s 2024-03-30T13:09:48.608 INFO:teuthology.orchestra.run.smithi083.stderr:164700K .......... .......... .......... .......... .......... 97% 31.8M 0s 2024-03-30T13:09:48.608 INFO:teuthology.orchestra.run.smithi083.stderr:164750K .......... .......... .......... .......... .......... 97% 37.9M 0s 2024-03-30T13:09:48.609 INFO:teuthology.orchestra.run.smithi083.stderr:164800K .......... .......... .......... .......... .......... 97% 37.0M 0s 2024-03-30T13:09:48.610 INFO:teuthology.orchestra.run.smithi083.stderr:164850K .......... .......... .......... .......... .......... 97% 37.0M 0s 2024-03-30T13:09:48.612 INFO:teuthology.orchestra.run.smithi083.stderr:164900K .......... .......... .......... .......... .......... 97% 31.1M 0s 2024-03-30T13:09:48.613 INFO:teuthology.orchestra.run.smithi083.stderr:164950K .......... .......... .......... .......... .......... 97% 36.6M 0s 2024-03-30T13:09:48.615 INFO:teuthology.orchestra.run.smithi083.stderr:165000K .......... .......... .......... .......... .......... 97% 35.1M 0s 2024-03-30T13:09:48.616 INFO:teuthology.orchestra.run.smithi083.stderr:165050K .......... .......... .......... .......... .......... 97% 35.7M 0s 2024-03-30T13:09:48.617 INFO:teuthology.orchestra.run.smithi083.stderr:165100K .......... .......... .......... .......... .......... 97% 30.9M 0s 2024-03-30T13:09:48.619 INFO:teuthology.orchestra.run.smithi083.stderr:165150K .......... .......... .......... .......... .......... 98% 35.3M 0s 2024-03-30T13:09:48.620 INFO:teuthology.orchestra.run.smithi083.stderr:165200K .......... .......... .......... .......... .......... 98% 36.1M 0s 2024-03-30T13:09:48.622 INFO:teuthology.orchestra.run.smithi083.stderr:165250K .......... .......... .......... .......... .......... 98% 35.9M 0s 2024-03-30T13:09:48.623 INFO:teuthology.orchestra.run.smithi083.stderr:165300K .......... .......... .......... .......... .......... 98% 30.4M 0s 2024-03-30T13:09:48.625 INFO:teuthology.orchestra.run.smithi083.stderr:165350K .......... .......... .......... .......... .......... 98% 32.8M 0s 2024-03-30T13:09:48.626 INFO:teuthology.orchestra.run.smithi083.stderr:165400K .......... .......... .......... .......... .......... 98% 34.3M 0s 2024-03-30T13:09:48.627 INFO:teuthology.orchestra.run.smithi083.stderr:165450K .......... .......... .......... .......... .......... 98% 34.3M 0s 2024-03-30T13:09:48.629 INFO:teuthology.orchestra.run.smithi083.stderr:165500K .......... .......... .......... .......... .......... 98% 29.3M 0s 2024-03-30T13:09:48.631 INFO:teuthology.orchestra.run.smithi083.stderr:165550K .......... .......... .......... .......... .......... 98% 32.6M 0s 2024-03-30T13:09:48.632 INFO:teuthology.orchestra.run.smithi083.stderr:165600K .......... .......... .......... .......... .......... 98% 33.7M 0s 2024-03-30T13:09:48.634 INFO:teuthology.orchestra.run.smithi083.stderr:165650K .......... .......... .......... .......... .......... 98% 33.6M 0s 2024-03-30T13:09:48.635 INFO:teuthology.orchestra.run.smithi083.stderr:165700K .......... .......... .......... .......... .......... 98% 27.5M 0s 2024-03-30T13:09:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:165750K .......... .......... .......... .......... .......... 98% 33.3M 0s 2024-03-30T13:09:48.638 INFO:teuthology.orchestra.run.smithi083.stderr:165800K .......... .......... .......... .......... .......... 98% 32.6M 0s 2024-03-30T13:09:48.640 INFO:teuthology.orchestra.run.smithi083.stderr:165850K .......... .......... .......... .......... .......... 98% 32.7M 0s 2024-03-30T13:09:48.641 INFO:teuthology.orchestra.run.smithi083.stderr:165900K .......... .......... .......... .......... .......... 98% 28.4M 0s 2024-03-30T13:09:48.643 INFO:teuthology.orchestra.run.smithi083.stderr:165950K .......... .......... .......... .......... .......... 98% 31.9M 0s 2024-03-30T13:09:48.644 INFO:teuthology.orchestra.run.smithi083.stderr:166000K .......... .......... .......... .......... .......... 98% 32.5M 0s 2024-03-30T13:09:48.646 INFO:teuthology.orchestra.run.smithi083.stderr:166050K .......... .......... .......... .......... .......... 98% 32.2M 0s 2024-03-30T13:09:48.648 INFO:teuthology.orchestra.run.smithi083.stderr:166100K .......... .......... .......... .......... .......... 98% 27.4M 0s 2024-03-30T13:09:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:166150K .......... .......... .......... .......... .......... 98% 32.3M 0s 2024-03-30T13:09:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:166200K .......... .......... .......... .......... .......... 98% 31.5M 0s 2024-03-30T13:09:48.653 INFO:teuthology.orchestra.run.smithi083.stderr:166250K .......... .......... .......... .......... .......... 98% 28.3M 0s 2024-03-30T13:09:48.655 INFO:teuthology.orchestra.run.smithi083.stderr:166300K .......... .......... .......... .......... .......... 98% 23.7M 0s 2024-03-30T13:09:48.656 INFO:teuthology.orchestra.run.smithi083.stderr:166350K .......... .......... .......... .......... .......... 98% 28.0M 0s 2024-03-30T13:09:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:166400K .......... .......... .......... .......... .......... 98% 27.8M 0s 2024-03-30T13:09:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:166450K .......... .......... .......... .......... .......... 98% 27.6M 0s 2024-03-30T13:09:48.662 INFO:teuthology.orchestra.run.smithi083.stderr:166500K .......... .......... .......... .......... .......... 98% 23.9M 0s 2024-03-30T13:09:48.664 INFO:teuthology.orchestra.run.smithi083.stderr:166550K .......... .......... .......... .......... .......... 98% 27.9M 0s 2024-03-30T13:09:48.665 INFO:teuthology.orchestra.run.smithi083.stderr:166600K .......... .......... .......... .......... .......... 98% 27.6M 0s 2024-03-30T13:09:48.667 INFO:teuthology.orchestra.run.smithi083.stderr:166650K .......... .......... .......... .......... .......... 98% 27.2M 0s 2024-03-30T13:09:48.669 INFO:teuthology.orchestra.run.smithi083.stderr:166700K .......... .......... .......... .......... .......... 98% 23.4M 0s 2024-03-30T13:09:48.671 INFO:teuthology.orchestra.run.smithi083.stderr:166750K .......... .......... .......... .......... .......... 98% 26.7M 0s 2024-03-30T13:09:48.673 INFO:teuthology.orchestra.run.smithi083.stderr:166800K .......... .......... .......... .......... .......... 98% 27.2M 0s 2024-03-30T13:09:48.675 INFO:teuthology.orchestra.run.smithi083.stderr:166850K .......... .......... .......... .......... .......... 99% 26.9M 0s 2024-03-30T13:09:48.677 INFO:teuthology.orchestra.run.smithi083.stderr:166900K .......... .......... .......... .......... .......... 99% 20.4M 0s 2024-03-30T13:09:48.679 INFO:teuthology.orchestra.run.smithi083.stderr:166950K .......... .......... .......... .......... .......... 99% 25.8M 0s 2024-03-30T13:09:48.681 INFO:teuthology.orchestra.run.smithi083.stderr:167000K .......... .......... .......... .......... .......... 99% 26.8M 0s 2024-03-30T13:09:48.683 INFO:teuthology.orchestra.run.smithi083.stderr:167050K .......... .......... .......... .......... .......... 99% 26.2M 0s 2024-03-30T13:09:48.685 INFO:teuthology.orchestra.run.smithi083.stderr:167100K .......... .......... .......... .......... .......... 99% 21.6M 0s 2024-03-30T13:09:48.687 INFO:teuthology.orchestra.run.smithi083.stderr:167150K .......... .......... .......... .......... .......... 99% 25.0M 0s 2024-03-30T13:09:48.689 INFO:teuthology.orchestra.run.smithi083.stderr:167200K .......... .......... .......... .......... .......... 99% 26.2M 0s 2024-03-30T13:09:48.691 INFO:teuthology.orchestra.run.smithi083.stderr:167250K .......... .......... .......... .......... .......... 99% 25.0M 0s 2024-03-30T13:09:48.693 INFO:teuthology.orchestra.run.smithi083.stderr:167300K .......... .......... .......... .......... .......... 99% 21.6M 0s 2024-03-30T13:09:48.695 INFO:teuthology.orchestra.run.smithi083.stderr:167350K .......... .......... .......... .......... .......... 99% 24.5M 0s 2024-03-30T13:09:48.697 INFO:teuthology.orchestra.run.smithi083.stderr:167400K .......... .......... .......... .......... .......... 99% 23.9M 0s 2024-03-30T13:09:48.699 INFO:teuthology.orchestra.run.smithi083.stderr:167450K .......... .......... .......... .......... .......... 99% 23.6M 0s 2024-03-30T13:09:48.702 INFO:teuthology.orchestra.run.smithi083.stderr:167500K .......... .......... .......... .......... .......... 99% 20.1M 0s 2024-03-30T13:09:48.704 INFO:teuthology.orchestra.run.smithi083.stderr:167550K .......... .......... .......... .......... .......... 99% 22.9M 0s 2024-03-30T13:09:48.706 INFO:teuthology.orchestra.run.smithi083.stderr:167600K .......... .......... .......... .......... .......... 99% 23.4M 0s 2024-03-30T13:09:48.708 INFO:teuthology.orchestra.run.smithi083.stderr:167650K .......... .......... .......... .......... .......... 99% 22.3M 0s 2024-03-30T13:09:48.711 INFO:teuthology.orchestra.run.smithi083.stderr:167700K .......... .......... .......... .......... .......... 99% 18.1M 0s 2024-03-30T13:09:48.713 INFO:teuthology.orchestra.run.smithi083.stderr:167750K .......... .......... .......... .......... .......... 99% 20.5M 0s 2024-03-30T13:09:48.716 INFO:teuthology.orchestra.run.smithi083.stderr:167800K .......... .......... .......... .......... .......... 99% 20.5M 0s 2024-03-30T13:09:48.718 INFO:teuthology.orchestra.run.smithi083.stderr:167850K .......... .......... .......... .......... .......... 99% 20.9M 0s 2024-03-30T13:09:48.721 INFO:teuthology.orchestra.run.smithi083.stderr:167900K .......... .......... .......... .......... .......... 99% 16.2M 0s 2024-03-30T13:09:48.724 INFO:teuthology.orchestra.run.smithi083.stderr:167950K .......... .......... .......... .......... .......... 99% 24.6M 0s 2024-03-30T13:09:48.725 INFO:teuthology.orchestra.run.smithi083.stderr:168000K .......... .......... .......... .......... .......... 99% 29.2M 0s 2024-03-30T13:09:48.729 INFO:teuthology.orchestra.run.smithi083.stderr:168050K .......... .......... .......... .......... .......... 99% 30.0M 0s 2024-03-30T13:09:48.729 INFO:teuthology.orchestra.run.smithi083.stderr:168100K .......... .......... .......... .......... .......... 99% 27.2M 0s 2024-03-30T13:09:48.730 INFO:teuthology.orchestra.run.smithi083.stderr:168150K .......... .......... .......... .......... .......... 99% 27.0M 0s 2024-03-30T13:09:48.731 INFO:teuthology.orchestra.run.smithi083.stderr:168200K .......... .......... .......... .......... .......... 99% 26.7M 0s 2024-03-30T13:09:48.733 INFO:teuthology.orchestra.run.smithi083.stderr:168250K .......... .......... .......... .......... .......... 99% 26.4M 0s 2024-03-30T13:09:48.735 INFO:teuthology.orchestra.run.smithi083.stderr:168300K .......... .......... .......... .......... .......... 99% 27.3M 0s 2024-03-30T13:09:48.738 INFO:teuthology.orchestra.run.smithi083.stderr:168350K .......... .......... .......... .......... .......... 99% 31.9M 0s 2024-03-30T13:09:48.739 INFO:teuthology.orchestra.run.smithi083.stderr:168400K .......... .......... .......... .......... .......... 99% 30.0M 0s 2024-03-30T13:09:48.740 INFO:teuthology.orchestra.run.smithi083.stderr:168450K .......... .......... .......... .......... .......... 99% 26.5M 0s 2024-03-30T13:09:48.743 INFO:teuthology.orchestra.run.smithi083.stderr:168500K .......... .......... .......... .......... .......... 99% 20.2M 0s 2024-03-30T13:09:48.743 INFO:teuthology.orchestra.run.smithi083.stderr:168550K .......... .......... . 100% 33.9M=6.4s 2024-03-30T13:09:48.744 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-03-30T13:09:48.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30 13:09:48 (25.7 MB/s) - 'linux-5.4.tar.gz' saved [172616875/172616875] 2024-03-30T13:09:48.745 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-03-30T13:09:48.746 INFO:tasks.cephfs.test_uninlining:Running Data Uninlining test with: without clearing cache, without unmount client, without mount.open_background, without multimds, without snapshots 2024-03-30T13:09:48.746 DEBUG:tasks.cephfs.test_uninlining:setting max_mds:1 2024-03-30T13:09:48.746 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-03-30T13:09:48.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32efcc2640 1 Processor -- start 2024-03-30T13:09:48.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32efcc2640 1 -- start start 2024-03-30T13:09:48.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32efcc2640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f32e806f8e0 0x7f32e80ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:48.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32efcc2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32e8162e20 0x7f32e8162210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:48.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32efcc2640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f32e806fcc0 0x7f32e8162750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:48.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32efcc2640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f32e80aec80 con 0x7f32e806fcc0 2024-03-30T13:09:48.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32efcc2640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f32e80af5d0 con 0x7f32e806f8e0 2024-03-30T13:09:48.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32efcc2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f32e80af870 con 0x7f32e8162e20 2024-03-30T13:09:48.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32ee25f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f32e806fcc0 0x7f32e8162750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:48.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32ee25f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f32e806fcc0 0x7f32e8162750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57876/0 (socket says 172.21.15.83:57876) 2024-03-30T13:09:48.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32ee25f640 1 -- 172.21.15.83:0/4255673510 learned_addr learned my addr 172.21.15.83:0/4255673510 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:48.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32ed25d640 1 --2- 172.21.15.83:0/4255673510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32e8162e20 0x7f32e8162210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:48.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32eda5e640 1 --2- 172.21.15.83:0/4255673510 >> v2:172.21.15.153:3300/0 conn(0x7f32e806f8e0 0x7f32e80ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:48.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32ee25f640 1 -- 172.21.15.83:0/4255673510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32e8162e20 msgr2=0x7f32e8162210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:48.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32ee25f640 1 --2- 172.21.15.83:0/4255673510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32e8162e20 0x7f32e8162210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:48.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32ee25f640 1 -- 172.21.15.83:0/4255673510 >> v2:172.21.15.153:3300/0 conn(0x7f32e806f8e0 msgr2=0x7f32e80ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:48.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32ee25f640 1 --2- 172.21.15.83:0/4255673510 >> v2:172.21.15.153:3300/0 conn(0x7f32e806f8e0 0x7f32e80ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:48.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32ee25f640 1 -- 172.21.15.83:0/4255673510 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e80afb50 con 0x7f32e806fcc0 2024-03-30T13:09:48.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.906+0000 7f32ee25f640 1 --2- 172.21.15.83:0/4255673510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e806fcc0 0x7f32e8162750 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f32e80d09a0 tx=0x7f32e001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5664e5129a640e10 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:48.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32eca5c640 1 -- 172.21.15.83:0/4255673510 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e00a56d0 con 0x7f32e806fcc0 2024-03-30T13:09:48.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32eca5c640 1 -- 172.21.15.83:0/4255673510 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e00a5870 con 0x7f32e806fcc0 2024-03-30T13:09:48.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32eca5c640 1 -- 172.21.15.83:0/4255673510 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e00a5c40 con 0x7f32e806fcc0 2024-03-30T13:09:48.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32efcc2640 1 -- 172.21.15.83:0/4255673510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e806fcc0 msgr2=0x7f32e8162750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:48.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32efcc2640 1 --2- 172.21.15.83:0/4255673510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e806fcc0 0x7f32e8162750 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f32e80d09a0 tx=0x7f32e001c960 comp rx=0 tx=0).stop 2024-03-30T13:09:48.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32efcc2640 1 -- 172.21.15.83:0/4255673510 shutdown_connections 2024-03-30T13:09:48.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32efcc2640 1 --2- 172.21.15.83:0/4255673510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e806fcc0 0x7f32e8162750 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:48.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32efcc2640 1 --2- 172.21.15.83:0/4255673510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32e8162e20 0x7f32e8162210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:48.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32efcc2640 1 --2- 172.21.15.83:0/4255673510 >> v2:172.21.15.153:3300/0 conn(0x7f32e806f8e0 0x7f32e80ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:48.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32efcc2640 1 -- 172.21.15.83:0/4255673510 >> 172.21.15.83:0/4255673510 conn(0x7f32e8072f00 msgr2=0x7f32e806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:48.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32efcc2640 1 -- 172.21.15.83:0/4255673510 shutdown_connections 2024-03-30T13:09:48.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32efcc2640 1 -- 172.21.15.83:0/4255673510 wait complete. 2024-03-30T13:09:48.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32efcc2640 1 Processor -- start 2024-03-30T13:09:48.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.910+0000 7f32efcc2640 1 -- start start 2024-03-30T13:09:48.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32efcc2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e806f8e0 0x7f32e815a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:48.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32efcc2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32e806fcc0 0x7f32e8159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:48.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32efcc2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e8162e20 0x7f32e815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32efcc2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f32e815f7c0 con 0x7f32e8162e20 2024-03-30T13:09:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32efcc2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32e815f640 con 0x7f32e806f8e0 2024-03-30T13:09:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32efcc2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f32e815f940 con 0x7f32e806fcc0 2024-03-30T13:09:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32ee25f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e8162e20 0x7f32e815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32ee25f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e8162e20 0x7f32e815d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57882/0 (socket says 172.21.15.83:57882) 2024-03-30T13:09:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32ee25f640 1 -- 172.21.15.83:0/556930443 learned_addr learned my addr 172.21.15.83:0/556930443 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32ed25d640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32e806fcc0 0x7f32e8159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32eda5e640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e806f8e0 0x7f32e815a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32ee25f640 1 -- 172.21.15.83:0/556930443 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32e806fcc0 msgr2=0x7f32e8159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32ee25f640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32e806fcc0 0x7f32e8159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32ee25f640 1 -- 172.21.15.83:0/556930443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e806f8e0 msgr2=0x7f32e815a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:48.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32ee25f640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e806f8e0 0x7f32e815a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:48.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32ee25f640 1 -- 172.21.15.83:0/556930443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e8159790 con 0x7f32e8162e20 2024-03-30T13:09:48.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32ee25f640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e8162e20 0x7f32e815d5e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f32e00af040 tx=0x7f32e815fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:48.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32de7fc640 1 -- 172.21.15.83:0/556930443 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e00bc030 con 0x7f32e8162e20 2024-03-30T13:09:48.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32de7fc640 1 -- 172.21.15.83:0/556930443 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e00b8470 con 0x7f32e8162e20 2024-03-30T13:09:48.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32efcc2640 1 -- 172.21.15.83:0/556930443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e8159a10 con 0x7f32e8162e20 2024-03-30T13:09:48.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32de7fc640 1 -- 172.21.15.83:0/556930443 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e00b8840 con 0x7f32e8162e20 2024-03-30T13:09:48.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32efcc2640 1 -- 172.21.15.83:0/556930443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e8159fd0 con 0x7f32e8162e20 2024-03-30T13:09:48.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32efcc2640 1 -- 172.21.15.83:0/556930443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e80737d0 con 0x7f32e8162e20 2024-03-30T13:09:48.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32de7fc640 1 -- 172.21.15.83:0/556930443 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f32e00bf070 con 0x7f32e8162e20 2024-03-30T13:09:48.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32de7fc640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f32cc067ff0 0x7f32cc06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:48.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32de7fc640 1 -- 172.21.15.83:0/556930443 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f32e0120d40 con 0x7f32e8162e20 2024-03-30T13:09:48.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.914+0000 7f32eda5e640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f32cc067ff0 0x7f32cc06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:48.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.918+0000 7f32eda5e640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f32cc067ff0 0x7f32cc06a4b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f32e40096f0 tx=0x7f32e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:48.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:48.922+0000 7f32de7fc640 1 -- 172.21.15.83:0/556930443 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f32e00c6020 con 0x7f32e8162e20 2024-03-30T13:09:49.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.118+0000 7f32efcc2640 1 -- 172.21.15.83:0/556930443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f32e804f9e0 con 0x7f32e8162e20 2024-03-30T13:09:49.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32de7fc640 1 -- 172.21.15.83:0/556930443 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7f32e8159790 con 0x7f32e8162e20 2024-03-30T13:09:49.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32efcc2640 1 -- 172.21.15.83:0/556930443 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f32cc067ff0 msgr2=0x7f32cc06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32efcc2640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f32cc067ff0 0x7f32cc06a4b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f32e40096f0 tx=0x7f32e4008040 comp rx=0 tx=0).stop 2024-03-30T13:09:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32efcc2640 1 -- 172.21.15.83:0/556930443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e8162e20 msgr2=0x7f32e815d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32efcc2640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e8162e20 0x7f32e815d5e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f32e00af040 tx=0x7f32e815fc30 comp rx=0 tx=0).stop 2024-03-30T13:09:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32efcc2640 1 -- 172.21.15.83:0/556930443 shutdown_connections 2024-03-30T13:09:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32efcc2640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f32cc067ff0 0x7f32cc06a4b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32efcc2640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e8162e20 0x7f32e815d5e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32efcc2640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32e806fcc0 0x7f32e8159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32efcc2640 1 --2- 172.21.15.83:0/556930443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32e806f8e0 0x7f32e815a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32efcc2640 1 -- 172.21.15.83:0/556930443 >> 172.21.15.83:0/556930443 conn(0x7f32e8072f00 msgr2=0x7f32e81605d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32efcc2640 1 -- 172.21.15.83:0/556930443 shutdown_connections 2024-03-30T13:09:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:49.238+0000 7f32efcc2640 1 -- 172.21.15.83:0/556930443 wait complete. 2024-03-30T13:09:49.262 DEBUG:tasks.cephfs.test_uninlining:getting client_max_inline_size 2024-03-30T13:09:49.263 DEBUG:tasks.cephfs.test_uninlining:got client_max_inline_size:4096 2024-03-30T13:09:49.263 DEBUG:tasks.cephfs.test_uninlining:extracting tarball 2024-03-30T13:09:49.263 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && tar -x -z -f linux-5.4.tar.gz linux-5.4/fs/ceph linux-5.4/fs/orangefs linux-5.4/fs/ext2 2024-03-30T13:09:54.849 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:09:54.852 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:09:55.517 DEBUG:tasks.cephfs.test_uninlining:fetching dir list 2024-03-30T13:09:55.517 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -mindepth 2 -maxdepth 2 -type d 2024-03-30T13:09:55.549 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph 2024-03-30T13:09:55.549 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2 2024-03-30T13:09:55.549 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs 2024-03-30T13:09:55.549 DEBUG:tasks.cephfs.test_uninlining:distributing dir pins 2024-03-30T13:09:55.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:55.550 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ceph) 2024-03-30T13:09:55.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:55.609 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ext2) 2024-03-30T13:09:55.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:55.656 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/orangefs) 2024-03-30T13:09:55.705 DEBUG:tasks.cephfs.test_uninlining:listing files with size <= 4096 2024-03-30T13:09:55.705 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -type f -size -4097c 2024-03-30T13:09:55.796 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:09:55.796 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/Makefile 2024-03-30T13:09:55.796 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:09:55.796 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/io.h 2024-03-30T13:09:55.796 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:09:55.796 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:09:55.796 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/Makefile 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/acl.h 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:09:55.797 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:09:55.798 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:09:55.798 INFO:tasks.cephfs.test_uninlining:Found 23 inlined files 2024-03-30T13:09:55.798 DEBUG:tasks.cephfs.test_uninlining:starting scrub 2024-03-30T13:09:55.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:55.798 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive 2024-03-30T13:09:55.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4b1ef9640 1 Processor -- start 2024-03-30T13:09:55.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4b1ef9640 1 -- start start 2024-03-30T13:09:55.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4b1ef9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4ac15b5e0 0x7fe4ac0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4b1ef9640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe4ac0ae9e0 0x7fe4ac0d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4b1ef9640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ac0b4e80 con 0x7fe4ac0b5c40 2024-03-30T13:09:55.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4b1ef9640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe4ac0cee90 con 0x7fe4ac0ae9e0 2024-03-30T13:09:55.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4b1ef9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ac0b5160 con 0x7fe4ac15b5e0 2024-03-30T13:09:55.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4ab7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4ac15b5e0 0x7fe4ac0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4ab7fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4ac15b5e0 0x7fe4ac0d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:56010/0 (socket says 172.21.15.83:56010) 2024-03-30T13:09:55.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/390467146 learned_addr learned my addr 172.21.15.83:0/390467146 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:55.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4abfff640 1 --2- 172.21.15.83:0/390467146 >> v2:172.21.15.153:3300/0 conn(0x7fe4ac0ae9e0 0x7fe4ac0d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4abfff640 1 -- 172.21.15.83:0/390467146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4ac15b5e0 msgr2=0x7fe4ac0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:55.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4abfff640 1 --2- 172.21.15.83:0/390467146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4ac15b5e0 0x7fe4ac0d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4abfff640 1 -- 172.21.15.83:0/390467146 >> v1:172.21.15.153:6789/0 conn(0x7fe4ac0b5c40 legacy=0x7fe4ac0ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:55.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4abfff640 1 -- 172.21.15.83:0/390467146 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ac0b5440 con 0x7fe4ac0ae9e0 2024-03-30T13:09:55.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.930+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/390467146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4ac15b5e0 0x7fe4ac0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:09:55.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4abfff640 1 --2- 172.21.15.83:0/390467146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4ac0ae9e0 0x7fe4ac0d11d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009d90 tx=0x7fe49c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b3ac6d9f2c06d31 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:55.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4aa7fc640 1 -- 172.21.15.83:0/390467146 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0b2070 con 0x7fe4ac0ae9e0 2024-03-30T13:09:55.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4aa7fc640 1 -- 172.21.15.83:0/390467146 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe49c0a58b0 con 0x7fe4ac0ae9e0 2024-03-30T13:09:55.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4aa7fc640 1 -- 172.21.15.83:0/390467146 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0a5c80 con 0x7fe4ac0ae9e0 2024-03-30T13:09:55.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/390467146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4ac0ae9e0 msgr2=0x7fe4ac0d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:55.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4b1ef9640 1 --2- 172.21.15.83:0/390467146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4ac0ae9e0 0x7fe4ac0d11d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009d90 tx=0x7fe49c01c8e0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/390467146 shutdown_connections 2024-03-30T13:09:55.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4b1ef9640 1 --2- 172.21.15.83:0/390467146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4ac0ae9e0 0x7fe4ac0d11d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4b1ef9640 1 --2- 172.21.15.83:0/390467146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4ac15b5e0 0x7fe4ac0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/390467146 >> 172.21.15.83:0/390467146 conn(0x7fe4ac0b6810 msgr2=0x7fe4ac0b6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:55.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/390467146 shutdown_connections 2024-03-30T13:09:55.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/390467146 wait complete. 2024-03-30T13:09:55.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4b1ef9640 1 Processor -- start 2024-03-30T13:09:55.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.934+0000 7fe4b1ef9640 1 -- start start 2024-03-30T13:09:55.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4b1ef9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4ac0b5c40 0x7fe4ac1473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4b1ef9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4ac15b5e0 0x7fe4ac14efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4b1ef9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4ac157980 0x7fe4ac1634a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4b1ef9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac168300 con 0x7fe4ac157980 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4b1ef9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac168180 con 0x7fe4ac0b5c40 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4b1ef9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ac168480 con 0x7fe4ac15b5e0 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4abfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4ac157980 0x7fe4ac1634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4abfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4ac157980 0x7fe4ac1634a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57892/0 (socket says 172.21.15.83:57892) 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4abfff640 1 -- 172.21.15.83:0/4089452600 learned_addr learned my addr 172.21.15.83:0/4089452600 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4ac0b5c40 0x7fe4ac1473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4aaffd640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4ac15b5e0 0x7fe4ac14efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4abfff640 1 -- 172.21.15.83:0/4089452600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4ac15b5e0 msgr2=0x7fe4ac14efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4abfff640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4ac15b5e0 0x7fe4ac14efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4abfff640 1 -- 172.21.15.83:0/4089452600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4ac0b5c40 msgr2=0x7fe4ac1473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4abfff640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4ac0b5c40 0x7fe4ac1473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4abfff640 1 -- 172.21.15.83:0/4089452600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ac147910 con 0x7fe4ac157980 2024-03-30T13:09:55.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4abfff640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4ac157980 0x7fe4ac1634a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe49c01af90 tx=0x7fe49c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:55.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe493fff640 1 -- 172.21.15.83:0/4089452600 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0b2050 con 0x7fe4ac157980 2024-03-30T13:09:55.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe493fff640 1 -- 172.21.15.83:0/4089452600 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe49c0be070 con 0x7fe4ac157980 2024-03-30T13:09:55.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/4089452600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ac14faa0 con 0x7fe4ac157980 2024-03-30T13:09:55.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe493fff640 1 -- 172.21.15.83:0/4089452600 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0ada50 con 0x7fe4ac157980 2024-03-30T13:09:55.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/4089452600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4ac14e7c0 con 0x7fe4ac157980 2024-03-30T13:09:55.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe493fff640 1 -- 172.21.15.83:0/4089452600 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fe49c0a5730 con 0x7fe4ac157980 2024-03-30T13:09:55.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe493fff640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe498067fc0 0x7fe49806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe493fff640 1 -- 172.21.15.83:0/4089452600 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe49c121410 con 0x7fe4ac157980 2024-03-30T13:09:55.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe498067fc0 0x7fe49806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.938+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe498067fc0 0x7fe49806a480 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4006cb0 tx=0x7fe4a4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:55.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 Processor -- start 2024-03-30T13:09:55.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- start start 2024-03-30T13:09:55.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 0x564b0bcb43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bcb4920 0x564b0bc6a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bc6a850 0x564b0bc6ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564b0bab8c60 con 0x564b0bcb4000 2024-03-30T13:09:55.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564b0ba55b80 con 0x564b0bcb4920 2024-03-30T13:09:55.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564b0bab4c10 con 0x564b0bc6a850 2024-03-30T13:09:55.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4ab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 0x564b0bcb43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4ab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 0x564b0bcb43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57898/0 (socket says 172.21.15.83:57898) 2024-03-30T13:09:55.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/3025634849 learned_addr learned my addr 172.21.15.83:0/3025634849 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:55.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4aaffd640 1 --2- 172.21.15.83:0/3025634849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bcb4920 0x564b0bc6a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/3025634849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bc6a850 msgr2=0x564b0bc6ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4abfff640 1 --2- 172.21.15.83:0/3025634849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bc6a850 0x564b0bc6ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/3025634849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bc6a850 0x564b0bc6ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/3025634849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bcb4920 msgr2=0x564b0bc6a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/3025634849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bcb4920 0x564b0bc6a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/3025634849 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0bb5ff10 con 0x564b0bcb4000 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/3025634849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 0x564b0bcb43e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4011de0 tx=0x7fe4a4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca01ee0b61775a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4917fa640 1 -- 172.21.15.83:0/3025634849 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4025070 con 0x564b0bcb4000 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4917fa640 1 -- 172.21.15.83:0/3025634849 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a401b070 con 0x564b0bcb4000 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4917fa640 1 -- 172.21.15.83:0/3025634849 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4014dd0 con 0x564b0bcb4000 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- 172.21.15.83:0/3025634849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 msgr2=0x564b0bcb43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 --2- 172.21.15.83:0/3025634849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 0x564b0bcb43e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4011de0 tx=0x7fe4a4014000 comp rx=0 tx=0).stop 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- 172.21.15.83:0/3025634849 shutdown_connections 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 --2- 172.21.15.83:0/3025634849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bc6a850 0x564b0bc6ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 --2- 172.21.15.83:0/3025634849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bcb4920 0x564b0bc6a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 --2- 172.21.15.83:0/3025634849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 0x564b0bcb43e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- 172.21.15.83:0/3025634849 >> 172.21.15.83:0/3025634849 conn(0x564b0ba65bd0 msgr2=0x564b0bc68bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:55.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- 172.21.15.83:0/3025634849 shutdown_connections 2024-03-30T13:09:55.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- 172.21.15.83:0/3025634849 wait complete. 2024-03-30T13:09:55.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- start start 2024-03-30T13:09:55.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 Processor -- start 2024-03-30T13:09:55.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bc6a850 0x564b0bc6edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 0x564b0bc98400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bcb4920 0x564b0bc98940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564b0ba762a0 con 0x564b0bcb4000 2024-03-30T13:09:55.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564b0ba77760 con 0x564b0bc6a850 2024-03-30T13:09:55.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564b0bb39d50 con 0x564b0bcb4920 2024-03-30T13:09:55.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4b507b000 10 client.0 _ll_register_callbacks cb 0x564b0bc55af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:09:55.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4aaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 0x564b0bc98400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4aaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 0x564b0bc98400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57912/0 (socket says 172.21.15.83:57912) 2024-03-30T13:09:55.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4aaffd640 1 -- 172.21.15.83:0/2996684523 learned_addr learned my addr 172.21.15.83:0/2996684523 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:55.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.942+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bc6a850 0x564b0bc6edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4abfff640 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bcb4920 0x564b0bc98940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4aaffd640 1 -- 172.21.15.83:0/2996684523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bcb4920 msgr2=0x564b0bc98940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:55.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4aaffd640 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bcb4920 0x564b0bc98940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4aaffd640 1 -- 172.21.15.83:0/2996684523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bc6a850 msgr2=0x564b0bc6edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:55.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4aaffd640 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bc6a850 0x564b0bc6edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4aaffd640 1 -- 172.21.15.83:0/2996684523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0ba928d0 con 0x564b0bcb4000 2024-03-30T13:09:55.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4aaffd640 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 0x564b0bc98400 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0003cf0 tx=0x7fe4a0001620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea26cd3a8a4004ba server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:55.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe48a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe48a7fc640 1 -- 172.21.15.83:0/2996684523 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0015470 con 0x564b0bcb4000 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe48a7fc640 1 -- 172.21.15.83:0/2996684523 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe4a0015610 con 0x564b0bcb4000 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 -- 172.21.15.83:0/2996684523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4a401b070 con 0x564b0bcb4000 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe48a7fc640 1 -- 172.21.15.83:0/2996684523 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fe4a0022050 con 0x564b0bcb4000 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 10 client.5430 fetch_fsmap learned FSMap version 17 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 -- 172.21.15.83:0/2996684523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x564b0bafe0d0 con 0x564b0bcb4000 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe48a7fc640 1 -- 172.21.15.83:0/2996684523 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a401b070 con 0x564b0bcb4000 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe48a7fc640 1 -- 172.21.15.83:0/2996684523 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fe4a0025020 con 0x564b0bcb4000 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 10 client.5430 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 10 client.5430 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 20 client.5430 populate_metadata read hostname 'smithi083' 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b0bcba820 0x564b0bcbac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 4 client.5430 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:09:55.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 -- 172.21.15.83:0/2996684523 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b0ba53f70 con 0x564b0bcba820 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b0bcba820 0x564b0bcbac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe48a7fc640 10 client.5430 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b0bcba820 0x564b0bcbac30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98ff6be7ee0f518b server_cookie=948811339024b749 in_seq=0 out_seq=0 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe48a7fc640 1 -- 172.21.15.83:0/2996684523 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x564b0ba53f70 con 0x564b0bcba820 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe48a7fc640 10 client.5430 handle_command_reply: tid=0 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 client.5430 shutdown 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 -- 172.21.15.83:0/2996684523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 msgr2=0x564b0bc98400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 0x564b0bc98400 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0003cf0 tx=0x7fe4a0001620 comp rx=0 tx=0).stop 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 -- 172.21.15.83:0/2996684523 shutdown_connections 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bcb4920 0x564b0bc98940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b0bcba820 0x564b0bcbac30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0bcb4000 0x564b0bc98400 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2996684523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bc6a850 0x564b0bc6edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe48a7fc640 0 client.5430 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:09:55.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 -- 172.21.15.83:0/2996684523 >> 172.21.15.83:0/2996684523 conn(0x564b0ba65bd0 msgr2=0x564b0bc68bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:55.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 -- 172.21.15.83:0/2996684523 shutdown_connections 2024-03-30T13:09:55.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 1 -- 172.21.15.83:0/2996684523 wait complete. 2024-03-30T13:09:55.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.946+0000 7fe4b507b000 20 client.5430 trim_cache size 0 max 16384 2024-03-30T13:09:55.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 Processor -- start 2024-03-30T13:09:55.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- start start 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 0x564b0bcc1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bc6a850 0x564b0bcca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bcb4000 0x564b0bccae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac165990 con 0x564b0ba65bd0 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac157140 con 0x564b0bc6a850 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ac165340 con 0x564b0bcb4000 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4ab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 0x564b0bcc1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4ab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 0x564b0bcc1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57928/0 (socket says 172.21.15.83:57928) 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/2397047804 learned_addr learned my addr 172.21.15.83:0/2397047804 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/2397047804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bcb4000 msgr2=0x564b0bccae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/2397047804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bcb4000 0x564b0bccae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/2397047804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bc6a850 msgr2=0x564b0bcca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:55.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/2397047804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bc6a850 0x564b0bcca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/2397047804 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0ba86410 con 0x564b0ba65bd0 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/2397047804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 0x564b0bcc1070 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4011690 tx=0x7fe4a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7477ec0f8877eab1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe490ff9640 1 -- 172.21.15.83:0/2397047804 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4025040 con 0x564b0ba65bd0 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe490ff9640 1 -- 172.21.15.83:0/2397047804 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a401b050 con 0x564b0ba65bd0 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe490ff9640 1 -- 172.21.15.83:0/2397047804 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4033d60 con 0x564b0ba65bd0 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- 172.21.15.83:0/2397047804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 msgr2=0x564b0bcc1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2397047804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 0x564b0bcc1070 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4011690 tx=0x7fe4a4016000 comp rx=0 tx=0).stop 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- 172.21.15.83:0/2397047804 shutdown_connections 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2397047804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bcb4000 0x564b0bccae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2397047804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bc6a850 0x564b0bcca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2397047804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 0x564b0bcc1070 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- 172.21.15.83:0/2397047804 >> 172.21.15.83:0/2397047804 conn(0x564b0bc97690 msgr2=0x564b0bc6d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:55.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- 172.21.15.83:0/2397047804 shutdown_connections 2024-03-30T13:09:55.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- 172.21.15.83:0/2397047804 wait complete. 2024-03-30T13:09:55.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- start start 2024-03-30T13:09:55.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 Processor -- start 2024-03-30T13:09:55.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 0x564b0bd26090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bc6a850 0x564b0bd265d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bcb4000 0x564b0bc68360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564b0babd290 con 0x564b0ba65bd0 2024-03-30T13:09:55.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564b0ba7e370 con 0x564b0bcb4000 2024-03-30T13:09:55.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564b0ba79ee0 con 0x564b0bc6a850 2024-03-30T13:09:55.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4b507b000 10 client.0 _ll_register_callbacks cb 0x7fe4a0005050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:09:55.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4ab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 0x564b0bd26090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4ab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 0x564b0bd26090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57940/0 (socket says 172.21.15.83:57940) 2024-03-30T13:09:55.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.966+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/2605916178 learned_addr learned my addr 172.21.15.83:0/2605916178 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:55.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4abfff640 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bcb4000 0x564b0bc68360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4aaffd640 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bc6a850 0x564b0bd265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/2605916178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bc6a850 msgr2=0x564b0bd265d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bc6a850 0x564b0bd265d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/2605916178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bcb4000 msgr2=0x564b0bc68360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bcb4000 0x564b0bc68360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4ab7fe640 1 -- 172.21.15.83:0/2605916178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0bb3a1e0 con 0x564b0ba65bd0 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4aaffd640 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bc6a850 0x564b0bd265d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4ab7fe640 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 0x564b0bd26090 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4016040 tx=0x7fe4a4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a43a61d55ac845 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe48a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe48a7fc640 1 -- 172.21.15.83:0/2605916178 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4025070 con 0x564b0ba65bd0 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe48a7fc640 1 -- 172.21.15.83:0/2605916178 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe4a4033d50 con 0x564b0ba65bd0 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 -- 172.21.15.83:0/2605916178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4a401b050 con 0x564b0ba65bd0 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe48a7fc640 1 -- 172.21.15.83:0/2605916178 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fe4a40333c0 con 0x564b0ba65bd0 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 10 client.5436 fetch_fsmap learned FSMap version 17 2024-03-30T13:09:55.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 -- 172.21.15.83:0/2605916178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x564b0b7743b0 con 0x564b0ba65bd0 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe48a7fc640 1 -- 172.21.15.83:0/2605916178 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a401b050 con 0x564b0ba65bd0 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe48a7fc640 1 -- 172.21.15.83:0/2605916178 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fe4a4020070 con 0x564b0ba65bd0 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 10 client.5436 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 10 client.5436 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 20 client.5436 populate_metadata read hostname 'smithi083' 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b0bcb4920 0x564b0bc688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 4 client.5436 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 -- 172.21.15.83:0/2605916178 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x564b0bac61a0 con 0x564b0bcb4920 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4aaffd640 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b0bcb4920 0x564b0bc688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe48a7fc640 10 client.5436 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4aaffd640 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b0bcb4920 0x564b0bc688a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f67814d4316291e1 server_cookie=7173bba104795c28 in_seq=0 out_seq=0 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe48a7fc640 1 -- 172.21.15.83:0/2605916178 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564b0bac61a0 con 0x564b0bcb4920 2024-03-30T13:09:55.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe48a7fc640 10 client.5436 handle_command_reply: tid=0 2024-03-30T13:09:55.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 client.5436 shutdown 2024-03-30T13:09:55.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 -- 172.21.15.83:0/2605916178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 msgr2=0x564b0bd26090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:55.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 0x564b0bd26090 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4016040 tx=0x7fe4a4004740 comp rx=0 tx=0).stop 2024-03-30T13:09:55.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 -- 172.21.15.83:0/2605916178 shutdown_connections 2024-03-30T13:09:55.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b0bcb4000 0x564b0bc68360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b0bc6a850 0x564b0bd265d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b0bcb4920 0x564b0bc688a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 --2- 172.21.15.83:0/2605916178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b0ba65bd0 0x564b0bd26090 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe48a7fc640 0 client.5436 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:09:55.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 -- 172.21.15.83:0/2605916178 >> 172.21.15.83:0/2605916178 conn(0x564b0bc97690 msgr2=0x564b0bc6ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:55.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 -- 172.21.15.83:0/2605916178 shutdown_connections 2024-03-30T13:09:55.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 1 -- 172.21.15.83:0/2605916178 wait complete. 2024-03-30T13:09:55.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.970+0000 7fe4b507b000 20 client.5436 trim_cache size 0 max 16384 2024-03-30T13:09:55.983 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:09:55.983 INFO:teuthology.orchestra.run.smithi083.stdout: "return_code": 0, 2024-03-30T13:09:55.983 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_tag": "5c4d6a0f-7247-4376-817a-ceb5e259597b", 2024-03-30T13:09:55.983 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": "asynchronous" 2024-03-30T13:09:55.983 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:09:55.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.974+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/4089452600 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe498067fc0 msgr2=0x7fe49806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:55.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.974+0000 7fe4b1ef9640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe498067fc0 0x7fe49806a480 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4006cb0 tx=0x7fe4a4009240 comp rx=0 tx=0).stop 2024-03-30T13:09:55.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.974+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/4089452600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4ac157980 msgr2=0x7fe4ac1634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:55.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.974+0000 7fe4b1ef9640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4ac157980 0x7fe4ac1634a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe49c01af90 tx=0x7fe49c019680 comp rx=0 tx=0).stop 2024-03-30T13:09:55.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.974+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/4089452600 shutdown_connections 2024-03-30T13:09:55.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.974+0000 7fe4b1ef9640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fe498067fc0 0x7fe49806a480 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.974+0000 7fe4b1ef9640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4ac157980 0x7fe4ac1634a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.974+0000 7fe4b1ef9640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4ac15b5e0 0x7fe4ac14efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.974+0000 7fe4b1ef9640 1 --2- 172.21.15.83:0/4089452600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4ac0b5c40 0x7fe4ac1473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:55.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.974+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/4089452600 >> 172.21.15.83:0/4089452600 conn(0x7fe4ac0b6810 msgr2=0x7fe4ac06e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:55.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.974+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/4089452600 shutdown_connections 2024-03-30T13:09:55.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:55.974+0000 7fe4b1ef9640 1 -- 172.21.15.83:0/4089452600 wait complete. 2024-03-30T13:09:56.005 DEBUG:tasks.cephfs.test_uninlining:scrub start response: {'return_code': 0, 'scrub_tag': '5c4d6a0f-7247-4376-817a-ceb5e259597b', 'mode': 'asynchronous'} 2024-03-30T13:09:56.005 DEBUG:tasks.cephfs.test_uninlining:waiting for scrub to complete 2024-03-30T13:09:56.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:09:56.006 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-30T13:09:56.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.158+0000 7fcefe656640 1 Processor -- start 2024-03-30T13:09:56.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.158+0000 7fcefe656640 1 -- start start 2024-03-30T13:09:56.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.158+0000 7fcefe656640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcef80af5d0 0x7fcef80afa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.158+0000 7fcefe656640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcef81621b0 0x7fcef80aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.158+0000 7fcefe656640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcef80b5130 con 0x7fcef815e5f0 2024-03-30T13:09:56.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.158+0000 7fcefe656640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcef80b5fc0 con 0x7fcef81621b0 2024-03-30T13:09:56.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.158+0000 7fcefe656640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcef80b6b60 con 0x7fcef80af5d0 2024-03-30T13:09:56.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.162+0000 7fcef77fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcef80af5d0 0x7fcef80afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.162+0000 7fcefcbf3640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcef81621b0 0x7fcef80aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.162+0000 7fcef77fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcef80af5d0 0x7fcef80afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:56064/0 (socket says 172.21.15.83:56064) 2024-03-30T13:09:56.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.162+0000 7fcefcbf3640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcef81621b0 0x7fcef80aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:45280/0 (socket says 172.21.15.83:45280) 2024-03-30T13:09:56.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.162+0000 7fcef77fe640 1 -- 172.21.15.83:0/2934688400 learned_addr learned my addr 172.21.15.83:0/2934688400 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:56.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.162+0000 7fcef77fe640 1 -- 172.21.15.83:0/2934688400 >> v2:172.21.15.153:3300/0 conn(0x7fcef81621b0 msgr2=0x7fcef80aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:56.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.162+0000 7fcef77fe640 1 --2- 172.21.15.83:0/2934688400 >> v2:172.21.15.153:3300/0 conn(0x7fcef81621b0 0x7fcef80aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.162+0000 7fcef77fe640 1 -- 172.21.15.83:0/2934688400 >> v1:172.21.15.153:6789/0 conn(0x7fcef815e5f0 legacy=0x7fcef80b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:56.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.162+0000 7fcef6ffd640 1 -- 172.21.15.83:0/2934688400 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178932264 0 0) 0x7fcee8001120 con 0x7fcef815e5f0 2024-03-30T13:09:56.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.162+0000 7fcef77fe640 1 -- 172.21.15.83:0/2934688400 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef80b53b0 con 0x7fcef80af5d0 2024-03-30T13:09:56.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.162+0000 7fcefcbf3640 1 --2- 172.21.15.83:0/2934688400 >> v2:172.21.15.153:3300/0 conn(0x7fcef81621b0 0x7fcef80aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:09:56.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.162+0000 7fcef77fe640 1 --2- 172.21.15.83:0/2934688400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcef80af5d0 0x7fcef80afa20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fceec009870 tx=0x7fceec01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7dc738254d8a98b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:56.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcef6ffd640 1 -- 172.21.15.83:0/2934688400 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec0a95f0 con 0x7fcef80af5d0 2024-03-30T13:09:56.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcef6ffd640 1 -- 172.21.15.83:0/2934688400 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceec0a9790 con 0x7fcef80af5d0 2024-03-30T13:09:56.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcef6ffd640 1 -- 172.21.15.83:0/2934688400 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec0a9b60 con 0x7fcef80af5d0 2024-03-30T13:09:56.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcefe656640 1 -- 172.21.15.83:0/2934688400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcef80af5d0 msgr2=0x7fcef80afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:56.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcefe656640 1 --2- 172.21.15.83:0/2934688400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcef80af5d0 0x7fcef80afa20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fceec009870 tx=0x7fceec01c530 comp rx=0 tx=0).stop 2024-03-30T13:09:56.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcefe656640 1 -- 172.21.15.83:0/2934688400 shutdown_connections 2024-03-30T13:09:56.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcefe656640 1 --2- 172.21.15.83:0/2934688400 >> v2:172.21.15.153:3300/0 conn(0x7fcef81621b0 0x7fcef80aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcefe656640 1 --2- 172.21.15.83:0/2934688400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcef80af5d0 0x7fcef80afa20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcefe656640 1 -- 172.21.15.83:0/2934688400 >> 172.21.15.83:0/2934688400 conn(0x7fcef8072f00 msgr2=0x7fcef806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:56.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcefe656640 1 -- 172.21.15.83:0/2934688400 shutdown_connections 2024-03-30T13:09:56.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcefe656640 1 -- 172.21.15.83:0/2934688400 wait complete. 2024-03-30T13:09:56.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcefe656640 1 Processor -- start 2024-03-30T13:09:56.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.166+0000 7fcefe656640 1 -- start start 2024-03-30T13:09:56.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcefe656640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcef815e5f0 0x7fcef814aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcefe656640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef81621b0 0x7fcef81fbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcefe656640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcef8157330 0x7fcef815fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcefe656640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcef80ada10 con 0x7fcef81621b0 2024-03-30T13:09:56.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcefe656640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcef815e9d0 con 0x7fcef815e5f0 2024-03-30T13:09:56.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcefe656640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcef816b550 con 0x7fcef8157330 2024-03-30T13:09:56.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef81621b0 0x7fcef81fbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef81621b0 0x7fcef81fbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57948/0 (socket says 172.21.15.83:57948) 2024-03-30T13:09:56.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef77fe640 1 -- 172.21.15.83:0/956815731 learned_addr learned my addr 172.21.15.83:0/956815731 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:56.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcefcbf3640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcef8157330 0x7fcef815fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef7fff640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcef815e5f0 0x7fcef814aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef77fe640 1 -- 172.21.15.83:0/956815731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcef8157330 msgr2=0x7fcef815fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:56.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef77fe640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcef8157330 0x7fcef815fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef77fe640 1 -- 172.21.15.83:0/956815731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcef815e5f0 msgr2=0x7fcef814aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:56.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef77fe640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcef815e5f0 0x7fcef814aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef77fe640 1 -- 172.21.15.83:0/956815731 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef814ea90 con 0x7fcef81621b0 2024-03-30T13:09:56.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef77fe640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef81621b0 0x7fcef81fbb60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fceec009870 tx=0x7fceec0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:56.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef4ff9640 1 -- 172.21.15.83:0/956815731 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec0c0070 con 0x7fcef81621b0 2024-03-30T13:09:56.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef4ff9640 1 -- 172.21.15.83:0/956815731 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceec004030 con 0x7fcef81621b0 2024-03-30T13:09:56.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcefe656640 1 -- 172.21.15.83:0/956815731 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef814ed70 con 0x7fcef81621b0 2024-03-30T13:09:56.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef4ff9640 1 -- 172.21.15.83:0/956815731 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec0043e0 con 0x7fcef81621b0 2024-03-30T13:09:56.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcefe656640 1 -- 172.21.15.83:0/956815731 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef814f330 con 0x7fcef81621b0 2024-03-30T13:09:56.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef4ff9640 1 -- 172.21.15.83:0/956815731 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fceec0c3070 con 0x7fcef81621b0 2024-03-30T13:09:56.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.170+0000 7fcef4ff9640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcee4067fc0 0x7fcee406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef4ff9640 1 -- 172.21.15.83:0/956815731 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fceec120830 con 0x7fcef81621b0 2024-03-30T13:09:56.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef7fff640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcee4067fc0 0x7fcee406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef7fff640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcee4067fc0 0x7fcee406a480 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcee8000f70 tx=0x7fcee8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:56.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcf017d8000 1 Processor -- start 2024-03-30T13:09:56.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcf017d8000 1 -- start start 2024-03-30T13:09:56.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcf017d8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 0x555e756a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcf017d8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2f20 0x555e756557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcf017d8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e75655ce0 0x555e756560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcf017d8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555e7553ee20 con 0x555e756a2600 2024-03-30T13:09:56.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcf017d8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555e754a7b00 con 0x555e75655ce0 2024-03-30T13:09:56.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcf017d8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x555e75444940 con 0x555e756a2f20 2024-03-30T13:09:56.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 0x555e756a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 0x555e756a29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57962/0 (socket says 172.21.15.83:57962) 2024-03-30T13:09:56.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef7fff640 1 -- 172.21.15.83:0/3573846011 learned_addr learned my addr 172.21.15.83:0/3573846011 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:56.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef77fe640 1 --2- 172.21.15.83:0/3573846011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2f20 0x555e756557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef7fff640 1 -- 172.21.15.83:0/3573846011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2f20 msgr2=0x555e756557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:56.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef7fff640 1 --2- 172.21.15.83:0/3573846011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2f20 0x555e756557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcefcbf3640 1 --2- 172.21.15.83:0/3573846011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e75655ce0 0x555e756560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef7fff640 1 -- 172.21.15.83:0/3573846011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e75655ce0 msgr2=0x555e756560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:56.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef7fff640 1 --2- 172.21.15.83:0/3573846011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e75655ce0 0x555e756560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef7fff640 1 -- 172.21.15.83:0/3573846011 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e7542d380 con 0x555e756a2600 2024-03-30T13:09:56.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef77fe640 1 --2- 172.21.15.83:0/3573846011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2f20 0x555e756557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:56.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.174+0000 7fcef7fff640 1 --2- 172.21.15.83:0/3573846011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 0x555e756a29e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcee800fb40 tx=0x7fcee8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c883cdc9693af0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:56.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fceddffb640 1 -- 172.21.15.83:0/3573846011 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8025070 con 0x555e756a2600 2024-03-30T13:09:56.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fceddffb640 1 -- 172.21.15.83:0/3573846011 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee801b050 con 0x555e756a2600 2024-03-30T13:09:56.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fceddffb640 1 -- 172.21.15.83:0/3573846011 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8014de0 con 0x555e756a2600 2024-03-30T13:09:56.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fcf017d8000 1 -- 172.21.15.83:0/3573846011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 msgr2=0x555e756a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:56.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fcf017d8000 1 --2- 172.21.15.83:0/3573846011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 0x555e756a29e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcee800fb40 tx=0x7fcee8012000 comp rx=0 tx=0).stop 2024-03-30T13:09:56.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fcf017d8000 1 -- 172.21.15.83:0/3573846011 shutdown_connections 2024-03-30T13:09:56.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fcf017d8000 1 --2- 172.21.15.83:0/3573846011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e75655ce0 0x555e756560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fcf017d8000 1 --2- 172.21.15.83:0/3573846011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2f20 0x555e756557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fcf017d8000 1 --2- 172.21.15.83:0/3573846011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 0x555e756a29e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fcf017d8000 1 -- 172.21.15.83:0/3573846011 >> 172.21.15.83:0/3573846011 conn(0x555e756833a0 msgr2=0x555e75685790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:56.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fcf017d8000 1 -- 172.21.15.83:0/3573846011 shutdown_connections 2024-03-30T13:09:56.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fcf017d8000 1 -- 172.21.15.83:0/3573846011 wait complete. 2024-03-30T13:09:56.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fcf017d8000 1 -- start start 2024-03-30T13:09:56.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.178+0000 7fcf017d8000 1 Processor -- start 2024-03-30T13:09:56.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcf017d8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e75655ce0 0x555e756b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcf017d8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 0x555e756b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcf017d8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e756a2f20 0x555e7565a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcf017d8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555e754651e0 con 0x555e756a2600 2024-03-30T13:09:56.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcf017d8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555e754a3ab0 con 0x555e756a2f20 2024-03-30T13:09:56.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcf017d8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x555e7545e750 con 0x555e75655ce0 2024-03-30T13:09:56.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcef7fff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e75655ce0 0x555e756b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcef7fff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e75655ce0 0x555e756b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:56100/0 (socket says 172.21.15.83:56100) 2024-03-30T13:09:56.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcef7fff640 1 -- 172.21.15.83:0/2191222542 learned_addr learned my addr 172.21.15.83:0/2191222542 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:56.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcef7fff640 1 -- 172.21.15.83:0/2191222542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e756a2f20 msgr2=0x555e7565a920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-30T13:09:56.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcef7fff640 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e756a2f20 0x555e7565a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcef7fff640 1 -- 172.21.15.83:0/2191222542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 msgr2=0x555e756b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:56.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcf017d8000 10 client.0 _ll_register_callbacks cb 0x555e756436a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:09:56.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcef77fe640 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 0x555e756b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.182+0000 7fcef7fff640 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 0x555e756b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcef7fff640 1 -- 172.21.15.83:0/2191222542 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x555e75463b70 con 0x555e75655ce0 2024-03-30T13:09:56.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcf017d8000 1 -- 172.21.15.83:0/2191222542 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcee801b050 con 0x555e75655ce0 2024-03-30T13:09:56.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcef7fff640 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e75655ce0 0x555e756b2100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcee8001e90 tx=0x7fcee8001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2ddd4b8b7fdf3bc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:56.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fced6ffd640 10 client.4913 ms_handle_connect on v2:172.21.15.153:3301/0 2024-03-30T13:09:56.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fced6ffd640 1 -- 172.21.15.83:0/2191222542 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8031060 con 0x555e75655ce0 2024-03-30T13:09:56.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcef77fe640 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 0x555e756b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:09:56.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fced6ffd640 1 -- 172.21.15.83:0/2191222542 <== mon.2 v2:172.21.15.153:3301/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fcee8020960 con 0x555e75655ce0 2024-03-30T13:09:56.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fced6ffd640 1 -- 172.21.15.83:0/2191222542 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fcee8025040 con 0x555e75655ce0 2024-03-30T13:09:56.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcf017d8000 10 client.4913 fetch_fsmap learned FSMap version 17 2024-03-30T13:09:56.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcf017d8000 1 -- 172.21.15.83:0/2191222542 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({fsmap=17}) -- 0x555e75444b90 con 0x555e75655ce0 2024-03-30T13:09:56.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fced6ffd640 1 -- 172.21.15.83:0/2191222542 <== mon.2 v2:172.21.15.153:3301/0 4 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fcee802b070 con 0x555e75655ce0 2024-03-30T13:09:56.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcf017d8000 10 client.4913 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:09:56.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcf017d8000 10 client.4913 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:09:56.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcf017d8000 20 client.4913 populate_metadata read hostname 'smithi083' 2024-03-30T13:09:56.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcf017d8000 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555e7565b690 0x555e7565baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcf017d8000 4 client.4913 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:09:56.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcf017d8000 1 -- 172.21.15.83:0/2191222542 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e75442dd0 con 0x555e7565b690 2024-03-30T13:09:56.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcef77fe640 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555e7565b690 0x555e7565baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fcef77fe640 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555e7565b690 0x555e7565baa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d88d48be6513f12f server_cookie=f4c600f593bdb4ad in_seq=0 out_seq=0 2024-03-30T13:09:56.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.186+0000 7fced6ffd640 10 client.4913 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:09:56.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fced6ffd640 1 -- 172.21.15.83:0/2191222542 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x555e75442dd0 con 0x555e7565b690 2024-03-30T13:09:56.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fced6ffd640 10 client.4913 handle_command_reply: tid=0 2024-03-30T13:09:56.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fcf017d8000 1 client.4913 shutdown 2024-03-30T13:09:56.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fcf017d8000 1 -- 172.21.15.83:0/2191222542 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e75655ce0 msgr2=0x555e756b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:56.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fcf017d8000 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e75655ce0 0x555e756b2100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcee8001e90 tx=0x7fcee8001090 comp rx=0 tx=0).stop 2024-03-30T13:09:56.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fcf017d8000 1 -- 172.21.15.83:0/2191222542 shutdown_connections 2024-03-30T13:09:56.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fcf017d8000 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e756a2f20 0x555e7565a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fcf017d8000 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555e7565b690 0x555e7565baa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fcf017d8000 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2600 0x555e756b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fcf017d8000 1 --2- 172.21.15.83:0/2191222542 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e75655ce0 0x555e756b2100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fced6ffd640 0 client.4913 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:09:56.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fcf017d8000 1 -- 172.21.15.83:0/2191222542 >> 172.21.15.83:0/2191222542 conn(0x555e756833a0 msgr2=0x555e75685790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:56.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fcf017d8000 1 -- 172.21.15.83:0/2191222542 shutdown_connections 2024-03-30T13:09:56.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fcf017d8000 1 -- 172.21.15.83:0/2191222542 wait complete. 2024-03-30T13:09:56.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.190+0000 7fcf017d8000 20 client.4913 trim_cache size 0 max 16384 2024-03-30T13:09:56.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 Processor -- start 2024-03-30T13:09:56.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 -- start start 2024-03-30T13:09:56.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e75655ce0 0x555e756b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2600 0x555e756c1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e756a2f20 0x555e756c1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fced800c740 con 0x555e75655ce0 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fced800b720 con 0x555e756a2f20 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fced800aa00 con 0x555e756a2600 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcef7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e75655ce0 0x555e756b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcef7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e75655ce0 0x555e756b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57982/0 (socket says 172.21.15.83:57982) 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcef7fff640 1 -- 172.21.15.83:0/677096871 learned_addr learned my addr 172.21.15.83:0/677096871 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcef77fe640 1 --2- 172.21.15.83:0/677096871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2600 0x555e756c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcefcbf3640 1 --2- 172.21.15.83:0/677096871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e756a2f20 0x555e756c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcef7fff640 1 -- 172.21.15.83:0/677096871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2600 msgr2=0x555e756c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcef7fff640 1 --2- 172.21.15.83:0/677096871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2600 0x555e756c1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcef7fff640 1 -- 172.21.15.83:0/677096871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e756a2f20 msgr2=0x555e756c1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:56.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcef7fff640 1 --2- 172.21.15.83:0/677096871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e756a2f20 0x555e756c1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcef7fff640 1 -- 172.21.15.83:0/677096871 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e756b1b40 con 0x555e75655ce0 2024-03-30T13:09:56.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcef7fff640 1 --2- 172.21.15.83:0/677096871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e75655ce0 0x555e756b7170 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fcee80013c0 tx=0x7fcee802b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6dbe642e267a120 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:56.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcedd7fa640 1 -- 172.21.15.83:0/677096871 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8031070 con 0x555e75655ce0 2024-03-30T13:09:56.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcedd7fa640 1 -- 172.21.15.83:0/677096871 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee801b050 con 0x555e75655ce0 2024-03-30T13:09:56.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcedd7fa640 1 -- 172.21.15.83:0/677096871 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee802c430 con 0x555e75655ce0 2024-03-30T13:09:56.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 -- 172.21.15.83:0/677096871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e75655ce0 msgr2=0x555e756b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:56.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 --2- 172.21.15.83:0/677096871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e75655ce0 0x555e756b7170 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fcee80013c0 tx=0x7fcee802b000 comp rx=0 tx=0).stop 2024-03-30T13:09:56.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 -- 172.21.15.83:0/677096871 shutdown_connections 2024-03-30T13:09:56.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 --2- 172.21.15.83:0/677096871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e756a2f20 0x555e756c1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 --2- 172.21.15.83:0/677096871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2600 0x555e756c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 --2- 172.21.15.83:0/677096871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e75655ce0 0x555e756b7170 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 -- 172.21.15.83:0/677096871 >> 172.21.15.83:0/677096871 conn(0x555e756833a0 msgr2=0x555e756a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 -- 172.21.15.83:0/677096871 shutdown_connections 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.210+0000 7fcf017d8000 1 -- 172.21.15.83:0/677096871 wait complete. 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 -- start start 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 Processor -- start 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e75655ce0 0x555e75718af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2600 0x555e7565a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2f20 0x555e7565aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555e75473150 con 0x555e756a2f20 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fced800b050 con 0x555e75655ce0 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x555e75576750 con 0x555e756a2600 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 10 client.0 _ll_register_callbacks cb 0x7fcee8023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:09:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcefcbf3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2f20 0x555e7565aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcefcbf3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2f20 0x555e7565aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57998/0 (socket says 172.21.15.83:57998) 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcefcbf3640 1 -- 172.21.15.83:0/1173244752 learned_addr learned my addr 172.21.15.83:0/1173244752 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcef7fff640 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e75655ce0 0x555e75718af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcef77fe640 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2600 0x555e7565a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcefcbf3640 1 -- 172.21.15.83:0/1173244752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2600 msgr2=0x555e7565a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcefcbf3640 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2600 0x555e7565a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcefcbf3640 1 -- 172.21.15.83:0/1173244752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e75655ce0 msgr2=0x555e75718af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcefcbf3640 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e75655ce0 0x555e75718af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcefcbf3640 1 -- 172.21.15.83:0/1173244752 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e75528470 con 0x555e756a2f20 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcef7fff640 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e75655ce0 0x555e75718af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcefcbf3640 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2f20 0x555e7565aa20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcef0007da0 tx=0x7fcef0014690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63350b68d230044 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fced6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fced6ffd640 1 -- 172.21.15.83:0/1173244752 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef001d070 con 0x555e756a2f20 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fced6ffd640 1 -- 172.21.15.83:0/1173244752 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fcef0017640 con 0x555e756a2f20 2024-03-30T13:09:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 -- 172.21.15.83:0/1173244752 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcee801b050 con 0x555e756a2f20 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fced6ffd640 1 -- 172.21.15.83:0/1173244752 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fcef0028050 con 0x555e756a2f20 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 10 client.5448 fetch_fsmap learned FSMap version 17 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 -- 172.21.15.83:0/1173244752 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x555e754361e0 con 0x555e756a2f20 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fced6ffd640 1 -- 172.21.15.83:0/1173244752 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee801b050 con 0x555e756a2f20 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fced6ffd640 1 -- 172.21.15.83:0/1173244752 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fcef002b020 con 0x555e756a2f20 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 10 client.5448 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 10 client.5448 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 20 client.5448 populate_metadata read hostname 'smithi083' 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555e756b3f30 0x555e756b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 4 client.5448 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 -- 172.21.15.83:0/1173244752 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555e754b5040 con 0x555e756b3f30 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcef7fff640 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555e756b3f30 0x555e756b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fced6ffd640 10 client.5448 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcef7fff640 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555e756b3f30 0x555e756b4340 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e4a89b9e6065e7d server_cookie=d0e037189d04dd53 in_seq=0 out_seq=0 2024-03-30T13:09:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fced6ffd640 1 -- 172.21.15.83:0/1173244752 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+564 (crc 0 0 0) 0x555e754b5040 con 0x555e756b3f30 2024-03-30T13:09:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fced6ffd640 10 client.5448 handle_command_reply: tid=0 2024-03-30T13:09:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 client.5448 shutdown 2024-03-30T13:09:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 -- 172.21.15.83:0/1173244752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2f20 msgr2=0x555e7565aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2f20 0x555e7565aa20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcef0007da0 tx=0x7fcef0014690 comp rx=0 tx=0).stop 2024-03-30T13:09:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 -- 172.21.15.83:0/1173244752 shutdown_connections 2024-03-30T13:09:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555e756b3f30 0x555e756b4340 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555e756a2f20 0x555e7565aa20 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555e756a2600 0x555e7565a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fced6ffd640 0 client.5448 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:09:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 --2- 172.21.15.83:0/1173244752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555e75655ce0 0x555e75718af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 -- 172.21.15.83:0/1173244752 >> 172.21.15.83:0/1173244752 conn(0x555e756833a0 msgr2=0x555e756a1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 -- 172.21.15.83:0/1173244752 shutdown_connections 2024-03-30T13:09:56.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 1 -- 172.21.15.83:0/1173244752 wait complete. 2024-03-30T13:09:56.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.214+0000 7fcf017d8000 20 client.5448 trim_cache size 0 max 16384 2024-03-30T13:09:56.227 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:09:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-30T13:09:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": { 2024-03-30T13:09:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: "5c4d6a0f-7247-4376-817a-ceb5e259597b": { 2024-03-30T13:09:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-03-30T13:09:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: "tag": "5c4d6a0f-7247-4376-817a-ceb5e259597b", 2024-03-30T13:09:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: "options": "recursive" 2024-03-30T13:09:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:09:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_stats": { 2024-03-30T13:09:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: "5c4d6a0f-7247-4376-817a-ceb5e259597b": { 2024-03-30T13:09:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: "start_time": "2024-03-30T13:09:55.970459+0000", 2024-03-30T13:09:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-03-30T13:09:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_started": 0, 2024-03-30T13:09:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_passed": 0, 2024-03-30T13:09:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_failed": 0, 2024-03-30T13:09:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_skipped": 0 2024-03-30T13:09:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:09:56.229 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:09:56.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.218+0000 7fcefe656640 1 -- 172.21.15.83:0/956815731 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcee4067fc0 msgr2=0x7fcee406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:56.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.218+0000 7fcefe656640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcee4067fc0 0x7fcee406a480 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcee8000f70 tx=0x7fcee8009040 comp rx=0 tx=0).stop 2024-03-30T13:09:56.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.218+0000 7fcefe656640 1 -- 172.21.15.83:0/956815731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef81621b0 msgr2=0x7fcef81fbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:09:56.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.218+0000 7fcefe656640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef81621b0 0x7fcef81fbb60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fceec009870 tx=0x7fceec0046d0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.218+0000 7fcefe656640 1 -- 172.21.15.83:0/956815731 shutdown_connections 2024-03-30T13:09:56.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.218+0000 7fcefe656640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcee4067fc0 0x7fcee406a480 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.218+0000 7fcefe656640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcef8157330 0x7fcef815fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.218+0000 7fcefe656640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef81621b0 0x7fcef81fbb60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.218+0000 7fcefe656640 1 --2- 172.21.15.83:0/956815731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcef815e5f0 0x7fcef814aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:09:56.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.218+0000 7fcefe656640 1 -- 172.21.15.83:0/956815731 >> 172.21.15.83:0/956815731 conn(0x7fcef8072f00 msgr2=0x7fcef806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:09:56.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.218+0000 7fcefe656640 1 -- 172.21.15.83:0/956815731 shutdown_connections 2024-03-30T13:09:56.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:09:56.218+0000 7fcefe656640 1 -- 172.21.15.83:0/956815731 wait complete. 2024-03-30T13:09:56.239 INFO:tasks.cephfs.filesystem:scrub status for tag:5c4d6a0f-7247-4376-817a-ceb5e259597b - {'path': '/', 'tag': '5c4d6a0f-7247-4376-817a-ceb5e259597b', 'options': 'recursive'} 2024-03-30T13:10:24.908 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:24.912 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:26.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:10:26.241 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-30T13:10:26.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.365+0000 7f643e62f640 1 Processor -- start 2024-03-30T13:10:26.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.365+0000 7f643e62f640 1 -- start start 2024-03-30T13:10:26.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.365+0000 7f643e62f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f643813f250 0x7f6438160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.365+0000 7f643e62f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438160b40 0x7f64380b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.365+0000 7f643e62f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f643806f310 con 0x7f643813f630 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.365+0000 7f643e62f640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f643806f5f0 con 0x7f643813f250 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.365+0000 7f643e62f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f643806f8d0 con 0x7f6438160b40 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.365+0000 7f643cbcc640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f643813f630 0x7f643806e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:58834/0 (socket says 172.21.15.83:58834) 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.365+0000 7f643cbcc640 1 -- 172.21.15.83:0/2752655870 learned_addr learned my addr 172.21.15.83:0/2752655870 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f6437fff640 1 --2- 172.21.15.83:0/2752655870 >> v2:172.21.15.153:3300/0 conn(0x7f643813f250 0x7f6438160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f642f7fe640 1 --2- 172.21.15.83:0/2752655870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438160b40 0x7f64380b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035950865 0 0) 0x7f643806f310 con 0x7f643813f630 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6424003530 con 0x7f643813f630 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3534404989 0 0) 0x7f6424003530 con 0x7f643813f630 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438160b40 msgr2=0x7f64380b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 --2- 172.21.15.83:0/2752655870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438160b40 0x7f64380b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 >> v2:172.21.15.153:3300/0 conn(0x7f643813f250 msgr2=0x7f6438160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 --2- 172.21.15.83:0/2752655870 >> v2:172.21.15.153:3300/0 conn(0x7f643813f250 0x7f6438160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643806fbb0 con 0x7f643813f630 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f6430001a00 con 0x7f643813f630 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 >> v1:172.21.15.83:6789/0 conn(0x7f643813f630 legacy=0x7f643806e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 --2- 172.21.15.83:0/2752655870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64240039c0 0x7f6424003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 --2- 172.21.15.83:0/2752655870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6424004810 0x7f6424004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 --2- 172.21.15.83:0/2752655870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438160b40 0x7f64240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f643806f5f0 con 0x7f64240039c0 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f643806f8d0 con 0x7f6424004810 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f642400b9d0 con 0x7f6438160b40 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f6437fff640 1 --2- 172.21.15.83:0/2752655870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64240039c0 0x7f6424003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f642f7fe640 1 --2- 172.21.15.83:0/2752655870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6424004810 0x7f6424004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f643cbcc640 1 --2- 172.21.15.83:0/2752655870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438160b40 0x7f64240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f6437fff640 1 -- 172.21.15.83:0/2752655870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438160b40 msgr2=0x7f64240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f6437fff640 1 --2- 172.21.15.83:0/2752655870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438160b40 0x7f64240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f6437fff640 1 -- 172.21.15.83:0/2752655870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6424004810 msgr2=0x7f6424004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f6437fff640 1 --2- 172.21.15.83:0/2752655870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6424004810 0x7f6424004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.369+0000 7f6437fff640 1 -- 172.21.15.83:0/2752655870 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6424003530 con 0x7f64240039c0 2024-03-30T13:10:26.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f6437fff640 1 --2- 172.21.15.83:0/2752655870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64240039c0 0x7f6424003de0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6428009ae0 tx=0x7f642801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c039efed36acde0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:26.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280096b0 con 0x7f64240039c0 2024-03-30T13:10:26.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64280a6480 con 0x7f64240039c0 2024-03-30T13:10:26.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f64377fe640 1 -- 172.21.15.83:0/2752655870 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280a6870 con 0x7f64240039c0 2024-03-30T13:10:26.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 -- 172.21.15.83:0/2752655870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64240039c0 msgr2=0x7f6424003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 --2- 172.21.15.83:0/2752655870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64240039c0 0x7f6424003de0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6428009ae0 tx=0x7f642801ca80 comp rx=0 tx=0).stop 2024-03-30T13:10:26.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643cbcc640 1 -- 172.21.15.83:0/2752655870 reap_dead start 2024-03-30T13:10:26.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 -- 172.21.15.83:0/2752655870 shutdown_connections 2024-03-30T13:10:26.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 -- 172.21.15.83:0/2752655870 >> 172.21.15.83:0/2752655870 conn(0x7f6438072ec0 msgr2=0x7f643806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:26.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 -- 172.21.15.83:0/2752655870 shutdown_connections 2024-03-30T13:10:26.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 -- 172.21.15.83:0/2752655870 wait complete. 2024-03-30T13:10:26.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 Processor -- start 2024-03-30T13:10:26.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 -- start start 2024-03-30T13:10:26.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64240039c0 0x7f643814a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438145330 0x7f643813a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6438145790 0x7f643813cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f64381601c0 con 0x7f64240039c0 2024-03-30T13:10:26.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6438160040 con 0x7f6438145790 2024-03-30T13:10:26.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643e62f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f64380b5e00 con 0x7f6438145330 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f6437fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64240039c0 0x7f643814a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f6437fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64240039c0 0x7f643814a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35834/0 (socket says 172.21.15.83:35834) 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f6437fff640 1 -- 172.21.15.83:0/3038222619 learned_addr learned my addr 172.21.15.83:0/3038222619 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f642f7fe640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438145330 0x7f643813a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.373+0000 7f643cbcc640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6438145790 0x7f643813cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f6437fff640 1 -- 172.21.15.83:0/3038222619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438145330 msgr2=0x7f643813a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f6437fff640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438145330 0x7f643813a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f6437fff640 1 -- 172.21.15.83:0/3038222619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6438145790 msgr2=0x7f643813cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f6437fff640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6438145790 0x7f643813cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f6437fff640 1 -- 172.21.15.83:0/3038222619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643813ac30 con 0x7f64240039c0 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f643cbcc640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6438145790 0x7f643813cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f6437fff640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64240039c0 0x7f643814a280 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6428009ae0 tx=0x7f6424005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f64357fa640 1 -- 172.21.15.83:0/3038222619 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280a6cb0 con 0x7f64240039c0 2024-03-30T13:10:26.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f64357fa640 1 -- 172.21.15.83:0/3038222619 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64280a6e50 con 0x7f64240039c0 2024-03-30T13:10:26.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f643e62f640 1 -- 172.21.15.83:0/3038222619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643813af10 con 0x7f64240039c0 2024-03-30T13:10:26.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f64357fa640 1 -- 172.21.15.83:0/3038222619 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280a7680 con 0x7f64240039c0 2024-03-30T13:10:26.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f643e62f640 1 -- 172.21.15.83:0/3038222619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643813b4d0 con 0x7f64240039c0 2024-03-30T13:10:26.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f64357fa640 1 -- 172.21.15.83:0/3038222619 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f64280a7820 con 0x7f64240039c0 2024-03-30T13:10:26.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f64357fa640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6418067fc0 0x7f641806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f642f7fe640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6418067fc0 0x7f641806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f64357fa640 1 -- 172.21.15.83:0/3038222619 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6428120970 con 0x7f64240039c0 2024-03-30T13:10:26.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f642f7fe640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6418067fc0 0x7f641806a480 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f643815e690 tx=0x7f6420008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f64417b1000 1 Processor -- start 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.377+0000 7f64417b1000 1 -- start start 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb8bce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8bd380 0x55b1fb86fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8700f0 0x55b1fb8704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b1fb754e20 con 0x55b1fb8bca60 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b1fb6bdb00 con 0x55b1fb8700f0 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b1fb65a940 con 0x55b1fb8bd380 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f6437fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb8bce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f6437fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb8bce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35846/0 (socket says 172.21.15.83:35846) 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f6437fff640 1 -- 172.21.15.83:0/3319197904 learned_addr learned my addr 172.21.15.83:0/3319197904 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f6437fff640 1 -- 172.21.15.83:0/3319197904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8bd380 msgr2=0x55b1fb86fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f6437fff640 1 --2- 172.21.15.83:0/3319197904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8bd380 0x55b1fb86fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f6437fff640 1 -- 172.21.15.83:0/3319197904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8700f0 msgr2=0x55b1fb8704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f6437fff640 1 --2- 172.21.15.83:0/3319197904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8700f0 0x55b1fb8704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f6437fff640 1 -- 172.21.15.83:0/3319197904 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1fb643380 con 0x55b1fb8bca60 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f6437fff640 1 --2- 172.21.15.83:0/3319197904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb8bce40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f64280f0680 tx=0x7f64280a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146a70f75e93a4a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f642dffb640 1 -- 172.21.15.83:0/3319197904 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280f0980 con 0x55b1fb8bca60 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f642dffb640 1 -- 172.21.15.83:0/3319197904 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64280f4d30 con 0x55b1fb8bca60 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f642dffb640 1 -- 172.21.15.83:0/3319197904 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280f9560 con 0x55b1fb8bca60 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 -- 172.21.15.83:0/3319197904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 msgr2=0x55b1fb8bce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 --2- 172.21.15.83:0/3319197904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb8bce40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f64280f0680 tx=0x7f64280a7000 comp rx=0 tx=0).stop 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 -- 172.21.15.83:0/3319197904 shutdown_connections 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 --2- 172.21.15.83:0/3319197904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8700f0 0x55b1fb8704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 --2- 172.21.15.83:0/3319197904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8bd380 0x55b1fb86fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 --2- 172.21.15.83:0/3319197904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb8bce40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 -- 172.21.15.83:0/3319197904 >> 172.21.15.83:0/3319197904 conn(0x55b1fb8993a0 msgr2=0x55b1fb89b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 -- 172.21.15.83:0/3319197904 shutdown_connections 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 -- 172.21.15.83:0/3319197904 wait complete. 2024-03-30T13:10:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 -- start start 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 Processor -- start 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 0x55b1fb879fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb87a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 0x55b1fb87aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b1fb67b1e0 con 0x55b1fb8bca60 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b1fb6b9ab0 con 0x55b1fb8bd380 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b1fb754e20 con 0x55b1fb8700f0 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f64417b1000 10 client.0 _ll_register_callbacks cb 0x55b1fb8596a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f642f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb87a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f642f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb87a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35848/0 (socket says 172.21.15.83:35848) 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f642f7fe640 1 -- 172.21.15.83:0/3561768456 learned_addr learned my addr 172.21.15.83:0/3561768456 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f6437fff640 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 0x55b1fb879fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f643cbcc640 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 0x55b1fb87aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f642f7fe640 1 -- 172.21.15.83:0/3561768456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 msgr2=0x55b1fb879fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f642f7fe640 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 0x55b1fb879fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f642f7fe640 1 -- 172.21.15.83:0/3561768456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 msgr2=0x55b1fb87aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f642f7fe640 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 0x55b1fb87aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.381+0000 7f642f7fe640 1 -- 172.21.15.83:0/3561768456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1fb679b70 con 0x55b1fb8bca60 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f642f7fe640 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb87a4f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6420013e60 tx=0x7f6420009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5062936dae28a4f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f6416ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f6416ffd640 1 -- 172.21.15.83:0/3561768456 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642001e050 con 0x55b1fb8bca60 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f6416ffd640 1 -- 172.21.15.83:0/3561768456 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6420023640 con 0x55b1fb8bca60 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 -- 172.21.15.83:0/3561768456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64280f4d30 con 0x55b1fb8bca60 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f6416ffd640 1 -- 172.21.15.83:0/3561768456 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6420030050 con 0x55b1fb8bca60 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 10 client.5460 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 -- 172.21.15.83:0/3561768456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55b1fb65ab90 con 0x55b1fb8bca60 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f6416ffd640 1 -- 172.21.15.83:0/3561768456 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64280f4d30 con 0x55b1fb8bca60 2024-03-30T13:10:26.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f6416ffd640 1 -- 172.21.15.83:0/3561768456 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f6420033020 con 0x55b1fb8bca60 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 10 client.5460 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 10 client.5460 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 20 client.5460 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1fb87b2d0 0x55b1fb8ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 4 client.5460 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 -- 172.21.15.83:0/3561768456 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1fb658dd0 con 0x55b1fb87b2d0 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f6437fff640 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1fb87b2d0 0x55b1fb8ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f6437fff640 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1fb87b2d0 0x55b1fb8ce1e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22d582b053987de7 server_cookie=6b2fd209f44f8b15 in_seq=0 out_seq=0 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f6416ffd640 10 client.5460 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f6416ffd640 1 -- 172.21.15.83:0/3561768456 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b1fb658dd0 con 0x55b1fb87b2d0 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f6416ffd640 10 client.5460 handle_command_reply: tid=0 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 client.5460 shutdown 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 -- 172.21.15.83:0/3561768456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 msgr2=0x55b1fb87a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb87a4f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6420013e60 tx=0x7f6420009190 comp rx=0 tx=0).stop 2024-03-30T13:10:26.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 -- 172.21.15.83:0/3561768456 shutdown_connections 2024-03-30T13:10:26.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 0x55b1fb87aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1fb87b2d0 0x55b1fb8ce1e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb87a4f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 --2- 172.21.15.83:0/3561768456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 0x55b1fb879fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f6416ffd640 0 client.5460 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:26.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 -- 172.21.15.83:0/3561768456 >> 172.21.15.83:0/3561768456 conn(0x55b1fb8993a0 msgr2=0x55b1fb86aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:26.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 -- 172.21.15.83:0/3561768456 shutdown_connections 2024-03-30T13:10:26.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 1 -- 172.21.15.83:0/3561768456 wait complete. 2024-03-30T13:10:26.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.385+0000 7f64417b1000 20 client.5460 trim_cache size 0 max 16384 2024-03-30T13:10:26.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 Processor -- start 2024-03-30T13:10:26.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 -- start start 2024-03-30T13:10:26.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 0x55b1fb897ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb898430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 0x55b1fb8ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f64381ffb00 con 0x55b1fb8bca60 2024-03-30T13:10:26.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64380b5450 con 0x55b1fb8bd380 2024-03-30T13:10:26.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f643815d3f0 con 0x55b1fb8700f0 2024-03-30T13:10:26.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f642f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb898430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f642f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb898430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35850/0 (socket says 172.21.15.83:35850) 2024-03-30T13:10:26.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f642f7fe640 1 -- 172.21.15.83:0/3105059913 learned_addr learned my addr 172.21.15.83:0/3105059913 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:26.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f642f7fe640 1 -- 172.21.15.83:0/3105059913 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 msgr2=0x55b1fb897ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f6437fff640 1 --2- 172.21.15.83:0/3105059913 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 0x55b1fb897ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f643cbcc640 1 --2- 172.21.15.83:0/3105059913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 0x55b1fb8ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f642f7fe640 1 --2- 172.21.15.83:0/3105059913 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 0x55b1fb897ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f642f7fe640 1 -- 172.21.15.83:0/3105059913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 msgr2=0x55b1fb8ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f642f7fe640 1 --2- 172.21.15.83:0/3105059913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 0x55b1fb8ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f642f7fe640 1 -- 172.21.15.83:0/3105059913 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1fb8bd1b0 con 0x55b1fb8bca60 2024-03-30T13:10:26.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f642f7fe640 1 --2- 172.21.15.83:0/3105059913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb898430 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6420014010 tx=0x7f6420022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257aeba2bc1cee37 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:26.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f642d7fa640 1 -- 172.21.15.83:0/3105059913 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642001e050 con 0x55b1fb8bca60 2024-03-30T13:10:26.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f642d7fa640 1 -- 172.21.15.83:0/3105059913 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6420028070 con 0x55b1fb8bca60 2024-03-30T13:10:26.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f642d7fa640 1 -- 172.21.15.83:0/3105059913 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64200343f0 con 0x55b1fb8bca60 2024-03-30T13:10:26.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 -- 172.21.15.83:0/3105059913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 msgr2=0x55b1fb898430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 --2- 172.21.15.83:0/3105059913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb898430 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6420014010 tx=0x7f6420022000 comp rx=0 tx=0).stop 2024-03-30T13:10:26.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 -- 172.21.15.83:0/3105059913 shutdown_connections 2024-03-30T13:10:26.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 --2- 172.21.15.83:0/3105059913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 0x55b1fb8ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 --2- 172.21.15.83:0/3105059913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb898430 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 --2- 172.21.15.83:0/3105059913 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 0x55b1fb897ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 -- 172.21.15.83:0/3105059913 >> 172.21.15.83:0/3105059913 conn(0x55b1fb8993a0 msgr2=0x55b1fb8977e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:26.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 -- 172.21.15.83:0/3105059913 shutdown_connections 2024-03-30T13:10:26.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.421+0000 7f64417b1000 1 -- 172.21.15.83:0/3105059913 wait complete. 2024-03-30T13:10:26.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 -- start start 2024-03-30T13:10:26.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 Processor -- start 2024-03-30T13:10:26.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 0x55b1fb8d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb92d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 0x55b1fb92d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b1fb6bdb00 con 0x55b1fb8bca60 2024-03-30T13:10:26.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64380b4e00 con 0x55b1fb8bd380 2024-03-30T13:10:26.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b1fb65a940 con 0x55b1fb8700f0 2024-03-30T13:10:26.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 10 client.0 _ll_register_callbacks cb 0x7f64200096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:26.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f642f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb92d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f642f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb92d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35852/0 (socket says 172.21.15.83:35852) 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f642f7fe640 1 -- 172.21.15.83:0/2684309027 learned_addr learned my addr 172.21.15.83:0/2684309027 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6437fff640 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 0x55b1fb8d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f643cbcc640 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 0x55b1fb92d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f642f7fe640 1 -- 172.21.15.83:0/2684309027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 msgr2=0x55b1fb8d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f642f7fe640 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 0x55b1fb8d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f642f7fe640 1 -- 172.21.15.83:0/2684309027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 msgr2=0x55b1fb92d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f642f7fe640 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 0x55b1fb92d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f642f7fe640 1 -- 172.21.15.83:0/2684309027 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1fb73e470 con 0x55b1fb8bca60 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f642f7fe640 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb92d470 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f642000b010 tx=0x7f6420019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bb3819ebd3ecd8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6416ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6416ffd640 1 -- 172.21.15.83:0/2684309027 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420043020 con 0x55b1fb8bca60 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6416ffd640 1 -- 172.21.15.83:0/2684309027 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f642002dca0 con 0x55b1fb8bca60 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 -- 172.21.15.83:0/2684309027 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6420028070 con 0x55b1fb8bca60 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6416ffd640 1 -- 172.21.15.83:0/2684309027 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f642004d050 con 0x55b1fb8bca60 2024-03-30T13:10:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 10 client.5466 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 -- 172.21.15.83:0/2684309027 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55b1fb64c1e0 con 0x55b1fb8bca60 2024-03-30T13:10:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6416ffd640 1 -- 172.21.15.83:0/2684309027 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6420028070 con 0x55b1fb8bca60 2024-03-30T13:10:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6416ffd640 1 -- 172.21.15.83:0/2684309027 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f6420050020 con 0x55b1fb8bca60 2024-03-30T13:10:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 10 client.5466 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 10 client.5466 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 20 client.5466 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1fb8ea1e0 0x55b1fb8ea5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 4 client.5466 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-30T13:10:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 -- 172.21.15.83:0/2684309027 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b1fb6cb040 con 0x55b1fb8ea1e0 2024-03-30T13:10:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6437fff640 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1fb8ea1e0 0x55b1fb8ea5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6437fff640 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1fb8ea1e0 0x55b1fb8ea5c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b48d9fbca9b64e5 server_cookie=e4969f37a7072927 in_seq=0 out_seq=0 2024-03-30T13:10:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6416ffd640 10 client.5466 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6416ffd640 1 -- 172.21.15.83:0/2684309027 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+376 (crc 0 0 0) 0x55b1fb6cb040 con 0x55b1fb8ea1e0 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6416ffd640 10 client.5466 handle_command_reply: tid=0 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 client.5466 shutdown 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 -- 172.21.15.83:0/2684309027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 msgr2=0x55b1fb92d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb92d470 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f642000b010 tx=0x7f6420019000 comp rx=0 tx=0).stop 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 -- 172.21.15.83:0/2684309027 shutdown_connections 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1fb8bd380 0x55b1fb92d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1fb8ea1e0 0x55b1fb8ea5c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1fb8bca60 0x55b1fb92d470 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f6416ffd640 0 client.5466 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 --2- 172.21.15.83:0/2684309027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1fb8700f0 0x55b1fb8d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 -- 172.21.15.83:0/2684309027 >> 172.21.15.83:0/2684309027 conn(0x55b1fb8993a0 msgr2=0x55b1fb898070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 -- 172.21.15.83:0/2684309027 shutdown_connections 2024-03-30T13:10:26.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 1 -- 172.21.15.83:0/2684309027 wait complete. 2024-03-30T13:10:26.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.425+0000 7f64417b1000 20 client.5466 trim_cache size 0 max 16384 2024-03-30T13:10:26.443 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:26.443 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "no active scrubs running", 2024-03-30T13:10:26.443 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": {}, 2024-03-30T13:10:26.443 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_stats": { 2024-03-30T13:10:26.443 INFO:teuthology.orchestra.run.smithi083.stdout: "5c4d6a0f-7247-4376-817a-ceb5e259597b": { 2024-03-30T13:10:26.444 INFO:teuthology.orchestra.run.smithi083.stdout: "start_time": "2024-03-30T13:09:55.970459+0000", 2024-03-30T13:10:26.444 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-03-30T13:10:26.444 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_started": 23, 2024-03-30T13:10:26.444 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_passed": 23, 2024-03-30T13:10:26.444 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_failed": 0, 2024-03-30T13:10:26.444 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_skipped": 0 2024-03-30T13:10:26.444 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:26.444 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:26.445 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:26.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.429+0000 7f643e62f640 1 -- 172.21.15.83:0/3038222619 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6418067fc0 msgr2=0x7f641806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.429+0000 7f643e62f640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6418067fc0 0x7f641806a480 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f643815e690 tx=0x7f6420008040 comp rx=0 tx=0).stop 2024-03-30T13:10:26.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.429+0000 7f643e62f640 1 -- 172.21.15.83:0/3038222619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64240039c0 msgr2=0x7f643814a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.429+0000 7f643e62f640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64240039c0 0x7f643814a280 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6428009ae0 tx=0x7f6424005840 comp rx=0 tx=0).stop 2024-03-30T13:10:26.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.429+0000 7f643e62f640 1 -- 172.21.15.83:0/3038222619 shutdown_connections 2024-03-30T13:10:26.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.429+0000 7f643e62f640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6418067fc0 0x7f641806a480 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.429+0000 7f643e62f640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6438145790 0x7f643813cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.429+0000 7f643e62f640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6438145330 0x7f643813a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.429+0000 7f643e62f640 1 --2- 172.21.15.83:0/3038222619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64240039c0 0x7f643814a280 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.429+0000 7f643e62f640 1 -- 172.21.15.83:0/3038222619 >> 172.21.15.83:0/3038222619 conn(0x7f6438072ec0 msgr2=0x7f643806c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:26.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.429+0000 7f643e62f640 1 -- 172.21.15.83:0/3038222619 shutdown_connections 2024-03-30T13:10:26.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:26.429+0000 7f643e62f640 1 -- 172.21.15.83:0/3038222619 wait complete. 2024-03-30T13:10:26.450 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-30T13:10:26.450 DEBUG:tasks.cephfs.test_uninlining:extracting inodes 2024-03-30T13:10:26.450 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:10:26.451 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Kconfig 2024-03-30T13:10:26.459 INFO:teuthology.orchestra.run.smithi083.stdout:1099511627780 linux-5.4/fs/ceph/Kconfig 2024-03-30T13:10:26.460 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Makefile 2024-03-30T13:10:26.460 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Makefile 2024-03-30T13:10:26.508 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628281 linux-5.4/fs/ceph/Makefile 2024-03-30T13:10:26.508 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:10:26.508 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:10:26.556 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628287 linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:10:26.557 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/io.h 2024-03-30T13:10:26.557 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/io.h 2024-03-30T13:10:26.606 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628294 linux-5.4/fs/ceph/io.h 2024-03-30T13:10:26.607 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:10:26.607 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:10:26.658 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628296 linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:10:26.659 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:10:26.659 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Kconfig 2024-03-30T13:10:26.711 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628308 linux-5.4/fs/ext2/Kconfig 2024-03-30T13:10:26.711 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:10:26.711 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:10:26.763 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628326 linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:10:26.763 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:10:26.763 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:10:26.814 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628324 linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:10:26.815 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Makefile 2024-03-30T13:10:26.815 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Makefile 2024-03-30T13:10:26.866 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628309 linux-5.4/fs/ext2/Makefile 2024-03-30T13:10:26.867 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:10:26.867 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/symlink.c 2024-03-30T13:10:26.919 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628321 linux-5.4/fs/ext2/symlink.c 2024-03-30T13:10:26.919 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/acl.h 2024-03-30T13:10:26.919 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/acl.h 2024-03-30T13:10:26.971 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628311 linux-5.4/fs/ext2/acl.h 2024-03-30T13:10:26.971 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:10:26.971 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:10:27.023 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628325 linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:10:27.023 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:10:27.023 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr.h 2024-03-30T13:10:27.075 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628323 linux-5.4/fs/ext2/xattr.h 2024-03-30T13:10:27.075 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:10:27.076 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:10:27.127 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628328 linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:10:27.127 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:10:27.128 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:10:27.182 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628341 linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:10:27.182 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:10:27.183 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:10:27.235 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628348 linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:10:27.235 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:10:27.235 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:10:27.286 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628331 linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:10:27.286 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:10:27.286 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:10:27.338 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628339 linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:10:27.338 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:10:27.339 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:10:27.390 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628343 linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:10:27.391 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:10:27.391 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:10:27.441 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628344 linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:10:27.441 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:10:27.441 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Makefile 2024-03-30T13:10:27.490 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628329 linux-5.4/fs/orangefs/Makefile 2024-03-30T13:10:27.490 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:10:27.491 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:10:27.542 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628352 linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:10:27.542 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:10:27.543 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:10:27.594 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628334 linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:10:27.594 DEBUG:tasks.cephfs.test_uninlining:getting inline data info 2024-03-30T13:10:27.594 DEBUG:tasks.cephfs.test_uninlining:getting inode info #1 of 23:1099511627780 2024-03-30T13:10:27.594 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511627780 2024-03-30T13:10:27.594 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511627780 2024-03-30T13:10:27.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2ee11d640 1 Processor -- start 2024-03-30T13:10:27.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2ee11d640 1 -- start start 2024-03-30T13:10:27.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2ee11d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2e80d1540 0x7fd2e81695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2ee11d640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e80d51f0 con 0x7fd2e80d31e0 2024-03-30T13:10:27.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2ee11d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e80d2140 con 0x7fd2e815e840 2024-03-30T13:10:27.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2ee11d640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e815ec20 con 0x7fd2e80d1540 2024-03-30T13:10:27.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2e7fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2e80d1540 0x7fd2e81695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2e6ffd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd2e80d31e0 0x7fd2e80d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36400/0 (socket says 172.21.15.83:36400) 2024-03-30T13:10:27.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/1804347966 learned_addr learned my addr 172.21.15.83:0/1804347966 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:27.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2e7fff640 1 -- 172.21.15.83:0/1804347966 >> v1:172.21.15.153:6789/0 conn(0x7fd2e815e840 legacy=0x7fd2e80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2e7fff640 1 -- 172.21.15.83:0/1804347966 >> v1:172.21.15.83:6789/0 conn(0x7fd2e80d31e0 legacy=0x7fd2e80d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2e67fc640 1 -- 172.21.15.83:0/1804347966 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774892776 0 0) 0x7fd2d0001120 con 0x7fd2e80d31e0 2024-03-30T13:10:27.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.753+0000 7fd2e7fff640 1 -- 172.21.15.83:0/1804347966 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e80d2420 con 0x7fd2e80d1540 2024-03-30T13:10:27.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2e7fff640 1 --2- 172.21.15.83:0/1804347966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e80d1540 0x7fd2e81695e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0009d90 tx=0x7fd2e001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d78a38740931c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2e67fc640 1 -- 172.21.15.83:0/1804347966 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00b2070 con 0x7fd2e80d1540 2024-03-30T13:10:27.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2e67fc640 1 -- 172.21.15.83:0/1804347966 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e00a5760 con 0x7fd2e80d1540 2024-03-30T13:10:27.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2e67fc640 1 -- 172.21.15.83:0/1804347966 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00a5b30 con 0x7fd2e80d1540 2024-03-30T13:10:27.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1804347966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e80d1540 msgr2=0x7fd2e81695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 --2- 172.21.15.83:0/1804347966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e80d1540 0x7fd2e81695e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0009d90 tx=0x7fd2e001c8a0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1804347966 shutdown_connections 2024-03-30T13:10:27.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 --2- 172.21.15.83:0/1804347966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e80d1540 0x7fd2e81695e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1804347966 >> 172.21.15.83:0/1804347966 conn(0x7fd2e809d7f0 msgr2=0x7fd2e80d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:27.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1804347966 shutdown_connections 2024-03-30T13:10:27.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1804347966 wait complete. 2024-03-30T13:10:27.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 Processor -- start 2024-03-30T13:10:27.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 -- start start 2024-03-30T13:10:27.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e80d1540 0x7fd2e80b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e80d31e0 0x7fd2e80cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2e815e840 0x7fd2e80b9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e816c750 con 0x7fd2e80d31e0 2024-03-30T13:10:27.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e80d0530 con 0x7fd2e80d1540 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.757+0000 7fd2ee11d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e816c8d0 con 0x7fd2e815e840 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e80d31e0 0x7fd2e80cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e80d31e0 0x7fd2e80cc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38052/0 (socket says 172.21.15.83:38052) 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/1862519075 learned_addr learned my addr 172.21.15.83:0/1862519075 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e7fff640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2e815e840 0x7fd2e80b9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e80d1540 0x7fd2e80b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/1862519075 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2e815e840 msgr2=0x7fd2e80b9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e6ffd640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2e815e840 0x7fd2e80b9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/1862519075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e80d1540 msgr2=0x7fd2e80b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e6ffd640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e80d1540 0x7fd2e80b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/1862519075 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e8155ac0 con 0x7fd2e80d31e0 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e6ffd640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e80d31e0 0x7fd2e80cc9d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000c7b0 tx=0x7fd2d000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2dffff640 1 -- 172.21.15.83:0/1862519075 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0018070 con 0x7fd2e80d31e0 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2dffff640 1 -- 172.21.15.83:0/1862519075 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d00072f0 con 0x7fd2e80d31e0 2024-03-30T13:10:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2dffff640 1 -- 172.21.15.83:0/1862519075 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00047f0 con 0x7fd2e80d31e0 2024-03-30T13:10:27.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1862519075 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e80b20d0 con 0x7fd2e80d31e0 2024-03-30T13:10:27.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1862519075 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e80b2690 con 0x7fd2e80d31e0 2024-03-30T13:10:27.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2dffff640 1 -- 172.21.15.83:0/1862519075 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fd2d001b070 con 0x7fd2e80d31e0 2024-03-30T13:10:27.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2dffff640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd2c8067fc0 0x7fd2c806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2dffff640 1 -- 172.21.15.83:0/1862519075 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd2d0085860 con 0x7fd2e80d31e0 2024-03-30T13:10:27.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd2c8067fc0 0x7fd2c806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd2c8067fc0 0x7fd2c806a480 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b810 tx=0x7fd2d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2f129f000 1 Processor -- start 2024-03-30T13:10:27.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.761+0000 7fd2f129f000 1 -- start start 2024-03-30T13:10:27.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a433150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a433690 0x560a7a3e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a3e9830 0x560a7a3e9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560a7a237aa0 con 0x560a7a432d70 2024-03-30T13:10:27.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560a7a1beaf0 con 0x560a7a3e9830 2024-03-30T13:10:27.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x560a7a233a50 con 0x560a7a433690 2024-03-30T13:10:27.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a433150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a433150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38056/0 (socket says 172.21.15.83:38056) 2024-03-30T13:10:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e77fe640 1 -- 172.21.15.83:0/1324245686 learned_addr learned my addr 172.21.15.83:0/1324245686 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e6ffd640 1 --2- 172.21.15.83:0/1324245686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a433690 0x560a7a3e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e77fe640 1 -- 172.21.15.83:0/1324245686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a433690 msgr2=0x560a7a3e92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/1324245686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a433690 0x560a7a3e92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e7fff640 1 --2- 172.21.15.83:0/1324245686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a3e9830 0x560a7a3e9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e77fe640 1 -- 172.21.15.83:0/1324245686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a3e9830 msgr2=0x560a7a3e9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/1324245686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a3e9830 0x560a7a3e9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e77fe640 1 -- 172.21.15.83:0/1324245686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a7a1bcd00 con 0x560a7a432d70 2024-03-30T13:10:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/1324245686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a433150 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800d830 tx=0x7fd2d8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1872ed9fe174c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2dd7fa640 1 -- 172.21.15.83:0/1324245686 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8024070 con 0x560a7a432d70 2024-03-30T13:10:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2dd7fa640 1 -- 172.21.15.83:0/1324245686 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d80149b0 con 0x560a7a432d70 2024-03-30T13:10:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2dd7fa640 1 -- 172.21.15.83:0/1324245686 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8014d60 con 0x560a7a432d70 2024-03-30T13:10:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 -- 172.21.15.83:0/1324245686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 msgr2=0x560a7a433150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 --2- 172.21.15.83:0/1324245686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a433150 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800d830 tx=0x7fd2d8010000 comp rx=0 tx=0).stop 2024-03-30T13:10:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 -- 172.21.15.83:0/1324245686 shutdown_connections 2024-03-30T13:10:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 --2- 172.21.15.83:0/1324245686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a3e9830 0x560a7a3e9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 --2- 172.21.15.83:0/1324245686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a433690 0x560a7a3e92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 --2- 172.21.15.83:0/1324245686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a433150 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 -- 172.21.15.83:0/1324245686 >> 172.21.15.83:0/1324245686 conn(0x560a7a3e57e0 msgr2=0x560a7a3e7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 -- 172.21.15.83:0/1324245686 shutdown_connections 2024-03-30T13:10:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 -- 172.21.15.83:0/1324245686 wait complete. 2024-03-30T13:10:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 -- start start 2024-03-30T13:10:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 Processor -- start 2024-03-30T13:10:27.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a3e9830 0x560a7a3eec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a417da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a433690 0x560a7a4182e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560a7a1ff270 con 0x560a7a432d70 2024-03-30T13:10:27.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560a7a1f56a0 con 0x560a7a3e9830 2024-03-30T13:10:27.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x560a7a1cf880 con 0x560a7a433690 2024-03-30T13:10:27.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2f129f000 10 client.0 _ll_register_callbacks cb 0x560a7a3d4490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:27.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a417da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a417da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38064/0 (socket says 172.21.15.83:38064) 2024-03-30T13:10:27.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.765+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/3702695948 learned_addr learned my addr 172.21.15.83:0/3702695948 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:27.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2e7fff640 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a433690 0x560a7a4182e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a3e9830 0x560a7a3eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/3702695948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a433690 msgr2=0x560a7a4182e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2e6ffd640 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a433690 0x560a7a4182e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/3702695948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a3e9830 msgr2=0x560a7a3eec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2e6ffd640 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a3e9830 0x560a7a3eec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/3702695948 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a7a1fc730 con 0x560a7a432d70 2024-03-30T13:10:27.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a3e9830 0x560a7a3eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:27.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2e7fff640 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a433690 0x560a7a4182e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:27.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2e6ffd640 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a417da0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd2d005e050 tx=0x7fd2d00553c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1e23540ccb975e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:27.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2c67fc640 1 -- 172.21.15.83:0/3702695948 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d005e2f0 con 0x560a7a432d70 2024-03-30T13:10:27.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2c67fc640 1 -- 172.21.15.83:0/3702695948 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd2d0054df0 con 0x560a7a432d70 2024-03-30T13:10:27.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 -- 172.21.15.83:0/3702695948 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2d80149b0 con 0x560a7a432d70 2024-03-30T13:10:27.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2c67fc640 1 -- 172.21.15.83:0/3702695948 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd2d0059d50 con 0x560a7a432d70 2024-03-30T13:10:27.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 10 client.5481 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:27.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 -- 172.21.15.83:0/3702695948 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x560a7a1efca0 con 0x560a7a432d70 2024-03-30T13:10:27.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2c67fc640 1 -- 172.21.15.83:0/3702695948 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d80149b0 con 0x560a7a432d70 2024-03-30T13:10:27.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2c67fc640 1 -- 172.21.15.83:0/3702695948 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fd2d00516f0 con 0x560a7a432d70 2024-03-30T13:10:27.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 10 client.5481 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:27.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 10 client.5481 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:27.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 20 client.5481 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:27.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560a7a43a5d0 0x560a7a43a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 4 client.5481 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 -- 172.21.15.83:0/3702695948 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a7a1d2c90 con 0x560a7a43a5d0 2024-03-30T13:10:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560a7a43a5d0 0x560a7a43a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560a7a43a5d0 0x560a7a43a9b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=950514e5ad2c20e3 server_cookie=97fdf224e2535525 in_seq=0 out_seq=0 2024-03-30T13:10:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2c67fc640 10 client.5481 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2c67fc640 1 -- 172.21.15.83:0/3702695948 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x560a7a1d2c90 con 0x560a7a43a5d0 2024-03-30T13:10:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2c67fc640 10 client.5481 handle_command_reply: tid=0 2024-03-30T13:10:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 client.5481 shutdown 2024-03-30T13:10:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 -- 172.21.15.83:0/3702695948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 msgr2=0x560a7a417da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a417da0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd2d005e050 tx=0x7fd2d00553c0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 -- 172.21.15.83:0/3702695948 shutdown_connections 2024-03-30T13:10:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a433690 0x560a7a4182e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560a7a43a5d0 0x560a7a43a9b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a417da0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 --2- 172.21.15.83:0/3702695948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a3e9830 0x560a7a3eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 -- 172.21.15.83:0/3702695948 >> 172.21.15.83:0/3702695948 conn(0x560a7a3e57e0 msgr2=0x560a7a3e8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:27.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2c67fc640 0 client.5481 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:27.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 -- 172.21.15.83:0/3702695948 shutdown_connections 2024-03-30T13:10:27.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 1 -- 172.21.15.83:0/3702695948 wait complete. 2024-03-30T13:10:27.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.769+0000 7fd2f129f000 20 client.5481 trim_cache size 0 max 16384 2024-03-30T13:10:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 Processor -- start 2024-03-30T13:10:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 -- start start 2024-03-30T13:10:27.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a3e9830 0x560a7a416d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a432d70 0x560a7a417290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a433690 0x560a7a4177d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8203e50 con 0x560a7a433690 2024-03-30T13:10:27.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8202e60 con 0x560a7a432d70 2024-03-30T13:10:27.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e8202340 con 0x560a7a3e9830 2024-03-30T13:10:27.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a433690 0x560a7a4177d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a433690 0x560a7a4177d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38080/0 (socket says 172.21.15.83:38080) 2024-03-30T13:10:27.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e7fff640 1 -- 172.21.15.83:0/2862066074 learned_addr learned my addr 172.21.15.83:0/2862066074 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:27.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/2862066074 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a3e9830 0x560a7a416d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e6ffd640 1 --2- 172.21.15.83:0/2862066074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a432d70 0x560a7a417290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e7fff640 1 -- 172.21.15.83:0/2862066074 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a3e9830 msgr2=0x560a7a416d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e7fff640 1 --2- 172.21.15.83:0/2862066074 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a3e9830 0x560a7a416d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e7fff640 1 -- 172.21.15.83:0/2862066074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a432d70 msgr2=0x560a7a417290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e7fff640 1 --2- 172.21.15.83:0/2862066074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a432d70 0x560a7a417290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e7fff640 1 -- 172.21.15.83:0/2862066074 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a7a1bed00 con 0x560a7a433690 2024-03-30T13:10:27.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e6ffd640 1 --2- 172.21.15.83:0/2862066074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a432d70 0x560a7a417290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:27.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/2862066074 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a3e9830 0x560a7a416d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:27.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2e7fff640 1 --2- 172.21.15.83:0/2862066074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a433690 0x560a7a4177d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00b0040 tx=0x7fd2e0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd6b56412e54c0d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2dcff9640 1 -- 172.21.15.83:0/2862066074 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00b2040 con 0x560a7a433690 2024-03-30T13:10:27.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2dcff9640 1 -- 172.21.15.83:0/2862066074 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e00a5860 con 0x560a7a433690 2024-03-30T13:10:27.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2dcff9640 1 -- 172.21.15.83:0/2862066074 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00a5c70 con 0x560a7a433690 2024-03-30T13:10:27.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 -- 172.21.15.83:0/2862066074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a433690 msgr2=0x560a7a4177d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 --2- 172.21.15.83:0/2862066074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a433690 0x560a7a4177d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00b0040 tx=0x7fd2e0004ac0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 -- 172.21.15.83:0/2862066074 shutdown_connections 2024-03-30T13:10:27.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 --2- 172.21.15.83:0/2862066074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a433690 0x560a7a4177d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 --2- 172.21.15.83:0/2862066074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a432d70 0x560a7a417290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 --2- 172.21.15.83:0/2862066074 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a3e9830 0x560a7a416d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 -- 172.21.15.83:0/2862066074 >> 172.21.15.83:0/2862066074 conn(0x560a7a3e57e0 msgr2=0x560a7a4162b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:27.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 -- 172.21.15.83:0/2862066074 shutdown_connections 2024-03-30T13:10:27.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.785+0000 7fd2f129f000 1 -- 172.21.15.83:0/2862066074 wait complete. 2024-03-30T13:10:27.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 -- start start 2024-03-30T13:10:27.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 Processor -- start 2024-03-30T13:10:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a3e9830 0x560a7a418050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a436ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a433690 0x560a7a437010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560a7a1ff270 con 0x560a7a432d70 2024-03-30T13:10:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8202810 con 0x560a7a433690 2024-03-30T13:10:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x560a7a4169c0 con 0x560a7a3e9830 2024-03-30T13:10:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 10 client.0 _ll_register_callbacks cb 0x7fd2d00076e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a436ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a436ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38092/0 (socket says 172.21.15.83:38092) 2024-03-30T13:10:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/1977789377 learned_addr learned my addr 172.21.15.83:0/1977789377 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a3e9830 0x560a7a418050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e7fff640 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a433690 0x560a7a437010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/1977789377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a3e9830 msgr2=0x560a7a418050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e6ffd640 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a3e9830 0x560a7a418050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/1977789377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a433690 msgr2=0x560a7a437010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e6ffd640 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a433690 0x560a7a437010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e6ffd640 1 -- 172.21.15.83:0/1977789377 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a7a2b8f70 con 0x560a7a432d70 2024-03-30T13:10:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e7fff640 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a433690 0x560a7a437010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e6ffd640 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a436ad0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0083040 tx=0x7fd2d0059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d25dc28ccc6550 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2c67fc640 1 -- 172.21.15.83:0/1977789377 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0074350 con 0x560a7a432d70 2024-03-30T13:10:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2c67fc640 1 -- 172.21.15.83:0/1977789377 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd2d0054df0 con 0x560a7a432d70 2024-03-30T13:10:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 -- 172.21.15.83:0/1977789377 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2e00a5860 con 0x560a7a432d70 2024-03-30T13:10:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2c67fc640 1 -- 172.21.15.83:0/1977789377 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd2d007a050 con 0x560a7a432d70 2024-03-30T13:10:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 10 client.5487 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 -- 172.21.15.83:0/1977789377 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x560a7a1de760 con 0x560a7a432d70 2024-03-30T13:10:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2c67fc640 1 -- 172.21.15.83:0/1977789377 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e00a5860 con 0x560a7a432d70 2024-03-30T13:10:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2c67fc640 1 -- 172.21.15.83:0/1977789377 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fd2d007d080 con 0x560a7a432d70 2024-03-30T13:10:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 10 client.5487 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 10 client.5487 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 20 client.5487 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560a7a4a4520 0x560a7a4a4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 4 client.5487 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511627780}] 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 -- 172.21.15.83:0/1977789377 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511627780}) -- 0x560a7a244fe0 con 0x560a7a4a4520 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560a7a4a4520 0x560a7a4a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2c67fc640 10 client.5487 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2e77fe640 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560a7a4a4520 0x560a7a4a4930 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6edfc2198d02e1d8 server_cookie=f2c18a3b35b232d8 in_seq=0 out_seq=0 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2c67fc640 1 -- 172.21.15.83:0/1977789377 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3812 (crc 0 0 0) 0x560a7a244fe0 con 0x560a7a4a4520 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2c67fc640 10 client.5487 handle_command_reply: tid=0 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 client.5487 shutdown 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 -- 172.21.15.83:0/1977789377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 msgr2=0x560a7a436ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a436ad0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0083040 tx=0x7fd2d0059000 comp rx=0 tx=0).stop 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 -- 172.21.15.83:0/1977789377 shutdown_connections 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560a7a433690 0x560a7a437010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x560a7a4a4520 0x560a7a4a4930 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a7a432d70 0x560a7a436ad0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 --2- 172.21.15.83:0/1977789377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x560a7a3e9830 0x560a7a418050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2c67fc640 0 client.5487 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 -- 172.21.15.83:0/1977789377 >> 172.21.15.83:0/1977789377 conn(0x560a7a3e57e0 msgr2=0x560a7a449680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 -- 172.21.15.83:0/1977789377 shutdown_connections 2024-03-30T13:10:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 1 -- 172.21.15.83:0/1977789377 wait complete. 2024-03-30T13:10:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2f129f000 20 client.5487 trim_cache size 0 max 16384 2024-03-30T13:10:27.810 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:27.810 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ceph/Kconfig", 2024-03-30T13:10:27.810 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511627780, 2024-03-30T13:10:27.810 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.000531+0000", 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:53.904464+0000", 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:27.811 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 1481, 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:53.904464+0000", 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:27.812 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:27.813 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:27.813 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:27.813 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:27.813 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:27.813 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:27.813 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:27.813 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:27.813 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:27.813 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1481, 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.000531+0000" 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:27.814 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1481, 2024-03-30T13:10:27.815 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:27.815 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:27.815 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:27.815 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.000531+0000" 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 84, 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 2, 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:27.816 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:27.817 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:27.818 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:27.819 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.820 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:27.821 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:27.822 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:27.822 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:27.822 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:27.822 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:27.822 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:27.822 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:27.822 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:27.822 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:27.822 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:27.822 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:27.823 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:27.823 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:27.823 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:27.823 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:27.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1862519075 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd2c8067fc0 msgr2=0x7fd2c806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2ee11d640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd2c8067fc0 0x7fd2c806a480 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b810 tx=0x7fd2d8008040 comp rx=0 tx=0).stop 2024-03-30T13:10:27.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1862519075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e80d31e0 msgr2=0x7fd2e80cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2ee11d640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e80d31e0 0x7fd2e80cc9d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000c7b0 tx=0x7fd2d000cc70 comp rx=0 tx=0).stop 2024-03-30T13:10:27.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1862519075 shutdown_connections 2024-03-30T13:10:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2ee11d640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd2c8067fc0 0x7fd2c806a480 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2ee11d640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2e815e840 0x7fd2e80b9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2ee11d640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e80d31e0 0x7fd2e80cc9d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2ee11d640 1 --2- 172.21.15.83:0/1862519075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e80d1540 0x7fd2e80b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1862519075 >> 172.21.15.83:0/1862519075 conn(0x7fd2e809d7f0 msgr2=0x7fd2e806cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1862519075 shutdown_connections 2024-03-30T13:10:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.789+0000 7fd2ee11d640 1 -- 172.21.15.83:0/1862519075 wait complete. 2024-03-30T13:10:27.825 DEBUG:tasks.cephfs.test_uninlining:getting inode info #2 of 23:1099511628281 2024-03-30T13:10:27.825 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628281 2024-03-30T13:10:27.826 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628281 2024-03-30T13:10:27.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.933+0000 7f6c3ef91640 1 Processor -- start 2024-03-30T13:10:27.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3ef91640 1 -- start start 2024-03-30T13:10:27.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3ef91640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6c380b6510 0x7f6c3815d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3ef91640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c38070720 con 0x7f6c380b0080 2024-03-30T13:10:27.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3ef91640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c3806fb10 con 0x7f6c3815d860 2024-03-30T13:10:27.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3ef91640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6c3806fdf0 con 0x7f6c380b6510 2024-03-30T13:10:27.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3cd2d640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f6c380b0080 0x7f6c380b5e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36402/0 (socket says 172.21.15.83:36402) 2024-03-30T13:10:27.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3cd2d640 1 -- 172.21.15.83:0/2016440297 learned_addr learned my addr 172.21.15.83:0/2016440297 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:27.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 803809824 0 0) 0x7f6c38070720 con 0x7f6c380b0080 2024-03-30T13:10:27.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c37fff640 1 --2- 172.21.15.83:0/2016440297 >> v2:172.21.15.153:3300/0 conn(0x7f6c380b6510 0x7f6c3815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c28003530 con 0x7f6c380b0080 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 789163561 0 0) 0x7f6c28003530 con 0x7f6c380b0080 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 >> v2:172.21.15.153:3300/0 conn(0x7f6c380b6510 msgr2=0x7f6c3815d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 --2- 172.21.15.83:0/2016440297 >> v2:172.21.15.153:3300/0 conn(0x7f6c380b6510 0x7f6c3815d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 >> v1:172.21.15.153:6789/0 conn(0x7f6c3815d860 legacy=0x7f6c3806e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c380700d0 con 0x7f6c380b0080 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f6c24001680 con 0x7f6c380b0080 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 >> v1:172.21.15.83:6789/0 conn(0x7f6c380b0080 legacy=0x7f6c380b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 --2- 172.21.15.83:0/2016440297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c280039c0 0x7f6c28003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 --2- 172.21.15.83:0/2016440297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28004810 0x7f6c28004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 --2- 172.21.15.83:0/2016440297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c280051d0 0x7f6c2800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3806fdf0 con 0x7f6c280051d0 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2800c070 con 0x7f6c280039c0 2024-03-30T13:10:27.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2800c270 con 0x7f6c28004810 2024-03-30T13:10:27.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3d52e640 1 --2- 172.21.15.83:0/2016440297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c280051d0 0x7f6c2800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c37fff640 1 --2- 172.21.15.83:0/2016440297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28004810 0x7f6c28004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/2016440297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c280039c0 0x7f6c28003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3d52e640 1 -- 172.21.15.83:0/2016440297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28004810 msgr2=0x7f6c28004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3d52e640 1 --2- 172.21.15.83:0/2016440297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28004810 0x7f6c28004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3d52e640 1 -- 172.21.15.83:0/2016440297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c280039c0 msgr2=0x7f6c28003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3d52e640 1 --2- 172.21.15.83:0/2016440297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c280039c0 0x7f6c28003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3d52e640 1 -- 172.21.15.83:0/2016440297 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c28003530 con 0x7f6c280051d0 2024-03-30T13:10:27.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.937+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/2016440297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c280039c0 0x7f6c28003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:27.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3d52e640 1 -- 172.21.15.83:0/2016440297 reap_dead start 2024-03-30T13:10:27.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3d52e640 1 --2- 172.21.15.83:0/2016440297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c280051d0 0x7f6c2800b9d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6c30001e70 tx=0x7f6c3001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716c2f07a5582b41 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30001a90 con 0x7f6c280051d0 2024-03-30T13:10:27.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c30003ba0 con 0x7f6c280051d0 2024-03-30T13:10:27.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c377fe640 1 -- 172.21.15.83:0/2016440297 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30005020 con 0x7f6c280051d0 2024-03-30T13:10:27.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 -- 172.21.15.83:0/2016440297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c280051d0 msgr2=0x7f6c2800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 --2- 172.21.15.83:0/2016440297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c280051d0 0x7f6c2800b9d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6c30001e70 tx=0x7f6c3001c780 comp rx=0 tx=0).stop 2024-03-30T13:10:27.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 -- 172.21.15.83:0/2016440297 shutdown_connections 2024-03-30T13:10:27.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 --2- 172.21.15.83:0/2016440297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c280051d0 0x7f6c2800b9d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 -- 172.21.15.83:0/2016440297 >> 172.21.15.83:0/2016440297 conn(0x7f6c38072f00 msgr2=0x7f6c3806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:27.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 -- 172.21.15.83:0/2016440297 shutdown_connections 2024-03-30T13:10:27.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 -- 172.21.15.83:0/2016440297 wait complete. 2024-03-30T13:10:27.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 Processor -- start 2024-03-30T13:10:27.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 -- start start 2024-03-30T13:10:27.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c280051d0 0x7f6c38136170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c380abfa0 0x7f6c380ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c3815a870 0x7f6c3815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3815cd30 con 0x7f6c380abfa0 2024-03-30T13:10:27.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3815cbb0 con 0x7f6c3815a870 2024-03-30T13:10:27.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3ef91640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3806f7e0 con 0x7f6c280051d0 2024-03-30T13:10:27.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c37fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c380abfa0 0x7f6c380ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c37fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c380abfa0 0x7f6c380ac400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38100/0 (socket says 172.21.15.83:38100) 2024-03-30T13:10:27.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c37fff640 1 -- 172.21.15.83:0/4225504061 learned_addr learned my addr 172.21.15.83:0/4225504061 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:27.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.941+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c280051d0 0x7f6c38136170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c3d52e640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c3815a870 0x7f6c3815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c37fff640 1 -- 172.21.15.83:0/4225504061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c280051d0 msgr2=0x7f6c38136170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c37fff640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c280051d0 0x7f6c38136170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c37fff640 1 -- 172.21.15.83:0/4225504061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c3815a870 msgr2=0x7f6c3815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c37fff640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c3815a870 0x7f6c3815acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c37fff640 1 -- 172.21.15.83:0/4225504061 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c380af430 con 0x7f6c380abfa0 2024-03-30T13:10:27.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c37fff640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c380abfa0 0x7f6c380ac400 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c011590 tx=0x7f6c2c011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c357fa640 1 -- 172.21.15.83:0/4225504061 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c015870 con 0x7f6c380abfa0 2024-03-30T13:10:27.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c357fa640 1 -- 172.21.15.83:0/4225504061 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c2c015a10 con 0x7f6c380abfa0 2024-03-30T13:10:27.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c357fa640 1 -- 172.21.15.83:0/4225504061 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c015dc0 con 0x7f6c380abfa0 2024-03-30T13:10:27.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c3ef91640 1 -- 172.21.15.83:0/4225504061 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c381366b0 con 0x7f6c380abfa0 2024-03-30T13:10:27.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c3ef91640 1 -- 172.21.15.83:0/4225504061 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c3815b730 con 0x7f6c380abfa0 2024-03-30T13:10:27.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c357fa640 1 -- 172.21.15.83:0/4225504061 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6c2c013400 con 0x7f6c380abfa0 2024-03-30T13:10:27.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c357fa640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c1c067fc0 0x7f6c1c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c357fa640 1 -- 172.21.15.83:0/4225504061 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c2c086af0 con 0x7f6c380abfa0 2024-03-30T13:10:27.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c1c067fc0 0x7f6c1c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c1c067fc0 0x7f6c1c06a480 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6c240017f0 tx=0x7f6c24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c42113000 1 Processor -- start 2024-03-30T13:10:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.945+0000 7f6c42113000 1 -- start start 2024-03-30T13:10:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 0x561b7f4de150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4de690 0x561b7f4942f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 0x561b7f494c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561b7f2e2aa0 con 0x561b7f4ddd70 2024-03-30T13:10:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561b7f269af0 con 0x561b7f4de690 2024-03-30T13:10:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x561b7f2dea50 con 0x561b7f494830 2024-03-30T13:10:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c3cd2d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 0x561b7f4de150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c3cd2d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 0x561b7f4de150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38106/0 (socket says 172.21.15.83:38106) 2024-03-30T13:10:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c3cd2d640 1 -- 172.21.15.83:0/1066651231 learned_addr learned my addr 172.21.15.83:0/1066651231 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c3cd2d640 1 -- 172.21.15.83:0/1066651231 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 msgr2=0x561b7f494c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/1066651231 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 0x561b7f494c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c3cd2d640 1 -- 172.21.15.83:0/1066651231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4de690 msgr2=0x561b7f4942f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c37fff640 1 --2- 172.21.15.83:0/1066651231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4de690 0x561b7f4942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/1066651231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4de690 0x561b7f4942f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c3cd2d640 1 -- 172.21.15.83:0/1066651231 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7f267d00 con 0x561b7f4ddd70 2024-03-30T13:10:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/1066651231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 0x561b7f4de150 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400fd60 tx=0x7f6c24012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d2e19fb66e5c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c227fc640 1 -- 172.21.15.83:0/1066651231 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24026070 con 0x561b7f4ddd70 2024-03-30T13:10:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c227fc640 1 -- 172.21.15.83:0/1066651231 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c24005260 con 0x561b7f4ddd70 2024-03-30T13:10:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c227fc640 1 -- 172.21.15.83:0/1066651231 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24005610 con 0x561b7f4ddd70 2024-03-30T13:10:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 -- 172.21.15.83:0/1066651231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 msgr2=0x561b7f4de150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 --2- 172.21.15.83:0/1066651231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 0x561b7f4de150 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400fd60 tx=0x7f6c24012000 comp rx=0 tx=0).stop 2024-03-30T13:10:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 -- 172.21.15.83:0/1066651231 shutdown_connections 2024-03-30T13:10:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 --2- 172.21.15.83:0/1066651231 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 0x561b7f494c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 --2- 172.21.15.83:0/1066651231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4de690 0x561b7f4942f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 --2- 172.21.15.83:0/1066651231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 0x561b7f4de150 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 -- 172.21.15.83:0/1066651231 >> 172.21.15.83:0/1066651231 conn(0x561b7f4907e0 msgr2=0x561b7f492bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 -- 172.21.15.83:0/1066651231 shutdown_connections 2024-03-30T13:10:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 -- 172.21.15.83:0/1066651231 wait complete. 2024-03-30T13:10:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 -- start start 2024-03-30T13:10:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 Processor -- start 2024-03-30T13:10:27.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.949+0000 7f6c42113000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 0x561b7f499c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4ddd70 0x561b7f4c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 0x561b7f4c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561b7f2aa270 con 0x561b7f4de690 2024-03-30T13:10:27.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561b7f2a06a0 con 0x561b7f4ddd70 2024-03-30T13:10:27.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x561b7f27a880 con 0x561b7f494830 2024-03-30T13:10:27.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 10 client.0 _ll_register_callbacks cb 0x561b7f47f490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c3d52e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 0x561b7f4c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c3d52e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 0x561b7f4c32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38120/0 (socket says 172.21.15.83:38120) 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c3d52e640 1 -- 172.21.15.83:0/1150733154 learned_addr learned my addr 172.21.15.83:0/1150733154 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 0x561b7f499c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c37fff640 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4ddd70 0x561b7f4c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c3d52e640 1 -- 172.21.15.83:0/1150733154 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 msgr2=0x561b7f499c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c3d52e640 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 0x561b7f499c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c3d52e640 1 -- 172.21.15.83:0/1150733154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4ddd70 msgr2=0x561b7f4c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c3d52e640 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4ddd70 0x561b7f4c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c3d52e640 1 -- 172.21.15.83:0/1150733154 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7f2a7730 con 0x561b7f4de690 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c3d52e640 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 0x561b7f4c32e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6c3001c5b0 tx=0x7f6c30019520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a50107a53a72c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c177fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c177fe640 1 -- 172.21.15.83:0/1150733154 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c300b7060 con 0x561b7f4de690 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c177fe640 1 -- 172.21.15.83:0/1150733154 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c30006b60 con 0x561b7f4de690 2024-03-30T13:10:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 -- 172.21.15.83:0/1150733154 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c24005260 con 0x561b7f4de690 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c177fe640 1 -- 172.21.15.83:0/1150733154 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6c300bd050 con 0x561b7f4de690 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 10 client.5499 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 -- 172.21.15.83:0/1150733154 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x561b7f29aca0 con 0x561b7f4de690 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c177fe640 1 -- 172.21.15.83:0/1150733154 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c24005260 con 0x561b7f4de690 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c177fe640 1 -- 172.21.15.83:0/1150733154 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f6c300c0020 con 0x561b7f4de690 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 10 client.5499 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 10 client.5499 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 20 client.5499 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561b7f4e55d0 0x561b7f4e59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 4 client.5499 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 -- 172.21.15.83:0/1150733154 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b7f27dc90 con 0x561b7f4e55d0 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561b7f4e55d0 0x561b7f4e59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c177fe640 10 client.5499 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561b7f4e55d0 0x561b7f4e59e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b84ee511a620cf2 server_cookie=bad65d48b3b61ef1 in_seq=0 out_seq=0 2024-03-30T13:10:27.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c177fe640 1 -- 172.21.15.83:0/1150733154 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x561b7f27dc90 con 0x561b7f4e55d0 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c177fe640 10 client.5499 handle_command_reply: tid=0 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 client.5499 shutdown 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 -- 172.21.15.83:0/1150733154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 msgr2=0x561b7f4c32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 0x561b7f4c32e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6c3001c5b0 tx=0x7f6c30019520 comp rx=0 tx=0).stop 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 -- 172.21.15.83:0/1150733154 shutdown_connections 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561b7f4e55d0 0x561b7f4e59e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 0x561b7f4c32e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4ddd70 0x561b7f4c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 --2- 172.21.15.83:0/1150733154 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 0x561b7f499c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 -- 172.21.15.83:0/1150733154 >> 172.21.15.83:0/1150733154 conn(0x561b7f4907e0 msgr2=0x561b7f493460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c177fe640 0 client.5499 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 -- 172.21.15.83:0/1150733154 shutdown_connections 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 1 -- 172.21.15.83:0/1150733154 wait complete. 2024-03-30T13:10:27.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.953+0000 7f6c42113000 20 client.5499 trim_cache size 0 max 16384 2024-03-30T13:10:27.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.981+0000 7f6c42113000 1 Processor -- start 2024-03-30T13:10:27.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.981+0000 7f6c42113000 1 -- start start 2024-03-30T13:10:27.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f494830 0x561b7f492bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 0x561b7f493110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f4de690 0x561b7f493650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:27.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381fcdc0 con 0x561b7f4ddd70 2024-03-30T13:10:27.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381fbe50 con 0x561b7f494830 2024-03-30T13:10:27.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c380aad10 con 0x561b7f4de690 2024-03-30T13:10:27.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c37fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 0x561b7f493110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c37fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 0x561b7f493110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38126/0 (socket says 172.21.15.83:38126) 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c37fff640 1 -- 172.21.15.83:0/975132200 learned_addr learned my addr 172.21.15.83:0/975132200 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/975132200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f494830 0x561b7f492bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c37fff640 1 -- 172.21.15.83:0/975132200 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f4de690 msgr2=0x561b7f493650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c3d52e640 1 --2- 172.21.15.83:0/975132200 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f4de690 0x561b7f493650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c37fff640 1 --2- 172.21.15.83:0/975132200 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f4de690 0x561b7f493650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c37fff640 1 -- 172.21.15.83:0/975132200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f494830 msgr2=0x561b7f492bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c37fff640 1 --2- 172.21.15.83:0/975132200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f494830 0x561b7f492bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c37fff640 1 -- 172.21.15.83:0/975132200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7f269d00 con 0x561b7f4ddd70 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/975132200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f494830 0x561b7f492bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c37fff640 1 --2- 172.21.15.83:0/975132200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 0x561b7f493110 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c011f50 tx=0x7f6c2c0572b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c677da3ab37a97 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c21ffb640 1 -- 172.21.15.83:0/975132200 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c022040 con 0x561b7f4ddd70 2024-03-30T13:10:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c21ffb640 1 -- 172.21.15.83:0/975132200 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c2c054d70 con 0x561b7f4ddd70 2024-03-30T13:10:27.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c21ffb640 1 -- 172.21.15.83:0/975132200 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c055ec0 con 0x561b7f4ddd70 2024-03-30T13:10:27.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 -- 172.21.15.83:0/975132200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 msgr2=0x561b7f493110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:27.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 --2- 172.21.15.83:0/975132200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 0x561b7f493110 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c011f50 tx=0x7f6c2c0572b0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 -- 172.21.15.83:0/975132200 shutdown_connections 2024-03-30T13:10:27.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 --2- 172.21.15.83:0/975132200 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f4de690 0x561b7f493650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 --2- 172.21.15.83:0/975132200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4ddd70 0x561b7f493110 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 --2- 172.21.15.83:0/975132200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f494830 0x561b7f492bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:27.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 -- 172.21.15.83:0/975132200 >> 172.21.15.83:0/975132200 conn(0x561b7f4907e0 msgr2=0x561b7f4f4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:27.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 -- 172.21.15.83:0/975132200 shutdown_connections 2024-03-30T13:10:27.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 -- 172.21.15.83:0/975132200 wait complete. 2024-03-30T13:10:27.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 -- start start 2024-03-30T13:10:27.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.985+0000 7f6c42113000 1 Processor -- start 2024-03-30T13:10:27.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 0x561b7f54f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4ddd70 0x561b7f54fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 0x561b7f4e1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561b7f2aa270 con 0x561b7f4de690 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c380ab360 con 0x561b7f4ddd70 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x561b7f4f5fb0 con 0x561b7f494830 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 10 client.0 _ll_register_callbacks cb 0x7f6c28004710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3d52e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 0x561b7f4e1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3d52e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 0x561b7f4e1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38134/0 (socket says 172.21.15.83:38134) 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3d52e640 1 -- 172.21.15.83:0/2927672370 learned_addr learned my addr 172.21.15.83:0/2927672370 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 0x561b7f54f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c37fff640 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4ddd70 0x561b7f54fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3d52e640 1 -- 172.21.15.83:0/2927672370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 msgr2=0x561b7f54f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3d52e640 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 0x561b7f54f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3d52e640 1 -- 172.21.15.83:0/2927672370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4ddd70 msgr2=0x561b7f54fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3d52e640 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4ddd70 0x561b7f54fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3d52e640 1 -- 172.21.15.83:0/2927672370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7f363f70 con 0x561b7f4de690 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c37fff640 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4ddd70 0x561b7f54fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3d52e640 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 0x561b7f4e1ad0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6c3001b000 tx=0x7f6c30007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f832aa9cabf7791c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c177fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c177fe640 1 -- 172.21.15.83:0/2927672370 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c300054f0 con 0x561b7f4de690 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 -- 172.21.15.83:0/2927672370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c2c054d70 con 0x561b7f4de690 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c177fe640 1 -- 172.21.15.83:0/2927672370 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c30005690 con 0x561b7f4de690 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c177fe640 1 -- 172.21.15.83:0/2927672370 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6c300cf050 con 0x561b7f4de690 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 10 client.5505 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 -- 172.21.15.83:0/2927672370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x561b7f289760 con 0x561b7f4de690 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c177fe640 1 -- 172.21.15.83:0/2927672370 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c2c054d70 con 0x561b7f4de690 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c177fe640 1 -- 172.21.15.83:0/2927672370 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f6c300d2020 con 0x561b7f4de690 2024-03-30T13:10:28.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 10 client.5505 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 10 client.5505 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 20 client.5505 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561b7f4e28e0 0x561b7f4e2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 4 client.5505 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628281}] 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 -- 172.21.15.83:0/2927672370 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628281}) -- 0x561b7f2effe0 con 0x561b7f4e28e0 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561b7f4e28e0 0x561b7f4e2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c177fe640 10 client.5505 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3cd2d640 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561b7f4e28e0 0x561b7f4e2cf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72bc9ac12db73cb9 server_cookie=859cb301cee7d787 in_seq=0 out_seq=0 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c177fe640 1 -- 172.21.15.83:0/2927672370 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3811 (crc 0 0 0) 0x561b7f2effe0 con 0x561b7f4e28e0 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c177fe640 10 client.5505 handle_command_reply: tid=0 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 client.5505 shutdown 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 -- 172.21.15.83:0/2927672370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 msgr2=0x561b7f4e1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 0x561b7f4e1ad0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6c3001b000 tx=0x7f6c30007f90 comp rx=0 tx=0).stop 2024-03-30T13:10:28.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 -- 172.21.15.83:0/2927672370 shutdown_connections 2024-03-30T13:10:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561b7f4e28e0 0x561b7f4e2cf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561b7f4de690 0x561b7f4e1ad0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b7f4ddd70 0x561b7f54fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c177fe640 0 client.5505 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 --2- 172.21.15.83:0/2927672370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561b7f494830 0x561b7f54f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 -- 172.21.15.83:0/2927672370 >> 172.21.15.83:0/2927672370 conn(0x561b7f4907e0 msgr2=0x561b7f4f4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 -- 172.21.15.83:0/2927672370 shutdown_connections 2024-03-30T13:10:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 1 -- 172.21.15.83:0/2927672370 wait complete. 2024-03-30T13:10:28.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c42113000 20 client.5505 trim_cache size 0 max 16384 2024-03-30T13:10:28.003 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:28.003 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ceph/Makefile", 2024-03-30T13:10:28.004 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628281, 2024-03-30T13:10:28.004 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:28.004 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.039191+0000", 2024-03-30T13:10:28.004 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:53.906383+0000", 2024-03-30T13:10:28.004 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:28.004 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:28.004 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:28.004 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:28.004 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:28.004 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:28.004 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 356, 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:28.005 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:53.906383+0000", 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:28.006 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 356, 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.039191+0000" 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 356, 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:28.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.039191+0000" 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 110, 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 4, 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:28.008 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.009 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:28.009 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:28.009 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:28.009 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:28.009 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:28.009 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:28.009 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.009 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:28.009 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:28.010 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:28.011 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:28.012 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.013 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:28.014 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:28.015 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:28.015 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:28.015 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:28.015 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:28.015 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:28.015 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.015 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:28.015 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:28.015 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:28.015 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:28.015 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:28.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3ef91640 1 -- 172.21.15.83:0/4225504061 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c1c067fc0 msgr2=0x7f6c1c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3ef91640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c1c067fc0 0x7f6c1c06a480 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6c240017f0 tx=0x7f6c24009040 comp rx=0 tx=0).stop 2024-03-30T13:10:28.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3ef91640 1 -- 172.21.15.83:0/4225504061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c380abfa0 msgr2=0x7f6c380ac400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3ef91640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c380abfa0 0x7f6c380ac400 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c011590 tx=0x7f6c2c011a50 comp rx=0 tx=0).stop 2024-03-30T13:10:28.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3ef91640 1 -- 172.21.15.83:0/4225504061 shutdown_connections 2024-03-30T13:10:28.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3ef91640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c1c067fc0 0x7f6c1c06a480 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3ef91640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c3815a870 0x7f6c3815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3ef91640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c380abfa0 0x7f6c380ac400 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3ef91640 1 --2- 172.21.15.83:0/4225504061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c280051d0 0x7f6c38136170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3ef91640 1 -- 172.21.15.83:0/4225504061 >> 172.21.15.83:0/4225504061 conn(0x7f6c38072f00 msgr2=0x7f6c38160770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3ef91640 1 -- 172.21.15.83:0/4225504061 shutdown_connections 2024-03-30T13:10:28.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:27.989+0000 7f6c3ef91640 1 -- 172.21.15.83:0/4225504061 wait complete. 2024-03-30T13:10:28.018 DEBUG:tasks.cephfs.test_uninlining:getting inode info #3 of 23:1099511628287 2024-03-30T13:10:28.018 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628287 2024-03-30T13:10:28.018 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628287 2024-03-30T13:10:28.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.125+0000 7f52b7cbd640 1 Processor -- start 2024-03-30T13:10:28.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.125+0000 7f52b7cbd640 1 -- start start 2024-03-30T13:10:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b7cbd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f52b0162e20 0x7f52b0162210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b7cbd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f52b006fcc0 0x7f52b0162750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b7cbd640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52b00af5d0 con 0x7f52b006f8e0 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b7cbd640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f52b00af870 con 0x7f52b006fcc0 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b7cbd640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f52b00afb50 con 0x7f52b0162e20 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b625a640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f52b006fcc0 0x7f52b0162750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b5a59640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f52b006f8e0 0x7f52b00ae740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36412/0 (socket says 172.21.15.83:36412) 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b5a59640 1 -- 172.21.15.83:0/3329138150 learned_addr learned my addr 172.21.15.83:0/3329138150 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b5258640 1 --2- 172.21.15.83:0/3329138150 >> v2:172.21.15.153:3300/0 conn(0x7f52b0162e20 0x7f52b0162210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b4a57640 1 -- 172.21.15.83:0/3329138150 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3310693148 0 0) 0x7f52b00af5d0 con 0x7f52b006f8e0 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b4a57640 1 -- 172.21.15.83:0/3329138150 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f529c003530 con 0x7f52b006f8e0 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b625a640 1 -- 172.21.15.83:0/3329138150 >> v2:172.21.15.153:3300/0 conn(0x7f52b0162e20 msgr2=0x7f52b0162210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b625a640 1 --2- 172.21.15.83:0/3329138150 >> v2:172.21.15.153:3300/0 conn(0x7f52b0162e20 0x7f52b0162210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b625a640 1 -- 172.21.15.83:0/3329138150 >> v1:172.21.15.83:6789/0 conn(0x7f52b006f8e0 legacy=0x7f52b00ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.129+0000 7f52b625a640 1 -- 172.21.15.83:0/3329138150 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b00afe30 con 0x7f52b006fcc0 2024-03-30T13:10:28.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b625a640 1 --2- 172.21.15.83:0/3329138150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52b006fcc0 0x7f52b0162750 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f52b00b4ca0 tx=0x7f52a801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c7dd652a147856 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b4a57640 1 -- 172.21.15.83:0/3329138150 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a80b2070 con 0x7f52b006fcc0 2024-03-30T13:10:28.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b4a57640 1 -- 172.21.15.83:0/3329138150 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a80a5870 con 0x7f52b006fcc0 2024-03-30T13:10:28.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b4a57640 1 -- 172.21.15.83:0/3329138150 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a80a5c40 con 0x7f52b006fcc0 2024-03-30T13:10:28.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 -- 172.21.15.83:0/3329138150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52b006fcc0 msgr2=0x7f52b0162750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 --2- 172.21.15.83:0/3329138150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52b006fcc0 0x7f52b0162750 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f52b00b4ca0 tx=0x7f52a801c8a0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 -- 172.21.15.83:0/3329138150 shutdown_connections 2024-03-30T13:10:28.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 --2- 172.21.15.83:0/3329138150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52b006fcc0 0x7f52b0162750 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 --2- 172.21.15.83:0/3329138150 >> v2:172.21.15.153:3300/0 conn(0x7f52b0162e20 0x7f52b0162210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 -- 172.21.15.83:0/3329138150 >> 172.21.15.83:0/3329138150 conn(0x7f52b0072f00 msgr2=0x7f52b006b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 -- 172.21.15.83:0/3329138150 shutdown_connections 2024-03-30T13:10:28.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 -- 172.21.15.83:0/3329138150 wait complete. 2024-03-30T13:10:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 Processor -- start 2024-03-30T13:10:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 -- start start 2024-03-30T13:10:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52b006f8e0 0x7f52b01522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52b006fcc0 0x7f52b0150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52b0162e20 0x7f52b0157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f52b00b5f40 con 0x7f52b006f8e0 2024-03-30T13:10:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52b00b5dc0 con 0x7f52b0162e20 2024-03-30T13:10:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b7cbd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f52b00b60c0 con 0x7f52b006fcc0 2024-03-30T13:10:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b5a59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52b006f8e0 0x7f52b01522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b5a59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52b006f8e0 0x7f52b01522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38152/0 (socket says 172.21.15.83:38152) 2024-03-30T13:10:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.133+0000 7f52b5a59640 1 -- 172.21.15.83:0/4190419668 learned_addr learned my addr 172.21.15.83:0/4190419668 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52b625a640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52b0162e20 0x7f52b0157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52b5258640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52b006fcc0 0x7f52b0150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52b5a59640 1 -- 172.21.15.83:0/4190419668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52b006fcc0 msgr2=0x7f52b0150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52b5a59640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52b006fcc0 0x7f52b0150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52b5a59640 1 -- 172.21.15.83:0/4190419668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52b0162e20 msgr2=0x7f52b0157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52b5a59640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52b0162e20 0x7f52b0157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52b5a59640 1 -- 172.21.15.83:0/4190419668 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b0150bc0 con 0x7f52b006f8e0 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52b5a59640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52b006f8e0 0x7f52b01522f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0010f0 tx=0x7f52ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52a67fc640 1 -- 172.21.15.83:0/4190419668 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac017070 con 0x7f52b006f8e0 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52a67fc640 1 -- 172.21.15.83:0/4190419668 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac005d10 con 0x7f52b006f8e0 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52a67fc640 1 -- 172.21.15.83:0/4190419668 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac007310 con 0x7f52b006f8e0 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52b7cbd640 1 -- 172.21.15.83:0/4190419668 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b0150e50 con 0x7f52b006f8e0 2024-03-30T13:10:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52b7cbd640 1 -- 172.21.15.83:0/4190419668 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b01510f0 con 0x7f52b006f8e0 2024-03-30T13:10:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52a67fc640 1 -- 172.21.15.83:0/4190419668 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f52ac01a070 con 0x7f52b006f8e0 2024-03-30T13:10:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52a67fc640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5294067fc0 0x7f529406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52bae3f000 1 Processor -- start 2024-03-30T13:10:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52a67fc640 1 -- 172.21.15.83:0/4190419668 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f52ac085950 con 0x7f52b006f8e0 2024-03-30T13:10:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52b5258640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5294067fc0 0x7f529406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.137+0000 7f52bae3f000 1 -- start start 2024-03-30T13:10:28.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5258640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5294067fc0 0x7f529406a480 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f52b00b0df0 tx=0x7f52a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2b23150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 0x555bd2ad92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 0x555bd2ad9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555bd2927aa0 con 0x555bd2b22d70 2024-03-30T13:10:28.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555bd28aeaf0 con 0x555bd2ad9830 2024-03-30T13:10:28.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x555bd2923a50 con 0x555bd2b23690 2024-03-30T13:10:28.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5a59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2b23150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5a59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2b23150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38160/0 (socket says 172.21.15.83:38160) 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5a59640 1 -- 172.21.15.83:0/99103644 learned_addr learned my addr 172.21.15.83:0/99103644 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5a59640 1 -- 172.21.15.83:0/99103644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 msgr2=0x555bd2ad92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5a59640 1 --2- 172.21.15.83:0/99103644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 0x555bd2ad92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b625a640 1 --2- 172.21.15.83:0/99103644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 0x555bd2ad9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5a59640 1 -- 172.21.15.83:0/99103644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 msgr2=0x555bd2ad9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5a59640 1 --2- 172.21.15.83:0/99103644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 0x555bd2ad9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5a59640 1 -- 172.21.15.83:0/99103644 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bd28acd00 con 0x555bd2b22d70 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5a59640 1 --2- 172.21.15.83:0/99103644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2b23150 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f52ac083ea0 tx=0x7f52ac055a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8bacc32fcbcf2c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52937fe640 1 -- 172.21.15.83:0/99103644 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac05e5e0 con 0x555bd2b22d70 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52937fe640 1 -- 172.21.15.83:0/99103644 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac053d00 con 0x555bd2b22d70 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52937fe640 1 -- 172.21.15.83:0/99103644 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac05c070 con 0x555bd2b22d70 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 -- 172.21.15.83:0/99103644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 msgr2=0x555bd2b23150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 --2- 172.21.15.83:0/99103644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2b23150 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f52ac083ea0 tx=0x7f52ac055a00 comp rx=0 tx=0).stop 2024-03-30T13:10:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 -- 172.21.15.83:0/99103644 shutdown_connections 2024-03-30T13:10:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 --2- 172.21.15.83:0/99103644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 0x555bd2ad9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 --2- 172.21.15.83:0/99103644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 0x555bd2ad92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 --2- 172.21.15.83:0/99103644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2b23150 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 -- 172.21.15.83:0/99103644 >> 172.21.15.83:0/99103644 conn(0x555bd2ad57e0 msgr2=0x555bd2ad7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 -- 172.21.15.83:0/99103644 shutdown_connections 2024-03-30T13:10:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 -- 172.21.15.83:0/99103644 wait complete. 2024-03-30T13:10:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 -- start start 2024-03-30T13:10:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 Processor -- start 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 0x555bd2adecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2b07da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 0x555bd2b082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555bd28ef270 con 0x555bd2b22d70 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555bd28e56a0 con 0x555bd2ad9830 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x555bd28bf880 con 0x555bd2b23690 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52bae3f000 10 client.0 _ll_register_callbacks cb 0x555bd2ac4490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5258640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2b07da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5258640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2b07da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38168/0 (socket says 172.21.15.83:38168) 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.141+0000 7f52b5258640 1 -- 172.21.15.83:0/642674533 learned_addr learned my addr 172.21.15.83:0/642674533 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52b5a59640 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 0x555bd2adecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52b625a640 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 0x555bd2b082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52b5258640 1 -- 172.21.15.83:0/642674533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 msgr2=0x555bd2b082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52b5258640 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 0x555bd2b082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52b5258640 1 -- 172.21.15.83:0/642674533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 msgr2=0x555bd2adecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52b5258640 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 0x555bd2adecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52b5258640 1 -- 172.21.15.83:0/642674533 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bd28ec730 con 0x555bd2b22d70 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52b625a640 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 0x555bd2b082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52b5258640 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2b07da0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f52a000ff60 tx=0x7f52a0014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8f835db1b678b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f5290ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f5290ff9640 1 -- 172.21.15.83:0/642674533 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0025060 con 0x555bd2b22d70 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f5290ff9640 1 -- 172.21.15.83:0/642674533 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f52a0015820 con 0x555bd2b22d70 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 -- 172.21.15.83:0/642674533 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52ac053d00 con 0x555bd2b22d70 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f5290ff9640 1 -- 172.21.15.83:0/642674533 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f52a002b050 con 0x555bd2b22d70 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 10 client.5520 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 -- 172.21.15.83:0/642674533 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x555bd28dfca0 con 0x555bd2b22d70 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f5290ff9640 1 -- 172.21.15.83:0/642674533 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac053d00 con 0x555bd2b22d70 2024-03-30T13:10:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f5290ff9640 1 -- 172.21.15.83:0/642674533 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f52a002e020 con 0x555bd2b22d70 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 10 client.5520 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 10 client.5520 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 20 client.5520 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555bd2b2a5d0 0x555bd2b2a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 4 client.5520 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 -- 172.21.15.83:0/642674533 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bd28c2c90 con 0x555bd2b2a5d0 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52b5a59640 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555bd2b2a5d0 0x555bd2b2a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f5290ff9640 10 client.5520 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52b5a59640 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555bd2b2a5d0 0x555bd2b2a9b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=733d3955240ad005 server_cookie=47a35bf44d47c09c in_seq=0 out_seq=0 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f5290ff9640 1 -- 172.21.15.83:0/642674533 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x555bd28c2c90 con 0x555bd2b2a5d0 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f5290ff9640 10 client.5520 handle_command_reply: tid=0 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 client.5520 shutdown 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 -- 172.21.15.83:0/642674533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 msgr2=0x555bd2b07da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2b07da0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f52a000ff60 tx=0x7f52a0014830 comp rx=0 tx=0).stop 2024-03-30T13:10:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 -- 172.21.15.83:0/642674533 shutdown_connections 2024-03-30T13:10:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 0x555bd2b082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555bd2b2a5d0 0x555bd2b2a9b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2b07da0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 --2- 172.21.15.83:0/642674533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 0x555bd2adecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f5290ff9640 0 client.5520 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 -- 172.21.15.83:0/642674533 >> 172.21.15.83:0/642674533 conn(0x555bd2ad57e0 msgr2=0x555bd2ad8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 -- 172.21.15.83:0/642674533 shutdown_connections 2024-03-30T13:10:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 1 -- 172.21.15.83:0/642674533 wait complete. 2024-03-30T13:10:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.145+0000 7f52bae3f000 20 client.5520 trim_cache size 0 max 16384 2024-03-30T13:10:28.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 Processor -- start 2024-03-30T13:10:28.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 -- start start 2024-03-30T13:10:28.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 0x555bd2b08180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2ad7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 0x555bd2ad8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0203550 con 0x555bd2b22d70 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52b015ec20 con 0x555bd2ad9830 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f52b015df80 con 0x555bd2b23690 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52b5258640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2ad7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52b5258640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2ad7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38180/0 (socket says 172.21.15.83:38180) 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52b5258640 1 -- 172.21.15.83:0/134855265 learned_addr learned my addr 172.21.15.83:0/134855265 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52b5258640 1 -- 172.21.15.83:0/134855265 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 msgr2=0x555bd2ad8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52b5258640 1 --2- 172.21.15.83:0/134855265 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 0x555bd2ad8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52b5258640 1 -- 172.21.15.83:0/134855265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 msgr2=0x555bd2b08180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52b5258640 1 --2- 172.21.15.83:0/134855265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 0x555bd2b08180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52b5258640 1 -- 172.21.15.83:0/134855265 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bd28aed00 con 0x555bd2b22d70 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52b5258640 1 --2- 172.21.15.83:0/134855265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2ad7bd0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f52a0014ef0 tx=0x7f52a001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee82bca4d856bd7c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f5292ffd640 1 -- 172.21.15.83:0/134855265 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a000fb40 con 0x555bd2b22d70 2024-03-30T13:10:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f5292ffd640 1 -- 172.21.15.83:0/134855265 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a0033070 con 0x555bd2b22d70 2024-03-30T13:10:28.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f5292ffd640 1 -- 172.21.15.83:0/134855265 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0015860 con 0x555bd2b22d70 2024-03-30T13:10:28.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 -- 172.21.15.83:0/134855265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 msgr2=0x555bd2ad7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 --2- 172.21.15.83:0/134855265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2ad7bd0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f52a0014ef0 tx=0x7f52a001e000 comp rx=0 tx=0).stop 2024-03-30T13:10:28.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 -- 172.21.15.83:0/134855265 shutdown_connections 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 --2- 172.21.15.83:0/134855265 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b23690 0x555bd2ad8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 --2- 172.21.15.83:0/134855265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2b22d70 0x555bd2ad7bd0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 --2- 172.21.15.83:0/134855265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2ad9830 0x555bd2b08180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 -- 172.21.15.83:0/134855265 >> 172.21.15.83:0/134855265 conn(0x555bd2ad57e0 msgr2=0x555bd2b39f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 -- 172.21.15.83:0/134855265 shutdown_connections 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 -- 172.21.15.83:0/134855265 wait complete. 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 -- start start 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.161+0000 7f52bae3f000 1 Processor -- start 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2ad9830 0x555bd2b951b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b22d70 0x555bd2b956f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2b23690 0x555bd2b26ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555bd28bf880 con 0x555bd2ad9830 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52b015e5d0 con 0x555bd2b23690 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x555bd29e3b00 con 0x555bd2b22d70 2024-03-30T13:10:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 10 client.0 _ll_register_callbacks cb 0x7f52a000bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b5a59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2ad9830 0x555bd2b951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b5a59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2ad9830 0x555bd2b951b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38190/0 (socket says 172.21.15.83:38190) 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b5a59640 1 -- 172.21.15.83:0/1129135462 learned_addr learned my addr 172.21.15.83:0/1129135462 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b5a59640 1 -- 172.21.15.83:0/1129135462 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b22d70 msgr2=0x555bd2b956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b5a59640 1 --2- 172.21.15.83:0/1129135462 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b22d70 0x555bd2b956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b5a59640 1 -- 172.21.15.83:0/1129135462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2b23690 msgr2=0x555bd2b26ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b5a59640 1 --2- 172.21.15.83:0/1129135462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2b23690 0x555bd2b26ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b5a59640 1 -- 172.21.15.83:0/1129135462 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bd29a8f70 con 0x555bd2ad9830 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b5a59640 1 --2- 172.21.15.83:0/1129135462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2ad9830 0x555bd2b951b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f52ac001210 tx=0x7f52ac083d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc43cf5a1eb80df7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f5290ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f5290ff9640 1 -- 172.21.15.83:0/1129135462 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac05c070 con 0x555bd2ad9830 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f5290ff9640 1 -- 172.21.15.83:0/1129135462 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f52ac05c210 con 0x555bd2ad9830 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 -- 172.21.15.83:0/1129135462 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52a0033070 con 0x555bd2ad9830 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f5290ff9640 1 -- 172.21.15.83:0/1129135462 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f52ac072030 con 0x555bd2ad9830 2024-03-30T13:10:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 10 client.5526 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 -- 172.21.15.83:0/1129135462 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x555bd28ce760 con 0x555bd2ad9830 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f5290ff9640 1 -- 172.21.15.83:0/1129135462 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a0033070 con 0x555bd2ad9830 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f5290ff9640 1 -- 172.21.15.83:0/1129135462 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f52ac0074b0 con 0x555bd2ad9830 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 10 client.5526 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 10 client.5526 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 20 client.5526 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 --2- 172.21.15.83:0/1129135462 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555bd2b27010 0x555bd2b27420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 4 client.5526 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628287}] 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 -- 172.21.15.83:0/1129135462 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628287}) -- 0x555bd2934fe0 con 0x555bd2b27010 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b5258640 1 --2- 172.21.15.83:0/1129135462 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555bd2b27010 0x555bd2b27420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f5290ff9640 10 client.5526 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b5258640 1 --2- 172.21.15.83:0/1129135462 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555bd2b27010 0x555bd2b27420 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85ae490153bef1f4 server_cookie=3ff22902e6fd28c2 in_seq=0 out_seq=0 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f5290ff9640 1 -- 172.21.15.83:0/1129135462 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3815 (crc 0 0 0) 0x555bd2934fe0 con 0x555bd2b27010 2024-03-30T13:10:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f5290ff9640 10 client.5526 handle_command_reply: tid=0 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 client.5526 shutdown 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 -- 172.21.15.83:0/1129135462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2ad9830 msgr2=0x555bd2b951b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 --2- 172.21.15.83:0/1129135462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2ad9830 0x555bd2b951b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f52ac001210 tx=0x7f52ac083d50 comp rx=0 tx=0).stop 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 -- 172.21.15.83:0/1129135462 shutdown_connections 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 --2- 172.21.15.83:0/1129135462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555bd2b23690 0x555bd2b26ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 --2- 172.21.15.83:0/1129135462 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555bd2b22d70 0x555bd2b956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 --2- 172.21.15.83:0/1129135462 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555bd2b27010 0x555bd2b27420 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 --2- 172.21.15.83:0/1129135462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555bd2ad9830 0x555bd2b951b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f5290ff9640 0 client.5526 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 -- 172.21.15.83:0/1129135462 >> 172.21.15.83:0/1129135462 conn(0x555bd2ad57e0 msgr2=0x555bd2b3a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 -- 172.21.15.83:0/1129135462 shutdown_connections 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 1 -- 172.21.15.83:0/1129135462 wait complete. 2024-03-30T13:10:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52bae3f000 20 client.5526 trim_cache size 0 max 16384 2024-03-30T13:10:28.180 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:28.180 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ceph/ceph_frag.c", 2024-03-30T13:10:28.180 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628287, 2024-03-30T13:10:28.180 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:28.180 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.059303+0000", 2024-03-30T13:10:28.180 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:53.925995+0000", 2024-03-30T13:10:28.180 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:28.180 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:28.180 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:28.180 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:28.180 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:28.180 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 401, 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:28.181 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:53.925995+0000", 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 401, 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.059303+0000" 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 401, 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.059303+0000" 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 114, 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 16, 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.184 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:28.185 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:28.186 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.187 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.188 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:28.189 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:28.190 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:28.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b7cbd640 1 -- 172.21.15.83:0/4190419668 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5294067fc0 msgr2=0x7f529406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b7cbd640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5294067fc0 0x7f529406a480 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f52b00b0df0 tx=0x7f52a0008040 comp rx=0 tx=0).stop 2024-03-30T13:10:28.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b7cbd640 1 -- 172.21.15.83:0/4190419668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52b006f8e0 msgr2=0x7f52b01522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b7cbd640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52b006f8e0 0x7f52b01522f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0010f0 tx=0x7f52ac00c8f0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b7cbd640 1 -- 172.21.15.83:0/4190419668 shutdown_connections 2024-03-30T13:10:28.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b7cbd640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5294067fc0 0x7f529406a480 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b7cbd640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52b0162e20 0x7f52b0157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b7cbd640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52b006fcc0 0x7f52b0150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b7cbd640 1 --2- 172.21.15.83:0/4190419668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52b006f8e0 0x7f52b01522f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b7cbd640 1 -- 172.21.15.83:0/4190419668 >> 172.21.15.83:0/4190419668 conn(0x7f52b0072f00 msgr2=0x7f52b00cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b7cbd640 1 -- 172.21.15.83:0/4190419668 shutdown_connections 2024-03-30T13:10:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.165+0000 7f52b7cbd640 1 -- 172.21.15.83:0/4190419668 wait complete. 2024-03-30T13:10:28.193 DEBUG:tasks.cephfs.test_uninlining:getting inode info #4 of 23:1099511628294 2024-03-30T13:10:28.193 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628294 2024-03-30T13:10:28.193 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628294 2024-03-30T13:10:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.293+0000 7f9cfa8b5640 1 Processor -- start 2024-03-30T13:10:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.293+0000 7f9cfa8b5640 1 -- start start 2024-03-30T13:10:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.293+0000 7f9cfa8b5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9cf413f520 0x7f9cf40ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.293+0000 7f9cfa8b5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf40b6510 0x7f9cf415d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cfa8b5640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf40ce990 con 0x7f9cf406e180 2024-03-30T13:10:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cfa8b5640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f9cf406f7a0 con 0x7f9cf413f520 2024-03-30T13:10:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cfa8b5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf406e740 con 0x7f9cf40b6510 2024-03-30T13:10:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cf3fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9cf413f520 0x7f9cf40ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cf3fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9cf413f520 0x7f9cf40ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38194/0 (socket says 172.21.15.83:38194) 2024-03-30T13:10:28.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cf3fff640 1 -- 172.21.15.83:0/1592723473 learned_addr learned my addr 172.21.15.83:0/1592723473 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cf8e52640 1 --2- 172.21.15.83:0/1592723473 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf40b6510 0x7f9cf415d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cf3fff640 1 -- 172.21.15.83:0/1592723473 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf40b6510 msgr2=0x7f9cf415d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/1592723473 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf40b6510 0x7f9cf415d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cf3fff640 1 -- 172.21.15.83:0/1592723473 >> v1:172.21.15.153:6789/0 conn(0x7f9cf406e180 legacy=0x7f9cf40b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cf3fff640 1 -- 172.21.15.83:0/1592723473 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf406ea20 con 0x7f9cf413f520 2024-03-30T13:10:28.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/1592723473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf413f520 0x7f9cf40ccce0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009870 tx=0x7f9ce401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42cea7ff8fb5997b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cf37fe640 1 -- 172.21.15.83:0/1592723473 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40b0070 con 0x7f9cf413f520 2024-03-30T13:10:28.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cf37fe640 1 -- 172.21.15.83:0/1592723473 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce40ab600 con 0x7f9cf413f520 2024-03-30T13:10:28.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cf37fe640 1 -- 172.21.15.83:0/1592723473 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40ab9d0 con 0x7f9cf413f520 2024-03-30T13:10:28.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/1592723473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf413f520 msgr2=0x7f9cf40ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cfa8b5640 1 --2- 172.21.15.83:0/1592723473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf413f520 0x7f9cf40ccce0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009870 tx=0x7f9ce401c4d0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.297+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/1592723473 shutdown_connections 2024-03-30T13:10:28.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 --2- 172.21.15.83:0/1592723473 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf40b6510 0x7f9cf415d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 --2- 172.21.15.83:0/1592723473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf413f520 0x7f9cf40ccce0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/1592723473 >> 172.21.15.83:0/1592723473 conn(0x7f9cf4072f00 msgr2=0x7f9cf406b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/1592723473 shutdown_connections 2024-03-30T13:10:28.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/1592723473 wait complete. 2024-03-30T13:10:28.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 Processor -- start 2024-03-30T13:10:28.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 -- start start 2024-03-30T13:10:28.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf406e180 0x7f9cf4151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf40b6510 0x7f9cf413fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf413f520 0x7f9cf4130e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf4070840 con 0x7f9cf413f520 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf40706c0 con 0x7f9cf40b6510 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf40709c0 con 0x7f9cf406e180 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf8e52640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf413f520 0x7f9cf4130e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf8e52640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf413f520 0x7f9cf4130e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38206/0 (socket says 172.21.15.83:38206) 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf8e52640 1 -- 172.21.15.83:0/457380453 learned_addr learned my addr 172.21.15.83:0/457380453 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf406e180 0x7f9cf4151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9ceb7fe640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf40b6510 0x7f9cf413fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf8e52640 1 -- 172.21.15.83:0/457380453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf406e180 msgr2=0x7f9cf4151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf8e52640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf406e180 0x7f9cf4151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf8e52640 1 -- 172.21.15.83:0/457380453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf40b6510 msgr2=0x7f9cf413fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf8e52640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf40b6510 0x7f9cf413fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf8e52640 1 -- 172.21.15.83:0/457380453 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf4151640 con 0x7f9cf413f520 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf406e180 0x7f9cf4151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf8e52640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf413f520 0x7f9cf4130e70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009e30 tx=0x7f9cec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf17fa640 1 -- 172.21.15.83:0/457380453 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec018020 con 0x7f9cf413f520 2024-03-30T13:10:28.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf17fa640 1 -- 172.21.15.83:0/457380453 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cec014480 con 0x7f9cf413f520 2024-03-30T13:10:28.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cf17fa640 1 -- 172.21.15.83:0/457380453 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec014870 con 0x7f9cf413f520 2024-03-30T13:10:28.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/457380453 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf41524b0 con 0x7f9cf413f520 2024-03-30T13:10:28.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.301+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/457380453 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf4152a70 con 0x7f9cf413f520 2024-03-30T13:10:28.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf17fa640 1 -- 172.21.15.83:0/457380453 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9cec01b020 con 0x7f9cf413f520 2024-03-30T13:10:28.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf17fa640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9cd4067fc0 0x7f9cd406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9cd4067fc0 0x7f9cd406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf17fa640 1 -- 172.21.15.83:0/457380453 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9cec087440 con 0x7f9cf413f520 2024-03-30T13:10:28.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9cd4067fc0 0x7f9cd406a480 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40ad000 tx=0x7f9ce4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 Processor -- start 2024-03-30T13:10:28.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 -- start start 2024-03-30T13:10:28.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557ddd70 0x564b557de150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 0x564b557942f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b55794830 0x564b55794c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564b555e2aa0 con 0x564b557ddd70 2024-03-30T13:10:28.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564b55569af0 con 0x564b55794830 2024-03-30T13:10:28.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564b555dea50 con 0x564b557de690 2024-03-30T13:10:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557ddd70 0x564b557de150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557ddd70 0x564b557de150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38222/0 (socket says 172.21.15.83:38222) 2024-03-30T13:10:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf3fff640 1 -- 172.21.15.83:0/2238630297 learned_addr learned my addr 172.21.15.83:0/2238630297 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf8e52640 1 --2- 172.21.15.83:0/2238630297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b55794830 0x564b55794c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf3fff640 1 -- 172.21.15.83:0/2238630297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 msgr2=0x564b557942f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/2238630297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 0x564b557942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf3fff640 1 -- 172.21.15.83:0/2238630297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b55794830 msgr2=0x564b55794c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/2238630297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b55794830 0x564b55794c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf3fff640 1 -- 172.21.15.83:0/2238630297 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b55567d00 con 0x564b557ddd70 2024-03-30T13:10:28.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/2238630297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557ddd70 0x564b557de150 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40ae040 tx=0x7f9ce4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552e50c9d2bc165d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9ce9ffb640 1 -- 172.21.15.83:0/2238630297 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40b0040 con 0x564b557ddd70 2024-03-30T13:10:28.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9ce9ffb640 1 -- 172.21.15.83:0/2238630297 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce40abd60 con 0x564b557ddd70 2024-03-30T13:10:28.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9ce9ffb640 1 -- 172.21.15.83:0/2238630297 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4004220 con 0x564b557ddd70 2024-03-30T13:10:28.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 -- 172.21.15.83:0/2238630297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557ddd70 msgr2=0x564b557de150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 --2- 172.21.15.83:0/2238630297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557ddd70 0x564b557de150 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40ae040 tx=0x7f9ce4004740 comp rx=0 tx=0).stop 2024-03-30T13:10:28.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 -- 172.21.15.83:0/2238630297 shutdown_connections 2024-03-30T13:10:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 --2- 172.21.15.83:0/2238630297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b55794830 0x564b55794c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 --2- 172.21.15.83:0/2238630297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 0x564b557942f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 --2- 172.21.15.83:0/2238630297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557ddd70 0x564b557de150 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.305+0000 7f9cfda37000 1 -- 172.21.15.83:0/2238630297 >> 172.21.15.83:0/2238630297 conn(0x564b557907e0 msgr2=0x564b55792bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 -- 172.21.15.83:0/2238630297 shutdown_connections 2024-03-30T13:10:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 -- 172.21.15.83:0/2238630297 wait complete. 2024-03-30T13:10:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 -- start start 2024-03-30T13:10:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 Processor -- start 2024-03-30T13:10:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 0x564b55799c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b557c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 0x564b557c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564b555aa270 con 0x564b55794830 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564b555a06a0 con 0x564b557ddd70 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564b5557a880 con 0x564b557de690 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 10 client.0 _ll_register_callbacks cb 0x564b5577f490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cf3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 0x564b55799c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cf3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 0x564b55799c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38228/0 (socket says 172.21.15.83:38228) 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cf3fff640 1 -- 172.21.15.83:0/3982163586 learned_addr learned my addr 172.21.15.83:0/3982163586 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9ceb7fe640 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b557c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cf8e52640 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 0x564b557c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cf3fff640 1 -- 172.21.15.83:0/3982163586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 msgr2=0x564b557c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 0x564b557c32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cf3fff640 1 -- 172.21.15.83:0/3982163586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 msgr2=0x564b557c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b557c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cf3fff640 1 -- 172.21.15.83:0/3982163586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b555a7730 con 0x564b55794830 2024-03-30T13:10:28.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cf8e52640 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 0x564b557c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:28.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9ceb7fe640 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b557c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:28.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 0x564b55799c80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4006db0 tx=0x7f9ce401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46b88ca4e18425b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:28.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cd2ffd640 1 -- 172.21.15.83:0/3982163586 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40b0070 con 0x564b55794830 2024-03-30T13:10:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cd2ffd640 1 -- 172.21.15.83:0/3982163586 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9ce40cbb00 con 0x564b55794830 2024-03-30T13:10:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 -- 172.21.15.83:0/3982163586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ce40abd60 con 0x564b55794830 2024-03-30T13:10:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cd2ffd640 1 -- 172.21.15.83:0/3982163586 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9ce40cbd00 con 0x564b55794830 2024-03-30T13:10:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 10 client.5538 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 -- 172.21.15.83:0/3982163586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x564b5559aca0 con 0x564b55794830 2024-03-30T13:10:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cd2ffd640 1 -- 172.21.15.83:0/3982163586 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce40abd60 con 0x564b55794830 2024-03-30T13:10:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cd2ffd640 1 -- 172.21.15.83:0/3982163586 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f9ce40b3030 con 0x564b55794830 2024-03-30T13:10:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 10 client.5538 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 10 client.5538 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 20 client.5538 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b557e55d0 0x564b557e59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 4 client.5538 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cfda37000 1 -- 172.21.15.83:0/3982163586 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b5557dc90 con 0x564b557e55d0 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9ceb7fe640 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b557e55d0 0x564b557e59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9ceb7fe640 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b557e55d0 0x564b557e59e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8bf71a49e81b784 server_cookie=aa00d5b2919ad8ab in_seq=0 out_seq=0 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.309+0000 7f9cd2ffd640 10 client.5538 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cd2ffd640 1 -- 172.21.15.83:0/3982163586 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x564b5557dc90 con 0x564b557e55d0 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cd2ffd640 10 client.5538 handle_command_reply: tid=0 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cfda37000 1 client.5538 shutdown 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cfda37000 1 -- 172.21.15.83:0/3982163586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 msgr2=0x564b55799c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cfda37000 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 0x564b55799c80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4006db0 tx=0x7f9ce401ad10 comp rx=0 tx=0).stop 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cfda37000 1 -- 172.21.15.83:0/3982163586 shutdown_connections 2024-03-30T13:10:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cfda37000 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 0x564b557c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cfda37000 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b557c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cfda37000 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b557e55d0 0x564b557e59e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cfda37000 1 --2- 172.21.15.83:0/3982163586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 0x564b55799c80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cd2ffd640 0 client.5538 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cfda37000 1 -- 172.21.15.83:0/3982163586 >> 172.21.15.83:0/3982163586 conn(0x564b557907e0 msgr2=0x564b55793460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cfda37000 1 -- 172.21.15.83:0/3982163586 shutdown_connections 2024-03-30T13:10:28.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cfda37000 1 -- 172.21.15.83:0/3982163586 wait complete. 2024-03-30T13:10:28.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.313+0000 7f9cfda37000 20 client.5538 trim_cache size 0 max 16384 2024-03-30T13:10:28.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.337+0000 7f9cfda37000 1 Processor -- start 2024-03-30T13:10:28.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.337+0000 7f9cfda37000 1 -- start start 2024-03-30T13:10:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.337+0000 7f9cfda37000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 0x564b557c3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.337+0000 7f9cfda37000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b55792bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.337+0000 7f9cfda37000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 0x564b55793110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.337+0000 7f9cfda37000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf4201870 con 0x564b55794830 2024-03-30T13:10:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.337+0000 7f9cfda37000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf4138040 con 0x564b557ddd70 2024-03-30T13:10:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.337+0000 7f9cfda37000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf41373a0 con 0x564b557de690 2024-03-30T13:10:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 0x564b557c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 0x564b557c3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38242/0 (socket says 172.21.15.83:38242) 2024-03-30T13:10:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf3fff640 1 -- 172.21.15.83:0/833258724 learned_addr learned my addr 172.21.15.83:0/833258724 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9ceb7fe640 1 --2- 172.21.15.83:0/833258724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b55792bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf8e52640 1 --2- 172.21.15.83:0/833258724 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 0x564b55793110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf3fff640 1 -- 172.21.15.83:0/833258724 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 msgr2=0x564b55793110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/833258724 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 0x564b55793110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf3fff640 1 -- 172.21.15.83:0/833258724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 msgr2=0x564b55792bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/833258724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b55792bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf3fff640 1 -- 172.21.15.83:0/833258724 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b55569d00 con 0x564b55794830 2024-03-30T13:10:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/833258724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 0x564b557c3180 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4008010 tx=0x7f9ce40c3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5f3263b650db55 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9ce97fa640 1 -- 172.21.15.83:0/833258724 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40b0040 con 0x564b55794830 2024-03-30T13:10:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9ce97fa640 1 -- 172.21.15.83:0/833258724 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce40abd60 con 0x564b55794830 2024-03-30T13:10:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9ce97fa640 1 -- 172.21.15.83:0/833258724 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4003a80 con 0x564b55794830 2024-03-30T13:10:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 -- 172.21.15.83:0/833258724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 msgr2=0x564b557c3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 --2- 172.21.15.83:0/833258724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 0x564b557c3180 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4008010 tx=0x7f9ce40c3040 comp rx=0 tx=0).stop 2024-03-30T13:10:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 -- 172.21.15.83:0/833258724 shutdown_connections 2024-03-30T13:10:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 --2- 172.21.15.83:0/833258724 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b557de690 0x564b55793110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 --2- 172.21.15.83:0/833258724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b55792bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 --2- 172.21.15.83:0/833258724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b55794830 0x564b557c3180 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 -- 172.21.15.83:0/833258724 >> 172.21.15.83:0/833258724 conn(0x564b557907e0 msgr2=0x564b557f4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 -- 172.21.15.83:0/833258724 shutdown_connections 2024-03-30T13:10:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 -- 172.21.15.83:0/833258724 wait complete. 2024-03-30T13:10:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 -- start start 2024-03-30T13:10:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 Processor -- start 2024-03-30T13:10:28.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b55794830 0x564b5584fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b558501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557de690 0x564b557e1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf41379f0 con 0x564b557de690 2024-03-30T13:10:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564b55586d10 con 0x564b557ddd70 2024-03-30T13:10:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564b5556da30 con 0x564b55794830 2024-03-30T13:10:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 10 client.0 _ll_register_callbacks cb 0x7f9cec0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf8e52640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557de690 0x564b557e1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf8e52640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557de690 0x564b557e1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38256/0 (socket says 172.21.15.83:38256) 2024-03-30T13:10:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf8e52640 1 -- 172.21.15.83:0/4003418358 learned_addr learned my addr 172.21.15.83:0/4003418358 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b55794830 0x564b5584fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9ceb7fe640 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b558501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf8e52640 1 -- 172.21.15.83:0/4003418358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b55794830 msgr2=0x564b5584fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf8e52640 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b55794830 0x564b5584fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf8e52640 1 -- 172.21.15.83:0/4003418358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 msgr2=0x564b558501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf8e52640 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b558501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf8e52640 1 -- 172.21.15.83:0/4003418358 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b55663f70 con 0x564b557de690 2024-03-30T13:10:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b55794830 0x564b5584fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cf8e52640 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557de690 0x564b557e1ad0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9cec057150 tx=0x7f9cec057450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8417b3aa4ff4830 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cd2ffd640 1 -- 172.21.15.83:0/4003418358 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec06f070 con 0x564b557de690 2024-03-30T13:10:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cd2ffd640 1 -- 172.21.15.83:0/4003418358 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9cec0568a0 con 0x564b557de690 2024-03-30T13:10:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 -- 172.21.15.83:0/4003418358 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ce40abd60 con 0x564b557de690 2024-03-30T13:10:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cd2ffd640 1 -- 172.21.15.83:0/4003418358 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9cec060030 con 0x564b557de690 2024-03-30T13:10:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 10 client.5544 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 1 -- 172.21.15.83:0/4003418358 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x564b55589760 con 0x564b557de690 2024-03-30T13:10:28.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cd2ffd640 1 -- 172.21.15.83:0/4003418358 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce40abd60 con 0x564b557de690 2024-03-30T13:10:28.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cd2ffd640 1 -- 172.21.15.83:0/4003418358 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f9cec024b40 con 0x564b557de690 2024-03-30T13:10:28.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 10 client.5544 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:28.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.341+0000 7f9cfda37000 10 client.5544 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:28.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 20 client.5544 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:28.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b557e2880 0x564b557e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 4 client.5544 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628294}] 2024-03-30T13:10:28.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 -- 172.21.15.83:0/4003418358 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628294}) -- 0x564b555effe0 con 0x564b557e2880 2024-03-30T13:10:28.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b557e2880 0x564b557e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cd2ffd640 10 client.5544 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cf3fff640 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b557e2880 0x564b557e2c90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=922d3bc066a928a1 server_cookie=a035d8ba5d7a854a in_seq=0 out_seq=0 2024-03-30T13:10:28.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cd2ffd640 1 -- 172.21.15.83:0/4003418358 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3808 (crc 0 0 0) 0x564b555effe0 con 0x564b557e2880 2024-03-30T13:10:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cd2ffd640 10 client.5544 handle_command_reply: tid=0 2024-03-30T13:10:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 client.5544 shutdown 2024-03-30T13:10:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 -- 172.21.15.83:0/4003418358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557de690 msgr2=0x564b557e1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557de690 0x564b557e1ad0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9cec057150 tx=0x7f9cec057450 comp rx=0 tx=0).stop 2024-03-30T13:10:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 -- 172.21.15.83:0/4003418358 shutdown_connections 2024-03-30T13:10:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564b557e2880 0x564b557e2c90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564b557de690 0x564b557e1ad0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cd2ffd640 0 client.5544 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b557ddd70 0x564b558501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 --2- 172.21.15.83:0/4003418358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564b55794830 0x564b5584fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 -- 172.21.15.83:0/4003418358 >> 172.21.15.83:0/4003418358 conn(0x564b557907e0 msgr2=0x564b557f5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 -- 172.21.15.83:0/4003418358 shutdown_connections 2024-03-30T13:10:28.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 1 -- 172.21.15.83:0/4003418358 wait complete. 2024-03-30T13:10:28.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfda37000 20 client.5544 trim_cache size 0 max 16384 2024-03-30T13:10:28.360 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:28.360 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ceph/io.h", 2024-03-30T13:10:28.360 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628294, 2024-03-30T13:10:28.360 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:28.360 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.065821+0000", 2024-03-30T13:10:28.360 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:53.959485+0000", 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:28.361 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:28.362 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:28.362 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:28.362 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:28.362 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.362 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:28.362 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 387, 2024-03-30T13:10:28.362 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:28.362 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:28.362 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:28.362 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:28.362 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:28.362 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:53.959485+0000", 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:28.363 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:28.364 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.364 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:28.364 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.364 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 387, 2024-03-30T13:10:28.364 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:28.364 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:28.364 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:28.364 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.065821+0000" 2024-03-30T13:10:28.364 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.364 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:28.364 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.364 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 387, 2024-03-30T13:10:28.365 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:28.365 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:28.365 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:28.365 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.065821+0000" 2024-03-30T13:10:28.365 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.365 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 116, 2024-03-30T13:10:28.365 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 30, 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:28.366 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:28.367 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:28.368 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:28.369 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:28.369 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:28.369 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.369 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:28.369 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:28.369 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.369 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.369 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:28.369 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.369 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.369 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.370 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.371 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:28.372 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:28.373 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.373 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:28.373 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:28.373 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:28.373 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:28.373 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:28.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/457380453 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9cd4067fc0 msgr2=0x7f9cd406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfa8b5640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9cd4067fc0 0x7f9cd406a480 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40ad000 tx=0x7f9ce4008040 comp rx=0 tx=0).stop 2024-03-30T13:10:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/457380453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf413f520 msgr2=0x7f9cf4130e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfa8b5640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf413f520 0x7f9cf4130e70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009e30 tx=0x7f9cec00c490 comp rx=0 tx=0).stop 2024-03-30T13:10:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/457380453 shutdown_connections 2024-03-30T13:10:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfa8b5640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9cd4067fc0 0x7f9cd406a480 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfa8b5640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf413f520 0x7f9cf4130e70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfa8b5640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf40b6510 0x7f9cf413fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfa8b5640 1 --2- 172.21.15.83:0/457380453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf406e180 0x7f9cf4151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/457380453 >> 172.21.15.83:0/457380453 conn(0x7f9cf4072f00 msgr2=0x7f9cf415e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/457380453 shutdown_connections 2024-03-30T13:10:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.345+0000 7f9cfa8b5640 1 -- 172.21.15.83:0/457380453 wait complete. 2024-03-30T13:10:28.376 DEBUG:tasks.cephfs.test_uninlining:getting inode info #5 of 23:1099511628296 2024-03-30T13:10:28.376 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628296 2024-03-30T13:10:28.376 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628296 2024-03-30T13:10:28.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f8e722640 1 Processor -- start 2024-03-30T13:10:28.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f8e722640 1 -- start start 2024-03-30T13:10:28.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f8e722640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5f88140890 0x7f5f88165770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f8e722640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f880cf280 con 0x7f5f8815b810 2024-03-30T13:10:28.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f8e722640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f880cf560 con 0x7f5f8815b430 2024-03-30T13:10:28.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f8e722640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f5f880cfbb0 con 0x7f5f88140890 2024-03-30T13:10:28.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f7ffff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f5f8815b810 0x7f5f88140180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36416/0 (socket says 172.21.15.83:36416) 2024-03-30T13:10:28.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f7ffff640 1 -- 172.21.15.83:0/4043558966 learned_addr learned my addr 172.21.15.83:0/4043558966 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:28.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f8ccbf640 1 --2- 172.21.15.83:0/4043558966 >> v2:172.21.15.83:3300/0 conn(0x7f5f88140890 0x7f5f88165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f8ccbf640 1 -- 172.21.15.83:0/4043558966 >> v1:172.21.15.153:6789/0 conn(0x7f5f8815b430 legacy=0x7f5f880b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f8ccbf640 1 -- 172.21.15.83:0/4043558966 >> v1:172.21.15.83:6789/0 conn(0x7f5f8815b810 legacy=0x7f5f88140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f8ccbf640 1 -- 172.21.15.83:0/4043558966 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f880cf840 con 0x7f5f88140890 2024-03-30T13:10:28.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.489+0000 7f5f877fe640 1 -- 172.21.15.83:0/4043558966 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063557742 0 0) 0x7f5f880cf280 con 0x7f5f8815b810 2024-03-30T13:10:28.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8ccbf640 1 --2- 172.21.15.83:0/4043558966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88140890 0x7f5f88165770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009d90 tx=0x7f5f8001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b885ebadde52f4c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f877fe640 1 -- 172.21.15.83:0/4043558966 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800b2070 con 0x7f5f88140890 2024-03-30T13:10:28.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f877fe640 1 -- 172.21.15.83:0/4043558966 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f800a5a10 con 0x7f5f88140890 2024-03-30T13:10:28.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f877fe640 1 -- 172.21.15.83:0/4043558966 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f880d0250 con 0x7f5f88140890 2024-03-30T13:10:28.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 -- 172.21.15.83:0/4043558966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88140890 msgr2=0x7f5f88165770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 --2- 172.21.15.83:0/4043558966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88140890 0x7f5f88165770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009d90 tx=0x7f5f8001c930 comp rx=0 tx=0).stop 2024-03-30T13:10:28.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 -- 172.21.15.83:0/4043558966 shutdown_connections 2024-03-30T13:10:28.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 --2- 172.21.15.83:0/4043558966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88140890 0x7f5f88165770 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 -- 172.21.15.83:0/4043558966 >> 172.21.15.83:0/4043558966 conn(0x7f5f88072f00 msgr2=0x7f5f8806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 -- 172.21.15.83:0/4043558966 shutdown_connections 2024-03-30T13:10:28.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 -- 172.21.15.83:0/4043558966 wait complete. 2024-03-30T13:10:28.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 Processor -- start 2024-03-30T13:10:28.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 -- start start 2024-03-30T13:10:28.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88140890 0x7f5f88151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f8815b430 0x7f5f881f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f8815b810 0x7f5f88136800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88168860 con 0x7f5f88140890 2024-03-30T13:10:28.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881686e0 con 0x7f5f8815b430 2024-03-30T13:10:28.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5f881689e0 con 0x7f5f8815b810 2024-03-30T13:10:28.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88140890 0x7f5f88151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88140890 0x7f5f88151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38276/0 (socket says 172.21.15.83:38276) 2024-03-30T13:10:28.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f87fff640 1 -- 172.21.15.83:0/112161875 learned_addr learned my addr 172.21.15.83:0/112161875 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8ccbf640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f8815b810 0x7f5f88136800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f87fff640 1 -- 172.21.15.83:0/112161875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f8815b810 msgr2=0x7f5f88136800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f7ffff640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f8815b430 0x7f5f881f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f87fff640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f8815b810 0x7f5f88136800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f87fff640 1 -- 172.21.15.83:0/112161875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f8815b430 msgr2=0x7f5f881f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f87fff640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f8815b430 0x7f5f881f5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f87fff640 1 -- 172.21.15.83:0/112161875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8815e2e0 con 0x7f5f88140890 2024-03-30T13:10:28.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f87fff640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88140890 0x7f5f88151430 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800c450 tx=0x7f5f7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f857fa640 1 -- 172.21.15.83:0/112161875 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78012830 con 0x7f5f88140890 2024-03-30T13:10:28.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f857fa640 1 -- 172.21.15.83:0/112161875 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f78017070 con 0x7f5f88140890 2024-03-30T13:10:28.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.493+0000 7f5f8e722640 1 -- 172.21.15.83:0/112161875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f881370e0 con 0x7f5f88140890 2024-03-30T13:10:28.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.497+0000 7f5f857fa640 1 -- 172.21.15.83:0/112161875 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78012c30 con 0x7f5f88140890 2024-03-30T13:10:28.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.497+0000 7f5f8e722640 1 -- 172.21.15.83:0/112161875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f881f4c60 con 0x7f5f88140890 2024-03-30T13:10:28.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.497+0000 7f5f857fa640 1 -- 172.21.15.83:0/112161875 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5f7801c460 con 0x7f5f88140890 2024-03-30T13:10:28.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.497+0000 7f5f857fa640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5f68067ff0 0x7f5f6806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.497+0000 7f5f7ffff640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5f68067ff0 0x7f5f6806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.497+0000 7f5f857fa640 1 -- 172.21.15.83:0/112161875 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5f78086220 con 0x7f5f88140890 2024-03-30T13:10:28.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.497+0000 7f5f7ffff640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5f68067ff0 0x7f5f6806a4b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5f881519a0 tx=0x7f5f70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.497+0000 7f5f918a4000 1 Processor -- start 2024-03-30T13:10:28.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.497+0000 7f5f918a4000 1 -- start start 2024-03-30T13:10:28.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035b17d70 0x55a035b18150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b18690 0x55a035ace2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035ace830 0x55a035acec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a03591caa0 con 0x55a035ace830 2024-03-30T13:10:28.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a0358a3af0 con 0x55a035b17d70 2024-03-30T13:10:28.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55a035918a50 con 0x55a035b18690 2024-03-30T13:10:28.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f8ccbf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035ace830 0x55a035acec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f8ccbf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035ace830 0x55a035acec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38284/0 (socket says 172.21.15.83:38284) 2024-03-30T13:10:28.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f8ccbf640 1 -- 172.21.15.83:0/3877653871 learned_addr learned my addr 172.21.15.83:0/3877653871 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f87fff640 1 --2- 172.21.15.83:0/3877653871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035b17d70 0x55a035b18150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f7ffff640 1 --2- 172.21.15.83:0/3877653871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b18690 0x55a035ace2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f8ccbf640 1 -- 172.21.15.83:0/3877653871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b18690 msgr2=0x55a035ace2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f8ccbf640 1 --2- 172.21.15.83:0/3877653871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b18690 0x55a035ace2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f8ccbf640 1 -- 172.21.15.83:0/3877653871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035b17d70 msgr2=0x55a035b18150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f8ccbf640 1 --2- 172.21.15.83:0/3877653871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035b17d70 0x55a035b18150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f8ccbf640 1 -- 172.21.15.83:0/3877653871 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0358a1d00 con 0x55a035ace830 2024-03-30T13:10:28.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f8ccbf640 1 --2- 172.21.15.83:0/3877653871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035ace830 0x55a035acec10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5f8001c970 tx=0x7f5f80004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a744f6a2a4c0c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f7dffb640 1 -- 172.21.15.83:0/3877653871 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800bd020 con 0x55a035ace830 2024-03-30T13:10:28.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f7dffb640 1 -- 172.21.15.83:0/3877653871 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f800b3040 con 0x55a035ace830 2024-03-30T13:10:28.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f7dffb640 1 -- 172.21.15.83:0/3877653871 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800b2070 con 0x55a035ace830 2024-03-30T13:10:28.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 -- 172.21.15.83:0/3877653871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035ace830 msgr2=0x55a035acec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 --2- 172.21.15.83:0/3877653871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035ace830 0x55a035acec10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5f8001c970 tx=0x7f5f80004ac0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 -- 172.21.15.83:0/3877653871 shutdown_connections 2024-03-30T13:10:28.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 --2- 172.21.15.83:0/3877653871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035ace830 0x55a035acec10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 --2- 172.21.15.83:0/3877653871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b18690 0x55a035ace2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 --2- 172.21.15.83:0/3877653871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035b17d70 0x55a035b18150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 -- 172.21.15.83:0/3877653871 >> 172.21.15.83:0/3877653871 conn(0x55a035aca7e0 msgr2=0x55a035accbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 -- 172.21.15.83:0/3877653871 shutdown_connections 2024-03-30T13:10:28.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 -- 172.21.15.83:0/3877653871 wait complete. 2024-03-30T13:10:28.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 -- start start 2024-03-30T13:10:28.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 Processor -- start 2024-03-30T13:10:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035ace830 0x55a035afbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.501+0000 7f5f918a4000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b17d70 0x55a035afc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b18690 0x55a035afc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a0358e4270 con 0x55a035b18690 2024-03-30T13:10:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a0358da6a0 con 0x55a035ace830 2024-03-30T13:10:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55a0358b4880 con 0x55a035b17d70 2024-03-30T13:10:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 10 client.0 _ll_register_callbacks cb 0x55a035ab9490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f8ccbf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b18690 0x55a035afc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f8ccbf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b18690 0x55a035afc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38290/0 (socket says 172.21.15.83:38290) 2024-03-30T13:10:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f8ccbf640 1 -- 172.21.15.83:0/1053359947 learned_addr learned my addr 172.21.15.83:0/1053359947 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f87fff640 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035ace830 0x55a035afbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f7ffff640 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b17d70 0x55a035afc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f8ccbf640 1 -- 172.21.15.83:0/1053359947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b17d70 msgr2=0x55a035afc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f8ccbf640 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b17d70 0x55a035afc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f8ccbf640 1 -- 172.21.15.83:0/1053359947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035ace830 msgr2=0x55a035afbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f8ccbf640 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035ace830 0x55a035afbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f8ccbf640 1 -- 172.21.15.83:0/1053359947 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0358e1730 con 0x55a035b18690 2024-03-30T13:10:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f87fff640 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035ace830 0x55a035afbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f8ccbf640 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b18690 0x55a035afc9b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5f8001afe0 tx=0x7f5f8001b170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34547679d90b663e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f66ffd640 1 -- 172.21.15.83:0/1053359947 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800bd030 con 0x55a035b18690 2024-03-30T13:10:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 -- 172.21.15.83:0/1053359947 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f800b3040 con 0x55a035b18690 2024-03-30T13:10:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f66ffd640 1 -- 172.21.15.83:0/1053359947 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5f800a5dd0 con 0x55a035b18690 2024-03-30T13:10:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f66ffd640 1 -- 172.21.15.83:0/1053359947 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5f800b2040 con 0x55a035b18690 2024-03-30T13:10:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 10 client.5559 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 -- 172.21.15.83:0/1053359947 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55a0358d4ca0 con 0x55a035b18690 2024-03-30T13:10:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f66ffd640 1 -- 172.21.15.83:0/1053359947 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f800b3040 con 0x55a035b18690 2024-03-30T13:10:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f66ffd640 1 -- 172.21.15.83:0/1053359947 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f5f800c2480 con 0x55a035b18690 2024-03-30T13:10:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 10 client.5559 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 10 client.5559 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 20 client.5559 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55a035b29220 0x55a035b2b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 4 client.5559 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 -- 172.21.15.83:0/1053359947 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0358b7c90 con 0x55a035b29220 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f87fff640 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55a035b29220 0x55a035b2b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f87fff640 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55a035b29220 0x55a035b2b610 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47ffa43f20f307a9 server_cookie=e424a8ea350c4dcb in_seq=0 out_seq=0 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f66ffd640 10 client.5559 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f66ffd640 1 -- 172.21.15.83:0/1053359947 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55a0358b7c90 con 0x55a035b29220 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f66ffd640 10 client.5559 handle_command_reply: tid=0 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 client.5559 shutdown 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 -- 172.21.15.83:0/1053359947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b18690 msgr2=0x55a035afc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b18690 0x55a035afc9b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5f8001afe0 tx=0x7f5f8001b170 comp rx=0 tx=0).stop 2024-03-30T13:10:28.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 -- 172.21.15.83:0/1053359947 shutdown_connections 2024-03-30T13:10:28.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55a035b29220 0x55a035b2b610 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b18690 0x55a035afc9b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f66ffd640 0 client.5559 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b17d70 0x55a035afc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 --2- 172.21.15.83:0/1053359947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035ace830 0x55a035afbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 -- 172.21.15.83:0/1053359947 >> 172.21.15.83:0/1053359947 conn(0x55a035aca7e0 msgr2=0x55a035acd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 -- 172.21.15.83:0/1053359947 shutdown_connections 2024-03-30T13:10:28.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 1 -- 172.21.15.83:0/1053359947 wait complete. 2024-03-30T13:10:28.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.505+0000 7f5f918a4000 20 client.5559 trim_cache size 0 max 16384 2024-03-30T13:10:28.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.517+0000 7f5f918a4000 1 Processor -- start 2024-03-30T13:10:28.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.517+0000 7f5f918a4000 1 -- start start 2024-03-30T13:10:28.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035ace830 0x55a035ad3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 0x55a035ad3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b18690 0x55a035b2b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8806bf70 con 0x55a035b17d70 2024-03-30T13:10:28.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88159340 con 0x55a035ace830 2024-03-30T13:10:28.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5f8813d420 con 0x55a035b18690 2024-03-30T13:10:28.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 0x55a035ad3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 0x55a035ad3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38300/0 (socket says 172.21.15.83:38300) 2024-03-30T13:10:28.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 -- 172.21.15.83:0/3926930655 learned_addr learned my addr 172.21.15.83:0/3926930655 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 -- 172.21.15.83:0/3926930655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b18690 msgr2=0x55a035b2b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 --2- 172.21.15.83:0/3926930655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b18690 0x55a035b2b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 -- 172.21.15.83:0/3926930655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035ace830 msgr2=0x55a035ad3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 --2- 172.21.15.83:0/3926930655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035ace830 0x55a035ad3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 -- 172.21.15.83:0/3926930655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0358a3d00 con 0x55a035b17d70 2024-03-30T13:10:28.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 --2- 172.21.15.83:0/3926930655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 0x55a035ad3ff0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5f70007390 tx=0x7f5f70011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9213c1c4d5e03354 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7d7fa640 1 -- 172.21.15.83:0/3926930655 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70027070 con 0x55a035b17d70 2024-03-30T13:10:28.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7d7fa640 1 -- 172.21.15.83:0/3926930655 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f7000d7a0 con 0x55a035b17d70 2024-03-30T13:10:28.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7d7fa640 1 -- 172.21.15.83:0/3926930655 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7001a070 con 0x55a035b17d70 2024-03-30T13:10:28.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 -- 172.21.15.83:0/3926930655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 msgr2=0x55a035ad3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 --2- 172.21.15.83:0/3926930655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 0x55a035ad3ff0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5f70007390 tx=0x7f5f70011000 comp rx=0 tx=0).stop 2024-03-30T13:10:28.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 -- 172.21.15.83:0/3926930655 shutdown_connections 2024-03-30T13:10:28.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 --2- 172.21.15.83:0/3926930655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035b18690 0x55a035b2b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 --2- 172.21.15.83:0/3926930655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 0x55a035ad3ff0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 --2- 172.21.15.83:0/3926930655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035ace830 0x55a035ad3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 -- 172.21.15.83:0/3926930655 >> 172.21.15.83:0/3926930655 conn(0x55a035aca7e0 msgr2=0x55a035ad33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 -- 172.21.15.83:0/3926930655 shutdown_connections 2024-03-30T13:10:28.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 -- 172.21.15.83:0/3926930655 wait complete. 2024-03-30T13:10:28.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 -- start start 2024-03-30T13:10:28.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 Processor -- start 2024-03-30T13:10:28.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035ace830 0x55a035b2e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 0x55a035b878c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035b18690 0x55a035b87e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88158cf0 con 0x55a035b17d70 2024-03-30T13:10:28.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a035b2ef80 con 0x55a035b18690 2024-03-30T13:10:28.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55a03591caa0 con 0x55a035ace830 2024-03-30T13:10:28.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f918a4000 10 client.0 _ll_register_callbacks cb 0x7f5f80009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:28.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 0x55a035b878c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 0x55a035b878c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38312/0 (socket says 172.21.15.83:38312) 2024-03-30T13:10:28.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 -- 172.21.15.83:0/1067663008 learned_addr learned my addr 172.21.15.83:0/1067663008 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 -- 172.21.15.83:0/1067663008 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035ace830 msgr2=0x55a035b2e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 --2- 172.21.15.83:0/1067663008 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035ace830 0x55a035b2e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f8ccbf640 1 --2- 172.21.15.83:0/1067663008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035b18690 0x55a035b87e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 -- 172.21.15.83:0/1067663008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035b18690 msgr2=0x55a035b87e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 --2- 172.21.15.83:0/1067663008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035b18690 0x55a035b87e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 -- 172.21.15.83:0/1067663008 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a03599df70 con 0x55a035b17d70 2024-03-30T13:10:28.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f7ffff640 1 --2- 172.21.15.83:0/1067663008 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 0x55a035b878c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5f70000f70 tx=0x7f5f70000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f73f7afef450aca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.521+0000 7f5f66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:28.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f66ffd640 1 -- 172.21.15.83:0/1067663008 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70031060 con 0x55a035b17d70 2024-03-30T13:10:28.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f66ffd640 1 -- 172.21.15.83:0/1067663008 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5f70012410 con 0x55a035b17d70 2024-03-30T13:10:28.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 -- 172.21.15.83:0/1067663008 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f7000d7a0 con 0x55a035b17d70 2024-03-30T13:10:28.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f66ffd640 1 -- 172.21.15.83:0/1067663008 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5f70027040 con 0x55a035b17d70 2024-03-30T13:10:28.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 10 client.5565 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:28.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 -- 172.21.15.83:0/1067663008 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55a0358c3760 con 0x55a035b17d70 2024-03-30T13:10:28.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f66ffd640 1 -- 172.21.15.83:0/1067663008 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f7000d7a0 con 0x55a035b17d70 2024-03-30T13:10:28.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f66ffd640 1 -- 172.21.15.83:0/1067663008 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f5f70020030 con 0x55a035b17d70 2024-03-30T13:10:28.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 10 client.5565 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:28.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 10 client.5565 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:28.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 20 client.5565 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:28.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 --2- 172.21.15.83:0/1067663008 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55a035b88b50 0x55a035b88f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 4 client.5565 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628296}] 2024-03-30T13:10:28.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 -- 172.21.15.83:0/1067663008 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628296}) -- 0x55a035929fe0 con 0x55a035b88b50 2024-03-30T13:10:28.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f87fff640 1 --2- 172.21.15.83:0/1067663008 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55a035b88b50 0x55a035b88f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f66ffd640 10 client.5565 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f87fff640 1 --2- 172.21.15.83:0/1067663008 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55a035b88b50 0x55a035b88f60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aebf2fbe58d8ae3 server_cookie=842b7c3175218ded in_seq=0 out_seq=0 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f66ffd640 1 -- 172.21.15.83:0/1067663008 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3814 (crc 0 0 0) 0x55a035929fe0 con 0x55a035b88b50 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f66ffd640 10 client.5565 handle_command_reply: tid=0 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 client.5565 shutdown 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 -- 172.21.15.83:0/1067663008 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 msgr2=0x55a035b878c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 --2- 172.21.15.83:0/1067663008 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 0x55a035b878c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5f70000f70 tx=0x7f5f70000ee0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 -- 172.21.15.83:0/1067663008 shutdown_connections 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 --2- 172.21.15.83:0/1067663008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a035b18690 0x55a035b87e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 --2- 172.21.15.83:0/1067663008 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55a035b88b50 0x55a035b88f60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 --2- 172.21.15.83:0/1067663008 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a035b17d70 0x55a035b878c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 --2- 172.21.15.83:0/1067663008 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55a035ace830 0x55a035b2e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 -- 172.21.15.83:0/1067663008 >> 172.21.15.83:0/1067663008 conn(0x55a035aca7e0 msgr2=0x55a035ad3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f66ffd640 0 client.5565 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 -- 172.21.15.83:0/1067663008 shutdown_connections 2024-03-30T13:10:28.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 1 -- 172.21.15.83:0/1067663008 wait complete. 2024-03-30T13:10:28.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f918a4000 20 client.5565 trim_cache size 0 max 16384 2024-03-30T13:10:28.540 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:28.540 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ceph/ioctl.h", 2024-03-30T13:10:28.540 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628296, 2024-03-30T13:10:28.540 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:28.540 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.067063+0000", 2024-03-30T13:10:28.540 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:53.963553+0000", 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:28.541 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:28.542 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:28.542 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:28.542 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.542 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:28.542 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 3724, 2024-03-30T13:10:28.542 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:28.542 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:28.542 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:28.542 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:28.542 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:53.963553+0000", 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:28.543 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 3724, 2024-03-30T13:10:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.067063+0000" 2024-03-30T13:10:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.545 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 3724, 2024-03-30T13:10:28.545 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:28.545 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:28.545 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:28.545 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.067063+0000" 2024-03-30T13:10:28.545 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.545 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 118, 2024-03-30T13:10:28.545 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:28.546 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:28.546 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 34, 2024-03-30T13:10:28.546 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:28.546 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:28.546 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:28.546 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:28.546 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:28.546 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:28.546 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:28.546 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.546 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:28.547 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.548 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:28.548 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:28.548 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:28.548 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:28.548 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.548 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:28.548 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.548 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:28.548 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:28.548 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:28.548 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:28.548 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:28.549 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:28.549 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:28.549 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:28.549 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:28.549 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:28.549 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:28.549 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:28.549 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:28.549 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.549 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:28.549 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:28.549 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.550 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.550 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:28.550 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.550 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.550 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.550 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.550 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.550 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.550 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:28.550 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.552 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:28.554 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:28.554 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:28.554 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.554 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:28.554 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:28.554 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:28.554 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:28.554 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f8e722640 1 -- 172.21.15.83:0/112161875 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5f68067ff0 msgr2=0x7f5f6806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f8e722640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5f68067ff0 0x7f5f6806a4b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5f881519a0 tx=0x7f5f70009040 comp rx=0 tx=0).stop 2024-03-30T13:10:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f8e722640 1 -- 172.21.15.83:0/112161875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88140890 msgr2=0x7f5f88151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f8e722640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88140890 0x7f5f88151430 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800c450 tx=0x7f5f7800c910 comp rx=0 tx=0).stop 2024-03-30T13:10:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f8e722640 1 -- 172.21.15.83:0/112161875 shutdown_connections 2024-03-30T13:10:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f8e722640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5f68067ff0 0x7f5f6806a4b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f8e722640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5f8815b810 0x7f5f88136800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f8e722640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f8815b430 0x7f5f881f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f8e722640 1 --2- 172.21.15.83:0/112161875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88140890 0x7f5f88151430 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f8e722640 1 -- 172.21.15.83:0/112161875 >> 172.21.15.83:0/112161875 conn(0x7f5f88072f00 msgr2=0x7f5f880b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f8e722640 1 -- 172.21.15.83:0/112161875 shutdown_connections 2024-03-30T13:10:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.525+0000 7f5f8e722640 1 -- 172.21.15.83:0/112161875 wait complete. 2024-03-30T13:10:28.557 DEBUG:tasks.cephfs.test_uninlining:getting inode info #6 of 23:1099511628308 2024-03-30T13:10:28.557 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628308 2024-03-30T13:10:28.557 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628308 2024-03-30T13:10:28.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b82278640 1 Processor -- start 2024-03-30T13:10:28.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b82278640 1 -- start start 2024-03-30T13:10:28.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b82278640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7b7c13f520 0x7f7b7c0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b82278640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b7c06e180 0x7f7b7c15d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b82278640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b7c0ce990 con 0x7f7b7c0b5e00 2024-03-30T13:10:28.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b82278640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f7b7c06f7a0 con 0x7f7b7c13f520 2024-03-30T13:10:28.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b82278640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7b7c06e740 con 0x7f7b7c06e180 2024-03-30T13:10:28.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b7bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7b7c13f520 0x7f7b7c0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b7bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7b7c13f520 0x7f7b7c0ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38322/0 (socket says 172.21.15.83:38322) 2024-03-30T13:10:28.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b7bfff640 1 -- 172.21.15.83:0/2047849374 learned_addr learned my addr 172.21.15.83:0/2047849374 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b73fff640 1 --2- 172.21.15.83:0/2047849374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b7c06e180 0x7f7b7c15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b7bfff640 1 -- 172.21.15.83:0/2047849374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b7c06e180 msgr2=0x7f7b7c15d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b7bfff640 1 --2- 172.21.15.83:0/2047849374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b7c06e180 0x7f7b7c15d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b7bfff640 1 -- 172.21.15.83:0/2047849374 >> v1:172.21.15.153:6789/0 conn(0x7f7b7c0b5e00 legacy=0x7f7b7c06fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.657+0000 7f7b7bfff640 1 -- 172.21.15.83:0/2047849374 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c06ea20 con 0x7f7b7c13f520 2024-03-30T13:10:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b7bfff640 1 --2- 172.21.15.83:0/2047849374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b7c13f520 0x7f7b7c0ccce0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009870 tx=0x7f7b6c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d10ad6aaf90a3de server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b7b7fe640 1 -- 172.21.15.83:0/2047849374 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0b0070 con 0x7f7b7c13f520 2024-03-30T13:10:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b7b7fe640 1 -- 172.21.15.83:0/2047849374 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6c0ab600 con 0x7f7b7c13f520 2024-03-30T13:10:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b7b7fe640 1 -- 172.21.15.83:0/2047849374 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0ab9d0 con 0x7f7b7c13f520 2024-03-30T13:10:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 -- 172.21.15.83:0/2047849374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b7c13f520 msgr2=0x7f7b7c0ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 --2- 172.21.15.83:0/2047849374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b7c13f520 0x7f7b7c0ccce0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009870 tx=0x7f7b6c01c4d0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 -- 172.21.15.83:0/2047849374 shutdown_connections 2024-03-30T13:10:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 --2- 172.21.15.83:0/2047849374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b7c06e180 0x7f7b7c15d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 --2- 172.21.15.83:0/2047849374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b7c13f520 0x7f7b7c0ccce0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 -- 172.21.15.83:0/2047849374 >> 172.21.15.83:0/2047849374 conn(0x7f7b7c072f00 msgr2=0x7f7b7c06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 -- 172.21.15.83:0/2047849374 shutdown_connections 2024-03-30T13:10:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 -- 172.21.15.83:0/2047849374 wait complete. 2024-03-30T13:10:28.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 Processor -- start 2024-03-30T13:10:28.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 -- start start 2024-03-30T13:10:28.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b7c06e180 0x7f7b7c156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b7c0b5e00 0x7f7b7c1417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b7c13f520 0x7f7b7c15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c070940 con 0x7f7b7c13f520 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c0707c0 con 0x7f7b7c06e180 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b82278640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7b7c169bb0 con 0x7f7b7c0b5e00 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b80815640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b7c13f520 0x7f7b7c15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b80815640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b7c13f520 0x7f7b7c15bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38328/0 (socket says 172.21.15.83:38328) 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b80815640 1 -- 172.21.15.83:0/1629789445 learned_addr learned my addr 172.21.15.83:0/1629789445 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b73fff640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b7c0b5e00 0x7f7b7c1417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b7bfff640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b7c06e180 0x7f7b7c156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b80815640 1 -- 172.21.15.83:0/1629789445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b7c0b5e00 msgr2=0x7f7b7c1417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b80815640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b7c0b5e00 0x7f7b7c1417d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b80815640 1 -- 172.21.15.83:0/1629789445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b7c06e180 msgr2=0x7f7b7c156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b80815640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b7c06e180 0x7f7b7c156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b80815640 1 -- 172.21.15.83:0/1629789445 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c13fc60 con 0x7f7b7c13f520 2024-03-30T13:10:28.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.661+0000 7f7b7bfff640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b7c06e180 0x7f7b7c156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b80815640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b7c13f520 0x7f7b7c15bab0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400c770 tx=0x7f7b7400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b797fa640 1 -- 172.21.15.83:0/1629789445 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74003b80 con 0x7f7b7c13f520 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b797fa640 1 -- 172.21.15.83:0/1629789445 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b74003d20 con 0x7f7b7c13f520 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b82278640 1 -- 172.21.15.83:0/1629789445 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b7c13ff40 con 0x7f7b7c13f520 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b797fa640 1 -- 172.21.15.83:0/1629789445 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7400aa90 con 0x7f7b7c13f520 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b82278640 1 -- 172.21.15.83:0/1629789445 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b7c140500 con 0x7f7b7c13f520 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b797fa640 1 -- 172.21.15.83:0/1629789445 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f7b7400ac30 con 0x7f7b7c13f520 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b797fa640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7b5c067fc0 0x7f7b5c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b7bfff640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7b5c067fc0 0x7f7b5c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b797fa640 1 -- 172.21.15.83:0/1629789445 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7b74086470 con 0x7f7b7c13f520 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b853fa000 1 Processor -- start 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b853fa000 1 -- start start 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b7bfff640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7b5c067fc0 0x7f7b5c06a480 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0ad000 tx=0x7f7b6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b853fa000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8b21d70 0x55f8d8b22150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b853fa000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b22690 0x55f8d8ad82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b853fa000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 0x55f8d8ad8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b853fa000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f8d8926aa0 con 0x55f8d8ad8830 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b853fa000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f8d88adaf0 con 0x55f8d8b22690 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b853fa000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f8d8922a50 con 0x55f8d8b21d70 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b80815640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 0x55f8d8ad8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b80815640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 0x55f8d8ad8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38338/0 (socket says 172.21.15.83:38338) 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.665+0000 7f7b80815640 1 -- 172.21.15.83:0/307826935 learned_addr learned my addr 172.21.15.83:0/307826935 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b7bfff640 1 --2- 172.21.15.83:0/307826935 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8b21d70 0x55f8d8b22150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b73fff640 1 --2- 172.21.15.83:0/307826935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b22690 0x55f8d8ad82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b80815640 1 -- 172.21.15.83:0/307826935 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8b21d70 msgr2=0x55f8d8b22150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b80815640 1 --2- 172.21.15.83:0/307826935 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8b21d70 0x55f8d8b22150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b80815640 1 -- 172.21.15.83:0/307826935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b22690 msgr2=0x55f8d8ad82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b80815640 1 --2- 172.21.15.83:0/307826935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b22690 0x55f8d8ad82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b80815640 1 -- 172.21.15.83:0/307826935 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d88abd00 con 0x55f8d8ad8830 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b73fff640 1 --2- 172.21.15.83:0/307826935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b22690 0x55f8d8ad82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b80815640 1 --2- 172.21.15.83:0/307826935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 0x55f8d8ad8c10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7b7405ebd0 tx=0x7f7b74055f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448b419c92d559a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b71ffb640 1 -- 172.21.15.83:0/307826935 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7406e070 con 0x55f8d8ad8830 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b71ffb640 1 -- 172.21.15.83:0/307826935 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7405a8d0 con 0x55f8d8ad8830 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b71ffb640 1 -- 172.21.15.83:0/307826935 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7405f100 con 0x55f8d8ad8830 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 -- 172.21.15.83:0/307826935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 msgr2=0x55f8d8ad8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 --2- 172.21.15.83:0/307826935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 0x55f8d8ad8c10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7b7405ebd0 tx=0x7f7b74055f40 comp rx=0 tx=0).stop 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 -- 172.21.15.83:0/307826935 shutdown_connections 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 --2- 172.21.15.83:0/307826935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 0x55f8d8ad8c10 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 --2- 172.21.15.83:0/307826935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b22690 0x55f8d8ad82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 --2- 172.21.15.83:0/307826935 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8b21d70 0x55f8d8b22150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 -- 172.21.15.83:0/307826935 >> 172.21.15.83:0/307826935 conn(0x55f8d8ad47e0 msgr2=0x55f8d8ad6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 -- 172.21.15.83:0/307826935 shutdown_connections 2024-03-30T13:10:28.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 -- 172.21.15.83:0/307826935 wait complete. 2024-03-30T13:10:28.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 -- start start 2024-03-30T13:10:28.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 Processor -- start 2024-03-30T13:10:28.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 0x55f8d8addc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 0x55f8d8b06da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8b22690 0x55f8d8b072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f8d88ee270 con 0x55f8d8ad8830 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f8d88e46a0 con 0x55f8d8b21d70 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f8d88be880 con 0x55f8d8b22690 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 10 client.0 _ll_register_callbacks cb 0x55f8d8ac3490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b7bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 0x55f8d8addc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b7bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 0x55f8d8addc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38352/0 (socket says 172.21.15.83:38352) 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b7bfff640 1 -- 172.21.15.83:0/1814476224 learned_addr learned my addr 172.21.15.83:0/1814476224 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b73fff640 1 --2- 172.21.15.83:0/1814476224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 0x55f8d8b06da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b7bfff640 1 -- 172.21.15.83:0/1814476224 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8b22690 msgr2=0x55f8d8b072e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b7bfff640 1 --2- 172.21.15.83:0/1814476224 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8b22690 0x55f8d8b072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b7bfff640 1 -- 172.21.15.83:0/1814476224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 msgr2=0x55f8d8b06da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b7bfff640 1 --2- 172.21.15.83:0/1814476224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 0x55f8d8b06da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b7bfff640 1 -- 172.21.15.83:0/1814476224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8d88eb730 con 0x55f8d8ad8830 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b7bfff640 1 --2- 172.21.15.83:0/1814476224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 0x55f8d8addc50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c008010 tx=0x7f7b6c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69c5f710e0dd64a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b5affd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b5affd640 1 -- 172.21.15.83:0/1814476224 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0c7060 con 0x55f8d8ad8830 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b5affd640 1 -- 172.21.15.83:0/1814476224 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7b6c0c2670 con 0x55f8d8ad8830 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 -- 172.21.15.83:0/1814476224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b7405a8d0 con 0x55f8d8ad8830 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b5affd640 1 -- 172.21.15.83:0/1814476224 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f7b6c0cd050 con 0x55f8d8ad8830 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 10 client.5577 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 1 -- 172.21.15.83:0/1814476224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55f8d88deca0 con 0x55f8d8ad8830 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b5affd640 1 -- 172.21.15.83:0/1814476224 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7405a8d0 con 0x55f8d8ad8830 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b5affd640 1 -- 172.21.15.83:0/1814476224 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f7b6c0d0020 con 0x55f8d8ad8830 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 10 client.5577 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 10 client.5577 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.669+0000 7f7b853fa000 20 client.5577 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 --2- 172.21.15.83:0/1814476224 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f8d8b295d0 0x55f8d8b299e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 4 client.5577 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 -- 172.21.15.83:0/1814476224 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8d88c1c90 con 0x55f8d8b295d0 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b73fff640 1 --2- 172.21.15.83:0/1814476224 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f8d8b295d0 0x55f8d8b299e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b73fff640 1 --2- 172.21.15.83:0/1814476224 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f8d8b295d0 0x55f8d8b299e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e24b2aab609390af server_cookie=146e6607e61fecec in_seq=0 out_seq=0 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b5affd640 10 client.5577 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b5affd640 1 -- 172.21.15.83:0/1814476224 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55f8d88c1c90 con 0x55f8d8b295d0 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b5affd640 10 client.5577 handle_command_reply: tid=0 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 client.5577 shutdown 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 -- 172.21.15.83:0/1814476224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 msgr2=0x55f8d8addc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 --2- 172.21.15.83:0/1814476224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 0x55f8d8addc50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c008010 tx=0x7f7b6c01ad10 comp rx=0 tx=0).stop 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 -- 172.21.15.83:0/1814476224 shutdown_connections 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 --2- 172.21.15.83:0/1814476224 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8b22690 0x55f8d8b072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 --2- 172.21.15.83:0/1814476224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 0x55f8d8b06da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 --2- 172.21.15.83:0/1814476224 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f8d8b295d0 0x55f8d8b299e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 --2- 172.21.15.83:0/1814476224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8ad8830 0x55f8d8addc50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b5affd640 0 client.5577 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 -- 172.21.15.83:0/1814476224 >> 172.21.15.83:0/1814476224 conn(0x55f8d8ad47e0 msgr2=0x55f8d8ad7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 -- 172.21.15.83:0/1814476224 shutdown_connections 2024-03-30T13:10:28.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 1 -- 172.21.15.83:0/1814476224 wait complete. 2024-03-30T13:10:28.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.673+0000 7f7b853fa000 20 client.5577 trim_cache size 0 max 16384 2024-03-30T13:10:28.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.685+0000 7f7b853fa000 1 Processor -- start 2024-03-30T13:10:28.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.685+0000 7f7b853fa000 1 -- start start 2024-03-30T13:10:28.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8ad8830 0x55f8d8b24a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 0x55f8d8b24fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 0x55f8d8b25500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c202130 con 0x55f8d8b22690 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c201150 con 0x55f8d8b21d70 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7b7c2005a0 con 0x55f8d8ad8830 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b80815640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 0x55f8d8b25500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b80815640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 0x55f8d8b25500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38362/0 (socket says 172.21.15.83:38362) 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b80815640 1 -- 172.21.15.83:0/2207351411 learned_addr learned my addr 172.21.15.83:0/2207351411 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b80815640 1 -- 172.21.15.83:0/2207351411 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8ad8830 msgr2=0x55f8d8b24a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b80815640 1 --2- 172.21.15.83:0/2207351411 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8ad8830 0x55f8d8b24a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b80815640 1 -- 172.21.15.83:0/2207351411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 msgr2=0x55f8d8b24fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b80815640 1 --2- 172.21.15.83:0/2207351411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 0x55f8d8b24fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b80815640 1 -- 172.21.15.83:0/2207351411 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d88add00 con 0x55f8d8b22690 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b80815640 1 --2- 172.21.15.83:0/2207351411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 0x55f8d8b25500 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7b740849f0 tx=0x7f7b74059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1655ed766d91812 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b717fa640 1 -- 172.21.15.83:0/2207351411 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74073070 con 0x55f8d8b22690 2024-03-30T13:10:28.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b717fa640 1 -- 172.21.15.83:0/2207351411 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7405f100 con 0x55f8d8b22690 2024-03-30T13:10:28.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b717fa640 1 -- 172.21.15.83:0/2207351411 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7406e040 con 0x55f8d8b22690 2024-03-30T13:10:28.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 -- 172.21.15.83:0/2207351411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 msgr2=0x55f8d8b25500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 --2- 172.21.15.83:0/2207351411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 0x55f8d8b25500 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7b740849f0 tx=0x7f7b74059040 comp rx=0 tx=0).stop 2024-03-30T13:10:28.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 -- 172.21.15.83:0/2207351411 shutdown_connections 2024-03-30T13:10:28.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 --2- 172.21.15.83:0/2207351411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 0x55f8d8b25500 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 --2- 172.21.15.83:0/2207351411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 0x55f8d8b24fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 --2- 172.21.15.83:0/2207351411 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8ad8830 0x55f8d8b24a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 -- 172.21.15.83:0/2207351411 >> 172.21.15.83:0/2207351411 conn(0x55f8d8ad47e0 msgr2=0x55f8d8b38f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 -- 172.21.15.83:0/2207351411 shutdown_connections 2024-03-30T13:10:28.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 -- 172.21.15.83:0/2207351411 wait complete. 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 -- start start 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 Processor -- start 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8ad8830 0x55f8d8b90cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 0x55f8d8b91210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 0x55f8d8b91750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f8d88c0ce0 con 0x55f8d8b22690 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c200b30 con 0x55f8d8b21d70 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f8d89e2b00 con 0x55f8d8ad8830 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b853fa000 10 client.0 _ll_register_callbacks cb 0x7f7b6c0ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b80815640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 0x55f8d8b91750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b80815640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 0x55f8d8b91750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38376/0 (socket says 172.21.15.83:38376) 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.689+0000 7f7b80815640 1 -- 172.21.15.83:0/1658364996 learned_addr learned my addr 172.21.15.83:0/1658364996 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b80815640 1 -- 172.21.15.83:0/1658364996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8ad8830 msgr2=0x55f8d8b90cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b80815640 1 --2- 172.21.15.83:0/1658364996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8ad8830 0x55f8d8b90cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b73fff640 1 --2- 172.21.15.83:0/1658364996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 0x55f8d8b91210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b80815640 1 -- 172.21.15.83:0/1658364996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 msgr2=0x55f8d8b91210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b80815640 1 --2- 172.21.15.83:0/1658364996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 0x55f8d8b91210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b80815640 1 -- 172.21.15.83:0/1658364996 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8d89a7f70 con 0x55f8d8b22690 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b80815640 1 --2- 172.21.15.83:0/1658364996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 0x55f8d8b91750 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7b74002240 tx=0x7f7b74001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5973896cfab9e2dc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b5affd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b5affd640 1 -- 172.21.15.83:0/1658364996 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74073040 con 0x55f8d8b22690 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b5affd640 1 -- 172.21.15.83:0/1658364996 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7b74019de0 con 0x55f8d8b22690 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 -- 172.21.15.83:0/1658364996 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b7405f100 con 0x55f8d8b22690 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b5affd640 1 -- 172.21.15.83:0/1658364996 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f7b7407e020 con 0x55f8d8b22690 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 10 client.5583 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 -- 172.21.15.83:0/1658364996 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55f8d88cd760 con 0x55f8d8b22690 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b5affd640 1 -- 172.21.15.83:0/1658364996 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7405f100 con 0x55f8d8b22690 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b5affd640 1 -- 172.21.15.83:0/1658364996 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f7b74052b90 con 0x55f8d8b22690 2024-03-30T13:10:28.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 10 client.5583 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 10 client.5583 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 20 client.5583 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 --2- 172.21.15.83:0/1658364996 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f8d8b92110 0x55f8d8b9c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 4 client.5583 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628308}] 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 -- 172.21.15.83:0/1658364996 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628308}) -- 0x55f8d8933fe0 con 0x55f8d8b92110 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b7bfff640 1 --2- 172.21.15.83:0/1658364996 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f8d8b92110 0x55f8d8b9c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b5affd640 10 client.5583 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b7bfff640 1 --2- 172.21.15.83:0/1658364996 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f8d8b92110 0x55f8d8b9c690 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d392422700247dc8 server_cookie=6da5d1248bf5dac4 in_seq=0 out_seq=0 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b5affd640 1 -- 172.21.15.83:0/1658364996 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3812 (crc 0 0 0) 0x55f8d8933fe0 con 0x55f8d8b92110 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b5affd640 10 client.5583 handle_command_reply: tid=0 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 client.5583 shutdown 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 -- 172.21.15.83:0/1658364996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 msgr2=0x55f8d8b91750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 --2- 172.21.15.83:0/1658364996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 0x55f8d8b91750 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7b74002240 tx=0x7f7b74001260 comp rx=0 tx=0).stop 2024-03-30T13:10:28.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 -- 172.21.15.83:0/1658364996 shutdown_connections 2024-03-30T13:10:28.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 --2- 172.21.15.83:0/1658364996 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f8d8b92110 0x55f8d8b9c690 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 --2- 172.21.15.83:0/1658364996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f8d8b22690 0x55f8d8b91750 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 --2- 172.21.15.83:0/1658364996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8d8b21d70 0x55f8d8b91210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 --2- 172.21.15.83:0/1658364996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f8d8ad8830 0x55f8d8b90cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 -- 172.21.15.83:0/1658364996 >> 172.21.15.83:0/1658364996 conn(0x55f8d8ad47e0 msgr2=0x55f8d8b39620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b5affd640 0 client.5583 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 -- 172.21.15.83:0/1658364996 shutdown_connections 2024-03-30T13:10:28.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 1 -- 172.21.15.83:0/1658364996 wait complete. 2024-03-30T13:10:28.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b853fa000 20 client.5583 trim_cache size 0 max 16384 2024-03-30T13:10:28.705 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:28.705 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/Kconfig", 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628308, 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.077577+0000", 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.029034+0000", 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:28.706 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 1240, 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:28.707 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.029034+0000", 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.708 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1240, 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.077577+0000" 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1240, 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.077577+0000" 2024-03-30T13:10:28.709 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 72, 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 2, 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:28.710 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:28.711 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:28.712 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.714 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:28.715 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:28.716 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:28.717 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:28.717 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b82278640 1 -- 172.21.15.83:0/1629789445 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7b5c067fc0 msgr2=0x7f7b5c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b82278640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7b5c067fc0 0x7f7b5c06a480 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0ad000 tx=0x7f7b6c008040 comp rx=0 tx=0).stop 2024-03-30T13:10:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b82278640 1 -- 172.21.15.83:0/1629789445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b7c13f520 msgr2=0x7f7b7c15bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b82278640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b7c13f520 0x7f7b7c15bab0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400c770 tx=0x7f7b7400cc30 comp rx=0 tx=0).stop 2024-03-30T13:10:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b82278640 1 -- 172.21.15.83:0/1629789445 shutdown_connections 2024-03-30T13:10:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b82278640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7b5c067fc0 0x7f7b5c06a480 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b82278640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b7c13f520 0x7f7b7c15bab0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b82278640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b7c0b5e00 0x7f7b7c1417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b82278640 1 --2- 172.21.15.83:0/1629789445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b7c06e180 0x7f7b7c156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b82278640 1 -- 172.21.15.83:0/1629789445 >> 172.21.15.83:0/1629789445 conn(0x7f7b7c072f00 msgr2=0x7f7b7c15eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b82278640 1 -- 172.21.15.83:0/1629789445 shutdown_connections 2024-03-30T13:10:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.693+0000 7f7b82278640 1 -- 172.21.15.83:0/1629789445 wait complete. 2024-03-30T13:10:28.719 DEBUG:tasks.cephfs.test_uninlining:getting inode info #7 of 23:1099511628326 2024-03-30T13:10:28.719 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628326 2024-03-30T13:10:28.720 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628326 2024-03-30T13:10:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.813+0000 7f2e131b4640 1 Processor -- start 2024-03-30T13:10:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.813+0000 7f2e131b4640 1 -- start start 2024-03-30T13:10:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.813+0000 7f2e131b4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e0c15fc00 0x7f2e0c0d2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.813+0000 7f2e131b4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c0ce660 0x7f2e0c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.813+0000 7f2e131b4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2e0c09af90 0x7f2e0c160370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.813+0000 7f2e131b4640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0c070500 con 0x7f2e0c09af90 2024-03-30T13:10:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.813+0000 7f2e131b4640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0c0ceb60 con 0x7f2e0c15fc00 2024-03-30T13:10:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.813+0000 7f2e131b4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0c06fbd0 con 0x7f2e0c0ce660 2024-03-30T13:10:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.813+0000 7f2e11751640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2e0c09af90 0x7f2e0c160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.813+0000 7f2e11751640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2e0c09af90 0x7f2e0c160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38390/0 (socket says 172.21.15.83:38390) 2024-03-30T13:10:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.813+0000 7f2e11751640 1 -- 172.21.15.83:0/668875491 learned_addr learned my addr 172.21.15.83:0/668875491 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.813+0000 7f2e0bfff640 1 --2- 172.21.15.83:0/668875491 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c0ce660 0x7f2e0c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e10f50640 1 --2- 172.21.15.83:0/668875491 >> v2:172.21.15.153:3300/0 conn(0x7f2e0c15fc00 0x7f2e0c0d2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e11751640 1 -- 172.21.15.83:0/668875491 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c0ce660 msgr2=0x7f2e0c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e11751640 1 --2- 172.21.15.83:0/668875491 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c0ce660 0x7f2e0c09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e11751640 1 -- 172.21.15.83:0/668875491 >> v2:172.21.15.153:3300/0 conn(0x7f2e0c15fc00 msgr2=0x7f2e0c0d2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e11751640 1 --2- 172.21.15.83:0/668875491 >> v2:172.21.15.153:3300/0 conn(0x7f2e0c15fc00 0x7f2e0c0d2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e11751640 1 -- 172.21.15.83:0/668875491 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c06feb0 con 0x7f2e0c09af90 2024-03-30T13:10:28.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e11751640 1 --2- 172.21.15.83:0/668875491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e0c09af90 0x7f2e0c160370 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0729c0 tx=0x7f2e0401c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4d95b90e0bb194 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e0b7fe640 1 -- 172.21.15.83:0/668875491 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e040ac020 con 0x7f2e0c09af90 2024-03-30T13:10:28.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e0b7fe640 1 -- 172.21.15.83:0/668875491 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e040a6440 con 0x7f2e0c09af90 2024-03-30T13:10:28.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e0b7fe640 1 -- 172.21.15.83:0/668875491 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e040a6810 con 0x7f2e0c09af90 2024-03-30T13:10:28.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e131b4640 1 -- 172.21.15.83:0/668875491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e0c09af90 msgr2=0x7f2e0c160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e131b4640 1 --2- 172.21.15.83:0/668875491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e0c09af90 0x7f2e0c160370 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0729c0 tx=0x7f2e0401c6a0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e131b4640 1 -- 172.21.15.83:0/668875491 shutdown_connections 2024-03-30T13:10:28.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e131b4640 1 --2- 172.21.15.83:0/668875491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e0c09af90 0x7f2e0c160370 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e131b4640 1 --2- 172.21.15.83:0/668875491 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c0ce660 0x7f2e0c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e131b4640 1 --2- 172.21.15.83:0/668875491 >> v2:172.21.15.153:3300/0 conn(0x7f2e0c15fc00 0x7f2e0c0d2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e131b4640 1 -- 172.21.15.83:0/668875491 >> 172.21.15.83:0/668875491 conn(0x7f2e0c0d22f0 msgr2=0x7f2e0c0d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e131b4640 1 -- 172.21.15.83:0/668875491 shutdown_connections 2024-03-30T13:10:28.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.817+0000 7f2e131b4640 1 -- 172.21.15.83:0/668875491 wait complete. 2024-03-30T13:10:28.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e131b4640 1 Processor -- start 2024-03-30T13:10:28.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e131b4640 1 -- start start 2024-03-30T13:10:28.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e131b4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e0c09af90 0x7f2e0c1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e131b4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c0ce660 0x7f2e0c09f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e131b4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e0c15fc00 0x7f2e0c0ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e131b4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c070af0 con 0x7f2e0c15fc00 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e131b4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c070970 con 0x7f2e0c09af90 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e131b4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0c0ccd60 con 0x7f2e0c0ce660 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e11751640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e0c15fc00 0x7f2e0c0ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e11751640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e0c15fc00 0x7f2e0c0ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38400/0 (socket says 172.21.15.83:38400) 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e11751640 1 -- 172.21.15.83:0/1823089218 learned_addr learned my addr 172.21.15.83:0/1823089218 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e0bfff640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c0ce660 0x7f2e0c09f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e10f50640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e0c09af90 0x7f2e0c1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e11751640 1 -- 172.21.15.83:0/1823089218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c0ce660 msgr2=0x7f2e0c09f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e11751640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c0ce660 0x7f2e0c09f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e11751640 1 -- 172.21.15.83:0/1823089218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e0c09af90 msgr2=0x7f2e0c1526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e11751640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e0c09af90 0x7f2e0c1526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e11751640 1 -- 172.21.15.83:0/1823089218 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c0b5340 con 0x7f2e0c15fc00 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e11751640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e0c15fc00 0x7f2e0c0ca9a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2e0401ad50 tx=0x7f2e04019440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e097fa640 1 -- 172.21.15.83:0/1823089218 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e040a6a80 con 0x7f2e0c15fc00 2024-03-30T13:10:28.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e097fa640 1 -- 172.21.15.83:0/1823089218 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e040a6c20 con 0x7f2e0c15fc00 2024-03-30T13:10:28.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e131b4640 1 -- 172.21.15.83:0/1823089218 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0c0b5620 con 0x7f2e0c15fc00 2024-03-30T13:10:28.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e097fa640 1 -- 172.21.15.83:0/1823089218 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e040bb440 con 0x7f2e0c15fc00 2024-03-30T13:10:28.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e131b4640 1 -- 172.21.15.83:0/1823089218 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e0c0b5be0 con 0x7f2e0c15fc00 2024-03-30T13:10:28.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e097fa640 1 -- 172.21.15.83:0/1823089218 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2e040af020 con 0x7f2e0c15fc00 2024-03-30T13:10:28.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e097fa640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2df0067fc0 0x7f2df006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e097fa640 1 -- 172.21.15.83:0/1823089218 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2e04120650 con 0x7f2e0c15fc00 2024-03-30T13:10:28.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.821+0000 7f2e10f50640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2df0067fc0 0x7f2df006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e10f50640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2df0067fc0 0x7f2df006a480 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009670 tx=0x7f2df8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 Processor -- start 2024-03-30T13:10:28.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 -- start start 2024-03-30T13:10:28.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 0x55f66ec10150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec10690 0x55f66ebc62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 0x55f66ebc6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f66ea14aa0 con 0x55f66ec0fd70 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f66e99baf0 con 0x55f66ec10690 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f66ea10a50 con 0x55f66ebc6830 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e10f50640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 0x55f66ec10150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e10f50640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 0x55f66ec10150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38404/0 (socket says 172.21.15.83:38404) 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e10f50640 1 -- 172.21.15.83:0/2431756341 learned_addr learned my addr 172.21.15.83:0/2431756341 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e0bfff640 1 --2- 172.21.15.83:0/2431756341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec10690 0x55f66ebc62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e10f50640 1 -- 172.21.15.83:0/2431756341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 msgr2=0x55f66ebc6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e11751640 1 --2- 172.21.15.83:0/2431756341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 0x55f66ebc6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e10f50640 1 --2- 172.21.15.83:0/2431756341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 0x55f66ebc6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e10f50640 1 -- 172.21.15.83:0/2431756341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec10690 msgr2=0x55f66ebc62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e10f50640 1 --2- 172.21.15.83:0/2431756341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec10690 0x55f66ebc62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e10f50640 1 -- 172.21.15.83:0/2431756341 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66e999d00 con 0x55f66ec0fd70 2024-03-30T13:10:28.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e10f50640 1 --2- 172.21.15.83:0/2431756341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 0x55f66ec10150 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2df80157a0 tx=0x7f2df8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5803337414429c68 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2df67fc640 1 -- 172.21.15.83:0/2431756341 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8025070 con 0x55f66ec0fd70 2024-03-30T13:10:28.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2df67fc640 1 -- 172.21.15.83:0/2431756341 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df800e670 con 0x55f66ec0fd70 2024-03-30T13:10:28.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2df67fc640 1 -- 172.21.15.83:0/2431756341 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df800f040 con 0x55f66ec0fd70 2024-03-30T13:10:28.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 -- 172.21.15.83:0/2431756341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 msgr2=0x55f66ec10150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 --2- 172.21.15.83:0/2431756341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 0x55f66ec10150 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2df80157a0 tx=0x7f2df8011000 comp rx=0 tx=0).stop 2024-03-30T13:10:28.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 -- 172.21.15.83:0/2431756341 shutdown_connections 2024-03-30T13:10:28.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 --2- 172.21.15.83:0/2431756341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 0x55f66ebc6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 --2- 172.21.15.83:0/2431756341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec10690 0x55f66ebc62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 --2- 172.21.15.83:0/2431756341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 0x55f66ec10150 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 -- 172.21.15.83:0/2431756341 >> 172.21.15.83:0/2431756341 conn(0x55f66ebc27e0 msgr2=0x55f66ebc4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 -- 172.21.15.83:0/2431756341 shutdown_connections 2024-03-30T13:10:28.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 -- 172.21.15.83:0/2431756341 wait complete. 2024-03-30T13:10:28.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 -- start start 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.825+0000 7f2e16336000 1 Processor -- start 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 0x55f66ebcbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 0x55f66ebf4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec10690 0x55f66ebf52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f66e9dc270 con 0x55f66ec0fd70 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f66e9d26a0 con 0x55f66ec10690 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f66e9ac880 con 0x55f66ebc6830 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 10 client.0 _ll_register_callbacks cb 0x55f66ebb1490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e0bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 0x55f66ebf4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e0bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 0x55f66ebf4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38416/0 (socket says 172.21.15.83:38416) 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e0bfff640 1 -- 172.21.15.83:0/2736547266 learned_addr learned my addr 172.21.15.83:0/2736547266 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e10f50640 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 0x55f66ebcbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e11751640 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec10690 0x55f66ebf52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e0bfff640 1 -- 172.21.15.83:0/2736547266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 msgr2=0x55f66ebcbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e0bfff640 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 0x55f66ebcbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e0bfff640 1 -- 172.21.15.83:0/2736547266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec10690 msgr2=0x55f66ebf52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e0bfff640 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec10690 0x55f66ebf52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e0bfff640 1 -- 172.21.15.83:0/2736547266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f66e9d9730 con 0x55f66ec0fd70 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e0bfff640 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 0x55f66ebf4da0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000ddf0 tx=0x7f2e0000f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacf5dbfdcedca6f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2deb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2deb7fe640 1 -- 172.21.15.83:0/2736547266 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00018070 con 0x55f66ec0fd70 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2deb7fe640 1 -- 172.21.15.83:0/2736547266 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2e00014680 con 0x55f66ec0fd70 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 -- 172.21.15.83:0/2736547266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2df800e670 con 0x55f66ec0fd70 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2deb7fe640 1 -- 172.21.15.83:0/2736547266 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2e00023050 con 0x55f66ec0fd70 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 10 client.5595 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 -- 172.21.15.83:0/2736547266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55f66e9ccca0 con 0x55f66ec0fd70 2024-03-30T13:10:28.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2deb7fe640 1 -- 172.21.15.83:0/2736547266 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df800e670 con 0x55f66ec0fd70 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2deb7fe640 1 -- 172.21.15.83:0/2736547266 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f2e00026020 con 0x55f66ec0fd70 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 10 client.5595 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 10 client.5595 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 20 client.5595 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f66ec175d0 0x55f66ec179b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 4 client.5595 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 -- 172.21.15.83:0/2736547266 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f66e9afc90 con 0x55f66ec175d0 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e10f50640 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f66ec175d0 0x55f66ec179b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2deb7fe640 10 client.5595 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e10f50640 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f66ec175d0 0x55f66ec179b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d24990b86e56ef5 server_cookie=8fcf320a1881f3f2 in_seq=0 out_seq=0 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2deb7fe640 1 -- 172.21.15.83:0/2736547266 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55f66e9afc90 con 0x55f66ec175d0 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2deb7fe640 10 client.5595 handle_command_reply: tid=0 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 client.5595 shutdown 2024-03-30T13:10:28.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 -- 172.21.15.83:0/2736547266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 msgr2=0x55f66ebf4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 0x55f66ebf4da0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000ddf0 tx=0x7f2e0000f5b0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 -- 172.21.15.83:0/2736547266 shutdown_connections 2024-03-30T13:10:28.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec10690 0x55f66ebf52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f66ec175d0 0x55f66ec179b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec0fd70 0x55f66ebf4da0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 --2- 172.21.15.83:0/2736547266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 0x55f66ebcbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2deb7fe640 0 client.5595 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 -- 172.21.15.83:0/2736547266 >> 172.21.15.83:0/2736547266 conn(0x55f66ebc27e0 msgr2=0x55f66ebc5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 -- 172.21.15.83:0/2736547266 shutdown_connections 2024-03-30T13:10:28.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 1 -- 172.21.15.83:0/2736547266 wait complete. 2024-03-30T13:10:28.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.829+0000 7f2e16336000 20 client.5595 trim_cache size 0 max 16384 2024-03-30T13:10:28.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.857+0000 7f2e16336000 1 Processor -- start 2024-03-30T13:10:28.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.857+0000 7f2e16336000 1 -- start start 2024-03-30T13:10:28.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.857+0000 7f2e16336000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 0x55f66ebf3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.857+0000 7f2e16336000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec0fd70 0x55f66ebf4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.857+0000 7f2e16336000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec10690 0x55f66ebf4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.857+0000 7f2e16336000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c201790 con 0x55f66ec10690 2024-03-30T13:10:28.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.857+0000 7f2e16336000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c2007d0 con 0x55f66ec0fd70 2024-03-30T13:10:28.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.857+0000 7f2e16336000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0c09cec0 con 0x55f66ebc6830 2024-03-30T13:10:28.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.857+0000 7f2e11751640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec10690 0x55f66ebf4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.857+0000 7f2e11751640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec10690 0x55f66ebf4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38428/0 (socket says 172.21.15.83:38428) 2024-03-30T13:10:28.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.857+0000 7f2e11751640 1 -- 172.21.15.83:0/2398001908 learned_addr learned my addr 172.21.15.83:0/2398001908 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e11751640 1 -- 172.21.15.83:0/2398001908 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 msgr2=0x55f66ebf3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e11751640 1 --2- 172.21.15.83:0/2398001908 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 0x55f66ebf3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e11751640 1 -- 172.21.15.83:0/2398001908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec0fd70 msgr2=0x55f66ebf4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e11751640 1 --2- 172.21.15.83:0/2398001908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec0fd70 0x55f66ebf4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e11751640 1 -- 172.21.15.83:0/2398001908 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66e99bd00 con 0x55f66ec10690 2024-03-30T13:10:28.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e11751640 1 --2- 172.21.15.83:0/2398001908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec10690 0x55f66ebf4a90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2e0411eba0 tx=0x7f2e040ecad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f43b141ed6a2ad server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2df5ffb640 1 -- 172.21.15.83:0/2398001908 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e040f0e00 con 0x55f66ec10690 2024-03-30T13:10:28.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2df5ffb640 1 -- 172.21.15.83:0/2398001908 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e040f0700 con 0x55f66ec10690 2024-03-30T13:10:28.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2df5ffb640 1 -- 172.21.15.83:0/2398001908 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e040f4ab0 con 0x55f66ec10690 2024-03-30T13:10:28.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 -- 172.21.15.83:0/2398001908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec10690 msgr2=0x55f66ebf4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 --2- 172.21.15.83:0/2398001908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec10690 0x55f66ebf4a90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2e0411eba0 tx=0x7f2e040ecad0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 -- 172.21.15.83:0/2398001908 shutdown_connections 2024-03-30T13:10:28.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 --2- 172.21.15.83:0/2398001908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ec10690 0x55f66ebf4a90 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 --2- 172.21.15.83:0/2398001908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec0fd70 0x55f66ebf4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 --2- 172.21.15.83:0/2398001908 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ebc6830 0x55f66ebf3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 -- 172.21.15.83:0/2398001908 >> 172.21.15.83:0/2398001908 conn(0x55f66ebc27e0 msgr2=0x55f66ec26680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 -- 172.21.15.83:0/2398001908 shutdown_connections 2024-03-30T13:10:28.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 -- 172.21.15.83:0/2398001908 wait complete. 2024-03-30T13:10:28.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 -- start start 2024-03-30T13:10:28.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 Processor -- start 2024-03-30T13:10:28.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ebc6830 0x55f66ec7dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec0fd70 0x55f66ebc5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ec10690 0x55f66ebc6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f66e9d26a0 con 0x55f66ebc6830 2024-03-30T13:10:28.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c200180 con 0x55f66ec0fd70 2024-03-30T13:10:28.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f66e9dc270 con 0x55f66ec10690 2024-03-30T13:10:28.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e16336000 10 client.0 _ll_register_callbacks cb 0x7f2e0000d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e10f50640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ebc6830 0x55f66ec7dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e10f50640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ebc6830 0x55f66ec7dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38438/0 (socket says 172.21.15.83:38438) 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.861+0000 7f2e10f50640 1 -- 172.21.15.83:0/2735468656 learned_addr learned my addr 172.21.15.83:0/2735468656 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e10f50640 1 -- 172.21.15.83:0/2735468656 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ec10690 msgr2=0x55f66ebc6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e10f50640 1 --2- 172.21.15.83:0/2735468656 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ec10690 0x55f66ebc6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e10f50640 1 -- 172.21.15.83:0/2735468656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec0fd70 msgr2=0x55f66ebc5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e10f50640 1 --2- 172.21.15.83:0/2735468656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec0fd70 0x55f66ebc5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e10f50640 1 -- 172.21.15.83:0/2735468656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f66ea95f70 con 0x55f66ebc6830 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e10f50640 1 --2- 172.21.15.83:0/2735468656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ebc6830 0x55f66ec7dcb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2df8018040 tx=0x7f2df80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58147f05f2ee2aae server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2deb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2deb7fe640 1 -- 172.21.15.83:0/2735468656 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8030020 con 0x55f66ebc6830 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2deb7fe640 1 -- 172.21.15.83:0/2735468656 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2df800eae0 con 0x55f66ebc6830 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 -- 172.21.15.83:0/2735468656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e040f0700 con 0x55f66ebc6830 2024-03-30T13:10:28.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2deb7fe640 1 -- 172.21.15.83:0/2735468656 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2df8025040 con 0x55f66ebc6830 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 10 client.5601 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 -- 172.21.15.83:0/2735468656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55f66e9bb760 con 0x55f66ebc6830 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2deb7fe640 1 -- 172.21.15.83:0/2735468656 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e040f0700 con 0x55f66ebc6830 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2deb7fe640 1 -- 172.21.15.83:0/2735468656 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f2df8012030 con 0x55f66ebc6830 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 10 client.5601 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 10 client.5601 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 20 client.5601 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 --2- 172.21.15.83:0/2735468656 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f66ec14270 0x55f66ec8a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 4 client.5601 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628326}] 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 -- 172.21.15.83:0/2735468656 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628326}) -- 0x55f66ea21fe0 con 0x55f66ec14270 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e0bfff640 1 --2- 172.21.15.83:0/2735468656 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f66ec14270 0x55f66ec8a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2deb7fe640 10 client.5601 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e0bfff640 1 --2- 172.21.15.83:0/2735468656 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f66ec14270 0x55f66ec8a2e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19ef5a42fa60bc9f server_cookie=6092c16503644180 in_seq=0 out_seq=0 2024-03-30T13:10:28.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2deb7fe640 1 -- 172.21.15.83:0/2735468656 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3818 (crc 0 0 0) 0x55f66ea21fe0 con 0x55f66ec14270 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2deb7fe640 10 client.5601 handle_command_reply: tid=0 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 client.5601 shutdown 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 -- 172.21.15.83:0/2735468656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ebc6830 msgr2=0x55f66ec7dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 --2- 172.21.15.83:0/2735468656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ebc6830 0x55f66ec7dcb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2df8018040 tx=0x7f2df80046d0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 -- 172.21.15.83:0/2735468656 shutdown_connections 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 --2- 172.21.15.83:0/2735468656 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f66ec10690 0x55f66ebc6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 --2- 172.21.15.83:0/2735468656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f66ec0fd70 0x55f66ebc5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 --2- 172.21.15.83:0/2735468656 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f66ec14270 0x55f66ec8a2e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 --2- 172.21.15.83:0/2735468656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f66ebc6830 0x55f66ec7dcb0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2deb7fe640 0 client.5601 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 -- 172.21.15.83:0/2735468656 >> 172.21.15.83:0/2735468656 conn(0x55f66ebc27e0 msgr2=0x55f66ec26f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 -- 172.21.15.83:0/2735468656 shutdown_connections 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 1 -- 172.21.15.83:0/2735468656 wait complete. 2024-03-30T13:10:28.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e16336000 20 client.5601 trim_cache size 0 max 16384 2024-03-30T13:10:28.877 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:28.877 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/xattr_user.c", 2024-03-30T13:10:28.877 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628326, 2024-03-30T13:10:28.877 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:28.877 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.080075+0000", 2024-03-30T13:10:28.877 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.096851+0000", 2024-03-30T13:10:28.877 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:28.877 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:28.877 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:28.877 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:28.877 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 1232, 2024-03-30T13:10:28.878 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.096851+0000", 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.879 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1232, 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.080075+0000" 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:28.880 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1232, 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.080075+0000" 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 74, 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 38, 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:28.881 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:28.882 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:28.883 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.884 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:28.885 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:28.887 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:28.889 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:28.889 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:28.889 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:28.889 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:28.889 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:28.889 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:28.889 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:28.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e131b4640 1 -- 172.21.15.83:0/1823089218 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2df0067fc0 msgr2=0x7f2df006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e131b4640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2df0067fc0 0x7f2df006a480 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009670 tx=0x7f2df8008040 comp rx=0 tx=0).stop 2024-03-30T13:10:28.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e131b4640 1 -- 172.21.15.83:0/1823089218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e0c15fc00 msgr2=0x7f2e0c0ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:28.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e131b4640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e0c15fc00 0x7f2e0c0ca9a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2e0401ad50 tx=0x7f2e04019440 comp rx=0 tx=0).stop 2024-03-30T13:10:28.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e131b4640 1 -- 172.21.15.83:0/1823089218 shutdown_connections 2024-03-30T13:10:28.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e131b4640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2df0067fc0 0x7f2df006a480 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e131b4640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e0c15fc00 0x7f2e0c0ca9a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e131b4640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e0c0ce660 0x7f2e0c09f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e131b4640 1 --2- 172.21.15.83:0/1823089218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e0c09af90 0x7f2e0c1526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:28.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e131b4640 1 -- 172.21.15.83:0/1823089218 >> 172.21.15.83:0/1823089218 conn(0x7f2e0c0d22f0 msgr2=0x7f2e0c0af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:28.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e131b4640 1 -- 172.21.15.83:0/1823089218 shutdown_connections 2024-03-30T13:10:28.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.865+0000 7f2e131b4640 1 -- 172.21.15.83:0/1823089218 wait complete. 2024-03-30T13:10:28.892 DEBUG:tasks.cephfs.test_uninlining:getting inode info #8 of 23:1099511628324 2024-03-30T13:10:28.892 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628324 2024-03-30T13:10:28.892 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628324 2024-03-30T13:10:29.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.993+0000 7f78b2745640 1 Processor -- start 2024-03-30T13:10:29.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.993+0000 7f78b2745640 1 -- start start 2024-03-30T13:10:29.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78b2745640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f78ac15b570 0x7f78ac0ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78b2745640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78ac0b37a0 con 0x7f78ac0aec70 2024-03-30T13:10:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78b2745640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78ac0b0af0 con 0x7f78ac0b5080 2024-03-30T13:10:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78b2745640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f78ac15b950 con 0x7f78ac15b570 2024-03-30T13:10:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78abfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f78ac15b570 0x7f78ac0ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78ab7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f78ac0aec70 0x7f78ac0b0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36420/0 (socket says 172.21.15.83:36420) 2024-03-30T13:10:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78ab7fe640 1 -- 172.21.15.83:0/3127117425 learned_addr learned my addr 172.21.15.83:0/3127117425 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78abfff640 1 -- 172.21.15.83:0/3127117425 >> v1:172.21.15.153:6789/0 conn(0x7f78ac0b5080 legacy=0x7f78ac0b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78abfff640 1 -- 172.21.15.83:0/3127117425 >> v1:172.21.15.83:6789/0 conn(0x7f78ac0aec70 legacy=0x7f78ac0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78abfff640 1 -- 172.21.15.83:0/3127117425 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac0af490 con 0x7f78ac15b570 2024-03-30T13:10:29.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78aaffd640 1 -- 172.21.15.83:0/3127117425 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516690061 0 0) 0x7f78ac0b37a0 con 0x7f78ac0aec70 2024-03-30T13:10:29.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78abfff640 1 --2- 172.21.15.83:0/3127117425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ac15b570 0x7f78ac0ae730 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f789c009d90 tx=0x7f789c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34de15906d3be6cc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78aaffd640 1 -- 172.21.15.83:0/3127117425 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c0b2070 con 0x7f78ac15b570 2024-03-30T13:10:29.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78aaffd640 1 -- 172.21.15.83:0/3127117425 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c0a59c0 con 0x7f78ac15b570 2024-03-30T13:10:29.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:28.997+0000 7f78aaffd640 1 -- 172.21.15.83:0/3127117425 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c0a5d90 con 0x7f78ac15b570 2024-03-30T13:10:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 -- 172.21.15.83:0/3127117425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ac15b570 msgr2=0x7f78ac0ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 --2- 172.21.15.83:0/3127117425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ac15b570 0x7f78ac0ae730 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f789c009d90 tx=0x7f789c01c900 comp rx=0 tx=0).stop 2024-03-30T13:10:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 -- 172.21.15.83:0/3127117425 shutdown_connections 2024-03-30T13:10:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 --2- 172.21.15.83:0/3127117425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ac15b570 0x7f78ac0ae730 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 -- 172.21.15.83:0/3127117425 >> 172.21.15.83:0/3127117425 conn(0x7f78ac072d30 msgr2=0x7f78ac0b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 -- 172.21.15.83:0/3127117425 shutdown_connections 2024-03-30T13:10:29.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 -- 172.21.15.83:0/3127117425 wait complete. 2024-03-30T13:10:29.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 Processor -- start 2024-03-30T13:10:29.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 -- start start 2024-03-30T13:10:29.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78ac0aec70 0x7f78ac1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78ac0b5080 0x7f78ac15e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ac15b570 0x7f78ac145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac0af1f0 con 0x7f78ac15b570 2024-03-30T13:10:29.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac0af070 con 0x7f78ac0aec70 2024-03-30T13:10:29.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f78ac0b1ef0 con 0x7f78ac0b5080 2024-03-30T13:10:29.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b0ce2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ac15b570 0x7f78ac145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b0ce2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ac15b570 0x7f78ac145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38458/0 (socket says 172.21.15.83:38458) 2024-03-30T13:10:29.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b0ce2640 1 -- 172.21.15.83:0/684120387 learned_addr learned my addr 172.21.15.83:0/684120387 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78abfff640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78ac0aec70 0x7f78ac1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b0ce2640 1 -- 172.21.15.83:0/684120387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78ac0b5080 msgr2=0x7f78ac15e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78ab7fe640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78ac0b5080 0x7f78ac15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b0ce2640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78ac0b5080 0x7f78ac15e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b0ce2640 1 -- 172.21.15.83:0/684120387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78ac0aec70 msgr2=0x7f78ac1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b0ce2640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78ac0aec70 0x7f78ac1584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b0ce2640 1 -- 172.21.15.83:0/684120387 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac148ca0 con 0x7f78ac15b570 2024-03-30T13:10:29.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78abfff640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78ac0aec70 0x7f78ac1584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b0ce2640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ac15b570 0x7f78ac145ed0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f78a400c390 tx=0x7f78a400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78a8ff9640 1 -- 172.21.15.83:0/684120387 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a4011790 con 0x7f78ac15b570 2024-03-30T13:10:29.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78a8ff9640 1 -- 172.21.15.83:0/684120387 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a4017070 con 0x7f78ac15b570 2024-03-30T13:10:29.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 -- 172.21.15.83:0/684120387 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ac148f80 con 0x7f78ac15b570 2024-03-30T13:10:29.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78a8ff9640 1 -- 172.21.15.83:0/684120387 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a4011b70 con 0x7f78ac15b570 2024-03-30T13:10:29.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.001+0000 7f78b2745640 1 -- 172.21.15.83:0/684120387 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ac147500 con 0x7f78ac15b570 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78a8ff9640 1 -- 172.21.15.83:0/684120387 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f78a4011d10 con 0x7f78ac15b570 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78a8ff9640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7898067fc0 0x7f789806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78abfff640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7898067fc0 0x7f789806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78a8ff9640 1 -- 172.21.15.83:0/684120387 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f78a4086010 con 0x7f78ac15b570 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78abfff640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7898067fc0 0x7f789806a480 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f789c0af000 tx=0x7f789c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b58c7000 1 Processor -- start 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b58c7000 1 -- start start 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b58c7000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18bd70 0x55f09d18c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b58c7000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18c690 0x55f09d1422f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b58c7000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 0x55f09d142c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b58c7000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f09cf90aa0 con 0x55f09d142830 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b58c7000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f09cf17af0 con 0x55f09d18c690 2024-03-30T13:10:29.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b58c7000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f09cf8ca50 con 0x55f09d18bd70 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b0ce2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 0x55f09d142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b0ce2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 0x55f09d142c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38474/0 (socket says 172.21.15.83:38474) 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b0ce2640 1 -- 172.21.15.83:0/824562566 learned_addr learned my addr 172.21.15.83:0/824562566 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78ab7fe640 1 --2- 172.21.15.83:0/824562566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18c690 0x55f09d1422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78abfff640 1 --2- 172.21.15.83:0/824562566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18bd70 0x55f09d18c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b0ce2640 1 -- 172.21.15.83:0/824562566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18bd70 msgr2=0x55f09d18c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b0ce2640 1 --2- 172.21.15.83:0/824562566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18bd70 0x55f09d18c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b0ce2640 1 -- 172.21.15.83:0/824562566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18c690 msgr2=0x55f09d1422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b0ce2640 1 --2- 172.21.15.83:0/824562566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18c690 0x55f09d1422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b0ce2640 1 -- 172.21.15.83:0/824562566 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f09cf15d00 con 0x55f09d142830 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78ab7fe640 1 --2- 172.21.15.83:0/824562566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18c690 0x55f09d1422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f78b0ce2640 1 --2- 172.21.15.83:0/824562566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 0x55f09d142c10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f78a40845f0 tx=0x7f78a4056210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7838bf29cbdcbe server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f7891ffb640 1 -- 172.21.15.83:0/824562566 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a406e070 con 0x55f09d142830 2024-03-30T13:10:29.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f7891ffb640 1 -- 172.21.15.83:0/824562566 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a4054450 con 0x55f09d142830 2024-03-30T13:10:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.005+0000 7f7891ffb640 1 -- 172.21.15.83:0/824562566 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a40527c0 con 0x55f09d142830 2024-03-30T13:10:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- 172.21.15.83:0/824562566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 msgr2=0x55f09d142c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 --2- 172.21.15.83:0/824562566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 0x55f09d142c10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f78a40845f0 tx=0x7f78a4056210 comp rx=0 tx=0).stop 2024-03-30T13:10:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- 172.21.15.83:0/824562566 shutdown_connections 2024-03-30T13:10:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 --2- 172.21.15.83:0/824562566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 0x55f09d142c10 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 --2- 172.21.15.83:0/824562566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18c690 0x55f09d1422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 --2- 172.21.15.83:0/824562566 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18bd70 0x55f09d18c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- 172.21.15.83:0/824562566 >> 172.21.15.83:0/824562566 conn(0x55f09d13e7e0 msgr2=0x55f09d140bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- 172.21.15.83:0/824562566 shutdown_connections 2024-03-30T13:10:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- 172.21.15.83:0/824562566 wait complete. 2024-03-30T13:10:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- start start 2024-03-30T13:10:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 Processor -- start 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 0x55f09d147c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18bd70 0x55f09d170da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18c690 0x55f09d1712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f09cf58270 con 0x55f09d142830 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f09cf4e6a0 con 0x55f09d18bd70 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f09cf28880 con 0x55f09d18c690 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 10 client.0 _ll_register_callbacks cb 0x55f09d12d490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78abfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 0x55f09d147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78abfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 0x55f09d147c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38478/0 (socket says 172.21.15.83:38478) 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78abfff640 1 -- 172.21.15.83:0/4085733959 learned_addr learned my addr 172.21.15.83:0/4085733959 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78abfff640 1 -- 172.21.15.83:0/4085733959 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18c690 msgr2=0x55f09d1712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78abfff640 1 --2- 172.21.15.83:0/4085733959 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18c690 0x55f09d1712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78abfff640 1 -- 172.21.15.83:0/4085733959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18bd70 msgr2=0x55f09d170da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78ab7fe640 1 --2- 172.21.15.83:0/4085733959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18bd70 0x55f09d170da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78abfff640 1 --2- 172.21.15.83:0/4085733959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18bd70 0x55f09d170da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78abfff640 1 -- 172.21.15.83:0/4085733959 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f09cf55730 con 0x55f09d142830 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78abfff640 1 --2- 172.21.15.83:0/4085733959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 0x55f09d147c80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f789c0b0040 tx=0x7f789c01b140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9326d3c9679bb73b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f788affd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f788affd640 1 -- 172.21.15.83:0/4085733959 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c0b2040 con 0x55f09d142830 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f788affd640 1 -- 172.21.15.83:0/4085733959 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f789c0b8c90 con 0x55f09d142830 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- 172.21.15.83:0/4085733959 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78a4054450 con 0x55f09d142830 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f788affd640 1 -- 172.21.15.83:0/4085733959 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f789c0d1050 con 0x55f09d142830 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 10 client.5616 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- 172.21.15.83:0/4085733959 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55f09cf48ca0 con 0x55f09d142830 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f788affd640 1 -- 172.21.15.83:0/4085733959 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a4054450 con 0x55f09d142830 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f788affd640 1 -- 172.21.15.83:0/4085733959 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f789c0d4020 con 0x55f09d142830 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 10 client.5616 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:29.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 10 client.5616 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 20 client.5616 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 --2- 172.21.15.83:0/4085733959 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f09d1935d0 0x55f09d1939b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 4 client.5616 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- 172.21.15.83:0/4085733959 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f09cf2bc90 con 0x55f09d1935d0 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78ab7fe640 1 --2- 172.21.15.83:0/4085733959 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f09d1935d0 0x55f09d1939b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f788affd640 10 client.5616 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78ab7fe640 1 --2- 172.21.15.83:0/4085733959 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f09d1935d0 0x55f09d1939b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e1ad419ae6ec41 server_cookie=904c9ffe6c07daa0 in_seq=0 out_seq=0 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f788affd640 1 -- 172.21.15.83:0/4085733959 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55f09cf2bc90 con 0x55f09d1935d0 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f788affd640 10 client.5616 handle_command_reply: tid=0 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 client.5616 shutdown 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- 172.21.15.83:0/4085733959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 msgr2=0x55f09d147c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 --2- 172.21.15.83:0/4085733959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 0x55f09d147c80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f789c0b0040 tx=0x7f789c01b140 comp rx=0 tx=0).stop 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 -- 172.21.15.83:0/4085733959 shutdown_connections 2024-03-30T13:10:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.009+0000 7f78b58c7000 1 --2- 172.21.15.83:0/4085733959 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18c690 0x55f09d1712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.013+0000 7f78b58c7000 1 --2- 172.21.15.83:0/4085733959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18bd70 0x55f09d170da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.013+0000 7f78b58c7000 1 --2- 172.21.15.83:0/4085733959 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f09d1935d0 0x55f09d1939b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.013+0000 7f78b58c7000 1 --2- 172.21.15.83:0/4085733959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d142830 0x55f09d147c80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.013+0000 7f788affd640 0 client.5616 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.013+0000 7f78b58c7000 1 -- 172.21.15.83:0/4085733959 >> 172.21.15.83:0/4085733959 conn(0x55f09d13e7e0 msgr2=0x55f09d141460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.013+0000 7f78b58c7000 1 -- 172.21.15.83:0/4085733959 shutdown_connections 2024-03-30T13:10:29.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.013+0000 7f78b58c7000 1 -- 172.21.15.83:0/4085733959 wait complete. 2024-03-30T13:10:29.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.013+0000 7f78b58c7000 20 client.5616 trim_cache size 0 max 16384 2024-03-30T13:10:29.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b58c7000 1 Processor -- start 2024-03-30T13:10:29.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b58c7000 1 -- start start 2024-03-30T13:10:29.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b58c7000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d142830 0x55f09d171180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b58c7000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18bd70 0x55f09d140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b58c7000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18c690 0x55f09d141110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b58c7000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac201630 con 0x55f09d18c690 2024-03-30T13:10:29.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b58c7000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac157450 con 0x55f09d18bd70 2024-03-30T13:10:29.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b58c7000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f78ac15d390 con 0x55f09d142830 2024-03-30T13:10:29.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b0ce2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18c690 0x55f09d141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b0ce2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18c690 0x55f09d141110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38484/0 (socket says 172.21.15.83:38484) 2024-03-30T13:10:29.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b0ce2640 1 -- 172.21.15.83:0/866935980 learned_addr learned my addr 172.21.15.83:0/866935980 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b0ce2640 1 -- 172.21.15.83:0/866935980 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d142830 msgr2=0x55f09d171180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b0ce2640 1 --2- 172.21.15.83:0/866935980 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d142830 0x55f09d171180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b0ce2640 1 -- 172.21.15.83:0/866935980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18bd70 msgr2=0x55f09d140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b0ce2640 1 --2- 172.21.15.83:0/866935980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18bd70 0x55f09d140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b0ce2640 1 -- 172.21.15.83:0/866935980 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f09cf17d00 con 0x55f09d18c690 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78b0ce2640 1 --2- 172.21.15.83:0/866935980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18c690 0x55f09d141110 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f78a405eef0 tx=0x7f78a401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc247537aa91a42 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78917fa640 1 -- 172.21.15.83:0/866935980 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a4083070 con 0x55f09d18c690 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78917fa640 1 -- 172.21.15.83:0/866935980 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a4084260 con 0x55f09d18c690 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.025+0000 7f78917fa640 1 -- 172.21.15.83:0/866935980 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a406e040 con 0x55f09d18c690 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- 172.21.15.83:0/866935980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18c690 msgr2=0x55f09d141110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- 172.21.15.83:0/866935980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18c690 0x55f09d141110 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f78a405eef0 tx=0x7f78a401e040 comp rx=0 tx=0).stop 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- 172.21.15.83:0/866935980 shutdown_connections 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- 172.21.15.83:0/866935980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18c690 0x55f09d141110 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- 172.21.15.83:0/866935980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d18bd70 0x55f09d140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- 172.21.15.83:0/866935980 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d142830 0x55f09d171180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- 172.21.15.83:0/866935980 >> 172.21.15.83:0/866935980 conn(0x55f09d13e7e0 msgr2=0x55f09d1a2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- 172.21.15.83:0/866935980 shutdown_connections 2024-03-30T13:10:29.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- 172.21.15.83:0/866935980 wait complete. 2024-03-30T13:10:29.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- start start 2024-03-30T13:10:29.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 Processor -- start 2024-03-30T13:10:29.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d142830 0x55f09d201fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18bd70 0x55f09d2024e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18c690 0x55f09d1fe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f09d04cb00 con 0x55f09d18bd70 2024-03-30T13:10:29.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac156e00 con 0x55f09d142830 2024-03-30T13:10:29.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f09cf58270 con 0x55f09d18c690 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 10 client.0 _ll_register_callbacks cb 0x7f789c0b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78ab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18bd70 0x55f09d2024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78ab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18bd70 0x55f09d2024e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38494/0 (socket says 172.21.15.83:38494) 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78ab7fe640 1 -- 172.21.15.83:0/1529739096 learned_addr learned my addr 172.21.15.83:0/1529739096 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78ab7fe640 1 -- 172.21.15.83:0/1529739096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18c690 msgr2=0x55f09d1fe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78abfff640 1 --2- 172.21.15.83:0/1529739096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d142830 0x55f09d201fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78ab7fe640 1 --2- 172.21.15.83:0/1529739096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18c690 0x55f09d1fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78ab7fe640 1 -- 172.21.15.83:0/1529739096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d142830 msgr2=0x55f09d201fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78ab7fe640 1 --2- 172.21.15.83:0/1529739096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d142830 0x55f09d201fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78ab7fe640 1 -- 172.21.15.83:0/1529739096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f09d011f70 con 0x55f09d18bd70 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78ab7fe640 1 --2- 172.21.15.83:0/1529739096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18bd70 0x55f09d2024e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f78ac1583f0 tx=0x7f78a0007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5a8dcabcbd5579 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f788affd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f788affd640 1 -- 172.21.15.83:0/1529739096 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0007660 con 0x55f09d18bd70 2024-03-30T13:10:29.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f788affd640 1 -- 172.21.15.83:0/1529739096 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f78a0001b30 con 0x55f09d18bd70 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- 172.21.15.83:0/1529739096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78a4084260 con 0x55f09d18bd70 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f788affd640 1 -- 172.21.15.83:0/1529739096 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f78a0001d30 con 0x55f09d18bd70 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 10 client.5622 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- 172.21.15.83:0/1529739096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55f09cf37760 con 0x55f09d18bd70 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f788affd640 1 -- 172.21.15.83:0/1529739096 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a4084260 con 0x55f09d18bd70 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f788affd640 1 -- 172.21.15.83:0/1529739096 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f78a0017040 con 0x55f09d18bd70 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 10 client.5622 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 10 client.5622 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 20 client.5622 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- 172.21.15.83:0/1529739096 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f09d1ff2f0 0x55f09d1ff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 4 client.5622 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628324}] 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- 172.21.15.83:0/1529739096 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628324}) -- 0x55f09cf9dfe0 con 0x55f09d1ff2f0 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78abfff640 1 --2- 172.21.15.83:0/1529739096 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f09d1ff2f0 0x55f09d1ff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f788affd640 10 client.5622 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78abfff640 1 --2- 172.21.15.83:0/1529739096 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f09d1ff2f0 0x55f09d1ff700 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f28bd7b3abfd9f server_cookie=daeb8215cba84d68 in_seq=0 out_seq=0 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f788affd640 1 -- 172.21.15.83:0/1529739096 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3822 (crc 0 0 0) 0x55f09cf9dfe0 con 0x55f09d1ff2f0 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f788affd640 10 client.5622 handle_command_reply: tid=0 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 client.5622 shutdown 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- 172.21.15.83:0/1529739096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18bd70 msgr2=0x55f09d2024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- 172.21.15.83:0/1529739096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18bd70 0x55f09d2024e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f78ac1583f0 tx=0x7f78a0007410 comp rx=0 tx=0).stop 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- 172.21.15.83:0/1529739096 shutdown_connections 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- 172.21.15.83:0/1529739096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f09d18c690 0x55f09d1fe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- 172.21.15.83:0/1529739096 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f09d1ff2f0 0x55f09d1ff700 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- 172.21.15.83:0/1529739096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f09d18bd70 0x55f09d2024e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 --2- 172.21.15.83:0/1529739096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f09d142830 0x55f09d201fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f788affd640 0 client.5622 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- 172.21.15.83:0/1529739096 >> 172.21.15.83:0/1529739096 conn(0x55f09d13e7e0 msgr2=0x55f09d1a3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.029+0000 7f78b58c7000 1 -- 172.21.15.83:0/1529739096 shutdown_connections 2024-03-30T13:10:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b58c7000 1 -- 172.21.15.83:0/1529739096 wait complete. 2024-03-30T13:10:29.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b58c7000 20 client.5622 trim_cache size 0 max 16384 2024-03-30T13:10:29.044 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:29.044 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/xattr_security.c", 2024-03-30T13:10:29.044 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628324, 2024-03-30T13:10:29.044 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:29.044 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.083603+0000", 2024-03-30T13:10:29.044 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.093425+0000", 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:29.045 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 1473, 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.093425+0000", 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:29.046 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1473, 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:29.047 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.083603+0000" 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1473, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.083603+0000" 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 82, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 34, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:29.048 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:29.049 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:29.050 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.051 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:29.052 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.053 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:29.054 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:29.055 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:29.055 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:29.055 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:29.055 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.055 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:29.055 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:29.055 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:29.055 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:29.055 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:29.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b2745640 1 -- 172.21.15.83:0/684120387 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7898067fc0 msgr2=0x7f789806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b2745640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7898067fc0 0x7f789806a480 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f789c0af000 tx=0x7f789c0a7070 comp rx=0 tx=0).stop 2024-03-30T13:10:29.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b2745640 1 -- 172.21.15.83:0/684120387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ac15b570 msgr2=0x7f78ac145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b2745640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ac15b570 0x7f78ac145ed0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f78a400c390 tx=0x7f78a400c850 comp rx=0 tx=0).stop 2024-03-30T13:10:29.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b2745640 1 -- 172.21.15.83:0/684120387 shutdown_connections 2024-03-30T13:10:29.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b2745640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7898067fc0 0x7f789806a480 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b2745640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ac15b570 0x7f78ac145ed0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b2745640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78ac0b5080 0x7f78ac15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b2745640 1 --2- 172.21.15.83:0/684120387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78ac0aec70 0x7f78ac1584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b2745640 1 -- 172.21.15.83:0/684120387 >> 172.21.15.83:0/684120387 conn(0x7f78ac072d30 msgr2=0x7f78ac148390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b2745640 1 -- 172.21.15.83:0/684120387 shutdown_connections 2024-03-30T13:10:29.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.033+0000 7f78b2745640 1 -- 172.21.15.83:0/684120387 wait complete. 2024-03-30T13:10:29.060 DEBUG:tasks.cephfs.test_uninlining:getting inode info #9 of 23:1099511628309 2024-03-30T13:10:29.060 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628309 2024-03-30T13:10:29.060 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628309 2024-03-30T13:10:29.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dda22e640 1 Processor -- start 2024-03-30T13:10:29.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dda22e640 1 -- start start 2024-03-30T13:10:29.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dda22e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2dd41416c0 0x7f2dd406f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dda22e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2dd40d0650 0x7f2dd415f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dda22e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd406fb00 con 0x7f2dd406c670 2024-03-30T13:10:29.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dda22e640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd415fd40 con 0x7f2dd40d0650 2024-03-30T13:10:29.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dda22e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd40d01c0 con 0x7f2dd41416c0 2024-03-30T13:10:29.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dcbfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2dd40d0650 0x7f2dd415f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dcbfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2dd40d0650 0x7f2dd415f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38508/0 (socket says 172.21.15.83:38508) 2024-03-30T13:10:29.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dcbfff640 1 -- 172.21.15.83:0/732596172 learned_addr learned my addr 172.21.15.83:0/732596172 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/732596172 >> v2:172.21.15.153:3300/0 conn(0x7f2dd41416c0 0x7f2dd406f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dcbfff640 1 -- 172.21.15.83:0/732596172 >> v2:172.21.15.153:3300/0 conn(0x7f2dd41416c0 msgr2=0x7f2dd406f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dcbfff640 1 --2- 172.21.15.83:0/732596172 >> v2:172.21.15.153:3300/0 conn(0x7f2dd41416c0 0x7f2dd406f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dcbfff640 1 -- 172.21.15.83:0/732596172 >> v1:172.21.15.153:6789/0 conn(0x7f2dd406c670 legacy=0x7f2dd4141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dcbfff640 1 -- 172.21.15.83:0/732596172 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd40cfb70 con 0x7f2dd40d0650 2024-03-30T13:10:29.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.169+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/732596172 >> v2:172.21.15.153:3300/0 conn(0x7f2dd41416c0 0x7f2dd406f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dcbfff640 1 --2- 172.21.15.83:0/732596172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dd40d0650 0x7f2dd415f800 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4067bb0 tx=0x7f2dbc01ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed78fd7f8eb54b14 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd2ffd640 1 -- 172.21.15.83:0/732596172 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0b4070 con 0x7f2dd40d0650 2024-03-30T13:10:29.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd2ffd640 1 -- 172.21.15.83:0/732596172 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dbc0a7b30 con 0x7f2dd40d0650 2024-03-30T13:10:29.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd2ffd640 1 -- 172.21.15.83:0/732596172 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0af440 con 0x7f2dd40d0650 2024-03-30T13:10:29.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 -- 172.21.15.83:0/732596172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dd40d0650 msgr2=0x7f2dd415f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 --2- 172.21.15.83:0/732596172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dd40d0650 0x7f2dd415f800 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4067bb0 tx=0x7f2dbc01ebb0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 -- 172.21.15.83:0/732596172 shutdown_connections 2024-03-30T13:10:29.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 --2- 172.21.15.83:0/732596172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dd40d0650 0x7f2dd415f800 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 --2- 172.21.15.83:0/732596172 >> v2:172.21.15.153:3300/0 conn(0x7f2dd41416c0 0x7f2dd406f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 -- 172.21.15.83:0/732596172 >> 172.21.15.83:0/732596172 conn(0x7f2dd4072000 msgr2=0x7f2dd4072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 -- 172.21.15.83:0/732596172 shutdown_connections 2024-03-30T13:10:29.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 -- 172.21.15.83:0/732596172 wait complete. 2024-03-30T13:10:29.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 Processor -- start 2024-03-30T13:10:29.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 -- start start 2024-03-30T13:10:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dd406c670 0x7f2dd415c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2dd40d0650 0x7f2dd4158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2dd41416c0 0x7f2dd4137e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd406e380 con 0x7f2dd406c670 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd406e200 con 0x7f2dd41416c0 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd406e500 con 0x7f2dd40d0650 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dd406c670 0x7f2dd415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dd406c670 0x7f2dd415c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38522/0 (socket says 172.21.15.83:38522) 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd37fe640 1 -- 172.21.15.83:0/2729987376 learned_addr learned my addr 172.21.15.83:0/2729987376 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd37fe640 1 -- 172.21.15.83:0/2729987376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2dd40d0650 msgr2=0x7f2dd4158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/2729987376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2dd40d0650 0x7f2dd4158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd37fe640 1 -- 172.21.15.83:0/2729987376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2dd41416c0 msgr2=0x7f2dd4137e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/2729987376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2dd41416c0 0x7f2dd4137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd37fe640 1 -- 172.21.15.83:0/2729987376 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd415de80 con 0x7f2dd406c670 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/2729987376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dd406c670 0x7f2dd415c180 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400c7f0 tx=0x7f2dc400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd0ff9640 1 -- 172.21.15.83:0/2729987376 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4015070 con 0x7f2dd406c670 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd0ff9640 1 -- 172.21.15.83:0/2729987376 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc4007820 con 0x7f2dd406c670 2024-03-30T13:10:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 -- 172.21.15.83:0/2729987376 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd415e120 con 0x7f2dd406c670 2024-03-30T13:10:29.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dd0ff9640 1 -- 172.21.15.83:0/2729987376 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4007c10 con 0x7f2dd406c670 2024-03-30T13:10:29.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.173+0000 7f2dda22e640 1 -- 172.21.15.83:0/2729987376 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd415c760 con 0x7f2dd406c670 2024-03-30T13:10:29.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dd0ff9640 1 -- 172.21.15.83:0/2729987376 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2dc4018070 con 0x7f2dd406c670 2024-03-30T13:10:29.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dd0ff9640 1 --2- 172.21.15.83:0/2729987376 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2db4067fc0 0x7f2db406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dcbfff640 1 --2- 172.21.15.83:0/2729987376 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2db4067fc0 0x7f2db406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dd0ff9640 1 -- 172.21.15.83:0/2729987376 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2dc40865e0 con 0x7f2dd406c670 2024-03-30T13:10:29.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dcbfff640 1 --2- 172.21.15.83:0/2729987376 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2db4067fc0 0x7f2db406a480 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0b1000 tx=0x7f2dbc004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2ddd3b0000 1 Processor -- start 2024-03-30T13:10:29.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2ddd3b0000 1 -- start start 2024-03-30T13:10:29.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2ddd3b0000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e111906d70 0x55e111907150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2ddd3b0000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111907690 0x55e1118bd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2ddd3b0000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e1118bd830 0x55e1118bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2ddd3b0000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e11170baa0 con 0x55e111906d70 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2ddd3b0000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e111692af0 con 0x55e1118bd830 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2ddd3b0000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55e111707a50 con 0x55e111907690 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dd37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e111906d70 0x55e111907150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dd37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e111906d70 0x55e111907150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38538/0 (socket says 172.21.15.83:38538) 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dd37fe640 1 -- 172.21.15.83:0/2336307486 learned_addr learned my addr 172.21.15.83:0/2336307486 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dd37fe640 1 -- 172.21.15.83:0/2336307486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111907690 msgr2=0x55e1118bd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/2336307486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111907690 0x55e1118bd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dd37fe640 1 -- 172.21.15.83:0/2336307486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e1118bd830 msgr2=0x55e1118bdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/2336307486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e1118bd830 0x55e1118bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dd37fe640 1 -- 172.21.15.83:0/2336307486 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e111690d00 con 0x55e111906d70 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.177+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/2336307486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e111906d70 0x55e111907150 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2dc405edb0 tx=0x7f2dc4056ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcf30aa37ccb9a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dc97fa640 1 -- 172.21.15.83:0/2336307486 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc406e020 con 0x55e111906d70 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dc97fa640 1 -- 172.21.15.83:0/2336307486 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc405f2e0 con 0x55e111906d70 2024-03-30T13:10:29.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dc97fa640 1 -- 172.21.15.83:0/2336307486 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc401f040 con 0x55e111906d70 2024-03-30T13:10:29.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2336307486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e111906d70 msgr2=0x55e111907150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/2336307486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e111906d70 0x55e111907150 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2dc405edb0 tx=0x7f2dc4056ec0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2336307486 shutdown_connections 2024-03-30T13:10:29.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/2336307486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e1118bd830 0x55e1118bdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/2336307486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111907690 0x55e1118bd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/2336307486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e111906d70 0x55e111907150 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2336307486 >> 172.21.15.83:0/2336307486 conn(0x55e1118b97e0 msgr2=0x55e1118bbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2336307486 shutdown_connections 2024-03-30T13:10:29.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2336307486 wait complete. 2024-03-30T13:10:29.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 -- start start 2024-03-30T13:10:29.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 Processor -- start 2024-03-30T13:10:29.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e1118c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111906d70 0x55e1118ebda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111907690 0x55e1118ec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e1116d3270 con 0x55e1118bd830 2024-03-30T13:10:29.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e1116c96a0 con 0x55e111906d70 2024-03-30T13:10:29.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55e1116a3880 con 0x55e111907690 2024-03-30T13:10:29.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 10 client.0 _ll_register_callbacks cb 0x55e1118a8490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:29.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dd37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e1118c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dd37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e1118c2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38552/0 (socket says 172.21.15.83:38552) 2024-03-30T13:10:29.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dd37fe640 1 -- 172.21.15.83:0/2993677119 learned_addr learned my addr 172.21.15.83:0/2993677119 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dd37fe640 1 -- 172.21.15.83:0/2993677119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111907690 msgr2=0x55e1118ec2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dcbfff640 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111906d70 0x55e1118ebda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dd3fff640 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111907690 0x55e1118ec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111907690 0x55e1118ec2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dd37fe640 1 -- 172.21.15.83:0/2993677119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111906d70 msgr2=0x55e1118ebda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111906d70 0x55e1118ebda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dd37fe640 1 -- 172.21.15.83:0/2993677119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1116d0730 con 0x55e1118bd830 2024-03-30T13:10:29.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e1118c2cc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4006fd0 tx=0x7f2dc4086050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60565fdf8c08c02b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2db27fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:29.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2db27fc640 1 -- 172.21.15.83:0/2993677119 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc401f040 con 0x55e1118bd830 2024-03-30T13:10:29.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2db27fc640 1 -- 172.21.15.83:0/2993677119 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2dc40860c0 con 0x55e1118bd830 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2993677119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dc405f2e0 con 0x55e1118bd830 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2db27fc640 1 -- 172.21.15.83:0/2993677119 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2dc406e040 con 0x55e1118bd830 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 10 client.5634 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2993677119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55e1116c3ca0 con 0x55e1118bd830 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2db27fc640 1 -- 172.21.15.83:0/2993677119 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc405f2e0 con 0x55e1118bd830 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2db27fc640 1 -- 172.21.15.83:0/2993677119 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f2dc4052450 con 0x55e1118bd830 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 10 client.5634 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 10 client.5634 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 20 client.5634 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e11190e5d0 0x55e11190e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 4 client.5634 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2993677119 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1116a6c90 con 0x55e11190e5d0 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dcbfff640 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e11190e5d0 0x55e11190e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2dcbfff640 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e11190e5d0 0x55e11190e9e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6366c386d1c40695 server_cookie=13c332cb996b273f in_seq=0 out_seq=0 2024-03-30T13:10:29.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.181+0000 7f2db27fc640 10 client.5634 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2db27fc640 1 -- 172.21.15.83:0/2993677119 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55e1116a6c90 con 0x55e11190e5d0 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2db27fc640 10 client.5634 handle_command_reply: tid=0 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2ddd3b0000 1 client.5634 shutdown 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2993677119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 msgr2=0x55e1118c2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e1118c2cc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4006fd0 tx=0x7f2dc4086050 comp rx=0 tx=0).stop 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2993677119 shutdown_connections 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111907690 0x55e1118ec2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111906d70 0x55e1118ebda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e11190e5d0 0x55e11190e9e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/2993677119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e1118c2cc0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2db27fc640 0 client.5634 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2993677119 >> 172.21.15.83:0/2993677119 conn(0x55e1118b97e0 msgr2=0x55e1118bc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2993677119 shutdown_connections 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/2993677119 wait complete. 2024-03-30T13:10:29.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.185+0000 7f2ddd3b0000 20 client.5634 trim_cache size 0 max 16384 2024-03-30T13:10:29.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2ddd3b0000 1 Processor -- start 2024-03-30T13:10:29.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2ddd3b0000 1 -- start start 2024-03-30T13:10:29.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2ddd3b0000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e1118ec180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2ddd3b0000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111906d70 0x55e1118bbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2ddd3b0000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111907690 0x55e1118bc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2ddd3b0000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd41ff880 con 0x55e1118bd830 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2ddd3b0000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd41fe8c0 con 0x55e111907690 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2ddd3b0000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd41fdc50 con 0x55e111906d70 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2dd37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e1118ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2dd37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e1118ec180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38568/0 (socket says 172.21.15.83:38568) 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2dd37fe640 1 -- 172.21.15.83:0/3732831849 learned_addr learned my addr 172.21.15.83:0/3732831849 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2dd37fe640 1 -- 172.21.15.83:0/3732831849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111906d70 msgr2=0x55e1118bbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/3732831849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111906d70 0x55e1118bbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2dd37fe640 1 -- 172.21.15.83:0/3732831849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111907690 msgr2=0x55e1118bc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/3732831849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111907690 0x55e1118bc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2dd37fe640 1 -- 172.21.15.83:0/3732831849 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e111692d00 con 0x55e1118bd830 2024-03-30T13:10:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/3732831849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e1118ec180 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40549b0 tx=0x7f2dc406c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a27eb03fcf5173 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2dc8ff9640 1 -- 172.21.15.83:0/3732831849 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc401f070 con 0x55e1118bd830 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2dc8ff9640 1 -- 172.21.15.83:0/3732831849 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc4052450 con 0x55e1118bd830 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.197+0000 7f2dc8ff9640 1 -- 172.21.15.83:0/3732831849 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4086300 con 0x55e1118bd830 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/3732831849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 msgr2=0x55e1118ec180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/3732831849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e1118ec180 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40549b0 tx=0x7f2dc406c070 comp rx=0 tx=0).stop 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/3732831849 shutdown_connections 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/3732831849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111907690 0x55e1118bc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/3732831849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111906d70 0x55e1118bbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/3732831849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e1118ec180 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/3732831849 >> 172.21.15.83:0/3732831849 conn(0x55e1118b97e0 msgr2=0x55e11191df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/3732831849 shutdown_connections 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/3732831849 wait complete. 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- start start 2024-03-30T13:10:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 Processor -- start 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e111978f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111906d70 0x55e111979470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111907690 0x55e11190aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd41fe270 con 0x55e1118bd830 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e111707a50 con 0x55e111907690 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55e11170baa0 con 0x55e111906d70 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 10 client.0 _ll_register_callbacks cb 0x7f2dc4056060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2dd37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e111978f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2dd37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e111978f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38574/0 (socket says 172.21.15.83:38574) 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2dd37fe640 1 -- 172.21.15.83:0/682014815 learned_addr learned my addr 172.21.15.83:0/682014815 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2dd37fe640 1 -- 172.21.15.83:0/682014815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111906d70 msgr2=0x55e111979470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/682014815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111906d70 0x55e111979470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2dd37fe640 1 -- 172.21.15.83:0/682014815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111907690 msgr2=0x55e11190aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/682014815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111907690 0x55e11190aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2dd37fe640 1 -- 172.21.15.83:0/682014815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e11178cf70 con 0x55e1118bd830 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2dd37fe640 1 --2- 172.21.15.83:0/682014815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e111978f30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4053080 tx=0x7f2dc40529a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774a9b03a8e59dc4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2db27fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2db27fc640 1 -- 172.21.15.83:0/682014815 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc401f040 con 0x55e1118bd830 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2db27fc640 1 -- 172.21.15.83:0/682014815 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2dc40555c0 con 0x55e1118bd830 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/682014815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dc4052450 con 0x55e1118bd830 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2db27fc640 1 -- 172.21.15.83:0/682014815 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2dc40557c0 con 0x55e1118bd830 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 10 client.5640 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/682014815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55e1116b2760 con 0x55e1118bd830 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2db27fc640 1 -- 172.21.15.83:0/682014815 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc4052450 con 0x55e1118bd830 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2db27fc640 1 -- 172.21.15.83:0/682014815 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f2dc407e0f0 con 0x55e1118bd830 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 10 client.5640 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 10 client.5640 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 20 client.5640 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/682014815 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e11190b400 0x55e11190b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 4 client.5640 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628309}] 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/682014815 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628309}) -- 0x55e111718fe0 con 0x55e11190b400 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2dcbfff640 1 --2- 172.21.15.83:0/682014815 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e11190b400 0x55e11190b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2dcbfff640 1 --2- 172.21.15.83:0/682014815 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e11190b400 0x55e11190b810 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff8680e6b0db5004 server_cookie=4559e0c50a0115ae in_seq=0 out_seq=0 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2db27fc640 10 client.5640 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2db27fc640 1 -- 172.21.15.83:0/682014815 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3810 (crc 0 0 0) 0x55e111718fe0 con 0x55e11190b400 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2db27fc640 10 client.5640 handle_command_reply: tid=0 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 client.5640 shutdown 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/682014815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 msgr2=0x55e111978f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/682014815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e111978f30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4053080 tx=0x7f2dc40529a0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/682014815 shutdown_connections 2024-03-30T13:10:29.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/682014815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e111907690 0x55e11190aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/682014815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e111906d70 0x55e111979470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/682014815 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e11190b400 0x55e11190b810 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 --2- 172.21.15.83:0/682014815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1118bd830 0x55e111978f30 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/682014815 >> 172.21.15.83:0/682014815 conn(0x55e1118b97e0 msgr2=0x55e11191e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.201+0000 7f2db27fc640 0 client.5640 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/682014815 shutdown_connections 2024-03-30T13:10:29.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2ddd3b0000 1 -- 172.21.15.83:0/682014815 wait complete. 2024-03-30T13:10:29.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2ddd3b0000 20 client.5640 trim_cache size 0 max 16384 2024-03-30T13:10:29.218 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:29.218 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/Makefile", 2024-03-30T13:10:29.218 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628309, 2024-03-30T13:10:29.218 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:29.218 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.108767+0000", 2024-03-30T13:10:29.218 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.031395+0000", 2024-03-30T13:10:29.218 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:29.219 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:29.219 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:29.219 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:29.219 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:29.219 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:29.219 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:29.219 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:29.219 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:29.219 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.219 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:29.219 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 378, 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.031395+0000", 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:29.220 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 378, 2024-03-30T13:10:29.221 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.108767+0000" 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 378, 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.108767+0000" 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 84, 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:29.222 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 4, 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:29.223 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:29.224 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:29.225 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:29.226 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.227 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:29.228 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:29.229 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:29.229 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:29.229 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:29.229 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:29.229 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:29.229 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:29.229 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.229 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:29.229 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:29.229 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:29.229 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:29.229 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:29.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2dda22e640 1 -- 172.21.15.83:0/2729987376 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2db4067fc0 msgr2=0x7f2db406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2dda22e640 1 --2- 172.21.15.83:0/2729987376 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2db4067fc0 0x7f2db406a480 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0b1000 tx=0x7f2dbc004740 comp rx=0 tx=0).stop 2024-03-30T13:10:29.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2dda22e640 1 -- 172.21.15.83:0/2729987376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dd406c670 msgr2=0x7f2dd415c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2dda22e640 1 --2- 172.21.15.83:0/2729987376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dd406c670 0x7f2dd415c180 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400c7f0 tx=0x7f2dc400ccb0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2dda22e640 1 -- 172.21.15.83:0/2729987376 shutdown_connections 2024-03-30T13:10:29.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2dda22e640 1 --2- 172.21.15.83:0/2729987376 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2db4067fc0 0x7f2db406a480 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2dda22e640 1 --2- 172.21.15.83:0/2729987376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2dd41416c0 0x7f2dd4137e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2dda22e640 1 --2- 172.21.15.83:0/2729987376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2dd40d0650 0x7f2dd4158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2dda22e640 1 --2- 172.21.15.83:0/2729987376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dd406c670 0x7f2dd415c180 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2dda22e640 1 -- 172.21.15.83:0/2729987376 >> 172.21.15.83:0/2729987376 conn(0x7f2dd4072000 msgr2=0x7f2dd40b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2dda22e640 1 -- 172.21.15.83:0/2729987376 shutdown_connections 2024-03-30T13:10:29.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.205+0000 7f2dda22e640 1 -- 172.21.15.83:0/2729987376 wait complete. 2024-03-30T13:10:29.232 DEBUG:tasks.cephfs.test_uninlining:getting inode info #10 of 23:1099511628321 2024-03-30T13:10:29.232 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628321 2024-03-30T13:10:29.232 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628321 2024-03-30T13:10:29.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca9828640 1 Processor -- start 2024-03-30T13:10:29.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca9828640 1 -- start start 2024-03-30T13:10:29.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca9828640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca4158620 0x7f8ca406e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca9828640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8ca415f170 0x7f8ca40b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca9828640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca40cf8b0 con 0x7f8ca415e5b0 2024-03-30T13:10:29.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca9828640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca40d0150 con 0x7f8ca415f170 2024-03-30T13:10:29.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca9828640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca40cfb90 con 0x7f8ca4158620 2024-03-30T13:10:29.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca27fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8ca415f170 0x7f8ca40b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca27fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8ca415f170 0x7f8ca40b6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38578/0 (socket says 172.21.15.83:38578) 2024-03-30T13:10:29.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca37fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f8ca415e5b0 0x7f8ca40b4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36426/0 (socket says 172.21.15.83:36426) 2024-03-30T13:10:29.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca27fc640 1 -- 172.21.15.83:0/2661538247 learned_addr learned my addr 172.21.15.83:0/2661538247 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/2661538247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca4158620 0x7f8ca406e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca27fc640 1 -- 172.21.15.83:0/2661538247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca4158620 msgr2=0x7f8ca406e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca27fc640 1 --2- 172.21.15.83:0/2661538247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca4158620 0x7f8ca406e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca27fc640 1 -- 172.21.15.83:0/2661538247 >> v1:172.21.15.83:6789/0 conn(0x7f8ca415e5b0 legacy=0x7f8ca40b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.333+0000 7f8ca27fc640 1 -- 172.21.15.83:0/2661538247 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca40cfe70 con 0x7f8ca415f170 2024-03-30T13:10:29.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.337+0000 7f8ca27fc640 1 --2- 172.21.15.83:0/2661538247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ca415f170 0x7f8ca40b6480 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009870 tx=0x7f8c9801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee8c09349d5b49 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.337+0000 7f8ca1ffb640 1 -- 172.21.15.83:0/2661538247 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c980a7070 con 0x7f8ca415f170 2024-03-30T13:10:29.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.337+0000 7f8ca1ffb640 1 -- 172.21.15.83:0/2661538247 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c980b0070 con 0x7f8ca415f170 2024-03-30T13:10:29.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.337+0000 7f8ca1ffb640 1 -- 172.21.15.83:0/2661538247 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c980ab890 con 0x7f8ca415f170 2024-03-30T13:10:29.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.337+0000 7f8ca9828640 1 -- 172.21.15.83:0/2661538247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ca415f170 msgr2=0x7f8ca40b6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.337+0000 7f8ca9828640 1 --2- 172.21.15.83:0/2661538247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ca415f170 0x7f8ca40b6480 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009870 tx=0x7f8c9801c560 comp rx=0 tx=0).stop 2024-03-30T13:10:29.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.337+0000 7f8ca9828640 1 -- 172.21.15.83:0/2661538247 shutdown_connections 2024-03-30T13:10:29.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.337+0000 7f8ca9828640 1 --2- 172.21.15.83:0/2661538247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ca415f170 0x7f8ca40b6480 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.337+0000 7f8ca9828640 1 --2- 172.21.15.83:0/2661538247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca4158620 0x7f8ca406e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.337+0000 7f8ca9828640 1 -- 172.21.15.83:0/2661538247 >> 172.21.15.83:0/2661538247 conn(0x7f8ca4072ec0 msgr2=0x7f8ca406b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.337+0000 7f8ca9828640 1 -- 172.21.15.83:0/2661538247 shutdown_connections 2024-03-30T13:10:29.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.337+0000 7f8ca9828640 1 -- 172.21.15.83:0/2661538247 wait complete. 2024-03-30T13:10:29.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca9828640 1 Processor -- start 2024-03-30T13:10:29.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca9828640 1 -- start start 2024-03-30T13:10:29.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca9828640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ca4158620 0x7f8ca4156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca9828640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca415e5b0 0x7f8ca4159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca9828640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca415f170 0x7f8ca4154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca9828640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca4067370 con 0x7f8ca4158620 2024-03-30T13:10:29.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca9828640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca40674f0 con 0x7f8ca415f170 2024-03-30T13:10:29.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca9828640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca4067670 con 0x7f8ca415e5b0 2024-03-30T13:10:29.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ca4158620 0x7f8ca4156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ca4158620 0x7f8ca4156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38594/0 (socket says 172.21.15.83:38594) 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca2ffd640 1 -- 172.21.15.83:0/745564198 learned_addr learned my addr 172.21.15.83:0/745564198 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca27fc640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca415e5b0 0x7f8ca4159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca37fe640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca415f170 0x7f8ca4154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca2ffd640 1 -- 172.21.15.83:0/745564198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca415e5b0 msgr2=0x7f8ca4159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca415e5b0 0x7f8ca4159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca2ffd640 1 -- 172.21.15.83:0/745564198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca415f170 msgr2=0x7f8ca4154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca415f170 0x7f8ca4154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca2ffd640 1 -- 172.21.15.83:0/745564198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca414b960 con 0x7f8ca4158620 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ca4158620 0x7f8ca4156630 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400d830 tx=0x7f8c9400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8c8bfff640 1 -- 172.21.15.83:0/745564198 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400b6c0 con 0x7f8ca4158620 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8c8bfff640 1 -- 172.21.15.83:0/745564198 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c94019070 con 0x7f8ca4158620 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8c8bfff640 1 -- 172.21.15.83:0/745564198 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400ba60 con 0x7f8ca4158620 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca9828640 1 -- 172.21.15.83:0/745564198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca4156c10 con 0x7f8ca4158620 2024-03-30T13:10:29.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.341+0000 7f8ca9828640 1 -- 172.21.15.83:0/745564198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca41571d0 con 0x7f8ca4158620 2024-03-30T13:10:29.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8c8bfff640 1 -- 172.21.15.83:0/745564198 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f8c9401e460 con 0x7f8ca4158620 2024-03-30T13:10:29.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8c8bfff640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8c90067ff0 0x7f8c9006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8c8bfff640 1 -- 172.21.15.83:0/745564198 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8c94086c00 con 0x7f8ca4158620 2024-03-30T13:10:29.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca27fc640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8c90067ff0 0x7f8c9006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca27fc640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8c90067ff0 0x7f8c9006a4b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c980af000 tx=0x7f8c980a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8cac9aa000 1 Processor -- start 2024-03-30T13:10:29.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8cac9aa000 1 -- start start 2024-03-30T13:10:29.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8cac9aa000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704370 0x5604a3704750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8cac9aa000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704c90 0x5604a36b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8cac9aa000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a36b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8cac9aa000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5604a3504aa0 con 0x5604a3704370 2024-03-30T13:10:29.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8cac9aa000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5604a348baf0 con 0x5604a36b6830 2024-03-30T13:10:29.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8cac9aa000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5604a3500a50 con 0x5604a3704c90 2024-03-30T13:10:29.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704370 0x5604a3704750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704370 0x5604a3704750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38600/0 (socket says 172.21.15.83:38600) 2024-03-30T13:10:29.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca2ffd640 1 -- 172.21.15.83:0/3876004582 learned_addr learned my addr 172.21.15.83:0/3876004582 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca27fc640 1 --2- 172.21.15.83:0/3876004582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704c90 0x5604a36b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca37fe640 1 --2- 172.21.15.83:0/3876004582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a36b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca2ffd640 1 -- 172.21.15.83:0/3876004582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704c90 msgr2=0x5604a36b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/3876004582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704c90 0x5604a36b62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca2ffd640 1 -- 172.21.15.83:0/3876004582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 msgr2=0x5604a36b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/3876004582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a36b6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca2ffd640 1 -- 172.21.15.83:0/3876004582 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604a3489d00 con 0x5604a3704370 2024-03-30T13:10:29.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.345+0000 7f8ca27fc640 1 --2- 172.21.15.83:0/3876004582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704c90 0x5604a36b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/3876004582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704370 0x5604a3704750 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8c94085150 tx=0x7f8c940574f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbfffb0a55a9c01 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8c897fa640 1 -- 172.21.15.83:0/3876004582 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9406f020 con 0x5604a3704370 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8c897fa640 1 -- 172.21.15.83:0/3876004582 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9405f890 con 0x5604a3704370 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8c897fa640 1 -- 172.21.15.83:0/3876004582 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400be10 con 0x5604a3704370 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 -- 172.21.15.83:0/3876004582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704370 msgr2=0x5604a3704750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/3876004582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704370 0x5604a3704750 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8c94085150 tx=0x7f8c940574f0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 -- 172.21.15.83:0/3876004582 shutdown_connections 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/3876004582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a36b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/3876004582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704c90 0x5604a36b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/3876004582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704370 0x5604a3704750 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 -- 172.21.15.83:0/3876004582 >> 172.21.15.83:0/3876004582 conn(0x5604a36b27e0 msgr2=0x5604a36b4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 -- 172.21.15.83:0/3876004582 shutdown_connections 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 -- 172.21.15.83:0/3876004582 wait complete. 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 -- start start 2024-03-30T13:10:29.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 Processor -- start 2024-03-30T13:10:29.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a36bbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704370 0x5604a36c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a36c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5604a34cc270 con 0x5604a3704c90 2024-03-30T13:10:29.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5604a34c26a0 con 0x5604a36b6830 2024-03-30T13:10:29.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5604a349c880 con 0x5604a3704370 2024-03-30T13:10:29.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 10 client.0 _ll_register_callbacks cb 0x5604a36a1490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:29.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a36c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a36c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38614/0 (socket says 172.21.15.83:38614) 2024-03-30T13:10:29.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca37fe640 1 -- 172.21.15.83:0/1049282227 learned_addr learned my addr 172.21.15.83:0/1049282227 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca27fc640 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704370 0x5604a36c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a36bbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca37fe640 1 -- 172.21.15.83:0/1049282227 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704370 msgr2=0x5604a36c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca37fe640 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704370 0x5604a36c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca37fe640 1 -- 172.21.15.83:0/1049282227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 msgr2=0x5604a36bbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca37fe640 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a36bbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca37fe640 1 -- 172.21.15.83:0/1049282227 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604a34c9730 con 0x5604a3704c90 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca37fe640 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a36c62b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00e4d0 tx=0x7f8c9c00e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1909cab94328f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8c827fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8c827fc640 1 -- 172.21.15.83:0/1049282227 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0070d0 con 0x5604a3704c90 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8c827fc640 1 -- 172.21.15.83:0/1049282227 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8c9c007270 con 0x5604a3704c90 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 -- 172.21.15.83:0/1049282227 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9405f890 con 0x5604a3704c90 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8c827fc640 1 -- 172.21.15.83:0/1049282227 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8c9c01f050 con 0x5604a3704c90 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 10 client.5655 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 -- 172.21.15.83:0/1049282227 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5604a34bcca0 con 0x5604a3704c90 2024-03-30T13:10:29.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8c827fc640 1 -- 172.21.15.83:0/1049282227 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9405f890 con 0x5604a3704c90 2024-03-30T13:10:29.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8c827fc640 1 -- 172.21.15.83:0/1049282227 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f8c9c022020 con 0x5604a3704c90 2024-03-30T13:10:29.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 10 client.5655 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:29.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 10 client.5655 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:29.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 20 client.5655 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:29.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5604a370b9c0 0x5604a370bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 4 client.5655 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:29.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8cac9aa000 1 -- 172.21.15.83:0/1049282227 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604a349fc90 con 0x5604a370b9c0 2024-03-30T13:10:29.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.349+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5604a370b9c0 0x5604a370bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8c827fc640 10 client.5655 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5604a370b9c0 0x5604a370bdd0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a409244c18403f0 server_cookie=2edd2969381f66b8 in_seq=0 out_seq=0 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8c827fc640 1 -- 172.21.15.83:0/1049282227 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5604a349fc90 con 0x5604a370b9c0 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8c827fc640 10 client.5655 handle_command_reply: tid=0 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8cac9aa000 1 client.5655 shutdown 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8cac9aa000 1 -- 172.21.15.83:0/1049282227 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 msgr2=0x5604a36c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a36c62b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00e4d0 tx=0x7f8c9c00e990 comp rx=0 tx=0).stop 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8cac9aa000 1 -- 172.21.15.83:0/1049282227 shutdown_connections 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5604a370b9c0 0x5604a370bdd0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a36c62b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8c827fc640 0 client.5655 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704370 0x5604a36c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/1049282227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a36bbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8cac9aa000 1 -- 172.21.15.83:0/1049282227 >> 172.21.15.83:0/1049282227 conn(0x5604a36b27e0 msgr2=0x5604a36b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8cac9aa000 1 -- 172.21.15.83:0/1049282227 shutdown_connections 2024-03-30T13:10:29.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8cac9aa000 1 -- 172.21.15.83:0/1049282227 wait complete. 2024-03-30T13:10:29.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.353+0000 7f8cac9aa000 20 client.5655 trim_cache size 0 max 16384 2024-03-30T13:10:29.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8cac9aa000 1 Processor -- start 2024-03-30T13:10:29.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8cac9aa000 1 -- start start 2024-03-30T13:10:29.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8cac9aa000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a36b6830 0x5604a36b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8cac9aa000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a3704370 0x5604a36b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8cac9aa000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a36b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8cac9aa000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca41ff8b0 con 0x5604a3704c90 2024-03-30T13:10:29.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8cac9aa000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca4149c80 con 0x5604a3704370 2024-03-30T13:10:29.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8cac9aa000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca41675b0 con 0x5604a36b6830 2024-03-30T13:10:29.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8ca37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a36b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8ca37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a36b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38630/0 (socket says 172.21.15.83:38630) 2024-03-30T13:10:29.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8ca37fe640 1 -- 172.21.15.83:0/3591075976 learned_addr learned my addr 172.21.15.83:0/3591075976 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8ca37fe640 1 -- 172.21.15.83:0/3591075976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a36b6830 msgr2=0x5604a36b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/3591075976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a36b6830 0x5604a36b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8ca27fc640 1 --2- 172.21.15.83:0/3591075976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a3704370 0x5604a36b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8ca37fe640 1 --2- 172.21.15.83:0/3591075976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a36b6830 0x5604a36b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8ca37fe640 1 -- 172.21.15.83:0/3591075976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a3704370 msgr2=0x5604a36b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8ca37fe640 1 --2- 172.21.15.83:0/3591075976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a3704370 0x5604a36b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8ca37fe640 1 -- 172.21.15.83:0/3591075976 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604a348bd00 con 0x5604a3704c90 2024-03-30T13:10:29.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/3591075976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a36b6830 0x5604a36b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8ca37fe640 1 --2- 172.21.15.83:0/3591075976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a36b5650 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00ef10 tx=0x7f8c9c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39341bb8b3406c74 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.365+0000 7f8c88ff9640 1 -- 172.21.15.83:0/3591075976 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c007650 con 0x5604a3704c90 2024-03-30T13:10:29.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8c88ff9640 1 -- 172.21.15.83:0/3591075976 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9c027020 con 0x5604a3704c90 2024-03-30T13:10:29.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8c88ff9640 1 -- 172.21.15.83:0/3591075976 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c007970 con 0x5604a3704c90 2024-03-30T13:10:29.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 -- 172.21.15.83:0/3591075976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 msgr2=0x5604a36b5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/3591075976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a36b5650 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00ef10 tx=0x7f8c9c007f90 comp rx=0 tx=0).stop 2024-03-30T13:10:29.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 -- 172.21.15.83:0/3591075976 shutdown_connections 2024-03-30T13:10:29.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/3591075976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a36b5650 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/3591075976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a3704370 0x5604a36b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/3591075976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a36b6830 0x5604a36b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 -- 172.21.15.83:0/3591075976 >> 172.21.15.83:0/3591075976 conn(0x5604a36b27e0 msgr2=0x5604a371b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 -- 172.21.15.83:0/3591075976 shutdown_connections 2024-03-30T13:10:29.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 -- 172.21.15.83:0/3591075976 wait complete. 2024-03-30T13:10:29.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 -- start start 2024-03-30T13:10:29.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 Processor -- start 2024-03-30T13:10:29.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a37762b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704370 0x5604a37767f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a37080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5604a34cc270 con 0x5604a3704c90 2024-03-30T13:10:29.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca4149630 con 0x5604a36b6830 2024-03-30T13:10:29.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5604a349c880 con 0x5604a3704370 2024-03-30T13:10:29.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 10 client.0 _ll_register_callbacks cb 0x7f8c9c001520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:29.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a37080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a37080d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38640/0 (socket says 172.21.15.83:38640) 2024-03-30T13:10:29.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca37fe640 1 -- 172.21.15.83:0/2874818054 learned_addr learned my addr 172.21.15.83:0/2874818054 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a37762b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca27fc640 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704370 0x5604a37767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca37fe640 1 -- 172.21.15.83:0/2874818054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704370 msgr2=0x5604a37767f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca37fe640 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704370 0x5604a37767f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca37fe640 1 -- 172.21.15.83:0/2874818054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 msgr2=0x5604a37762b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca37fe640 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a37762b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca37fe640 1 -- 172.21.15.83:0/2874818054 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604a3585f70 con 0x5604a3704c90 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca27fc640 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704370 0x5604a37767f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a37762b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca37fe640 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a37080d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0017d0 tx=0x7f8c9c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e46adbe0b68543 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8c827fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8c827fc640 1 -- 172.21.15.83:0/2874818054 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c030070 con 0x5604a3704c90 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8c827fc640 1 -- 172.21.15.83:0/2874818054 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8c9c013650 con 0x5604a3704c90 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 -- 172.21.15.83:0/2874818054 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9c027020 con 0x5604a3704c90 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8c827fc640 1 -- 172.21.15.83:0/2874818054 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8c9c03b050 con 0x5604a3704c90 2024-03-30T13:10:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 10 client.5661 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 -- 172.21.15.83:0/2874818054 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5604a34ab760 con 0x5604a3704c90 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8c827fc640 1 -- 172.21.15.83:0/2874818054 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9c027020 con 0x5604a3704c90 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8c827fc640 1 -- 172.21.15.83:0/2874818054 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f8c9c03e020 con 0x5604a3704c90 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 10 client.5661 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 10 client.5661 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 20 client.5661 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5604a3708a30 0x5604a3708e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 4 client.5661 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628321}] 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8cac9aa000 1 -- 172.21.15.83:0/2874818054 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628321}) -- 0x5604a3511fe0 con 0x5604a3708a30 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5604a3708a30 0x5604a3708e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8c827fc640 10 client.5661 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.369+0000 7f8ca2ffd640 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5604a3708a30 0x5604a3708e10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329e3dfc1b769610 server_cookie=d32b7fa74ce90604 in_seq=0 out_seq=0 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8c827fc640 1 -- 172.21.15.83:0/2874818054 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3812 (crc 0 0 0) 0x5604a3511fe0 con 0x5604a3708a30 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8c827fc640 10 client.5661 handle_command_reply: tid=0 2024-03-30T13:10:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8cac9aa000 1 client.5661 shutdown 2024-03-30T13:10:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8cac9aa000 1 -- 172.21.15.83:0/2874818054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 msgr2=0x5604a37080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a37080d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0017d0 tx=0x7f8c9c011000 comp rx=0 tx=0).stop 2024-03-30T13:10:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8cac9aa000 1 -- 172.21.15.83:0/2874818054 shutdown_connections 2024-03-30T13:10:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5604a3708a30 0x5604a3708e10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5604a3704c90 0x5604a37080d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5604a3704370 0x5604a37767f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8c827fc640 0 client.5661 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8cac9aa000 1 --2- 172.21.15.83:0/2874818054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5604a36b6830 0x5604a37762b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8cac9aa000 1 -- 172.21.15.83:0/2874818054 >> 172.21.15.83:0/2874818054 conn(0x5604a36b27e0 msgr2=0x5604a371ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8cac9aa000 1 -- 172.21.15.83:0/2874818054 shutdown_connections 2024-03-30T13:10:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8cac9aa000 1 -- 172.21.15.83:0/2874818054 wait complete. 2024-03-30T13:10:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8cac9aa000 20 client.5661 trim_cache size 0 max 16384 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/symlink.c", 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628321, 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.115232+0000", 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.086970+0000", 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:29.386 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 916, 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:29.387 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.086970+0000", 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:29.388 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 916, 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.115232+0000" 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 916, 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:29.389 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.115232+0000" 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 88, 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 28, 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.390 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:29.391 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:29.392 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:29.393 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.394 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:29.395 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:29.396 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:29.397 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:29.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8ca9828640 1 -- 172.21.15.83:0/745564198 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8c90067ff0 msgr2=0x7f8c9006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8ca9828640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8c90067ff0 0x7f8c9006a4b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c980af000 tx=0x7f8c980a7000 comp rx=0 tx=0).stop 2024-03-30T13:10:29.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8ca9828640 1 -- 172.21.15.83:0/745564198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ca4158620 msgr2=0x7f8ca4156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8ca9828640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ca4158620 0x7f8ca4156630 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400d830 tx=0x7f8c9400dcf0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8ca9828640 1 -- 172.21.15.83:0/745564198 shutdown_connections 2024-03-30T13:10:29.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8ca9828640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8c90067ff0 0x7f8c9006a4b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8ca9828640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca415f170 0x7f8ca4154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8ca9828640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca415e5b0 0x7f8ca4159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8ca9828640 1 --2- 172.21.15.83:0/745564198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ca4158620 0x7f8ca4156630 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8ca9828640 1 -- 172.21.15.83:0/745564198 >> 172.21.15.83:0/745564198 conn(0x7f8ca4072ec0 msgr2=0x7f8ca406ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8ca9828640 1 -- 172.21.15.83:0/745564198 shutdown_connections 2024-03-30T13:10:29.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.373+0000 7f8ca9828640 1 -- 172.21.15.83:0/745564198 wait complete. 2024-03-30T13:10:29.399 DEBUG:tasks.cephfs.test_uninlining:getting inode info #11 of 23:1099511628311 2024-03-30T13:10:29.399 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628311 2024-03-30T13:10:29.399 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628311 2024-03-30T13:10:29.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a4125640 1 Processor -- start 2024-03-30T13:10:29.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a4125640 1 -- start start 2024-03-30T13:10:29.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a4125640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff79c15e860 0x7ff79c0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a4125640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79c0b6320 0x7ff79c06b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a4125640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff79c06bba0 0x7ff79c0b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a4125640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff79c0b2080 con 0x7ff79c15e860 2024-03-30T13:10:29.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a4125640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff79c0b2360 con 0x7ff79c06bba0 2024-03-30T13:10:29.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a4125640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff79c0b2640 con 0x7ff79c0b6320 2024-03-30T13:10:29.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a1ec1640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff79c15e860 0x7ff79c0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a1ec1640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff79c15e860 0x7ff79c0b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38650/0 (socket says 172.21.15.83:38650) 2024-03-30T13:10:29.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a1ec1640 1 -- 172.21.15.83:0/3039066038 learned_addr learned my addr 172.21.15.83:0/3039066038 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/3039066038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79c0b6320 0x7ff79c06b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a26c2640 1 --2- 172.21.15.83:0/3039066038 >> v2:172.21.15.153:3300/0 conn(0x7ff79c06bba0 0x7ff79c0b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a1ec1640 1 -- 172.21.15.83:0/3039066038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79c0b6320 msgr2=0x7ff79c06b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/3039066038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79c0b6320 0x7ff79c06b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a1ec1640 1 -- 172.21.15.83:0/3039066038 >> v2:172.21.15.153:3300/0 conn(0x7ff79c06bba0 msgr2=0x7ff79c0b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/3039066038 >> v2:172.21.15.153:3300/0 conn(0x7ff79c06bba0 0x7ff79c0b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a1ec1640 1 -- 172.21.15.83:0/3039066038 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79c0b2920 con 0x7ff79c15e860 2024-03-30T13:10:29.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.501+0000 7ff7a26c2640 1 --2- 172.21.15.83:0/3039066038 >> v2:172.21.15.153:3300/0 conn(0x7ff79c06bba0 0x7ff79c0b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/3039066038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff79c15e860 0x7ff79c0b5de0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff79c06c510 tx=0x7ff79801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85c8067607582d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a0ebf640 1 -- 172.21.15.83:0/3039066038 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7980b5070 con 0x7ff79c15e860 2024-03-30T13:10:29.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a0ebf640 1 -- 172.21.15.83:0/3039066038 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7980a89d0 con 0x7ff79c15e860 2024-03-30T13:10:29.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a0ebf640 1 -- 172.21.15.83:0/3039066038 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7980a8da0 con 0x7ff79c15e860 2024-03-30T13:10:29.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 -- 172.21.15.83:0/3039066038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff79c15e860 msgr2=0x7ff79c0b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 --2- 172.21.15.83:0/3039066038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff79c15e860 0x7ff79c0b5de0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff79c06c510 tx=0x7ff79801ed10 comp rx=0 tx=0).stop 2024-03-30T13:10:29.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 -- 172.21.15.83:0/3039066038 shutdown_connections 2024-03-30T13:10:29.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 --2- 172.21.15.83:0/3039066038 >> v2:172.21.15.153:3300/0 conn(0x7ff79c06bba0 0x7ff79c0b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 --2- 172.21.15.83:0/3039066038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79c0b6320 0x7ff79c06b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 --2- 172.21.15.83:0/3039066038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff79c15e860 0x7ff79c0b5de0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 -- 172.21.15.83:0/3039066038 >> 172.21.15.83:0/3039066038 conn(0x7ff79c072d30 msgr2=0x7ff79c0b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 -- 172.21.15.83:0/3039066038 shutdown_connections 2024-03-30T13:10:29.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 -- 172.21.15.83:0/3039066038 wait complete. 2024-03-30T13:10:29.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 Processor -- start 2024-03-30T13:10:29.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 -- start start 2024-03-30T13:10:29.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79c06bba0 0x7ff79c1f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff79c0b6320 0x7ff79c09ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79c15e860 0x7ff79c1f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff79c0b12a0 con 0x7ff79c0b6320 2024-03-30T13:10:29.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff79c0b1120 con 0x7ff79c06bba0 2024-03-30T13:10:29.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff79c0b1420 con 0x7ff79c15e860 2024-03-30T13:10:29.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a16c0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff79c0b6320 0x7ff79c09ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a16c0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff79c0b6320 0x7ff79c09ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38666/0 (socket says 172.21.15.83:38666) 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a16c0640 1 -- 172.21.15.83:0/2799808549 learned_addr learned my addr 172.21.15.83:0/2799808549 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79c06bba0 0x7ff79c1f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a26c2640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79c15e860 0x7ff79c1f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a16c0640 1 -- 172.21.15.83:0/2799808549 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79c15e860 msgr2=0x7ff79c1f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79c15e860 0x7ff79c1f3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a16c0640 1 -- 172.21.15.83:0/2799808549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79c06bba0 msgr2=0x7ff79c1f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79c06bba0 0x7ff79c1f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a16c0640 1 -- 172.21.15.83:0/2799808549 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79c09f100 con 0x7ff79c0b6320 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff79c0b6320 0x7ff79c09ebc0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00d800 tx=0x7ff78c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7927fc640 1 -- 172.21.15.83:0/2799808549 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c004020 con 0x7ff79c0b6320 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7927fc640 1 -- 172.21.15.83:0/2799808549 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78c0041c0 con 0x7ff79c0b6320 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 -- 172.21.15.83:0/2799808549 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79c0cab80 con 0x7ff79c0b6320 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7927fc640 1 -- 172.21.15.83:0/2799808549 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0043b0 con 0x7ff79c0b6320 2024-03-30T13:10:29.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.505+0000 7ff7a4125640 1 -- 172.21.15.83:0/2799808549 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff79c0cb140 con 0x7ff79c0b6320 2024-03-30T13:10:29.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.509+0000 7ff7927fc640 1 -- 172.21.15.83:0/2799808549 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff78c01b020 con 0x7ff79c0b6320 2024-03-30T13:10:29.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.509+0000 7ff7927fc640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff780067fc0 0x7ff78006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.509+0000 7ff7927fc640 1 -- 172.21.15.83:0/2799808549 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff78c0862f0 con 0x7ff79c0b6320 2024-03-30T13:10:29.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.509+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff780067fc0 0x7ff78006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.509+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff780067fc0 0x7ff78006a480 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff7980b2000 tx=0x7ff798008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.509+0000 7ff7a72a7000 1 Processor -- start 2024-03-30T13:10:29.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.509+0000 7ff7a72a7000 1 -- start start 2024-03-30T13:10:29.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca39d70 0x5642dca3a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca3a690 0x5642dc9f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dc9f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5642dc83eaa0 con 0x5642dc9f0830 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5642dc7c5af0 con 0x5642dca3a690 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5642dc83aa50 con 0x5642dca39d70 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a26c2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dc9f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a26c2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dc9f0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38674/0 (socket says 172.21.15.83:38674) 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a26c2640 1 -- 172.21.15.83:0/1196527713 learned_addr learned my addr 172.21.15.83:0/1196527713 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/1196527713 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca39d70 0x5642dca3a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/1196527713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca3a690 0x5642dc9f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a26c2640 1 -- 172.21.15.83:0/1196527713 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca39d70 msgr2=0x5642dca3a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a26c2640 1 --2- 172.21.15.83:0/1196527713 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca39d70 0x5642dca3a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a26c2640 1 -- 172.21.15.83:0/1196527713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca3a690 msgr2=0x5642dc9f02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a26c2640 1 --2- 172.21.15.83:0/1196527713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca3a690 0x5642dc9f02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a26c2640 1 -- 172.21.15.83:0/1196527713 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642dc7c3d00 con 0x5642dc9f0830 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/1196527713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca3a690 0x5642dc9f02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a26c2640 1 --2- 172.21.15.83:0/1196527713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dc9f0c10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff794008f50 tx=0x7ff79400d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e28b3f16be2658 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff77f7fe640 1 -- 172.21.15.83:0/1196527713 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79401a070 con 0x5642dc9f0830 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff77f7fe640 1 -- 172.21.15.83:0/1196527713 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79400b680 con 0x5642dc9f0830 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff77f7fe640 1 -- 172.21.15.83:0/1196527713 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79400ba70 con 0x5642dc9f0830 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 -- 172.21.15.83:0/1196527713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 msgr2=0x5642dc9f0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/1196527713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dc9f0c10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff794008f50 tx=0x7ff79400d8c0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 -- 172.21.15.83:0/1196527713 shutdown_connections 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/1196527713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dc9f0c10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/1196527713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca3a690 0x5642dc9f02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/1196527713 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca39d70 0x5642dca3a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 -- 172.21.15.83:0/1196527713 >> 172.21.15.83:0/1196527713 conn(0x5642dc9ec7e0 msgr2=0x5642dc9eebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 -- 172.21.15.83:0/1196527713 shutdown_connections 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 -- 172.21.15.83:0/1196527713 wait complete. 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 -- start start 2024-03-30T13:10:29.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.513+0000 7ff7a72a7000 1 Processor -- start 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dc9f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca39d70 0x5642dca1eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 0x5642dca1f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5642dc806270 con 0x5642dc9f0830 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5642dc7fc6a0 con 0x5642dca39d70 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5642dc7d6880 con 0x5642dca3a690 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a1ec1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dc9f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 10 client.0 _ll_register_callbacks cb 0x5642dc9db490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a1ec1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dc9f5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38676/0 (socket says 172.21.15.83:38676) 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a1ec1640 1 -- 172.21.15.83:0/3260259727 learned_addr learned my addr 172.21.15.83:0/3260259727 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a26c2640 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 0x5642dca1f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca39d70 0x5642dca1eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a1ec1640 1 -- 172.21.15.83:0/3260259727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 msgr2=0x5642dca1f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 0x5642dca1f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a1ec1640 1 -- 172.21.15.83:0/3260259727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca39d70 msgr2=0x5642dca1eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca39d70 0x5642dca1eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a1ec1640 1 -- 172.21.15.83:0/3260259727 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642dc803730 con 0x5642dc9f0830 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a26c2640 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 0x5642dca1f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dc9f5c80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff798000c10 tx=0x7ff79801d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8b8bfef2fb5b43 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff77cff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff77cff9640 1 -- 172.21.15.83:0/3260259727 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7980b5040 con 0x5642dc9f0830 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff77cff9640 1 -- 172.21.15.83:0/3260259727 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff7980bab30 con 0x5642dc9f0830 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 -- 172.21.15.83:0/3260259727 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff79400b680 con 0x5642dc9f0830 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff77cff9640 1 -- 172.21.15.83:0/3260259727 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7ff7980d3050 con 0x5642dc9f0830 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 10 client.5673 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 -- 172.21.15.83:0/3260259727 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5642dc7f6ca0 con 0x5642dc9f0830 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff77cff9640 1 -- 172.21.15.83:0/3260259727 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79400b680 con 0x5642dc9f0830 2024-03-30T13:10:29.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff77cff9640 1 -- 172.21.15.83:0/3260259727 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7ff7980d6020 con 0x5642dc9f0830 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 10 client.5673 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 10 client.5673 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 20 client.5673 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5642dca415d0 0x5642dca419b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 4 client.5673 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 -- 172.21.15.83:0/3260259727 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642dc7d9c90 con 0x5642dca415d0 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5642dca415d0 0x5642dca419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5642dca415d0 0x5642dca419b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c15c548824336e server_cookie=d8644539dc6ca29 in_seq=0 out_seq=0 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff77cff9640 10 client.5673 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff77cff9640 1 -- 172.21.15.83:0/3260259727 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5642dc7d9c90 con 0x5642dca415d0 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff77cff9640 10 client.5673 handle_command_reply: tid=0 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 client.5673 shutdown 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 -- 172.21.15.83:0/3260259727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 msgr2=0x5642dc9f5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dc9f5c80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff798000c10 tx=0x7ff79801d550 comp rx=0 tx=0).stop 2024-03-30T13:10:29.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 -- 172.21.15.83:0/3260259727 shutdown_connections 2024-03-30T13:10:29.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 0x5642dca1f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca39d70 0x5642dca1eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5642dca415d0 0x5642dca419b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/3260259727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dc9f5c80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff77cff9640 0 client.5673 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 -- 172.21.15.83:0/3260259727 >> 172.21.15.83:0/3260259727 conn(0x5642dc9ec7e0 msgr2=0x5642dc9ef460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 -- 172.21.15.83:0/3260259727 shutdown_connections 2024-03-30T13:10:29.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 1 -- 172.21.15.83:0/3260259727 wait complete. 2024-03-30T13:10:29.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.517+0000 7ff7a72a7000 20 client.5673 trim_cache size 0 max 16384 2024-03-30T13:10:29.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 Processor -- start 2024-03-30T13:10:29.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 -- start start 2024-03-30T13:10:29.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dc9f0830 0x5642dca1f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dca39d70 0x5642dc9eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 0x5642dc9ef110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff79c200b40 con 0x5642dca39d70 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff79c09c410 con 0x5642dc9f0830 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff79c1f84f0 con 0x5642dca3a690 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a16c0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dca39d70 0x5642dc9eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a16c0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dca39d70 0x5642dc9eebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38682/0 (socket says 172.21.15.83:38682) 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a16c0640 1 -- 172.21.15.83:0/841947182 learned_addr learned my addr 172.21.15.83:0/841947182 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a16c0640 1 -- 172.21.15.83:0/841947182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 msgr2=0x5642dc9ef110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/841947182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 0x5642dc9ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a16c0640 1 -- 172.21.15.83:0/841947182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dc9f0830 msgr2=0x5642dca1f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/841947182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dc9f0830 0x5642dca1f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a16c0640 1 -- 172.21.15.83:0/841947182 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642dc7c5d00 con 0x5642dca39d70 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/841947182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dca39d70 0x5642dc9eebd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0563c0 tx=0x7ff78c086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e810411b6627f46 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff77effd640 1 -- 172.21.15.83:0/841947182 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c05f010 con 0x5642dca39d70 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff77effd640 1 -- 172.21.15.83:0/841947182 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78c06e030 con 0x5642dca39d70 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff77effd640 1 -- 172.21.15.83:0/841947182 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c01ce30 con 0x5642dca39d70 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 -- 172.21.15.83:0/841947182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dca39d70 msgr2=0x5642dc9eebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/841947182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dca39d70 0x5642dc9eebd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0563c0 tx=0x7ff78c086040 comp rx=0 tx=0).stop 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 -- 172.21.15.83:0/841947182 shutdown_connections 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/841947182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 0x5642dc9ef110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/841947182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dca39d70 0x5642dc9eebd0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/841947182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dc9f0830 0x5642dca1f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.533+0000 7ff7a72a7000 1 -- 172.21.15.83:0/841947182 >> 172.21.15.83:0/841947182 conn(0x5642dc9ec7e0 msgr2=0x5642dca50f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- 172.21.15.83:0/841947182 shutdown_connections 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- 172.21.15.83:0/841947182 wait complete. 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- start start 2024-03-30T13:10:29.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 Processor -- start 2024-03-30T13:10:29.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dcaabb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca39d70 0x5642dcaac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 0x5642dca3dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5642dc7d6880 con 0x5642dc9f0830 2024-03-30T13:10:29.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff79c153f30 con 0x5642dca39d70 2024-03-30T13:10:29.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5642dc806270 con 0x5642dca3a690 2024-03-30T13:10:29.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 10 client.0 _ll_register_callbacks cb 0x7ff7980b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:29.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a1ec1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dcaabb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a1ec1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dcaabb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38686/0 (socket says 172.21.15.83:38686) 2024-03-30T13:10:29.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a1ec1640 1 -- 172.21.15.83:0/890457832 learned_addr learned my addr 172.21.15.83:0/890457832 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a26c2640 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 0x5642dca3dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a1ec1640 1 -- 172.21.15.83:0/890457832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 msgr2=0x5642dca3dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca39d70 0x5642dcaac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 0x5642dca3dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a1ec1640 1 -- 172.21.15.83:0/890457832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca39d70 msgr2=0x5642dcaac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca39d70 0x5642dcaac0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a1ec1640 1 -- 172.21.15.83:0/890457832 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642dc8bff70 con 0x5642dc9f0830 2024-03-30T13:10:29.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a1ec1640 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dcaabb60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff79801bea0 tx=0x7ff79801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bfc3d5aca58328 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff77cff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:29.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff77cff9640 1 -- 172.21.15.83:0/890457832 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7980b5050 con 0x5642dc9f0830 2024-03-30T13:10:29.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff77cff9640 1 -- 172.21.15.83:0/890457832 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff7980c6a00 con 0x5642dc9f0830 2024-03-30T13:10:29.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- 172.21.15.83:0/890457832 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff78c06e030 con 0x5642dc9f0830 2024-03-30T13:10:29.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff77cff9640 1 -- 172.21.15.83:0/890457832 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7ff7980e5050 con 0x5642dc9f0830 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 10 client.5679 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- 172.21.15.83:0/890457832 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5642dc7e5760 con 0x5642dc9f0830 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff77cff9640 1 -- 172.21.15.83:0/890457832 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78c06e030 con 0x5642dc9f0830 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff77cff9640 1 -- 172.21.15.83:0/890457832 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7ff7980e8020 con 0x5642dc9f0830 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 10 client.5679 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 10 client.5679 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 20 client.5679 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5642dca3e810 0x5642dca3ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 4 client.5679 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628311}] 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- 172.21.15.83:0/890457832 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628311}) -- 0x5642dc84bfe0 con 0x5642dca3e810 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5642dca3e810 0x5642dca3ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff77cff9640 10 client.5679 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a16c0640 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5642dca3e810 0x5642dca3ec20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0cad1b8e3f6139b server_cookie=efc76ab85b46119 in_seq=0 out_seq=0 2024-03-30T13:10:29.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff77cff9640 1 -- 172.21.15.83:0/890457832 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3810 (crc 0 0 0) 0x5642dc84bfe0 con 0x5642dca3e810 2024-03-30T13:10:29.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff77cff9640 10 client.5679 handle_command_reply: tid=0 2024-03-30T13:10:29.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 client.5679 shutdown 2024-03-30T13:10:29.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- 172.21.15.83:0/890457832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 msgr2=0x5642dcaabb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dcaabb60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff79801bea0 tx=0x7ff79801bab0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- 172.21.15.83:0/890457832 shutdown_connections 2024-03-30T13:10:29.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5642dca3a690 0x5642dca3dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5642dca39d70 0x5642dcaac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5642dca3e810 0x5642dca3ec20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 --2- 172.21.15.83:0/890457832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5642dc9f0830 0x5642dcaabb60 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- 172.21.15.83:0/890457832 >> 172.21.15.83:0/890457832 conn(0x5642dc9ec7e0 msgr2=0x5642dca51620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff77cff9640 0 client.5679 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- 172.21.15.83:0/890457832 shutdown_connections 2024-03-30T13:10:29.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.537+0000 7ff7a72a7000 1 -- 172.21.15.83:0/890457832 wait complete. 2024-03-30T13:10:29.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a72a7000 20 client.5679 trim_cache size 0 max 16384 2024-03-30T13:10:29.553 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:29.553 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/acl.h", 2024-03-30T13:10:29.553 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628311, 2024-03-30T13:10:29.553 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:29.553 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.119779+0000", 2024-03-30T13:10:29.553 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.041778+0000", 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:29.554 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 1502, 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.041778+0000", 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:29.555 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1502, 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:29.556 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.119779+0000" 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1502, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.119779+0000" 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 86, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 8, 2024-03-30T13:10:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:29.565 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:29.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a4125640 1 -- 172.21.15.83:0/2799808549 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff780067fc0 msgr2=0x7ff78006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a4125640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff780067fc0 0x7ff78006a480 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff7980b2000 tx=0x7ff798008040 comp rx=0 tx=0).stop 2024-03-30T13:10:29.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a4125640 1 -- 172.21.15.83:0/2799808549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff79c0b6320 msgr2=0x7ff79c09ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a4125640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff79c0b6320 0x7ff79c09ebc0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00d800 tx=0x7ff78c00dcc0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a4125640 1 -- 172.21.15.83:0/2799808549 shutdown_connections 2024-03-30T13:10:29.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a4125640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff780067fc0 0x7ff78006a480 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a4125640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff79c15e860 0x7ff79c1f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a4125640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff79c0b6320 0x7ff79c09ebc0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a4125640 1 --2- 172.21.15.83:0/2799808549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79c06bba0 0x7ff79c1f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a4125640 1 -- 172.21.15.83:0/2799808549 >> 172.21.15.83:0/2799808549 conn(0x7ff79c072d30 msgr2=0x7ff79c06eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a4125640 1 -- 172.21.15.83:0/2799808549 shutdown_connections 2024-03-30T13:10:29.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.541+0000 7ff7a4125640 1 -- 172.21.15.83:0/2799808549 wait complete. 2024-03-30T13:10:29.568 DEBUG:tasks.cephfs.test_uninlining:getting inode info #12 of 23:1099511628325 2024-03-30T13:10:29.568 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628325 2024-03-30T13:10:29.568 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628325 2024-03-30T13:10:29.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.665+0000 7f5fe0cfa640 1 Processor -- start 2024-03-30T13:10:29.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.665+0000 7f5fe0cfa640 1 -- start start 2024-03-30T13:10:29.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fe0cfa640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5fdc13f250 0x7f5fdc160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fe0cfa640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc13f630 0x7f5fdc15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fe0cfa640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fdc06f310 con 0x7f5fdc160b40 2024-03-30T13:10:29.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fe0cfa640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f5fdc06f5f0 con 0x7f5fdc13f250 2024-03-30T13:10:29.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fe0cfa640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5fdc06f8d0 con 0x7f5fdc13f630 2024-03-30T13:10:29.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fda59c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5fdc13f250 0x7f5fdc160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fd9d9b640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f5fdc160b40 0x7f5fdc0b5e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36432/0 (socket says 172.21.15.83:36432) 2024-03-30T13:10:29.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fd9d9b640 1 -- 172.21.15.83:0/1905104195 learned_addr learned my addr 172.21.15.83:0/1905104195 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:29.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fda59c640 1 -- 172.21.15.83:0/1905104195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc13f630 msgr2=0x7f5fdc15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fda59c640 1 --2- 172.21.15.83:0/1905104195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc13f630 0x7f5fdc15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fda59c640 1 -- 172.21.15.83:0/1905104195 >> v1:172.21.15.83:6789/0 conn(0x7f5fdc160b40 legacy=0x7f5fdc0b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fd959a640 1 -- 172.21.15.83:0/1905104195 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3306915232 0 0) 0x7f5fdc06f310 con 0x7f5fdc160b40 2024-03-30T13:10:29.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fda59c640 1 -- 172.21.15.83:0/1905104195 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fdc06fbb0 con 0x7f5fdc13f250 2024-03-30T13:10:29.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fda59c640 1 --2- 172.21.15.83:0/1905104195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fdc13f250 0x7f5fdc160600 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0097c0 tx=0x7f5fcc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405f4821dd7546cf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fd959a640 1 -- 172.21.15.83:0/1905104195 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0ab600 con 0x7f5fdc13f250 2024-03-30T13:10:29.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fd959a640 1 -- 172.21.15.83:0/1905104195 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fcc0b0070 con 0x7f5fdc13f250 2024-03-30T13:10:29.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fd959a640 1 -- 172.21.15.83:0/1905104195 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0ab9c0 con 0x7f5fdc13f250 2024-03-30T13:10:29.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/1905104195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fdc13f250 msgr2=0x7f5fdc160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.669+0000 7f5fe0cfa640 1 --2- 172.21.15.83:0/1905104195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fdc13f250 0x7f5fdc160600 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0097c0 tx=0x7f5fcc01c470 comp rx=0 tx=0).stop 2024-03-30T13:10:29.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/1905104195 shutdown_connections 2024-03-30T13:10:29.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 --2- 172.21.15.83:0/1905104195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc13f630 0x7f5fdc15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 --2- 172.21.15.83:0/1905104195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fdc13f250 0x7f5fdc160600 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/1905104195 >> 172.21.15.83:0/1905104195 conn(0x7f5fdc072ec0 msgr2=0x7f5fdc06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/1905104195 shutdown_connections 2024-03-30T13:10:29.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/1905104195 wait complete. 2024-03-30T13:10:29.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 Processor -- start 2024-03-30T13:10:29.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 -- start start 2024-03-30T13:10:29.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fdc13f250 0x7f5fdc135680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc13f630 0x7f5fdc150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fdc160b40 0x7f5fdc151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc0b6690 con 0x7f5fdc160b40 2024-03-30T13:10:29.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc0b6510 con 0x7f5fdc13f250 2024-03-30T13:10:29.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5fdc15e6f0 con 0x7f5fdc13f630 2024-03-30T13:10:29.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fdad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fdc160b40 0x7f5fdc151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fdad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fdc160b40 0x7f5fdc151440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38700/0 (socket says 172.21.15.83:38700) 2024-03-30T13:10:29.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fdad9d640 1 -- 172.21.15.83:0/3889669373 learned_addr learned my addr 172.21.15.83:0/3889669373 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fda59c640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fdc13f250 0x7f5fdc135680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fd9d9b640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc13f630 0x7f5fdc150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fdad9d640 1 -- 172.21.15.83:0/3889669373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc13f630 msgr2=0x7f5fdc150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fdad9d640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc13f630 0x7f5fdc150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fdad9d640 1 -- 172.21.15.83:0/3889669373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fdc13f250 msgr2=0x7f5fdc135680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fdad9d640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fdc13f250 0x7f5fdc135680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fdad9d640 1 -- 172.21.15.83:0/3889669373 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fdc153aa0 con 0x7f5fdc160b40 2024-03-30T13:10:29.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fd9d9b640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc13f630 0x7f5fdc150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fda59c640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fdc13f250 0x7f5fdc135680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fdad9d640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fdc160b40 0x7f5fdc151440 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400b9e0 tx=0x7f5fd400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fcaffd640 1 -- 172.21.15.83:0/3889669373 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4019070 con 0x7f5fdc160b40 2024-03-30T13:10:29.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fcaffd640 1 -- 172.21.15.83:0/3889669373 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd400cb40 con 0x7f5fdc160b40 2024-03-30T13:10:29.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/3889669373 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fdc151c70 con 0x7f5fdc160b40 2024-03-30T13:10:29.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fcaffd640 1 -- 172.21.15.83:0/3889669373 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4014440 con 0x7f5fdc160b40 2024-03-30T13:10:29.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.673+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/3889669373 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fdc152230 con 0x7f5fdc160b40 2024-03-30T13:10:29.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fcaffd640 1 -- 172.21.15.83:0/3889669373 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5fd401c070 con 0x7f5fdc160b40 2024-03-30T13:10:29.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fcaffd640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5fbc067fc0 0x7f5fbc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fcaffd640 1 -- 172.21.15.83:0/3889669373 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5fd4086210 con 0x7f5fdc160b40 2024-03-30T13:10:29.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fda59c640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5fbc067fc0 0x7f5fbc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fda59c640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5fbc067fc0 0x7f5fbc06a480 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0af000 tx=0x7f5fcc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 Processor -- start 2024-03-30T13:10:29.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 -- start start 2024-03-30T13:10:29.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834cadd70 0x562834cae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 0x562834c642f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834c64830 0x562834c64c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562834ab2aa0 con 0x562834cae690 2024-03-30T13:10:29.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562834a39af0 con 0x562834cadd70 2024-03-30T13:10:29.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x562834aaea50 con 0x562834c64830 2024-03-30T13:10:29.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fd9d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 0x562834c642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fd9d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 0x562834c642f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38704/0 (socket says 172.21.15.83:38704) 2024-03-30T13:10:29.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fd9d9b640 1 -- 172.21.15.83:0/1493958745 learned_addr learned my addr 172.21.15.83:0/1493958745 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fda59c640 1 --2- 172.21.15.83:0/1493958745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834cadd70 0x562834cae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fdad9d640 1 --2- 172.21.15.83:0/1493958745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834c64830 0x562834c64c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fd9d9b640 1 -- 172.21.15.83:0/1493958745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834c64830 msgr2=0x562834c64c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fd9d9b640 1 --2- 172.21.15.83:0/1493958745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834c64830 0x562834c64c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fd9d9b640 1 -- 172.21.15.83:0/1493958745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834cadd70 msgr2=0x562834cae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fd9d9b640 1 --2- 172.21.15.83:0/1493958745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834cadd70 0x562834cae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fd9d9b640 1 -- 172.21.15.83:0/1493958745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562834a37d00 con 0x562834cae690 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fdad9d640 1 --2- 172.21.15.83:0/1493958745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834c64830 0x562834c64c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fda59c640 1 --2- 172.21.15.83:0/1493958745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834cadd70 0x562834cae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fd9d9b640 1 --2- 172.21.15.83:0/1493958745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 0x562834c642f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc13eb40 tx=0x7f5fd0001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb3a3042e5b3a87 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fbbfff640 1 -- 172.21.15.83:0/1493958745 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00074e0 con 0x562834cae690 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fbbfff640 1 -- 172.21.15.83:0/1493958745 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd00047f0 con 0x562834cae690 2024-03-30T13:10:29.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fbbfff640 1 -- 172.21.15.83:0/1493958745 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0007680 con 0x562834cae690 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/1493958745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 msgr2=0x562834c642f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/1493958745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 0x562834c642f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc13eb40 tx=0x7f5fd0001b80 comp rx=0 tx=0).stop 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/1493958745 shutdown_connections 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/1493958745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834c64830 0x562834c64c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/1493958745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 0x562834c642f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/1493958745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834cadd70 0x562834cae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/1493958745 >> 172.21.15.83:0/1493958745 conn(0x562834c607e0 msgr2=0x562834c62bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/1493958745 shutdown_connections 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.677+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/1493958745 wait complete. 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 -- start start 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 Processor -- start 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834c64830 0x562834c69c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cadd70 0x562834c92da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cae690 0x562834c932e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562834a7a270 con 0x562834cadd70 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562834a706a0 con 0x562834c64830 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x562834a4a880 con 0x562834cae690 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 10 client.0 _ll_register_callbacks cb 0x562834c4f490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fd9d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cadd70 0x562834c92da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fd9d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cadd70 0x562834c92da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38712/0 (socket says 172.21.15.83:38712) 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fd9d9b640 1 -- 172.21.15.83:0/752911733 learned_addr learned my addr 172.21.15.83:0/752911733 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fda59c640 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834c64830 0x562834c69c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fdad9d640 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cae690 0x562834c932e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fd9d9b640 1 -- 172.21.15.83:0/752911733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cae690 msgr2=0x562834c932e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fd9d9b640 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cae690 0x562834c932e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fd9d9b640 1 -- 172.21.15.83:0/752911733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834c64830 msgr2=0x562834c69c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fd9d9b640 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834c64830 0x562834c69c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fd9d9b640 1 -- 172.21.15.83:0/752911733 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562834a77730 con 0x562834cadd70 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fd9d9b640 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cadd70 0x562834c92da0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0001bc0 tx=0x7f5fd0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4678f48ac41ade6b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fb97fa640 1 -- 172.21.15.83:0/752911733 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0024020 con 0x562834cadd70 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fb97fa640 1 -- 172.21.15.83:0/752911733 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5fd0004db0 con 0x562834cadd70 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/752911733 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fd00047f0 con 0x562834cadd70 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fb97fa640 1 -- 172.21.15.83:0/752911733 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5fd002e050 con 0x562834cadd70 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 10 client.5694 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/752911733 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x562834a6aca0 con 0x562834cadd70 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fb97fa640 1 -- 172.21.15.83:0/752911733 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd00047f0 con 0x562834cadd70 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fb97fa640 1 -- 172.21.15.83:0/752911733 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f5fd0031020 con 0x562834cadd70 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 10 client.5694 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 10 client.5694 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 20 client.5694 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562834cb55d0 0x562834cb59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 4 client.5694 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:29.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/752911733 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562834a4dc90 con 0x562834cb55d0 2024-03-30T13:10:29.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fda59c640 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562834cb55d0 0x562834cb59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fda59c640 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562834cb55d0 0x562834cb59b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec0b2195ed6b3b9e server_cookie=340301fa12e238ea in_seq=0 out_seq=0 2024-03-30T13:10:29.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fb97fa640 10 client.5694 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fb97fa640 1 -- 172.21.15.83:0/752911733 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x562834a4dc90 con 0x562834cb55d0 2024-03-30T13:10:29.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fb97fa640 10 client.5694 handle_command_reply: tid=0 2024-03-30T13:10:29.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 client.5694 shutdown 2024-03-30T13:10:29.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/752911733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cadd70 msgr2=0x562834c92da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cadd70 0x562834c92da0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0001bc0 tx=0x7f5fd0000ee0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/752911733 shutdown_connections 2024-03-30T13:10:29.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cae690 0x562834c932e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562834cb55d0 0x562834cb59b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cadd70 0x562834c92da0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/752911733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834c64830 0x562834c69c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/752911733 >> 172.21.15.83:0/752911733 conn(0x562834c607e0 msgr2=0x562834c63460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fb97fa640 0 client.5694 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/752911733 shutdown_connections 2024-03-30T13:10:29.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/752911733 wait complete. 2024-03-30T13:10:29.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.681+0000 7f5fe3e7c000 20 client.5694 trim_cache size 0 max 16384 2024-03-30T13:10:29.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 Processor -- start 2024-03-30T13:10:29.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 -- start start 2024-03-30T13:10:29.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834c64830 0x562834c64000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cadd70 0x562834c62bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 0x562834c63110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc201460 con 0x562834cae690 2024-03-30T13:10:29.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc153720 con 0x562834c64830 2024-03-30T13:10:29.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5fdc156fc0 con 0x562834cadd70 2024-03-30T13:10:29.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fdad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 0x562834c63110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fdad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 0x562834c63110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38714/0 (socket says 172.21.15.83:38714) 2024-03-30T13:10:29.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fdad9d640 1 -- 172.21.15.83:0/1664335568 learned_addr learned my addr 172.21.15.83:0/1664335568 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fdad9d640 1 -- 172.21.15.83:0/1664335568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cadd70 msgr2=0x562834c62bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fdad9d640 1 --2- 172.21.15.83:0/1664335568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cadd70 0x562834c62bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fdad9d640 1 -- 172.21.15.83:0/1664335568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834c64830 msgr2=0x562834c64000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fda59c640 1 --2- 172.21.15.83:0/1664335568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834c64830 0x562834c64000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fdad9d640 1 --2- 172.21.15.83:0/1664335568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834c64830 0x562834c64000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fdad9d640 1 -- 172.21.15.83:0/1664335568 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562834a39d00 con 0x562834cae690 2024-03-30T13:10:29.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fdad9d640 1 --2- 172.21.15.83:0/1664335568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 0x562834c63110 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4084760 tx=0x7f5fd4004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7332014be4aec6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fbb7fe640 1 -- 172.21.15.83:0/1664335568 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd405eea0 con 0x562834cae690 2024-03-30T13:10:29.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fbb7fe640 1 -- 172.21.15.83:0/1664335568 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd40545c0 con 0x562834cae690 2024-03-30T13:10:29.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fbb7fe640 1 -- 172.21.15.83:0/1664335568 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd405ea10 con 0x562834cae690 2024-03-30T13:10:29.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/1664335568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 msgr2=0x562834c63110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/1664335568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 0x562834c63110 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4084760 tx=0x7f5fd4004b60 comp rx=0 tx=0).stop 2024-03-30T13:10:29.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/1664335568 shutdown_connections 2024-03-30T13:10:29.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/1664335568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834cae690 0x562834c63110 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/1664335568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cadd70 0x562834c62bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/1664335568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834c64830 0x562834c64000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/1664335568 >> 172.21.15.83:0/1664335568 conn(0x562834c607e0 msgr2=0x562834c912b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/1664335568 shutdown_connections 2024-03-30T13:10:29.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/1664335568 wait complete. 2024-03-30T13:10:29.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.697+0000 7f5fe3e7c000 1 -- start start 2024-03-30T13:10:29.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 Processor -- start 2024-03-30T13:10:29.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834c64830 0x562834c93050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834cadd70 0x562834cb1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cae690 0x562834cb2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562834b6eb00 con 0x562834c64830 2024-03-30T13:10:29.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562834c919c0 con 0x562834cadd70 2024-03-30T13:10:29.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x562834a3da30 con 0x562834cae690 2024-03-30T13:10:29.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 10 client.0 _ll_register_callbacks cb 0x7f5fd0001570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:29.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fda59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834c64830 0x562834c93050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fda59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834c64830 0x562834c93050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38718/0 (socket says 172.21.15.83:38718) 2024-03-30T13:10:29.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fda59c640 1 -- 172.21.15.83:0/3410382251 learned_addr learned my addr 172.21.15.83:0/3410382251 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fda59c640 1 -- 172.21.15.83:0/3410382251 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cae690 msgr2=0x562834cb2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fda59c640 1 --2- 172.21.15.83:0/3410382251 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cae690 0x562834cb2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fda59c640 1 -- 172.21.15.83:0/3410382251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834cadd70 msgr2=0x562834cb1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fda59c640 1 --2- 172.21.15.83:0/3410382251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834cadd70 0x562834cb1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fda59c640 1 -- 172.21.15.83:0/3410382251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562834b33f70 con 0x562834c64830 2024-03-30T13:10:29.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fda59c640 1 --2- 172.21.15.83:0/3410382251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834c64830 0x562834c93050 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0ad040 tx=0x7f5fcc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a4bfccd1c6c40a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:29.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fb97fa640 1 -- 172.21.15.83:0/3410382251 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0bb070 con 0x562834c64830 2024-03-30T13:10:29.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fb97fa640 1 -- 172.21.15.83:0/3410382251 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5fcc0ca610 con 0x562834c64830 2024-03-30T13:10:29.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/3410382251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fd40545c0 con 0x562834c64830 2024-03-30T13:10:29.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fb97fa640 1 -- 172.21.15.83:0/3410382251 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5fcc0d9050 con 0x562834c64830 2024-03-30T13:10:29.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 10 client.5700 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:29.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/3410382251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x562834a59760 con 0x562834c64830 2024-03-30T13:10:29.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fb97fa640 1 -- 172.21.15.83:0/3410382251 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd40545c0 con 0x562834c64830 2024-03-30T13:10:29.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fb97fa640 1 -- 172.21.15.83:0/3410382251 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f5fcc0dc020 con 0x562834c64830 2024-03-30T13:10:29.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 10 client.5700 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:29.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 10 client.5700 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:29.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 20 client.5700 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:29.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/3410382251 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562834cb2550 0x562834d1f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 4 client.5700 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628325}] 2024-03-30T13:10:29.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/3410382251 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628325}) -- 0x562834abffe0 con 0x562834cb2550 2024-03-30T13:10:29.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fd9d9b640 1 --2- 172.21.15.83:0/3410382251 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562834cb2550 0x562834d1f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fb97fa640 10 client.5700 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fd9d9b640 1 --2- 172.21.15.83:0/3410382251 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562834cb2550 0x562834d1f3c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46acc017d43cdc62 server_cookie=d9b35c7db63336c in_seq=0 out_seq=0 2024-03-30T13:10:29.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fb97fa640 1 -- 172.21.15.83:0/3410382251 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3821 (crc 0 0 0) 0x562834abffe0 con 0x562834cb2550 2024-03-30T13:10:29.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fb97fa640 10 client.5700 handle_command_reply: tid=0 2024-03-30T13:10:29.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 client.5700 shutdown 2024-03-30T13:10:29.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/3410382251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834c64830 msgr2=0x562834c93050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/3410382251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834c64830 0x562834c93050 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0ad040 tx=0x7f5fcc01acb0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/3410382251 shutdown_connections 2024-03-30T13:10:29.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/3410382251 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562834cae690 0x562834cb2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/3410382251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562834cadd70 0x562834cb1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/3410382251 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562834cb2550 0x562834d1f3c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 --2- 172.21.15.83:0/3410382251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562834c64830 0x562834c93050 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fb97fa640 0 client.5700 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/3410382251 >> 172.21.15.83:0/3410382251 conn(0x562834c607e0 msgr2=0x562834cc4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/3410382251 shutdown_connections 2024-03-30T13:10:29.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 1 -- 172.21.15.83:0/3410382251 wait complete. 2024-03-30T13:10:29.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe3e7c000 20 client.5700 trim_cache size 0 max 16384 2024-03-30T13:10:29.719 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:29.719 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/xattr_trusted.c", 2024-03-30T13:10:29.719 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628325, 2024-03-30T13:10:29.719 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:29.719 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.125724+0000", 2024-03-30T13:10:29.719 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.095162+0000", 2024-03-30T13:10:29.719 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:29.720 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:29.720 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:29.720 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:29.720 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:29.720 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:29.720 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:29.720 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:29.720 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:29.720 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.720 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:29.720 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:29.720 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:29.721 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:29.721 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:29.721 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:29.721 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.721 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:29.721 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 1094, 2024-03-30T13:10:29.721 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:29.721 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:29.721 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:29.721 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:29.721 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:29.721 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.095162+0000", 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:29.722 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1094, 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.125724+0000" 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1094, 2024-03-30T13:10:29.723 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:29.724 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:29.724 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:29.724 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.125724+0000" 2024-03-30T13:10:29.724 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.724 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 90, 2024-03-30T13:10:29.724 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:29.724 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:29.724 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 36, 2024-03-30T13:10:29.724 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:29.724 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:29.724 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:29.724 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:29.725 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:29.726 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:29.726 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:29.726 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:29.726 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:29.726 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.726 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:29.726 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:29.726 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:29.726 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:29.726 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.726 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:29.726 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:29.727 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:29.728 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.728 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.728 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:29.728 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.728 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.728 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.728 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.728 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.728 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.728 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:29.728 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:29.728 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.729 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:29.730 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:29.731 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:29.731 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:29.731 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:29.731 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.731 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:29.731 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:29.731 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:29.731 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:29.731 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:29.731 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:29.731 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:29.731 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:29.732 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.732 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:29.732 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:29.732 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:29.732 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:29.732 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:29.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/3889669373 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5fbc067fc0 msgr2=0x7f5fbc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe0cfa640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5fbc067fc0 0x7f5fbc06a480 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0af000 tx=0x7f5fcc0a7000 comp rx=0 tx=0).stop 2024-03-30T13:10:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/3889669373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fdc160b40 msgr2=0x7f5fdc151440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe0cfa640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fdc160b40 0x7f5fdc151440 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400b9e0 tx=0x7f5fd400bea0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/3889669373 shutdown_connections 2024-03-30T13:10:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe0cfa640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5fbc067fc0 0x7f5fbc06a480 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe0cfa640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fdc160b40 0x7f5fdc151440 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe0cfa640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc13f630 0x7f5fdc150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe0cfa640 1 --2- 172.21.15.83:0/3889669373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fdc13f250 0x7f5fdc135680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/3889669373 >> 172.21.15.83:0/3889669373 conn(0x7f5fdc072ec0 msgr2=0x7f5fdc06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/3889669373 shutdown_connections 2024-03-30T13:10:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.701+0000 7f5fe0cfa640 1 -- 172.21.15.83:0/3889669373 wait complete. 2024-03-30T13:10:29.735 DEBUG:tasks.cephfs.test_uninlining:getting inode info #13 of 23:1099511628323 2024-03-30T13:10:29.735 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628323 2024-03-30T13:10:29.735 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628323 2024-03-30T13:10:29.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54b1204640 1 Processor -- start 2024-03-30T13:10:29.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54b1204640 1 -- start start 2024-03-30T13:10:29.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54b1204640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f54ac145c40 0x7f54ac09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54b1204640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54ac160c30 0x7f54ac0b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54b1204640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ac0b0690 con 0x7f54ac160090 2024-03-30T13:10:29.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54b1204640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f54ac0ae3a0 con 0x7f54ac145c40 2024-03-30T13:10:29.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54b1204640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac0b3520 con 0x7f54ac160c30 2024-03-30T13:10:29.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54a3fff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f54ac160090 0x7f54ac160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36446/0 (socket says 172.21.15.83:36446) 2024-03-30T13:10:29.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54a3fff640 1 -- 172.21.15.83:0/2598409779 learned_addr learned my addr 172.21.15.83:0/2598409779 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:29.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aad9d640 1 --2- 172.21.15.83:0/2598409779 >> v2:172.21.15.153:3300/0 conn(0x7f54ac145c40 0x7f54ac09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54ab59e640 1 --2- 172.21.15.83:0/2598409779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54ac160c30 0x7f54ac0b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280397069 0 0) 0x7f54ac0b0690 con 0x7f54ac160090 2024-03-30T13:10:29.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5498003530 con 0x7f54ac160090 2024-03-30T13:10:29.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3572582528 0 0) 0x7f5498003530 con 0x7f54ac160090 2024-03-30T13:10:29.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54ac160c30 msgr2=0x7f54ac0b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 --2- 172.21.15.83:0/2598409779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54ac160c30 0x7f54ac0b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 >> v2:172.21.15.153:3300/0 conn(0x7f54ac145c40 msgr2=0x7f54ac09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 --2- 172.21.15.83:0/2598409779 >> v2:172.21.15.153:3300/0 conn(0x7f54ac145c40 0x7f54ac09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac0b3800 con 0x7f54ac160090 2024-03-30T13:10:29.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f5494001680 con 0x7f54ac160090 2024-03-30T13:10:29.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 >> v1:172.21.15.83:6789/0 conn(0x7f54ac160090 legacy=0x7f54ac160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 --2- 172.21.15.83:0/2598409779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54ac160c30 0x7f54980039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 --2- 172.21.15.83:0/2598409779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5498003f40 0x7f5498004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 --2- 172.21.15.83:0/2598409779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5498004d50 0x7f54980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac0b3520 con 0x7f5498003f40 2024-03-30T13:10:29.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f549800fde0 con 0x7f5498004d50 2024-03-30T13:10:29.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f549800ff60 con 0x7f54ac160c30 2024-03-30T13:10:29.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54a3fff640 1 --2- 172.21.15.83:0/2598409779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5498003f40 0x7f5498004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54a3fff640 1 -- 172.21.15.83:0/2598409779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54ac160c30 msgr2=0x7f54980039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54a3fff640 1 --2- 172.21.15.83:0/2598409779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54ac160c30 0x7f54980039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54a3fff640 1 -- 172.21.15.83:0/2598409779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5498004d50 msgr2=0x7f54980051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54a3fff640 1 --2- 172.21.15.83:0/2598409779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5498004d50 0x7f54980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.841+0000 7f54a3fff640 1 -- 172.21.15.83:0/2598409779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5498003530 con 0x7f5498003f40 2024-03-30T13:10:29.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54a3fff640 1 --2- 172.21.15.83:0/2598409779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5498003f40 0x7f5498004810 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f549400c210 tx=0x7f549401f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c579a846566d34d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5494007d60 con 0x7f5498003f40 2024-03-30T13:10:29.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5494005ae0 con 0x7f5498003f40 2024-03-30T13:10:29.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54aa59c640 1 -- 172.21.15.83:0/2598409779 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5494007070 con 0x7f5498003f40 2024-03-30T13:10:29.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 -- 172.21.15.83:0/2598409779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5498003f40 msgr2=0x7f5498004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 --2- 172.21.15.83:0/2598409779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5498003f40 0x7f5498004810 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f549400c210 tx=0x7f549401f390 comp rx=0 tx=0).stop 2024-03-30T13:10:29.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54ab59e640 1 -- 172.21.15.83:0/2598409779 reap_dead start 2024-03-30T13:10:29.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 -- 172.21.15.83:0/2598409779 shutdown_connections 2024-03-30T13:10:29.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 -- 172.21.15.83:0/2598409779 >> 172.21.15.83:0/2598409779 conn(0x7f54ac072d30 msgr2=0x7f54ac0b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 -- 172.21.15.83:0/2598409779 shutdown_connections 2024-03-30T13:10:29.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 -- 172.21.15.83:0/2598409779 wait complete. 2024-03-30T13:10:29.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 Processor -- start 2024-03-30T13:10:29.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 -- start start 2024-03-30T13:10:29.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5498003f40 0x7f54ac0c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54ac09eae0 0x7f54ac1efef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54ac143100 0x7f54ac0b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac0b0970 con 0x7f5498003f40 2024-03-30T13:10:29.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac146020 con 0x7f54ac143100 2024-03-30T13:10:29.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54b1204640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac0b0af0 con 0x7f54ac09eae0 2024-03-30T13:10:29.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54aad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5498003f40 0x7f54ac0c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54aad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5498003f40 0x7f54ac0c6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38732/0 (socket says 172.21.15.83:38732) 2024-03-30T13:10:29.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54aad9d640 1 -- 172.21.15.83:0/2499357079 learned_addr learned my addr 172.21.15.83:0/2499357079 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54a3fff640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54ac09eae0 0x7f54ac1efef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54ab59e640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54ac143100 0x7f54ac0b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54aad9d640 1 -- 172.21.15.83:0/2499357079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54ac09eae0 msgr2=0x7f54ac1efef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54aad9d640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54ac09eae0 0x7f54ac1efef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54aad9d640 1 -- 172.21.15.83:0/2499357079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54ac143100 msgr2=0x7f54ac0b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54aad9d640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54ac143100 0x7f54ac0b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.845+0000 7f54aad9d640 1 -- 172.21.15.83:0/2499357079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac09efe0 con 0x7f5498003f40 2024-03-30T13:10:29.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54aad9d640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5498003f40 0x7f54ac0c6890 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f549c00e7f0 tx=0x7f549c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54a37fe640 1 -- 172.21.15.83:0/2499357079 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c017070 con 0x7f5498003f40 2024-03-30T13:10:29.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54a37fe640 1 -- 172.21.15.83:0/2499357079 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549c00c940 con 0x7f5498003f40 2024-03-30T13:10:29.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54b1204640 1 -- 172.21.15.83:0/2499357079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac09ce20 con 0x7f5498003f40 2024-03-30T13:10:29.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54a37fe640 1 -- 172.21.15.83:0/2499357079 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c00cd30 con 0x7f5498003f40 2024-03-30T13:10:29.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54b1204640 1 -- 172.21.15.83:0/2499357079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac09d3e0 con 0x7f5498003f40 2024-03-30T13:10:29.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54a37fe640 1 -- 172.21.15.83:0/2499357079 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f549c01a070 con 0x7f5498003f40 2024-03-30T13:10:29.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54a37fe640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f548c067ff0 0x7f548c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54a37fe640 1 -- 172.21.15.83:0/2499357079 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f549c0866a0 con 0x7f5498003f40 2024-03-30T13:10:29.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54a3fff640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f548c067ff0 0x7f548c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54b4386000 1 Processor -- start 2024-03-30T13:10:29.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54b4386000 1 -- start start 2024-03-30T13:10:29.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54a3fff640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f548c067ff0 0x7f548c06a4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f54940ae000 tx=0x7f5494000ff0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54b4386000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e96d70 0x55f351e97150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54b4386000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 0x55f351e4d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54b4386000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e4d830 0x55f351e4dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54b4386000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f351c9baa0 con 0x55f351e97690 2024-03-30T13:10:29.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54b4386000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f351c22af0 con 0x55f351e4d830 2024-03-30T13:10:29.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54b4386000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f351c97a50 con 0x55f351e96d70 2024-03-30T13:10:29.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.849+0000 7f54a3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 0x55f351e4d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54a3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 0x55f351e4d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38734/0 (socket says 172.21.15.83:38734) 2024-03-30T13:10:29.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54a3fff640 1 -- 172.21.15.83:0/3331890859 learned_addr learned my addr 172.21.15.83:0/3331890859 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54a3fff640 1 -- 172.21.15.83:0/3331890859 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e96d70 msgr2=0x55f351e97150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54a3fff640 1 --2- 172.21.15.83:0/3331890859 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e96d70 0x55f351e97150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54a3fff640 1 -- 172.21.15.83:0/3331890859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e4d830 msgr2=0x55f351e4dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54a3fff640 1 --2- 172.21.15.83:0/3331890859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e4d830 0x55f351e4dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54a3fff640 1 -- 172.21.15.83:0/3331890859 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f351c20d00 con 0x55f351e97690 2024-03-30T13:10:29.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54a3fff640 1 --2- 172.21.15.83:0/3331890859 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 0x55f351e4d2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f549400c300 tx=0x7f54ac09af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f10e185fe4a1a6f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54a0ff9640 1 -- 172.21.15.83:0/3331890859 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5494004bf0 con 0x55f351e97690 2024-03-30T13:10:29.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54a0ff9640 1 -- 172.21.15.83:0/3331890859 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5494004d90 con 0x55f351e97690 2024-03-30T13:10:29.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54a0ff9640 1 -- 172.21.15.83:0/3331890859 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5494007240 con 0x55f351e97690 2024-03-30T13:10:29.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 -- 172.21.15.83:0/3331890859 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 msgr2=0x55f351e4d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 --2- 172.21.15.83:0/3331890859 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 0x55f351e4d2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f549400c300 tx=0x7f54ac09af90 comp rx=0 tx=0).stop 2024-03-30T13:10:29.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 -- 172.21.15.83:0/3331890859 shutdown_connections 2024-03-30T13:10:29.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 --2- 172.21.15.83:0/3331890859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e4d830 0x55f351e4dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 --2- 172.21.15.83:0/3331890859 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 0x55f351e4d2f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 --2- 172.21.15.83:0/3331890859 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e96d70 0x55f351e97150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 -- 172.21.15.83:0/3331890859 >> 172.21.15.83:0/3331890859 conn(0x55f351e497e0 msgr2=0x55f351e4bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 -- 172.21.15.83:0/3331890859 shutdown_connections 2024-03-30T13:10:29.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 -- 172.21.15.83:0/3331890859 wait complete. 2024-03-30T13:10:29.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 -- start start 2024-03-30T13:10:29.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 Processor -- start 2024-03-30T13:10:29.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e4d830 0x55f351e52c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e96d70 0x55f351e7bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e97690 0x55f351e7c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f351c63270 con 0x55f351e4d830 2024-03-30T13:10:29.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f351c596a0 con 0x55f351e96d70 2024-03-30T13:10:29.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f351c33880 con 0x55f351e97690 2024-03-30T13:10:29.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54b4386000 10 client.0 _ll_register_callbacks cb 0x55f351e38490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:29.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.853+0000 7f54aad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e4d830 0x55f351e52c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54aad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e4d830 0x55f351e52c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38748/0 (socket says 172.21.15.83:38748) 2024-03-30T13:10:29.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54aad9d640 1 -- 172.21.15.83:0/3697370883 learned_addr learned my addr 172.21.15.83:0/3697370883 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54ab59e640 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e97690 0x55f351e7c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54a3fff640 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e96d70 0x55f351e7bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54aad9d640 1 -- 172.21.15.83:0/3697370883 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e97690 msgr2=0x55f351e7c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54aad9d640 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e97690 0x55f351e7c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54aad9d640 1 -- 172.21.15.83:0/3697370883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e96d70 msgr2=0x55f351e7bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54aad9d640 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e96d70 0x55f351e7bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54aad9d640 1 -- 172.21.15.83:0/3697370883 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f351c60730 con 0x55f351e4d830 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54aad9d640 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e4d830 0x55f351e52c40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f549c05ee90 tx=0x7f549c056ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964dfbf75a7ce1c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f5489ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f5489ffb640 1 -- 172.21.15.83:0/3697370883 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c021070 con 0x55f351e4d830 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f5489ffb640 1 -- 172.21.15.83:0/3697370883 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f549c055e30 con 0x55f351e4d830 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 -- 172.21.15.83:0/3697370883 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5494004d90 con 0x55f351e4d830 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f5489ffb640 1 -- 172.21.15.83:0/3697370883 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f549c05ab90 con 0x55f351e4d830 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 10 client.5712 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 -- 172.21.15.83:0/3697370883 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55f351c53ca0 con 0x55f351e4d830 2024-03-30T13:10:29.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f5489ffb640 1 -- 172.21.15.83:0/3697370883 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5494004d90 con 0x55f351e4d830 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f5489ffb640 1 -- 172.21.15.83:0/3697370883 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f549c057b10 con 0x55f351e4d830 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 10 client.5712 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 10 client.5712 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 20 client.5712 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f351e9e5d0 0x55f351e9e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 4 client.5712 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 -- 172.21.15.83:0/3697370883 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f351c36c90 con 0x55f351e9e5d0 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54a3fff640 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f351e9e5d0 0x55f351e9e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54a3fff640 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f351e9e5d0 0x55f351e9e9e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50ccaa5316530e78 server_cookie=1358f5f01d913cdf in_seq=0 out_seq=0 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f5489ffb640 10 client.5712 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f5489ffb640 1 -- 172.21.15.83:0/3697370883 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55f351c36c90 con 0x55f351e9e5d0 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f5489ffb640 10 client.5712 handle_command_reply: tid=0 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 client.5712 shutdown 2024-03-30T13:10:29.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 -- 172.21.15.83:0/3697370883 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e4d830 msgr2=0x55f351e52c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e4d830 0x55f351e52c40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f549c05ee90 tx=0x7f549c056ee0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 -- 172.21.15.83:0/3697370883 shutdown_connections 2024-03-30T13:10:29.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e97690 0x55f351e7c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e96d70 0x55f351e7bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f351e9e5d0 0x55f351e9e9e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 --2- 172.21.15.83:0/3697370883 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e4d830 0x55f351e52c40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f5489ffb640 0 client.5712 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 -- 172.21.15.83:0/3697370883 >> 172.21.15.83:0/3697370883 conn(0x55f351e497e0 msgr2=0x55f351e4c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 -- 172.21.15.83:0/3697370883 shutdown_connections 2024-03-30T13:10:29.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 1 -- 172.21.15.83:0/3697370883 wait complete. 2024-03-30T13:10:29.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.857+0000 7f54b4386000 20 client.5712 trim_cache size 0 max 16384 2024-03-30T13:10:29.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.869+0000 7f54b4386000 1 Processor -- start 2024-03-30T13:10:29.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- start start 2024-03-30T13:10:29.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e4d830 0x55f351e7bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e96d70 0x55f351e7c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 0x55f351e99a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1fcc00 con 0x55f351e97690 2024-03-30T13:10:29.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1fbc90 con 0x55f351e4d830 2024-03-30T13:10:29.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac09bab0 con 0x55f351e96d70 2024-03-30T13:10:29.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54ab59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 0x55f351e99a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54ab59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 0x55f351e99a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38752/0 (socket says 172.21.15.83:38752) 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54ab59e640 1 -- 172.21.15.83:0/25965135 learned_addr learned my addr 172.21.15.83:0/25965135 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54a3fff640 1 --2- 172.21.15.83:0/25965135 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e96d70 0x55f351e7c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54aad9d640 1 --2- 172.21.15.83:0/25965135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e4d830 0x55f351e7bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54ab59e640 1 -- 172.21.15.83:0/25965135 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e96d70 msgr2=0x55f351e7c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54ab59e640 1 --2- 172.21.15.83:0/25965135 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e96d70 0x55f351e7c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54ab59e640 1 -- 172.21.15.83:0/25965135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e4d830 msgr2=0x55f351e7bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54ab59e640 1 --2- 172.21.15.83:0/25965135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e4d830 0x55f351e7bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54ab59e640 1 -- 172.21.15.83:0/25965135 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f351c22d00 con 0x55f351e97690 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54aad9d640 1 --2- 172.21.15.83:0/25965135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e4d830 0x55f351e7bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54ab59e640 1 --2- 172.21.15.83:0/25965135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 0x55f351e99a80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0b6760 tx=0x7f54a4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00d4940505641fc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f548bfff640 1 -- 172.21.15.83:0/25965135 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4016610 con 0x55f351e97690 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f548bfff640 1 -- 172.21.15.83:0/25965135 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a401b070 con 0x55f351e97690 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f548bfff640 1 -- 172.21.15.83:0/25965135 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a40169d0 con 0x55f351e97690 2024-03-30T13:10:29.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- 172.21.15.83:0/25965135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 msgr2=0x55f351e99a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 --2- 172.21.15.83:0/25965135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 0x55f351e99a80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0b6760 tx=0x7f54a4004a50 comp rx=0 tx=0).stop 2024-03-30T13:10:29.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- 172.21.15.83:0/25965135 shutdown_connections 2024-03-30T13:10:29.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 --2- 172.21.15.83:0/25965135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e97690 0x55f351e99a80 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 --2- 172.21.15.83:0/25965135 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e96d70 0x55f351e7c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 --2- 172.21.15.83:0/25965135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e4d830 0x55f351e7bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- 172.21.15.83:0/25965135 >> 172.21.15.83:0/25965135 conn(0x55f351e497e0 msgr2=0x55f351eadf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- 172.21.15.83:0/25965135 shutdown_connections 2024-03-30T13:10:29.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- 172.21.15.83:0/25965135 wait complete. 2024-03-30T13:10:29.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- start start 2024-03-30T13:10:29.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 Processor -- start 2024-03-30T13:10:29.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e4d830 0x55f351f07f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e96d70 0x55f351e9aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e97690 0x55f351e9b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f351c63270 con 0x55f351e96d70 2024-03-30T13:10:29.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1fb700 con 0x55f351e97690 2024-03-30T13:10:29.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f351c9adb0 con 0x55f351e4d830 2024-03-30T13:10:29.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54b4386000 10 client.0 _ll_register_callbacks cb 0x7f549c00ef00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:29.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54a3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e96d70 0x55f351e9aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54a3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e96d70 0x55f351e9aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38754/0 (socket says 172.21.15.83:38754) 2024-03-30T13:10:29.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54a3fff640 1 -- 172.21.15.83:0/1473822095 learned_addr learned my addr 172.21.15.83:0/1473822095 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:29.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54aad9d640 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e4d830 0x55f351f07f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54ab59e640 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e97690 0x55f351e9b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54a3fff640 1 -- 172.21.15.83:0/1473822095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e4d830 msgr2=0x55f351f07f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54a3fff640 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e4d830 0x55f351f07f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54a3fff640 1 -- 172.21.15.83:0/1473822095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e97690 msgr2=0x55f351e9b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:29.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54a3fff640 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e97690 0x55f351e9b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.873+0000 7f54a3fff640 1 -- 172.21.15.83:0/1473822095 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f351d1cf70 con 0x55f351e96d70 2024-03-30T13:10:29.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54aad9d640 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e4d830 0x55f351f07f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54ab59e640 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e97690 0x55f351e9b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:29.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54a3fff640 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e96d70 0x55f351e9aad0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f549400c300 tx=0x7f549401c190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a08d56febfba54 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:29.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f5489ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f5489ffb640 1 -- 172.21.15.83:0/1473822095 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54940d5060 con 0x55f351e96d70 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f5489ffb640 1 -- 172.21.15.83:0/1473822095 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f54940c3040 con 0x55f351e96d70 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 -- 172.21.15.83:0/1473822095 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54a401b070 con 0x55f351e96d70 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f5489ffb640 1 -- 172.21.15.83:0/1473822095 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5494004d50 con 0x55f351e96d70 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 10 client.5718 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 -- 172.21.15.83:0/1473822095 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55f351c42760 con 0x55f351e96d70 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f5489ffb640 1 -- 172.21.15.83:0/1473822095 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a401b070 con 0x55f351e96d70 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f5489ffb640 1 -- 172.21.15.83:0/1473822095 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f54940cfb40 con 0x55f351e96d70 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 10 client.5718 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 10 client.5718 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 20 client.5718 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f351e9b9a0 0x55f351e9bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 4 client.5718 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628323}] 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 -- 172.21.15.83:0/1473822095 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628323}) -- 0x55f351ca8fe0 con 0x55f351e9b9a0 2024-03-30T13:10:29.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54aad9d640 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f351e9b9a0 0x55f351e9bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f5489ffb640 10 client.5718 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54aad9d640 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f351e9b9a0 0x55f351e9bdb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6667323a6a7706 server_cookie=39300a9f1d536e91 in_seq=0 out_seq=0 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f5489ffb640 1 -- 172.21.15.83:0/1473822095 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3813 (crc 0 0 0) 0x55f351ca8fe0 con 0x55f351e9b9a0 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f5489ffb640 10 client.5718 handle_command_reply: tid=0 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 client.5718 shutdown 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 -- 172.21.15.83:0/1473822095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e96d70 msgr2=0x55f351e9aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e96d70 0x55f351e9aad0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f549400c300 tx=0x7f549401c190 comp rx=0 tx=0).stop 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 -- 172.21.15.83:0/1473822095 shutdown_connections 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f351e97690 0x55f351e9b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f351e9b9a0 0x55f351e9bdb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f351e96d70 0x55f351e9aad0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 --2- 172.21.15.83:0/1473822095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f351e4d830 0x55f351f07f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f5489ffb640 0 client.5718 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 -- 172.21.15.83:0/1473822095 >> 172.21.15.83:0/1473822095 conn(0x55f351e497e0 msgr2=0x55f351eae620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 -- 172.21.15.83:0/1473822095 shutdown_connections 2024-03-30T13:10:29.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 1 -- 172.21.15.83:0/1473822095 wait complete. 2024-03-30T13:10:29.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b4386000 20 client.5718 trim_cache size 0 max 16384 2024-03-30T13:10:29.895 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:29.895 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/xattr.h", 2024-03-30T13:10:29.895 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628323, 2024-03-30T13:10:29.895 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:29.895 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.128653+0000", 2024-03-30T13:10:29.895 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.091687+0000", 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:29.896 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 3340, 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.091687+0000", 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:29.897 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 3340, 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:29.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.128653+0000" 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 3340, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.128653+0000" 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 92, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 32, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:29.899 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:29.901 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.902 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.903 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:29.904 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:29.906 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:29.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b1204640 1 -- 172.21.15.83:0/2499357079 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f548c067ff0 msgr2=0x7f548c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b1204640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f548c067ff0 0x7f548c06a4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f54940ae000 tx=0x7f5494000ff0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b1204640 1 -- 172.21.15.83:0/2499357079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5498003f40 msgr2=0x7f54ac0c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b1204640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5498003f40 0x7f54ac0c6890 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f549c00e7f0 tx=0x7f549c00ecb0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b1204640 1 -- 172.21.15.83:0/2499357079 shutdown_connections 2024-03-30T13:10:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b1204640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f548c067ff0 0x7f548c06a4b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b1204640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54ac143100 0x7f54ac0b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b1204640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54ac09eae0 0x7f54ac1efef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b1204640 1 --2- 172.21.15.83:0/2499357079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5498003f40 0x7f54ac0c6890 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b1204640 1 -- 172.21.15.83:0/2499357079 >> 172.21.15.83:0/2499357079 conn(0x7f54ac072d30 msgr2=0x7f54ac06fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b1204640 1 -- 172.21.15.83:0/2499357079 shutdown_connections 2024-03-30T13:10:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:29.877+0000 7f54b1204640 1 -- 172.21.15.83:0/2499357079 wait complete. 2024-03-30T13:10:29.912 DEBUG:tasks.cephfs.test_uninlining:getting inode info #14 of 23:1099511628328 2024-03-30T13:10:29.912 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628328 2024-03-30T13:10:29.912 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628328 2024-03-30T13:10:30.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a56189640 1 Processor -- start 2024-03-30T13:10:30.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a56189640 1 -- start start 2024-03-30T13:10:30.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a56189640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a500d31e0 0x7f3a500d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a56189640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a500d51f0 con 0x7f3a500d1370 2024-03-30T13:10:30.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a56189640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a500d2140 con 0x7f3a5015e840 2024-03-30T13:10:30.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a56189640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5015ec20 con 0x7f3a500d31e0 2024-03-30T13:10:30.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a4ffff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3a500d1370 0x7f3a5006c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36456/0 (socket says 172.21.15.83:36456) 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a4ffff640 1 -- 172.21.15.83:0/3020800409 learned_addr learned my addr 172.21.15.83:0/3020800409 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a4effd640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a500d31e0 0x7f3a500d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694769913 0 0) 0x7f3a40001120 con 0x7f3a500d1370 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a3c003530 con 0x7f3a500d1370 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2566440420 0 0) 0x7f3a3c003530 con 0x7f3a500d1370 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a500d31e0 msgr2=0x7f3a500d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a4e7fc640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a500d31e0 0x7f3a500d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 >> v1:172.21.15.153:6789/0 conn(0x7f3a5015e840 legacy=0x7f3a500cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a500d2420 con 0x7f3a500d1370 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f3a40001850 con 0x7f3a500d1370 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.009+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 >> v1:172.21.15.83:6789/0 conn(0x7f3a500d1370 legacy=0x7f3a5006c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4e7fc640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a3c0039f0 0x7f3a3c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4e7fc640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3c004810 0x7f3a3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4e7fc640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a500d31e0 0x7f3a3c005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c00bb60 con 0x7f3a3c0039f0 2024-03-30T13:10:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c00bce0 con 0x7f3a3c004810 2024-03-30T13:10:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3c00bee0 con 0x7f3a500d31e0 2024-03-30T13:10:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a3c0039f0 0x7f3a3c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4ffff640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a500d31e0 0x7f3a3c005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4effd640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3c004810 0x7f3a3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4f7fe640 1 -- 172.21.15.83:0/3020800409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a500d31e0 msgr2=0x7f3a3c005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a500d31e0 0x7f3a3c005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4f7fe640 1 -- 172.21.15.83:0/3020800409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3c004810 msgr2=0x7f3a3c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a3c004810 0x7f3a3c004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4f7fe640 1 -- 172.21.15.83:0/3020800409 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c003530 con 0x7f3a3c0039f0 2024-03-30T13:10:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4ffff640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a500d31e0 0x7f3a3c005280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a3c0039f0 0x7f3a3c003e10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3a48001e70 tx=0x7f3a4801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9543c31fd2722be7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a480af070 con 0x7f3a3c0039f0 2024-03-30T13:10:30.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a48003b80 con 0x7f3a3c0039f0 2024-03-30T13:10:30.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4e7fc640 1 -- 172.21.15.83:0/3020800409 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48001a90 con 0x7f3a3c0039f0 2024-03-30T13:10:30.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a56189640 1 -- 172.21.15.83:0/3020800409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a3c0039f0 msgr2=0x7f3a3c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a56189640 1 --2- 172.21.15.83:0/3020800409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a3c0039f0 0x7f3a3c003e10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3a48001e70 tx=0x7f3a4801c780 comp rx=0 tx=0).stop 2024-03-30T13:10:30.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a4ffff640 1 -- 172.21.15.83:0/3020800409 reap_dead start 2024-03-30T13:10:30.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a56189640 1 -- 172.21.15.83:0/3020800409 shutdown_connections 2024-03-30T13:10:30.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a56189640 1 -- 172.21.15.83:0/3020800409 >> 172.21.15.83:0/3020800409 conn(0x7f3a5009d7f0 msgr2=0x7f3a500d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a56189640 1 -- 172.21.15.83:0/3020800409 shutdown_connections 2024-03-30T13:10:30.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.013+0000 7f3a56189640 1 -- 172.21.15.83:0/3020800409 wait complete. 2024-03-30T13:10:30.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a56189640 1 Processor -- start 2024-03-30T13:10:30.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a56189640 1 -- start start 2024-03-30T13:10:30.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a56189640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a3c0039f0 0x7f3a500cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a56189640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a50158c90 0x7f3a50159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a56189640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a50162ce0 0x7f3a50163160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a56189640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3a500d17a0 con 0x7f3a50162ce0 2024-03-30T13:10:30.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a56189640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a500d2d50 con 0x7f3a50158c90 2024-03-30T13:10:30.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a56189640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5016a5f0 con 0x7f3a3c0039f0 2024-03-30T13:10:30.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a4ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a50162ce0 0x7f3a50163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a4ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a50162ce0 0x7f3a50163160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38758/0 (socket says 172.21.15.83:38758) 2024-03-30T13:10:30.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a4ffff640 1 -- 172.21.15.83:0/2281738279 learned_addr learned my addr 172.21.15.83:0/2281738279 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a3c0039f0 0x7f3a500cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a4effd640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a50158c90 0x7f3a50159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a4ffff640 1 -- 172.21.15.83:0/2281738279 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a3c0039f0 msgr2=0x7f3a500cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a4ffff640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a3c0039f0 0x7f3a500cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a4ffff640 1 -- 172.21.15.83:0/2281738279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a50158c90 msgr2=0x7f3a50159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a4ffff640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a50158c90 0x7f3a50159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a4ffff640 1 -- 172.21.15.83:0/2281738279 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a501636a0 con 0x7f3a50162ce0 2024-03-30T13:10:30.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a4ffff640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a50162ce0 0x7f3a50163160 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3a500d4380 tx=0x7f3a4000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a47fff640 1 -- 172.21.15.83:0/2281738279 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a400074e0 con 0x7f3a50162ce0 2024-03-30T13:10:30.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a47fff640 1 -- 172.21.15.83:0/2281738279 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a400047f0 con 0x7f3a50162ce0 2024-03-30T13:10:30.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a56189640 1 -- 172.21.15.83:0/2281738279 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a500ccb80 con 0x7f3a50162ce0 2024-03-30T13:10:30.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a47fff640 1 -- 172.21.15.83:0/2281738279 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40007680 con 0x7f3a50162ce0 2024-03-30T13:10:30.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a56189640 1 -- 172.21.15.83:0/2281738279 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a500cd140 con 0x7f3a50162ce0 2024-03-30T13:10:30.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a47fff640 1 -- 172.21.15.83:0/2281738279 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f3a4001b020 con 0x7f3a50162ce0 2024-03-30T13:10:30.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.017+0000 7f3a47fff640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3a30067ff0 0x7f3a3006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a47fff640 1 -- 172.21.15.83:0/2281738279 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3a40085fa0 con 0x7f3a50162ce0 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3a30067ff0 0x7f3a3006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3a30067ff0 0x7f3a3006a4b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3a48001e70 tx=0x7f3a48001520 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 Processor -- start 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 -- start start 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8bad150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 0x55efc8b632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8b63830 0x55efc8b63c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55efc89b1aa0 con 0x55efc8bacd70 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55efc8938af0 con 0x55efc8b63830 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55efc89ada50 con 0x55efc8bad690 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8bad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8bad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38772/0 (socket says 172.21.15.83:38772) 2024-03-30T13:10:30.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4f7fe640 1 -- 172.21.15.83:0/2218946867 learned_addr learned my addr 172.21.15.83:0/2218946867 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4ffff640 1 --2- 172.21.15.83:0/2218946867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8b63830 0x55efc8b63c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4f7fe640 1 -- 172.21.15.83:0/2218946867 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 msgr2=0x55efc8b632f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/2218946867 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 0x55efc8b632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4f7fe640 1 -- 172.21.15.83:0/2218946867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8b63830 msgr2=0x55efc8b63c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/2218946867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8b63830 0x55efc8b63c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4f7fe640 1 -- 172.21.15.83:0/2218946867 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc8936d00 con 0x55efc8bacd70 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4ffff640 1 --2- 172.21.15.83:0/2218946867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8b63830 0x55efc8b63c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/2218946867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8bad150 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3a4801c7c0 tx=0x7f3a480014b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a07fb6cbc0ffc4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a457fa640 1 -- 172.21.15.83:0/2218946867 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a480c3070 con 0x55efc8bacd70 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a457fa640 1 -- 172.21.15.83:0/2218946867 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a480b0040 con 0x55efc8bacd70 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a457fa640 1 -- 172.21.15.83:0/2218946867 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a480b9040 con 0x55efc8bacd70 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 -- 172.21.15.83:0/2218946867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 msgr2=0x55efc8bad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 --2- 172.21.15.83:0/2218946867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8bad150 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3a4801c7c0 tx=0x7f3a480014b0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 -- 172.21.15.83:0/2218946867 shutdown_connections 2024-03-30T13:10:30.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 --2- 172.21.15.83:0/2218946867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8b63830 0x55efc8b63c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 --2- 172.21.15.83:0/2218946867 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 0x55efc8b632f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 --2- 172.21.15.83:0/2218946867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8bad150 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 -- 172.21.15.83:0/2218946867 >> 172.21.15.83:0/2218946867 conn(0x55efc8b5f7e0 msgr2=0x55efc8b61bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 -- 172.21.15.83:0/2218946867 shutdown_connections 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 -- 172.21.15.83:0/2218946867 wait complete. 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 -- start start 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.021+0000 7f3a5930b000 1 Processor -- start 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8b63830 0x55efc8b68c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8b91da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 0x55efc8b922e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55efc8979270 con 0x55efc8bacd70 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55efc896f6a0 con 0x55efc8b63830 2024-03-30T13:10:30.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55efc8949880 con 0x55efc8bad690 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 10 client.0 _ll_register_callbacks cb 0x55efc8b4e490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8b91da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8b91da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38784/0 (socket says 172.21.15.83:38784) 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4effd640 1 -- 172.21.15.83:0/1754797634 learned_addr learned my addr 172.21.15.83:0/1754797634 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8b63830 0x55efc8b68c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4ffff640 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 0x55efc8b922e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4effd640 1 -- 172.21.15.83:0/1754797634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 msgr2=0x55efc8b922e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4effd640 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 0x55efc8b922e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4effd640 1 -- 172.21.15.83:0/1754797634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8b63830 msgr2=0x55efc8b68c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4effd640 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8b63830 0x55efc8b68c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4effd640 1 -- 172.21.15.83:0/1754797634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efc8976730 con 0x55efc8bacd70 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4ffff640 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 0x55efc8b922e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4effd640 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8b91da0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009160 tx=0x7f3a38012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6bba5be7811c0e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a2e7fc640 1 -- 172.21.15.83:0/1754797634 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38019070 con 0x55efc8bacd70 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a2e7fc640 1 -- 172.21.15.83:0/1754797634 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3a38004230 con 0x55efc8bacd70 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 -- 172.21.15.83:0/1754797634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a480b0040 con 0x55efc8bacd70 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a2e7fc640 1 -- 172.21.15.83:0/1754797634 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3a3800f040 con 0x55efc8bacd70 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 10 client.5730 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 -- 172.21.15.83:0/1754797634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55efc8969ca0 con 0x55efc8bacd70 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a2e7fc640 1 -- 172.21.15.83:0/1754797634 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a480b0040 con 0x55efc8bacd70 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a2e7fc640 1 -- 172.21.15.83:0/1754797634 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f3a380059a0 con 0x55efc8bacd70 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 10 client.5730 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 10 client.5730 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 20 client.5730 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55efc8bb45d0 0x55efc8bb49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 4 client.5730 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:30.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 -- 172.21.15.83:0/1754797634 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efc894cc90 con 0x55efc8bb45d0 2024-03-30T13:10:30.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55efc8bb45d0 0x55efc8bb49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a2e7fc640 10 client.5730 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55efc8bb45d0 0x55efc8bb49b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ea733a3cbc43747 server_cookie=f4ce6fe666f31960 in_seq=0 out_seq=0 2024-03-30T13:10:30.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a2e7fc640 1 -- 172.21.15.83:0/1754797634 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55efc894cc90 con 0x55efc8bb45d0 2024-03-30T13:10:30.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a2e7fc640 10 client.5730 handle_command_reply: tid=0 2024-03-30T13:10:30.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 client.5730 shutdown 2024-03-30T13:10:30.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 -- 172.21.15.83:0/1754797634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 msgr2=0x55efc8b91da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8b91da0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009160 tx=0x7f3a38012980 comp rx=0 tx=0).stop 2024-03-30T13:10:30.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 -- 172.21.15.83:0/1754797634 shutdown_connections 2024-03-30T13:10:30.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 0x55efc8b922e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55efc8bb45d0 0x55efc8bb49b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8b91da0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a2e7fc640 0 client.5730 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 --2- 172.21.15.83:0/1754797634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8b63830 0x55efc8b68c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 -- 172.21.15.83:0/1754797634 >> 172.21.15.83:0/1754797634 conn(0x55efc8b5f7e0 msgr2=0x55efc8b62460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 -- 172.21.15.83:0/1754797634 shutdown_connections 2024-03-30T13:10:30.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 1 -- 172.21.15.83:0/1754797634 wait complete. 2024-03-30T13:10:30.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.025+0000 7f3a5930b000 20 client.5730 trim_cache size 0 max 16384 2024-03-30T13:10:30.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 Processor -- start 2024-03-30T13:10:30.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 -- start start 2024-03-30T13:10:30.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8b63830 0x55efc8b92180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8bafa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8bad690 0x55efc8baffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3a50204720 con 0x55efc8bacd70 2024-03-30T13:10:30.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a50203790 con 0x55efc8bad690 2024-03-30T13:10:30.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3a50156bb0 con 0x55efc8b63830 2024-03-30T13:10:30.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a4effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8bafa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a4effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8bafa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38794/0 (socket says 172.21.15.83:38794) 2024-03-30T13:10:30.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a4effd640 1 -- 172.21.15.83:0/674295799 learned_addr learned my addr 172.21.15.83:0/674295799 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a4ffff640 1 --2- 172.21.15.83:0/674295799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8bad690 0x55efc8baffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/674295799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8b63830 0x55efc8b92180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a4effd640 1 -- 172.21.15.83:0/674295799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8b63830 msgr2=0x55efc8b92180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a4effd640 1 --2- 172.21.15.83:0/674295799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8b63830 0x55efc8b92180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a4effd640 1 -- 172.21.15.83:0/674295799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8bad690 msgr2=0x55efc8baffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a4effd640 1 --2- 172.21.15.83:0/674295799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8bad690 0x55efc8baffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a4effd640 1 -- 172.21.15.83:0/674295799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc8938d00 con 0x55efc8bacd70 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a4ffff640 1 --2- 172.21.15.83:0/674295799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8bad690 0x55efc8baffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a4effd640 1 --2- 172.21.15.83:0/674295799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8bafa80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009390 tx=0x7f3a38010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901380d320919552 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a44ff9640 1 -- 172.21.15.83:0/674295799 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38019050 con 0x55efc8bacd70 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a44ff9640 1 -- 172.21.15.83:0/674295799 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a38000e50 con 0x55efc8bacd70 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a44ff9640 1 -- 172.21.15.83:0/674295799 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38005b20 con 0x55efc8bacd70 2024-03-30T13:10:30.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 -- 172.21.15.83:0/674295799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 msgr2=0x55efc8bafa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 --2- 172.21.15.83:0/674295799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8bafa80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009390 tx=0x7f3a38010000 comp rx=0 tx=0).stop 2024-03-30T13:10:30.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 -- 172.21.15.83:0/674295799 shutdown_connections 2024-03-30T13:10:30.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 --2- 172.21.15.83:0/674295799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8bad690 0x55efc8baffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 --2- 172.21.15.83:0/674295799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8bacd70 0x55efc8bafa80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 --2- 172.21.15.83:0/674295799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8b63830 0x55efc8b92180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 -- 172.21.15.83:0/674295799 >> 172.21.15.83:0/674295799 conn(0x55efc8b5f7e0 msgr2=0x55efc8bc3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 -- 172.21.15.83:0/674295799 shutdown_connections 2024-03-30T13:10:30.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.041+0000 7f3a5930b000 1 -- 172.21.15.83:0/674295799 wait complete. 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 -- start start 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 Processor -- start 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8b63830 0x55efc8c1f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8bacd70 0x55efc8c1f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 0x55efc8bb0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55efc89b0db0 con 0x55efc8b63830 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a50203300 con 0x55efc8bacd70 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55efc8a6db00 con 0x55efc8bad690 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 10 client.0 _ll_register_callbacks cb 0x7f3a38006c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8b63830 0x55efc8c1f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8b63830 0x55efc8c1f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38810/0 (socket says 172.21.15.83:38810) 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4f7fe640 1 -- 172.21.15.83:0/1071796432 learned_addr learned my addr 172.21.15.83:0/1071796432 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4effd640 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8bacd70 0x55efc8c1f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4f7fe640 1 -- 172.21.15.83:0/1071796432 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 msgr2=0x55efc8bb0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 0x55efc8bb0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4f7fe640 1 -- 172.21.15.83:0/1071796432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8bacd70 msgr2=0x55efc8c1f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8bacd70 0x55efc8c1f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4f7fe640 1 -- 172.21.15.83:0/1071796432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efc8a32f70 con 0x55efc8b63830 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4effd640 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8bacd70 0x55efc8c1f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4f7fe640 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8b63830 0x55efc8c1f0d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3a4801cc60 tx=0x7f3a48019520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc634cd345339b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a2e7fc640 1 -- 172.21.15.83:0/1071796432 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a480cf060 con 0x55efc8b63830 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a2e7fc640 1 -- 172.21.15.83:0/1071796432 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3a480ca230 con 0x55efc8b63830 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 -- 172.21.15.83:0/1071796432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a38000e50 con 0x55efc8b63830 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a2e7fc640 1 -- 172.21.15.83:0/1071796432 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3a480d5050 con 0x55efc8b63830 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 10 client.5736 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 -- 172.21.15.83:0/1071796432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55efc8958760 con 0x55efc8b63830 2024-03-30T13:10:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a2e7fc640 1 -- 172.21.15.83:0/1071796432 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a38000e50 con 0x55efc8b63830 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a2e7fc640 1 -- 172.21.15.83:0/1071796432 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f3a480d8020 con 0x55efc8b63830 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 10 client.5736 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 10 client.5736 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 20 client.5736 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55efc8bb13a0 0x55efc8bb17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 4 client.5736 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628328}] 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 -- 172.21.15.83:0/1071796432 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628328}) -- 0x55efc89befe0 con 0x55efc8bb13a0 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4effd640 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55efc8bb13a0 0x55efc8bb17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a2e7fc640 10 client.5736 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a4effd640 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55efc8bb13a0 0x55efc8bb17b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e35b90579421cb server_cookie=f0dd8caf7f0c426f in_seq=0 out_seq=0 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a2e7fc640 1 -- 172.21.15.83:0/1071796432 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3813 (crc 0 0 0) 0x55efc89befe0 con 0x55efc8bb13a0 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a2e7fc640 10 client.5736 handle_command_reply: tid=0 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 client.5736 shutdown 2024-03-30T13:10:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 -- 172.21.15.83:0/1071796432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8b63830 msgr2=0x55efc8c1f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8b63830 0x55efc8c1f0d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3a4801cc60 tx=0x7f3a48019520 comp rx=0 tx=0).stop 2024-03-30T13:10:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 -- 172.21.15.83:0/1071796432 shutdown_connections 2024-03-30T13:10:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55efc8bad690 0x55efc8bb0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55efc8bacd70 0x55efc8c1f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55efc8bb13a0 0x55efc8bb17b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 --2- 172.21.15.83:0/1071796432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55efc8b63830 0x55efc8c1f0d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 -- 172.21.15.83:0/1071796432 >> 172.21.15.83:0/1071796432 conn(0x55efc8b5f7e0 msgr2=0x55efc8bc4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a2e7fc640 0 client.5736 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 -- 172.21.15.83:0/1071796432 shutdown_connections 2024-03-30T13:10:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 1 -- 172.21.15.83:0/1071796432 wait complete. 2024-03-30T13:10:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.045+0000 7f3a5930b000 20 client.5736 trim_cache size 0 max 16384 2024-03-30T13:10:30.060 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:30.060 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/Kconfig", 2024-03-30T13:10:30.060 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628328, 2024-03-30T13:10:30.060 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:30.060 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.131184+0000", 2024-03-30T13:10:30.060 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.221084+0000", 2024-03-30T13:10:30.060 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:30.060 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:30.060 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:30.060 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:30.060 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:30.060 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:30.061 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:30.061 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:30.061 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:30.061 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.061 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:30.061 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:30.061 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:30.061 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:30.061 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 228, 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.221084+0000", 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:30.062 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 228, 2024-03-30T13:10:30.063 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.131184+0000" 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 228, 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.131184+0000" 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 84, 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:30.064 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 2, 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:30.065 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.066 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:30.067 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:30.068 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.068 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:30.068 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:30.068 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.068 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.068 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:30.068 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.068 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.068 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.068 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.069 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.070 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:30.071 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:30.072 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:30.072 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:30.072 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.072 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:30.072 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:30.072 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:30.072 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:30.072 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:30.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.049+0000 7f3a56189640 1 -- 172.21.15.83:0/2281738279 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3a30067ff0 msgr2=0x7f3a3006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.049+0000 7f3a56189640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3a30067ff0 0x7f3a3006a4b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3a48001e70 tx=0x7f3a48001520 comp rx=0 tx=0).stop 2024-03-30T13:10:30.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.049+0000 7f3a56189640 1 -- 172.21.15.83:0/2281738279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a50162ce0 msgr2=0x7f3a50163160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.049+0000 7f3a56189640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a50162ce0 0x7f3a50163160 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3a500d4380 tx=0x7f3a4000d9d0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.049+0000 7f3a56189640 1 -- 172.21.15.83:0/2281738279 shutdown_connections 2024-03-30T13:10:30.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.049+0000 7f3a56189640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3a30067ff0 0x7f3a3006a4b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.049+0000 7f3a56189640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a50162ce0 0x7f3a50163160 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.049+0000 7f3a56189640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a50158c90 0x7f3a50159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.049+0000 7f3a56189640 1 --2- 172.21.15.83:0/2281738279 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a3c0039f0 0x7f3a500cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.049+0000 7f3a56189640 1 -- 172.21.15.83:0/2281738279 >> 172.21.15.83:0/2281738279 conn(0x7f3a5009d7f0 msgr2=0x7f3a50168fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.049+0000 7f3a56189640 1 -- 172.21.15.83:0/2281738279 shutdown_connections 2024-03-30T13:10:30.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.049+0000 7f3a56189640 1 -- 172.21.15.83:0/2281738279 wait complete. 2024-03-30T13:10:30.075 DEBUG:tasks.cephfs.test_uninlining:getting inode info #15 of 23:1099511628341 2024-03-30T13:10:30.075 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628341 2024-03-30T13:10:30.075 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628341 2024-03-30T13:10:30.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b875b6640 1 Processor -- start 2024-03-30T13:10:30.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b875b6640 1 -- start start 2024-03-30T13:10:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b875b6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b8006f8e0 0x7f8b800ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b875b6640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8b80162e20 0x7f8b80162210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b875b6640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b800aec80 con 0x7f8b8006fcc0 2024-03-30T13:10:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b875b6640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f8b800af5d0 con 0x7f8b80162e20 2024-03-30T13:10:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b875b6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8b800af870 con 0x7f8b8006f8e0 2024-03-30T13:10:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b84b51640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8b80162e20 0x7f8b80162210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b84b51640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8b80162e20 0x7f8b80162210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38816/0 (socket says 172.21.15.83:38816) 2024-03-30T13:10:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b84b51640 1 -- 172.21.15.83:0/3170414368 learned_addr learned my addr 172.21.15.83:0/3170414368 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b85352640 1 --2- 172.21.15.83:0/3170414368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b8006f8e0 0x7f8b800ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b84b51640 1 -- 172.21.15.83:0/3170414368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b8006f8e0 msgr2=0x7f8b800ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b84b51640 1 --2- 172.21.15.83:0/3170414368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b8006f8e0 0x7f8b800ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b84b51640 1 -- 172.21.15.83:0/3170414368 >> v1:172.21.15.153:6789/0 conn(0x7f8b8006fcc0 legacy=0x7f8b8015ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.169+0000 7f8b84b51640 1 -- 172.21.15.83:0/3170414368 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b800afb50 con 0x7f8b80162e20 2024-03-30T13:10:30.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.173+0000 7f8b84b51640 1 --2- 172.21.15.83:0/3170414368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b80162e20 0x7f8b80162210 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009870 tx=0x7f8b7c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eeea6d7905f3102 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.173+0000 7f8b77fff640 1 -- 172.21.15.83:0/3170414368 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0b1070 con 0x7f8b80162e20 2024-03-30T13:10:30.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.173+0000 7f8b77fff640 1 -- 172.21.15.83:0/3170414368 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c0ac620 con 0x7f8b80162e20 2024-03-30T13:10:30.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.173+0000 7f8b77fff640 1 -- 172.21.15.83:0/3170414368 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0ac9f0 con 0x7f8b80162e20 2024-03-30T13:10:30.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.173+0000 7f8b875b6640 1 -- 172.21.15.83:0/3170414368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b80162e20 msgr2=0x7f8b80162210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.173+0000 7f8b875b6640 1 --2- 172.21.15.83:0/3170414368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b80162e20 0x7f8b80162210 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009870 tx=0x7f8b7c01c4d0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.173+0000 7f8b875b6640 1 -- 172.21.15.83:0/3170414368 shutdown_connections 2024-03-30T13:10:30.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.173+0000 7f8b875b6640 1 --2- 172.21.15.83:0/3170414368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b80162e20 0x7f8b80162210 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.173+0000 7f8b875b6640 1 --2- 172.21.15.83:0/3170414368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b8006f8e0 0x7f8b800ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.173+0000 7f8b875b6640 1 -- 172.21.15.83:0/3170414368 >> 172.21.15.83:0/3170414368 conn(0x7f8b80072f00 msgr2=0x7f8b8006b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.173+0000 7f8b875b6640 1 -- 172.21.15.83:0/3170414368 shutdown_connections 2024-03-30T13:10:30.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.173+0000 7f8b875b6640 1 -- 172.21.15.83:0/3170414368 wait complete. 2024-03-30T13:10:30.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b875b6640 1 Processor -- start 2024-03-30T13:10:30.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b875b6640 1 -- start start 2024-03-30T13:10:30.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b875b6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b8006f8e0 0x7f8b80148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b875b6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b8006fcc0 0x7f8b80154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b875b6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b80162e20 0x7f8b8014beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b875b6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8016b7c0 con 0x7f8b80162e20 2024-03-30T13:10:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b875b6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80162b60 con 0x7f8b8006f8e0 2024-03-30T13:10:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b875b6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8016b940 con 0x7f8b8006fcc0 2024-03-30T13:10:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b85b53640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b80162e20 0x7f8b8014beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b85b53640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b80162e20 0x7f8b8014beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38832/0 (socket says 172.21.15.83:38832) 2024-03-30T13:10:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b85b53640 1 -- 172.21.15.83:0/3153256375 learned_addr learned my addr 172.21.15.83:0/3153256375 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b85352640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b8006f8e0 0x7f8b80148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b85b53640 1 -- 172.21.15.83:0/3153256375 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b8006fcc0 msgr2=0x7f8b80154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b84b51640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b8006fcc0 0x7f8b80154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b85b53640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b8006fcc0 0x7f8b80154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b85b53640 1 -- 172.21.15.83:0/3153256375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b8006f8e0 msgr2=0x7f8b80148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b85b53640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b8006f8e0 0x7f8b80148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b85b53640 1 -- 172.21.15.83:0/3153256375 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b80154d90 con 0x7f8b80162e20 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b85352640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b8006f8e0 0x7f8b80148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b85b53640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b80162e20 0x7f8b8014beb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800c770 tx=0x7f8b7800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b75ffb640 1 -- 172.21.15.83:0/3153256375 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78003b80 con 0x7f8b80162e20 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b75ffb640 1 -- 172.21.15.83:0/3153256375 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b78003d20 con 0x7f8b80162e20 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b875b6640 1 -- 172.21.15.83:0/3153256375 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b80155070 con 0x7f8b80162e20 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b75ffb640 1 -- 172.21.15.83:0/3153256375 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7800aa90 con 0x7f8b80162e20 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b875b6640 1 -- 172.21.15.83:0/3153256375 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b8014d1c0 con 0x7f8b80162e20 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b75ffb640 1 -- 172.21.15.83:0/3153256375 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f8b7800ac30 con 0x7f8b80162e20 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b75ffb640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8b64067ff0 0x7f8b6406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b75ffb640 1 -- 172.21.15.83:0/3153256375 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8b780863b0 con 0x7f8b80162e20 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.177+0000 7f8b85352640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8b64067ff0 0x7f8b6406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b85352640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8b64067ff0 0x7f8b6406a4b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8b700097a0 tx=0x7f8b70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 Processor -- start 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- start start 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c7d70 0x55b86f0c8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c8690 0x55b86f07e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 0x55b86f07ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b86eeccaa0 con 0x55b86f0c8690 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b86ee53af0 con 0x55b86f0c7d70 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b86eec8a50 con 0x55b86f07e830 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b84b51640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c8690 0x55b86f07e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b84b51640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c8690 0x55b86f07e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38844/0 (socket says 172.21.15.83:38844) 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b84b51640 1 -- 172.21.15.83:0/3087809401 learned_addr learned my addr 172.21.15.83:0/3087809401 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b84b51640 1 -- 172.21.15.83:0/3087809401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 msgr2=0x55b86f07ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b84b51640 1 --2- 172.21.15.83:0/3087809401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 0x55b86f07ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b84b51640 1 -- 172.21.15.83:0/3087809401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c7d70 msgr2=0x55b86f0c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b84b51640 1 --2- 172.21.15.83:0/3087809401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c7d70 0x55b86f0c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b84b51640 1 -- 172.21.15.83:0/3087809401 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86ee51d00 con 0x55b86f0c8690 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b84b51640 1 --2- 172.21.15.83:0/3087809401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c8690 0x55b86f07e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c01a100 tx=0x7f8b7c0a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe580bc693b849c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b6affd640 1 -- 172.21.15.83:0/3087809401 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0b1040 con 0x55b86f0c8690 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b6affd640 1 -- 172.21.15.83:0/3087809401 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c0ac560 con 0x55b86f0c8690 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b6affd640 1 -- 172.21.15.83:0/3087809401 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0ac950 con 0x55b86f0c8690 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- 172.21.15.83:0/3087809401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c8690 msgr2=0x55b86f07e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 --2- 172.21.15.83:0/3087809401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c8690 0x55b86f07e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c01a100 tx=0x7f8b7c0a7000 comp rx=0 tx=0).stop 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- 172.21.15.83:0/3087809401 shutdown_connections 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 --2- 172.21.15.83:0/3087809401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 0x55b86f07ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 --2- 172.21.15.83:0/3087809401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c8690 0x55b86f07e2f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 --2- 172.21.15.83:0/3087809401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c7d70 0x55b86f0c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- 172.21.15.83:0/3087809401 >> 172.21.15.83:0/3087809401 conn(0x55b86f07a7e0 msgr2=0x55b86f07cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- 172.21.15.83:0/3087809401 shutdown_connections 2024-03-30T13:10:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- 172.21.15.83:0/3087809401 wait complete. 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- start start 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 Processor -- start 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f07e830 0x55b86f083c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f0acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f0c8690 0x55b86f0ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b86ee94270 con 0x55b86f0c7d70 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b86ee8a6a0 con 0x55b86f07e830 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b86ee64880 con 0x55b86f0c8690 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.181+0000 7f8b8a738000 10 client.0 _ll_register_callbacks cb 0x55b86f069490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b84b51640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f0acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b84b51640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f0acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38854/0 (socket says 172.21.15.83:38854) 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b84b51640 1 -- 172.21.15.83:0/2351550606 learned_addr learned my addr 172.21.15.83:0/2351550606 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b85352640 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f07e830 0x55b86f083c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b85b53640 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f0c8690 0x55b86f0ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b84b51640 1 -- 172.21.15.83:0/2351550606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f0c8690 msgr2=0x55b86f0ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b84b51640 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f0c8690 0x55b86f0ad2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b84b51640 1 -- 172.21.15.83:0/2351550606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f07e830 msgr2=0x55b86f083c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b84b51640 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f07e830 0x55b86f083c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b84b51640 1 -- 172.21.15.83:0/2351550606 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b86ee91730 con 0x55b86f0c7d70 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b85352640 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f07e830 0x55b86f083c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b84b51640 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f0acda0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0190e0 tx=0x7f8b7c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7ea98e6162b8b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b5ffff640 1 -- 172.21.15.83:0/2351550606 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0b1040 con 0x55b86f0c7d70 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b5ffff640 1 -- 172.21.15.83:0/2351550606 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8b7c0c1b20 con 0x55b86f0c7d70 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 -- 172.21.15.83:0/2351550606 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b7c0ac560 con 0x55b86f0c7d70 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b5ffff640 1 -- 172.21.15.83:0/2351550606 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8b7c0c1d20 con 0x55b86f0c7d70 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 10 client.5748 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 -- 172.21.15.83:0/2351550606 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55b86ee84ca0 con 0x55b86f0c7d70 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b5ffff640 1 -- 172.21.15.83:0/2351550606 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c0ac560 con 0x55b86f0c7d70 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b5ffff640 1 -- 172.21.15.83:0/2351550606 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f8b7c0b4030 con 0x55b86f0c7d70 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 10 client.5748 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 10 client.5748 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 20 client.5748 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b86f0cf5d0 0x55b86f0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 4 client.5748 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 -- 172.21.15.83:0/2351550606 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b86ee67c90 con 0x55b86f0cf5d0 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b85352640 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b86f0cf5d0 0x55b86f0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b5ffff640 10 client.5748 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b85352640 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b86f0cf5d0 0x55b86f0cf9b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52e7fe6c2e422adb server_cookie=31b8acf5dfe49769 in_seq=0 out_seq=0 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b5ffff640 1 -- 172.21.15.83:0/2351550606 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b86ee67c90 con 0x55b86f0cf5d0 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b5ffff640 10 client.5748 handle_command_reply: tid=0 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 client.5748 shutdown 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 -- 172.21.15.83:0/2351550606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 msgr2=0x55b86f0acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f0acda0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0190e0 tx=0x7f8b7c01ad10 comp rx=0 tx=0).stop 2024-03-30T13:10:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 -- 172.21.15.83:0/2351550606 shutdown_connections 2024-03-30T13:10:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f0c8690 0x55b86f0ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b86f0cf5d0 0x55b86f0cf9b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f0acda0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 --2- 172.21.15.83:0/2351550606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f07e830 0x55b86f083c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b5ffff640 0 client.5748 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 -- 172.21.15.83:0/2351550606 >> 172.21.15.83:0/2351550606 conn(0x55b86f07a7e0 msgr2=0x55b86f07d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 -- 172.21.15.83:0/2351550606 shutdown_connections 2024-03-30T13:10:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 1 -- 172.21.15.83:0/2351550606 wait complete. 2024-03-30T13:10:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.185+0000 7f8b8a738000 20 client.5748 trim_cache size 0 max 16384 2024-03-30T13:10:30.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 Processor -- start 2024-03-30T13:10:30.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- start start 2024-03-30T13:10:30.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 0x55b86f0ad180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f07cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c8690 0x55b86f07d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80204100 con 0x55b86f0c7d70 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80203120 con 0x55b86f0c8690 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8b802024b0 con 0x55b86f07e830 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b84b51640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f07cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b84b51640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f07cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38870/0 (socket says 172.21.15.83:38870) 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b84b51640 1 -- 172.21.15.83:0/3494124325 learned_addr learned my addr 172.21.15.83:0/3494124325 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b85b53640 1 --2- 172.21.15.83:0/3494124325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c8690 0x55b86f07d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b85352640 1 --2- 172.21.15.83:0/3494124325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 0x55b86f0ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b84b51640 1 -- 172.21.15.83:0/3494124325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 msgr2=0x55b86f0ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b84b51640 1 --2- 172.21.15.83:0/3494124325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 0x55b86f0ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b84b51640 1 -- 172.21.15.83:0/3494124325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c8690 msgr2=0x55b86f07d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b84b51640 1 --2- 172.21.15.83:0/3494124325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c8690 0x55b86f07d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b84b51640 1 -- 172.21.15.83:0/3494124325 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86ee53d00 con 0x55b86f0c7d70 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b85b53640 1 --2- 172.21.15.83:0/3494124325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c8690 0x55b86f07d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b84b51640 1 --2- 172.21.15.83:0/3494124325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f07cbd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c008010 tx=0x7f8b7c0ae040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20726e846fa222bc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b6a7fc640 1 -- 172.21.15.83:0/3494124325 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0ce020 con 0x55b86f0c7d70 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b6a7fc640 1 -- 172.21.15.83:0/3494124325 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c000e50 con 0x55b86f0c7d70 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b6a7fc640 1 -- 172.21.15.83:0/3494124325 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0b1070 con 0x55b86f0c7d70 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- 172.21.15.83:0/3494124325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 msgr2=0x55b86f07cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 --2- 172.21.15.83:0/3494124325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f07cbd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c008010 tx=0x7f8b7c0ae040 comp rx=0 tx=0).stop 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- 172.21.15.83:0/3494124325 shutdown_connections 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 --2- 172.21.15.83:0/3494124325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c8690 0x55b86f07d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 --2- 172.21.15.83:0/3494124325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f07cbd0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 --2- 172.21.15.83:0/3494124325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 0x55b86f0ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- 172.21.15.83:0/3494124325 >> 172.21.15.83:0/3494124325 conn(0x55b86f07a7e0 msgr2=0x55b86f0def10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- 172.21.15.83:0/3494124325 shutdown_connections 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- 172.21.15.83:0/3494124325 wait complete. 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- start start 2024-03-30T13:10:30.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 Processor -- start 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 0x55b86f139a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f139fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c8690 0x55b86f0cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b86ee64880 con 0x55b86f0c7d70 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80202b00 con 0x55b86f0c8690 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b86eecbdb0 con 0x55b86f07e830 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b8a738000 10 client.0 _ll_register_callbacks cb 0x7f8b7c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.205+0000 7f8b84b51640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f139fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b84b51640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f139fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38878/0 (socket says 172.21.15.83:38878) 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b84b51640 1 -- 172.21.15.83:0/149184519 learned_addr learned my addr 172.21.15.83:0/149184519 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b84b51640 1 -- 172.21.15.83:0/149184519 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 msgr2=0x55b86f139a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b84b51640 1 --2- 172.21.15.83:0/149184519 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 0x55b86f139a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b84b51640 1 -- 172.21.15.83:0/149184519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c8690 msgr2=0x55b86f0cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b84b51640 1 --2- 172.21.15.83:0/149184519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c8690 0x55b86f0cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b84b51640 1 -- 172.21.15.83:0/149184519 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b86ef4df70 con 0x55b86f0c7d70 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b84b51640 1 --2- 172.21.15.83:0/149184519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f139fa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0a5020 tx=0x7f8b7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bc5ee46d041c90 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b5ffff640 1 -- 172.21.15.83:0/149184519 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0ce070 con 0x55b86f0c7d70 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b5ffff640 1 -- 172.21.15.83:0/149184519 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8b7c003620 con 0x55b86f0c7d70 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 -- 172.21.15.83:0/149184519 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b7c000e50 con 0x55b86f0c7d70 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b5ffff640 1 -- 172.21.15.83:0/149184519 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8b7c0d8050 con 0x55b86f0c7d70 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 10 client.5754 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 -- 172.21.15.83:0/149184519 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55b86ee73760 con 0x55b86f0c7d70 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b5ffff640 1 -- 172.21.15.83:0/149184519 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c000e50 con 0x55b86f0c7d70 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b5ffff640 1 -- 172.21.15.83:0/149184519 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f8b7c0db020 con 0x55b86f0c7d70 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 10 client.5754 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 10 client.5754 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 20 client.5754 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 --2- 172.21.15.83:0/149184519 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b86f0cc490 0x55b86f0cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 4 client.5754 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628341}] 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 -- 172.21.15.83:0/149184519 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628341}) -- 0x55b86eed9fe0 con 0x55b86f0cc490 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b85352640 1 --2- 172.21.15.83:0/149184519 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b86f0cc490 0x55b86f0cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b85352640 1 --2- 172.21.15.83:0/149184519 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b86f0cc490 0x55b86f0cc8a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7e948aba9a2219f server_cookie=e3e36c3d40243c86 in_seq=0 out_seq=0 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b5ffff640 10 client.5754 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b5ffff640 1 -- 172.21.15.83:0/149184519 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3826 (crc 0 0 0) 0x55b86eed9fe0 con 0x55b86f0cc490 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b5ffff640 10 client.5754 handle_command_reply: tid=0 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 client.5754 shutdown 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 -- 172.21.15.83:0/149184519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 msgr2=0x55b86f139fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 --2- 172.21.15.83:0/149184519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f139fa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0a5020 tx=0x7f8b7c008040 comp rx=0 tx=0).stop 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 -- 172.21.15.83:0/149184519 shutdown_connections 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 --2- 172.21.15.83:0/149184519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b86f0c8690 0x55b86f0cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 --2- 172.21.15.83:0/149184519 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b86f0cc490 0x55b86f0cc8a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 --2- 172.21.15.83:0/149184519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b86f0c7d70 0x55b86f139fa0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 --2- 172.21.15.83:0/149184519 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b86f07e830 0x55b86f139a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b5ffff640 0 client.5754 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 -- 172.21.15.83:0/149184519 >> 172.21.15.83:0/149184519 conn(0x55b86f07a7e0 msgr2=0x55b86f0df620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 -- 172.21.15.83:0/149184519 shutdown_connections 2024-03-30T13:10:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 1 -- 172.21.15.83:0/149184519 wait complete. 2024-03-30T13:10:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b8a738000 20 client.5754 trim_cache size 0 max 16384 2024-03-30T13:10:30.227 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:30.227 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-debug.h", 2024-03-30T13:10:30.227 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628341, 2024-03-30T13:10:30.227 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:30.227 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.135810+0000", 2024-03-30T13:10:30.227 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.291568+0000", 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:30.228 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 2579, 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.291568+0000", 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 4, 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:30.229 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:30.230 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:30.230 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:30.230 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:30.230 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.230 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:30.230 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 2579, 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.135810+0000" 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 2579, 2024-03-30T13:10:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:30.232 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:30.232 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:30.232 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.135810+0000" 2024-03-30T13:10:30.232 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.232 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 94, 2024-03-30T13:10:30.232 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:30.232 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:30.232 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 28, 2024-03-30T13:10:30.232 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:30.232 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:30.232 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:30.233 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:30.234 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.235 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.236 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.237 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:30.238 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:30.239 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:30.239 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:30.239 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.239 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:30.239 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:30.239 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:30.239 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:30.239 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b875b6640 1 -- 172.21.15.83:0/3153256375 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8b64067ff0 msgr2=0x7f8b6406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b875b6640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8b64067ff0 0x7f8b6406a4b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8b700097a0 tx=0x7f8b70008040 comp rx=0 tx=0).stop 2024-03-30T13:10:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b875b6640 1 -- 172.21.15.83:0/3153256375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b80162e20 msgr2=0x7f8b8014beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b875b6640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b80162e20 0x7f8b8014beb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800c770 tx=0x7f8b7800cc30 comp rx=0 tx=0).stop 2024-03-30T13:10:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b875b6640 1 -- 172.21.15.83:0/3153256375 shutdown_connections 2024-03-30T13:10:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b875b6640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8b64067ff0 0x7f8b6406a4b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b875b6640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b80162e20 0x7f8b8014beb0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b875b6640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b8006fcc0 0x7f8b80154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b875b6640 1 --2- 172.21.15.83:0/3153256375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b8006f8e0 0x7f8b80148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b875b6640 1 -- 172.21.15.83:0/3153256375 >> 172.21.15.83:0/3153256375 conn(0x7f8b80072f00 msgr2=0x7f8b800add90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b875b6640 1 -- 172.21.15.83:0/3153256375 shutdown_connections 2024-03-30T13:10:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.209+0000 7f8b875b6640 1 -- 172.21.15.83:0/3153256375 wait complete. 2024-03-30T13:10:30.242 DEBUG:tasks.cephfs.test_uninlining:getting inode info #16 of 23:1099511628348 2024-03-30T13:10:30.242 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628348 2024-03-30T13:10:30.242 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628348 2024-03-30T13:10:30.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9bf0818640 1 Processor -- start 2024-03-30T13:10:30.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9bf0818640 1 -- start start 2024-03-30T13:10:30.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9bf0818640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bec06ede0 0x7f9bec1691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9bf0818640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bec0add40 con 0x7f9bec0721d0 2024-03-30T13:10:30.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9bf0818640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bec0b4440 con 0x7f9bec161bc0 2024-03-30T13:10:30.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9bf0818640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9bec0b4720 con 0x7f9bec06ede0 2024-03-30T13:10:30.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be9d9b640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f9bec0721d0 0x7f9bec06e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36472/0 (socket says 172.21.15.83:36472) 2024-03-30T13:10:30.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be9d9b640 1 -- 172.21.15.83:0/101810423 learned_addr learned my addr 172.21.15.83:0/101810423 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:30.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9bead9d640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bec06ede0 0x7f9bec1691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1040331628 0 0) 0x7f9bec0add40 con 0x7f9bec0721d0 2024-03-30T13:10:30.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bd4003530 con 0x7f9bec0721d0 2024-03-30T13:10:30.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 668557881 0 0) 0x7f9bd4003530 con 0x7f9bec0721d0 2024-03-30T13:10:30.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bec06ede0 msgr2=0x7f9bec1691c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bec06ede0 0x7f9bec1691c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 >> v1:172.21.15.153:6789/0 conn(0x7f9bec161bc0 legacy=0x7f9bec0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bec0b4a00 con 0x7f9bec0721d0 2024-03-30T13:10:30.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f9be0001680 con 0x7f9bec0721d0 2024-03-30T13:10:30.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 >> v1:172.21.15.83:6789/0 conn(0x7f9bec0721d0 legacy=0x7f9bec06e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bd40039f0 0x7f9bd4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bd4004810 0x7f9bd4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bec06ede0 0x7f9bd40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec0b4720 con 0x7f9bd4004810 2024-03-30T13:10:30.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd400bab0 con 0x7f9bd40039f0 2024-03-30T13:10:30.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd400bcb0 con 0x7f9bec06ede0 2024-03-30T13:10:30.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bd4004810 0x7f9bd4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9bea59c640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bd40039f0 0x7f9bd4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9bead9d640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bec06ede0 0x7f9bd40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be9d9b640 1 -- 172.21.15.83:0/101810423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bec06ede0 msgr2=0x7f9bd40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bec06ede0 0x7f9bd40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be9d9b640 1 -- 172.21.15.83:0/101810423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bd40039f0 msgr2=0x7f9bd4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bd40039f0 0x7f9bd4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9be9d9b640 1 -- 172.21.15.83:0/101810423 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd4003530 con 0x7f9bd4004810 2024-03-30T13:10:30.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.365+0000 7f9bead9d640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bec06ede0 0x7f9bd40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bd4004810 0x7f9bd4004c90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9be0001ec0 tx=0x7f9be001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4139e11cf8edf13d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be0007d40 con 0x7f9bd4004810 2024-03-30T13:10:30.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be0005b00 con 0x7f9bd4004810 2024-03-30T13:10:30.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be959a640 1 -- 172.21.15.83:0/101810423 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be0007070 con 0x7f9bd4004810 2024-03-30T13:10:30.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 -- 172.21.15.83:0/101810423 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bd4004810 msgr2=0x7f9bd4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 --2- 172.21.15.83:0/101810423 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bd4004810 0x7f9bd4004c90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9be0001ec0 tx=0x7f9be001f3b0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bead9d640 1 -- 172.21.15.83:0/101810423 reap_dead start 2024-03-30T13:10:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 -- 172.21.15.83:0/101810423 shutdown_connections 2024-03-30T13:10:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 -- 172.21.15.83:0/101810423 >> 172.21.15.83:0/101810423 conn(0x7f9bec06b660 msgr2=0x7f9bec06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 -- 172.21.15.83:0/101810423 shutdown_connections 2024-03-30T13:10:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 -- 172.21.15.83:0/101810423 wait complete. 2024-03-30T13:10:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 Processor -- start 2024-03-30T13:10:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 -- start start 2024-03-30T13:10:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bd4004810 0x7f9bec09af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bec160ee0 0x7f9bec152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bec1f41f0 0x7f9bec09c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec0af690 con 0x7f9bec160ee0 2024-03-30T13:10:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec0af510 con 0x7f9bec1f41f0 2024-03-30T13:10:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9bec0af810 con 0x7f9bd4004810 2024-03-30T13:10:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be9d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bec160ee0 0x7f9bec152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be9d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bec160ee0 0x7f9bec152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38888/0 (socket says 172.21.15.83:38888) 2024-03-30T13:10:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be9d9b640 1 -- 172.21.15.83:0/4214473126 learned_addr learned my addr 172.21.15.83:0/4214473126 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bead9d640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bec1f41f0 0x7f9bec09c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bea59c640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bd4004810 0x7f9bec09af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be9d9b640 1 -- 172.21.15.83:0/4214473126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bd4004810 msgr2=0x7f9bec09af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bd4004810 0x7f9bec09af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be9d9b640 1 -- 172.21.15.83:0/4214473126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bec1f41f0 msgr2=0x7f9bec09c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bec1f41f0 0x7f9bec09c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be9d9b640 1 -- 172.21.15.83:0/4214473126 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bec152c90 con 0x7f9bec160ee0 2024-03-30T13:10:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bea59c640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bd4004810 0x7f9bec09af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bec160ee0 0x7f9bec152440 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9be009bb00 tx=0x7f9bd4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bdaffd640 1 -- 172.21.15.83:0/4214473126 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be0007d20 con 0x7f9bec160ee0 2024-03-30T13:10:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bdaffd640 1 -- 172.21.15.83:0/4214473126 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be00b6040 con 0x7f9bec160ee0 2024-03-30T13:10:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bdaffd640 1 -- 172.21.15.83:0/4214473126 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be00049f0 con 0x7f9bec160ee0 2024-03-30T13:10:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 -- 172.21.15.83:0/4214473126 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bec14ff40 con 0x7f9bec160ee0 2024-03-30T13:10:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.369+0000 7f9bf0818640 1 -- 172.21.15.83:0/4214473126 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bec150500 con 0x7f9bec160ee0 2024-03-30T13:10:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bdaffd640 1 -- 172.21.15.83:0/4214473126 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9be0004b90 con 0x7f9bec160ee0 2024-03-30T13:10:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bdaffd640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9bcc067fc0 0x7f9bcc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bdaffd640 1 -- 172.21.15.83:0/4214473126 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9be01239b0 con 0x7f9bec160ee0 2024-03-30T13:10:30.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bea59c640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9bcc067fc0 0x7f9bcc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bea59c640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9bcc067fc0 0x7f9bcc06a480 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc007fd0 tx=0x7f9bdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bf399a000 1 Processor -- start 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bf399a000 1 -- start start 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bf399a000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb6d70 0x55ad4eeb7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bf399a000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4eeb7690 0x55ad4ee6d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bf399a000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4ee6d830 0x55ad4ee6dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bf399a000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ad4ecbbaa0 con 0x55ad4ee6d830 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bf399a000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ad4ec42af0 con 0x55ad4eeb6d70 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bf399a000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55ad4ecb7a50 con 0x55ad4eeb7690 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bead9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4ee6d830 0x55ad4ee6dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bead9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4ee6d830 0x55ad4ee6dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38896/0 (socket says 172.21.15.83:38896) 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bead9d640 1 -- 172.21.15.83:0/3967040038 learned_addr learned my addr 172.21.15.83:0/3967040038 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bead9d640 1 -- 172.21.15.83:0/3967040038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4eeb7690 msgr2=0x55ad4ee6d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bead9d640 1 --2- 172.21.15.83:0/3967040038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4eeb7690 0x55ad4ee6d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bead9d640 1 -- 172.21.15.83:0/3967040038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb6d70 msgr2=0x55ad4eeb7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bead9d640 1 --2- 172.21.15.83:0/3967040038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb6d70 0x55ad4eeb7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bead9d640 1 -- 172.21.15.83:0/3967040038 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad4ec40d00 con 0x55ad4ee6d830 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bead9d640 1 --2- 172.21.15.83:0/3967040038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4ee6d830 0x55ad4ee6dc10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0b4e50 tx=0x7f9be4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68130e21d5f33d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bcbfff640 1 -- 172.21.15.83:0/3967040038 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4016610 con 0x55ad4ee6d830 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bcbfff640 1 -- 172.21.15.83:0/3967040038 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be401b070 con 0x55ad4ee6d830 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.373+0000 7f9bcbfff640 1 -- 172.21.15.83:0/3967040038 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be40169d0 con 0x55ad4ee6d830 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 -- 172.21.15.83:0/3967040038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4ee6d830 msgr2=0x55ad4ee6dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3967040038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4ee6d830 0x55ad4ee6dc10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0b4e50 tx=0x7f9be4009750 comp rx=0 tx=0).stop 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 -- 172.21.15.83:0/3967040038 shutdown_connections 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3967040038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4ee6d830 0x55ad4ee6dc10 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3967040038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4eeb7690 0x55ad4ee6d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3967040038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb6d70 0x55ad4eeb7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 -- 172.21.15.83:0/3967040038 >> 172.21.15.83:0/3967040038 conn(0x55ad4ee697e0 msgr2=0x55ad4ee6bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 -- 172.21.15.83:0/3967040038 shutdown_connections 2024-03-30T13:10:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 -- 172.21.15.83:0/3967040038 wait complete. 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 -- start start 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 Processor -- start 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4ee6d830 0x55ad4ee72c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4eeb6d70 0x55ad4ee9bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 0x55ad4ee9c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ad4ec83270 con 0x55ad4eeb7690 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ad4ec796a0 con 0x55ad4ee6d830 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55ad4ec53880 con 0x55ad4eeb6d70 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 10 client.0 _ll_register_callbacks cb 0x55ad4ee58490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bead9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 0x55ad4ee9c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bead9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 0x55ad4ee9c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38900/0 (socket says 172.21.15.83:38900) 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bead9d640 1 -- 172.21.15.83:0/3473893804 learned_addr learned my addr 172.21.15.83:0/3473893804 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bea59c640 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4ee6d830 0x55ad4ee72c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4eeb6d70 0x55ad4ee9bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bead9d640 1 -- 172.21.15.83:0/3473893804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4eeb6d70 msgr2=0x55ad4ee9bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bead9d640 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4eeb6d70 0x55ad4ee9bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bead9d640 1 -- 172.21.15.83:0/3473893804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4ee6d830 msgr2=0x55ad4ee72c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bead9d640 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4ee6d830 0x55ad4ee72c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bead9d640 1 -- 172.21.15.83:0/3473893804 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad4ec80730 con 0x55ad4eeb7690 2024-03-30T13:10:30.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bead9d640 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 0x55ad4ee9c2e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9be400b010 tx=0x7f9be4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f4a9d4d9a4dfde server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:30.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bc97fa640 1 -- 172.21.15.83:0/3473893804 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4016dc0 con 0x55ad4eeb7690 2024-03-30T13:10:30.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bc97fa640 1 -- 172.21.15.83:0/3473893804 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9be402b480 con 0x55ad4eeb7690 2024-03-30T13:10:30.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 -- 172.21.15.83:0/3473893804 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9be401b070 con 0x55ad4eeb7690 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bc97fa640 1 -- 172.21.15.83:0/3473893804 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9be4033050 con 0x55ad4eeb7690 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 10 client.5766 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 -- 172.21.15.83:0/3473893804 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55ad4ec73ca0 con 0x55ad4eeb7690 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bc97fa640 1 -- 172.21.15.83:0/3473893804 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be401b070 con 0x55ad4eeb7690 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bc97fa640 1 -- 172.21.15.83:0/3473893804 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f9be4036020 con 0x55ad4eeb7690 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 10 client.5766 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 10 client.5766 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 20 client.5766 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55ad4eebe5d0 0x55ad4eebe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 4 client.5766 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bf399a000 1 -- 172.21.15.83:0/3473893804 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad4ec56c90 con 0x55ad4eebe5d0 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bea59c640 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55ad4eebe5d0 0x55ad4eebe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bea59c640 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55ad4eebe5d0 0x55ad4eebe9b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=577ad2b8a356f4cf server_cookie=783e866ec0df6cac in_seq=0 out_seq=0 2024-03-30T13:10:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.377+0000 7f9bc97fa640 10 client.5766 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bc97fa640 1 -- 172.21.15.83:0/3473893804 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55ad4ec56c90 con 0x55ad4eebe5d0 2024-03-30T13:10:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bc97fa640 10 client.5766 handle_command_reply: tid=0 2024-03-30T13:10:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bf399a000 1 client.5766 shutdown 2024-03-30T13:10:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bf399a000 1 -- 172.21.15.83:0/3473893804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 msgr2=0x55ad4ee9c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 0x55ad4ee9c2e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9be400b010 tx=0x7f9be4004a50 comp rx=0 tx=0).stop 2024-03-30T13:10:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bf399a000 1 -- 172.21.15.83:0/3473893804 shutdown_connections 2024-03-30T13:10:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55ad4eebe5d0 0x55ad4eebe9b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 0x55ad4ee9c2e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bc97fa640 0 client.5766 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4eeb6d70 0x55ad4ee9bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3473893804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4ee6d830 0x55ad4ee72c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bf399a000 1 -- 172.21.15.83:0/3473893804 >> 172.21.15.83:0/3473893804 conn(0x55ad4ee697e0 msgr2=0x55ad4ee6c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bf399a000 1 -- 172.21.15.83:0/3473893804 shutdown_connections 2024-03-30T13:10:30.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bf399a000 1 -- 172.21.15.83:0/3473893804 wait complete. 2024-03-30T13:10:30.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.381+0000 7f9bf399a000 20 client.5766 trim_cache size 0 max 16384 2024-03-30T13:10:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.405+0000 7f9bf399a000 1 Processor -- start 2024-03-30T13:10:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.405+0000 7f9bf399a000 1 -- start start 2024-03-30T13:10:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4ee6d830 0x55ad4ee9c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb6d70 0x55ad4ee6bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 0x55ad4ee6c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec201370 con 0x55ad4eeb7690 2024-03-30T13:10:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec200390 con 0x55ad4eeb6d70 2024-03-30T13:10:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9bec1f8360 con 0x55ad4ee6d830 2024-03-30T13:10:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bead9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 0x55ad4ee6c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bead9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 0x55ad4ee6c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38910/0 (socket says 172.21.15.83:38910) 2024-03-30T13:10:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bead9d640 1 -- 172.21.15.83:0/3192656191 learned_addr learned my addr 172.21.15.83:0/3192656191 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/3192656191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb6d70 0x55ad4ee6bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bea59c640 1 --2- 172.21.15.83:0/3192656191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4ee6d830 0x55ad4ee9c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bead9d640 1 -- 172.21.15.83:0/3192656191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4ee6d830 msgr2=0x55ad4ee9c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bead9d640 1 --2- 172.21.15.83:0/3192656191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4ee6d830 0x55ad4ee9c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bead9d640 1 -- 172.21.15.83:0/3192656191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb6d70 msgr2=0x55ad4ee6bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bead9d640 1 --2- 172.21.15.83:0/3192656191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb6d70 0x55ad4ee6bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bead9d640 1 -- 172.21.15.83:0/3192656191 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad4ec42d00 con 0x55ad4eeb7690 2024-03-30T13:10:30.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/3192656191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb6d70 0x55ad4ee6bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bead9d640 1 --2- 172.21.15.83:0/3192656191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 0x55ad4ee6c110 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9be402b800 tx=0x7f9be4022070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6daa3029c9d922e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bcb7fe640 1 -- 172.21.15.83:0/3192656191 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4016bc0 con 0x55ad4eeb7690 2024-03-30T13:10:30.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bcb7fe640 1 -- 172.21.15.83:0/3192656191 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be401b040 con 0x55ad4eeb7690 2024-03-30T13:10:30.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bcb7fe640 1 -- 172.21.15.83:0/3192656191 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be402b980 con 0x55ad4eeb7690 2024-03-30T13:10:30.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 -- 172.21.15.83:0/3192656191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 msgr2=0x55ad4ee6c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3192656191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 0x55ad4ee6c110 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9be402b800 tx=0x7f9be4022070 comp rx=0 tx=0).stop 2024-03-30T13:10:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 -- 172.21.15.83:0/3192656191 shutdown_connections 2024-03-30T13:10:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3192656191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb7690 0x55ad4ee6c110 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3192656191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb6d70 0x55ad4ee6bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 --2- 172.21.15.83:0/3192656191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4ee6d830 0x55ad4ee9c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 -- 172.21.15.83:0/3192656191 >> 172.21.15.83:0/3192656191 conn(0x55ad4ee697e0 msgr2=0x55ad4eecdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 -- 172.21.15.83:0/3192656191 shutdown_connections 2024-03-30T13:10:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 -- 172.21.15.83:0/3192656191 wait complete. 2024-03-30T13:10:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 -- start start 2024-03-30T13:10:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 Processor -- start 2024-03-30T13:10:30.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4ee6d830 0x55ad4ef29030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb6d70 0x55ad4ef29570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb7690 0x55ad4eebaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ad4ec83270 con 0x55ad4eeb6d70 2024-03-30T13:10:30.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec1ffd40 con 0x55ad4eeb7690 2024-03-30T13:10:30.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55ad4ed77b00 con 0x55ad4ee6d830 2024-03-30T13:10:30.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bf399a000 10 client.0 _ll_register_callbacks cb 0x7f9be4003a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:30.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9be9d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb6d70 0x55ad4ef29570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9be9d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb6d70 0x55ad4ef29570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38914/0 (socket says 172.21.15.83:38914) 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9be9d9b640 1 -- 172.21.15.83:0/1126232145 learned_addr learned my addr 172.21.15.83:0/1126232145 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bead9d640 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb7690 0x55ad4eebaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bea59c640 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4ee6d830 0x55ad4ef29030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9be9d9b640 1 -- 172.21.15.83:0/1126232145 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4ee6d830 msgr2=0x55ad4ef29030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4ee6d830 0x55ad4ef29030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9be9d9b640 1 -- 172.21.15.83:0/1126232145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb7690 msgr2=0x55ad4eebaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb7690 0x55ad4eebaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9be9d9b640 1 -- 172.21.15.83:0/1126232145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad4ed3cf70 con 0x55ad4eeb6d70 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.409+0000 7f9bea59c640 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4ee6d830 0x55ad4ef29030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9be9d9b640 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb6d70 0x55ad4ef29570 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9be00f3a80 tx=0x7f9be00f36f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbcd3b298e9d8d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bc97fa640 1 -- 172.21.15.83:0/1126232145 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be00f3af0 con 0x55ad4eeb6d70 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bc97fa640 1 -- 172.21.15.83:0/1126232145 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9be00f0160 con 0x55ad4eeb6d70 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 -- 172.21.15.83:0/1126232145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9be401b040 con 0x55ad4eeb6d70 2024-03-30T13:10:30.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bc97fa640 1 -- 172.21.15.83:0/1126232145 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9be0120050 con 0x55ad4eeb6d70 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 10 client.5772 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 -- 172.21.15.83:0/1126232145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55ad4ec62760 con 0x55ad4eeb6d70 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bc97fa640 1 -- 172.21.15.83:0/1126232145 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be401b040 con 0x55ad4eeb6d70 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bc97fa640 1 -- 172.21.15.83:0/1126232145 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f9be00f2f40 con 0x55ad4eeb6d70 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 10 client.5772 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 10 client.5772 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 20 client.5772 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55ad4eebb460 0x55ad4eebb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 4 client.5772 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628348}] 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 -- 172.21.15.83:0/1126232145 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628348}) -- 0x55ad4ecc8fe0 con 0x55ad4eebb460 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bea59c640 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55ad4eebb460 0x55ad4eebb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bc97fa640 10 client.5772 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bea59c640 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55ad4eebb460 0x55ad4eebb870 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7278ea46f6d7cb30 server_cookie=f55228c7f4a1ef96 in_seq=0 out_seq=0 2024-03-30T13:10:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bc97fa640 1 -- 172.21.15.83:0/1126232145 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3820 (crc 0 0 0) 0x55ad4ecc8fe0 con 0x55ad4eebb460 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bc97fa640 10 client.5772 handle_command_reply: tid=0 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 client.5772 shutdown 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 -- 172.21.15.83:0/1126232145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb6d70 msgr2=0x55ad4ef29570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb6d70 0x55ad4ef29570 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9be00f3a80 tx=0x7f9be00f36f0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 -- 172.21.15.83:0/1126232145 shutdown_connections 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad4eeb7690 0x55ad4eebaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55ad4eebb460 0x55ad4eebb870 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad4eeb6d70 0x55ad4ef29570 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 --2- 172.21.15.83:0/1126232145 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ad4ee6d830 0x55ad4ef29030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bc97fa640 0 client.5772 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 -- 172.21.15.83:0/1126232145 >> 172.21.15.83:0/1126232145 conn(0x55ad4ee697e0 msgr2=0x55ad4eece620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 -- 172.21.15.83:0/1126232145 shutdown_connections 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 1 -- 172.21.15.83:0/1126232145 wait complete. 2024-03-30T13:10:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf399a000 20 client.5772 trim_cache size 0 max 16384 2024-03-30T13:10:30.428 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:30.428 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-sysfs.h", 2024-03-30T13:10:30.428 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628348, 2024-03-30T13:10:30.428 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:30.428 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.138464+0000", 2024-03-30T13:10:30.428 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.313641+0000", 2024-03-30T13:10:30.428 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:30.428 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:30.428 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:30.428 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:30.429 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 77, 2024-03-30T13:10:30.430 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:30.430 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:30.430 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:30.430 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:30.430 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:30.430 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.313641+0000", 2024-03-30T13:10:30.430 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:30.430 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:30.430 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:30.430 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:30.430 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:30.430 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 77, 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:30.431 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.138464+0000" 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 77, 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.138464+0000" 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 92, 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 42, 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:30.433 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:30.434 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.435 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:30.436 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:30.437 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:30.438 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:30.439 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:30.439 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:30.439 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:30.439 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:30.439 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:30.439 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.439 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:30.439 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:30.439 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:30.439 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:30.439 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:30.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf0818640 1 -- 172.21.15.83:0/4214473126 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9bcc067fc0 msgr2=0x7f9bcc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf0818640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9bcc067fc0 0x7f9bcc06a480 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc007fd0 tx=0x7f9bdc009040 comp rx=0 tx=0).stop 2024-03-30T13:10:30.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf0818640 1 -- 172.21.15.83:0/4214473126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bec160ee0 msgr2=0x7f9bec152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf0818640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bec160ee0 0x7f9bec152440 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9be009bb00 tx=0x7f9bd4005840 comp rx=0 tx=0).stop 2024-03-30T13:10:30.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf0818640 1 -- 172.21.15.83:0/4214473126 shutdown_connections 2024-03-30T13:10:30.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf0818640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9bcc067fc0 0x7f9bcc06a480 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf0818640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bec1f41f0 0x7f9bec09c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf0818640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bec160ee0 0x7f9bec152440 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf0818640 1 --2- 172.21.15.83:0/4214473126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9bd4004810 0x7f9bec09af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf0818640 1 -- 172.21.15.83:0/4214473126 >> 172.21.15.83:0/4214473126 conn(0x7f9bec06b660 msgr2=0x7f9bec0b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf0818640 1 -- 172.21.15.83:0/4214473126 shutdown_connections 2024-03-30T13:10:30.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.413+0000 7f9bf0818640 1 -- 172.21.15.83:0/4214473126 wait complete. 2024-03-30T13:10:30.442 DEBUG:tasks.cephfs.test_uninlining:getting inode info #17 of 23:1099511628331 2024-03-30T13:10:30.442 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628331 2024-03-30T13:10:30.442 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628331 2024-03-30T13:10:30.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b32ec640 1 Processor -- start 2024-03-30T13:10:30.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b32ec640 1 -- start start 2024-03-30T13:10:30.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b32ec640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff9ac06f8e0 0x7ff9ac0ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b32ec640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac162920 0x7ff9ac0b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b32ec640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ac0aec80 con 0x7ff9ac162e20 2024-03-30T13:10:30.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b32ec640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ac0af5d0 con 0x7ff9ac06f8e0 2024-03-30T13:10:30.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b32ec640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac0af870 con 0x7ff9ac162920 2024-03-30T13:10:30.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b0887640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff9ac162e20 0x7ff9ac162210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36486/0 (socket says 172.21.15.83:36486) 2024-03-30T13:10:30.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b0887640 1 -- 172.21.15.83:0/2372719046 learned_addr learned my addr 172.21.15.83:0/2372719046 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:30.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b1889640 1 --2- 172.21.15.83:0/2372719046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac162920 0x7ff9ac0b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b1088640 1 --2- 172.21.15.83:0/2372719046 >> v2:172.21.15.153:3300/0 conn(0x7ff9ac06f8e0 0x7ff9ac0ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578951132 0 0) 0x7ff9ac0aec80 con 0x7ff9ac162e20 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff998003530 con 0x7ff9ac162e20 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3418184885 0 0) 0x7ff998003530 con 0x7ff9ac162e20 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac162920 msgr2=0x7ff9ac0b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 --2- 172.21.15.83:0/2372719046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac162920 0x7ff9ac0b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 >> v2:172.21.15.153:3300/0 conn(0x7ff9ac06f8e0 msgr2=0x7ff9ac0ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 --2- 172.21.15.83:0/2372719046 >> v2:172.21.15.153:3300/0 conn(0x7ff9ac06f8e0 0x7ff9ac0ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac0afb50 con 0x7ff9ac162e20 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7ff99c001680 con 0x7ff9ac162e20 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 >> v1:172.21.15.83:6789/0 conn(0x7ff9ac162e20 legacy=0x7ff9ac162210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 --2- 172.21.15.83:0/2372719046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9980039c0 0x7ff998003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 --2- 172.21.15.83:0/2372719046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff998004810 0x7ff998004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 --2- 172.21.15.83:0/2372719046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac162920 0x7ff9980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0af5d0 con 0x7ff9980039c0 2024-03-30T13:10:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0af870 con 0x7ff998004810 2024-03-30T13:10:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff99800ba00 con 0x7ff9ac162920 2024-03-30T13:10:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b1088640 1 --2- 172.21.15.83:0/2372719046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9980039c0 0x7ff998003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b0887640 1 --2- 172.21.15.83:0/2372719046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff998004810 0x7ff998004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b1889640 1 --2- 172.21.15.83:0/2372719046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac162920 0x7ff9980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b1088640 1 -- 172.21.15.83:0/2372719046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac162920 msgr2=0x7ff9980051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b1088640 1 --2- 172.21.15.83:0/2372719046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac162920 0x7ff9980051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b1088640 1 -- 172.21.15.83:0/2372719046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff998004810 msgr2=0x7ff998004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b1088640 1 --2- 172.21.15.83:0/2372719046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff998004810 0x7ff998004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.545+0000 7ff9b1088640 1 -- 172.21.15.83:0/2372719046 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff998003530 con 0x7ff9980039c0 2024-03-30T13:10:30.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.549+0000 7ff9b1088640 1 --2- 172.21.15.83:0/2372719046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9980039c0 0x7ff998003de0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009ae0 tx=0x7ff9a801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f39d73a3fdb9881 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.549+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80096b0 con 0x7ff9980039c0 2024-03-30T13:10:30.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.549+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a80a64a0 con 0x7ff9980039c0 2024-03-30T13:10:30.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.549+0000 7ff9a3fff640 1 -- 172.21.15.83:0/2372719046 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80a6890 con 0x7ff9980039c0 2024-03-30T13:10:30.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.549+0000 7ff9b32ec640 1 -- 172.21.15.83:0/2372719046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9980039c0 msgr2=0x7ff998003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.549+0000 7ff9b32ec640 1 --2- 172.21.15.83:0/2372719046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9980039c0 0x7ff998003de0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009ae0 tx=0x7ff9a801ca50 comp rx=0 tx=0).stop 2024-03-30T13:10:30.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.549+0000 7ff9b1889640 1 -- 172.21.15.83:0/2372719046 reap_dead start 2024-03-30T13:10:30.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.549+0000 7ff9b32ec640 1 -- 172.21.15.83:0/2372719046 shutdown_connections 2024-03-30T13:10:30.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.549+0000 7ff9b32ec640 1 -- 172.21.15.83:0/2372719046 >> 172.21.15.83:0/2372719046 conn(0x7ff9ac072f00 msgr2=0x7ff9ac06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.549+0000 7ff9b32ec640 1 -- 172.21.15.83:0/2372719046 shutdown_connections 2024-03-30T13:10:30.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.549+0000 7ff9b32ec640 1 -- 172.21.15.83:0/2372719046 wait complete. 2024-03-30T13:10:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b32ec640 1 Processor -- start 2024-03-30T13:10:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b32ec640 1 -- start start 2024-03-30T13:10:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b32ec640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9980039c0 0x7ff9ac149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b32ec640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac146f30 0x7ff9ac14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b32ec640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9ac14aad0 0x7ff9ac152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b32ec640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b5f40 con 0x7ff9ac14aad0 2024-03-30T13:10:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b32ec640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b5dc0 con 0x7ff9980039c0 2024-03-30T13:10:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b32ec640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b60c0 con 0x7ff9ac146f30 2024-03-30T13:10:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b1889640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9ac14aad0 0x7ff9ac152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b1889640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9ac14aad0 0x7ff9ac152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38928/0 (socket says 172.21.15.83:38928) 2024-03-30T13:10:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b1889640 1 -- 172.21.15.83:0/1926383109 learned_addr learned my addr 172.21.15.83:0/1926383109 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b1088640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9980039c0 0x7ff9ac149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b0887640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac146f30 0x7ff9ac14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b1889640 1 -- 172.21.15.83:0/1926383109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac146f30 msgr2=0x7ff9ac14a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b1889640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac146f30 0x7ff9ac14a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b1889640 1 -- 172.21.15.83:0/1926383109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9980039c0 msgr2=0x7ff9ac149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b1889640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9980039c0 0x7ff9ac149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b1889640 1 -- 172.21.15.83:0/1926383109 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac14b410 con 0x7ff9ac14aad0 2024-03-30T13:10:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b0887640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac146f30 0x7ff9ac14a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b1088640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9980039c0 0x7ff9ac149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b1889640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9ac14aad0 0x7ff9ac152110 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac067570 tx=0x7ff9a400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9a1ffb640 1 -- 172.21.15.83:0/1926383109 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a401c070 con 0x7ff9ac14aad0 2024-03-30T13:10:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9a1ffb640 1 -- 172.21.15.83:0/1926383109 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a4017400 con 0x7ff9ac14aad0 2024-03-30T13:10:30.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b32ec640 1 -- 172.21.15.83:0/1926383109 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac14b9b0 con 0x7ff9ac14aad0 2024-03-30T13:10:30.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9a1ffb640 1 -- 172.21.15.83:0/1926383109 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a40177f0 con 0x7ff9ac14aad0 2024-03-30T13:10:30.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9b32ec640 1 -- 172.21.15.83:0/1926383109 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ac149610 con 0x7ff9ac14aad0 2024-03-30T13:10:30.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.553+0000 7ff9a1ffb640 1 -- 172.21.15.83:0/1926383109 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff9a401f070 con 0x7ff9ac14aad0 2024-03-30T13:10:30.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9a1ffb640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff990067fc0 0x7ff99006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b1088640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff990067fc0 0x7ff99006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9a1ffb640 1 -- 172.21.15.83:0/1926383109 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff9a40869a0 con 0x7ff9ac14aad0 2024-03-30T13:10:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b1088640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff990067fc0 0x7ff99006a480 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80ad000 tx=0x7ff9a80b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 Processor -- start 2024-03-30T13:10:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 -- start start 2024-03-30T13:10:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 0x562e0c7d6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d6690 0x562e0c78c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c78c830 0x562e0c78cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562e0c5daaa0 con 0x562e0c7d5d70 2024-03-30T13:10:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562e0c561af0 con 0x562e0c78c830 2024-03-30T13:10:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x562e0c5d6a50 con 0x562e0c7d6690 2024-03-30T13:10:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b1088640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 0x562e0c7d6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b1088640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 0x562e0c7d6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38940/0 (socket says 172.21.15.83:38940) 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b1088640 1 -- 172.21.15.83:0/2964569033 learned_addr learned my addr 172.21.15.83:0/2964569033 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b1889640 1 --2- 172.21.15.83:0/2964569033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c78c830 0x562e0c78cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b0887640 1 --2- 172.21.15.83:0/2964569033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d6690 0x562e0c78c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b1088640 1 -- 172.21.15.83:0/2964569033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d6690 msgr2=0x562e0c78c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b1088640 1 --2- 172.21.15.83:0/2964569033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d6690 0x562e0c78c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b1088640 1 -- 172.21.15.83:0/2964569033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c78c830 msgr2=0x562e0c78cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b1088640 1 --2- 172.21.15.83:0/2964569033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c78c830 0x562e0c78cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b1088640 1 -- 172.21.15.83:0/2964569033 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e0c55fd00 con 0x562e0c7d5d70 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b1088640 1 --2- 172.21.15.83:0/2964569033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 0x562e0c7d6150 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8006f90 tx=0x7ff9a8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30319299cc59e340 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff996ffd640 1 -- 172.21.15.83:0/2964569033 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80ca070 con 0x562e0c7d5d70 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff996ffd640 1 -- 172.21.15.83:0/2964569033 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a80a7600 con 0x562e0c7d5d70 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff996ffd640 1 -- 172.21.15.83:0/2964569033 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80a79b0 con 0x562e0c7d5d70 2024-03-30T13:10:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 -- 172.21.15.83:0/2964569033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 msgr2=0x562e0c7d6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 --2- 172.21.15.83:0/2964569033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 0x562e0c7d6150 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8006f90 tx=0x7ff9a8004740 comp rx=0 tx=0).stop 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 -- 172.21.15.83:0/2964569033 shutdown_connections 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 --2- 172.21.15.83:0/2964569033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c78c830 0x562e0c78cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 --2- 172.21.15.83:0/2964569033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d6690 0x562e0c78c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 --2- 172.21.15.83:0/2964569033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 0x562e0c7d6150 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 -- 172.21.15.83:0/2964569033 >> 172.21.15.83:0/2964569033 conn(0x562e0c7887e0 msgr2=0x562e0c78abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 -- 172.21.15.83:0/2964569033 shutdown_connections 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 -- 172.21.15.83:0/2964569033 wait complete. 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 -- start start 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.557+0000 7ff9b646e000 1 Processor -- start 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c78c830 0x562e0c791c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 0x562e0c7bada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d6690 0x562e0c7bb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562e0c5a2270 con 0x562e0c7d5d70 2024-03-30T13:10:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562e0c5986a0 con 0x562e0c7d6690 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x562e0c572880 con 0x562e0c78c830 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 10 client.0 _ll_register_callbacks cb 0x562e0c777490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b0887640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 0x562e0c7bada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b0887640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 0x562e0c7bada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38952/0 (socket says 172.21.15.83:38952) 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b0887640 1 -- 172.21.15.83:0/2361599088 learned_addr learned my addr 172.21.15.83:0/2361599088 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b1889640 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d6690 0x562e0c7bb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b1088640 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c78c830 0x562e0c791c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b0887640 1 -- 172.21.15.83:0/2361599088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c78c830 msgr2=0x562e0c791c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b0887640 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c78c830 0x562e0c791c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b0887640 1 -- 172.21.15.83:0/2361599088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d6690 msgr2=0x562e0c7bb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b0887640 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d6690 0x562e0c7bb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b0887640 1 -- 172.21.15.83:0/2361599088 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e0c59f730 con 0x562e0c7d5d70 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b1889640 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d6690 0x562e0c7bb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b1088640 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c78c830 0x562e0c791c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff98bfff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b0887640 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 0x562e0c7bada0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff99c011450 tx=0x7ff99c011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3dc8ea07ac0b54a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff98bfff640 1 -- 172.21.15.83:0/2361599088 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c010040 con 0x562e0c7d5d70 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff98bfff640 1 -- 172.21.15.83:0/2361599088 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff99c0137a0 con 0x562e0c7d5d70 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 -- 172.21.15.83:0/2361599088 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9a80a7600 con 0x562e0c7d5d70 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff98bfff640 1 -- 172.21.15.83:0/2361599088 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7ff99c022050 con 0x562e0c7d5d70 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 10 client.5784 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 -- 172.21.15.83:0/2361599088 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x562e0c592ca0 con 0x562e0c7d5d70 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff98bfff640 1 -- 172.21.15.83:0/2361599088 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a80a7600 con 0x562e0c7d5d70 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff98bfff640 1 -- 172.21.15.83:0/2361599088 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7ff99c025020 con 0x562e0c7d5d70 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 10 client.5784 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 10 client.5784 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 20 client.5784 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562e0c7dd5d0 0x562e0c7dd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 4 client.5784 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 -- 172.21.15.83:0/2361599088 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e0c575c90 con 0x562e0c7dd5d0 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b1088640 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562e0c7dd5d0 0x562e0c7dd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff98bfff640 10 client.5784 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b1088640 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562e0c7dd5d0 0x562e0c7dd9b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9bcbf45c672e7f2 server_cookie=9a52cd84fb1ce149 in_seq=0 out_seq=0 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff98bfff640 1 -- 172.21.15.83:0/2361599088 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x562e0c575c90 con 0x562e0c7dd5d0 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff98bfff640 10 client.5784 handle_command_reply: tid=0 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 client.5784 shutdown 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 -- 172.21.15.83:0/2361599088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 msgr2=0x562e0c7bada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 0x562e0c7bada0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff99c011450 tx=0x7ff99c011910 comp rx=0 tx=0).stop 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 -- 172.21.15.83:0/2361599088 shutdown_connections 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d6690 0x562e0c7bb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562e0c7dd5d0 0x562e0c7dd9b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c7d5d70 0x562e0c7bada0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 --2- 172.21.15.83:0/2361599088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c78c830 0x562e0c791c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff98bfff640 0 client.5784 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 -- 172.21.15.83:0/2361599088 >> 172.21.15.83:0/2361599088 conn(0x562e0c7887e0 msgr2=0x562e0c78b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 -- 172.21.15.83:0/2361599088 shutdown_connections 2024-03-30T13:10:30.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 1 -- 172.21.15.83:0/2361599088 wait complete. 2024-03-30T13:10:30.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.561+0000 7ff9b646e000 20 client.5784 trim_cache size 0 max 16384 2024-03-30T13:10:30.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 Processor -- start 2024-03-30T13:10:30.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 -- start start 2024-03-30T13:10:30.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 0x562e0c7bb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d5d70 0x562e0c7d8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d6690 0x562e0c7d8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac204330 con 0x562e0c78c830 2024-03-30T13:10:30.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac2033a0 con 0x562e0c7d5d70 2024-03-30T13:10:30.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac14e0f0 con 0x562e0c7d6690 2024-03-30T13:10:30.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b1088640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 0x562e0c7bb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b1088640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 0x562e0c7bb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38960/0 (socket says 172.21.15.83:38960) 2024-03-30T13:10:30.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b1088640 1 -- 172.21.15.83:0/1013779970 learned_addr learned my addr 172.21.15.83:0/1013779970 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b1889640 1 --2- 172.21.15.83:0/1013779970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d6690 0x562e0c7d8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b1088640 1 -- 172.21.15.83:0/1013779970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d6690 msgr2=0x562e0c7d8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b0887640 1 --2- 172.21.15.83:0/1013779970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d5d70 0x562e0c7d8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b1088640 1 --2- 172.21.15.83:0/1013779970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d6690 0x562e0c7d8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b1088640 1 -- 172.21.15.83:0/1013779970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d5d70 msgr2=0x562e0c7d8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b1088640 1 --2- 172.21.15.83:0/1013779970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d5d70 0x562e0c7d8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b1088640 1 -- 172.21.15.83:0/1013779970 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e0c561d00 con 0x562e0c78c830 2024-03-30T13:10:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b1889640 1 --2- 172.21.15.83:0/1013779970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d6690 0x562e0c7d8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b1088640 1 --2- 172.21.15.83:0/1013779970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 0x562e0c7bb180 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff9a801cf30 tx=0x7ff9a80a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3489019d4ba6f24 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9967fc640 1 -- 172.21.15.83:0/1013779970 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80ca040 con 0x562e0c78c830 2024-03-30T13:10:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9967fc640 1 -- 172.21.15.83:0/1013779970 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a80a7a30 con 0x562e0c78c830 2024-03-30T13:10:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9967fc640 1 -- 172.21.15.83:0/1013779970 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80a7e00 con 0x562e0c78c830 2024-03-30T13:10:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 -- 172.21.15.83:0/1013779970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 msgr2=0x562e0c7bb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 --2- 172.21.15.83:0/1013779970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 0x562e0c7bb180 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff9a801cf30 tx=0x7ff9a80a7000 comp rx=0 tx=0).stop 2024-03-30T13:10:30.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 -- 172.21.15.83:0/1013779970 shutdown_connections 2024-03-30T13:10:30.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 --2- 172.21.15.83:0/1013779970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d6690 0x562e0c7d8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 --2- 172.21.15.83:0/1013779970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d5d70 0x562e0c7d8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 --2- 172.21.15.83:0/1013779970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 0x562e0c7bb180 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 -- 172.21.15.83:0/1013779970 >> 172.21.15.83:0/1013779970 conn(0x562e0c7887e0 msgr2=0x562e0c7ecf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 -- 172.21.15.83:0/1013779970 shutdown_connections 2024-03-30T13:10:30.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 -- 172.21.15.83:0/1013779970 wait complete. 2024-03-30T13:10:30.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 -- start start 2024-03-30T13:10:30.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.577+0000 7ff9b646e000 1 Processor -- start 2024-03-30T13:10:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 0x562e0c848030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d5d70 0x562e0c848570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d6690 0x562e0c7d9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562e0c5d9db0 con 0x562e0c78c830 2024-03-30T13:10:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac14e740 con 0x562e0c7d6690 2024-03-30T13:10:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x562e0c696b00 con 0x562e0c7d5d70 2024-03-30T13:10:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 10 client.0 _ll_register_callbacks cb 0x7ff99c001d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b1088640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 0x562e0c848030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b1088640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 0x562e0c848030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38970/0 (socket says 172.21.15.83:38970) 2024-03-30T13:10:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b1088640 1 -- 172.21.15.83:0/715303586 learned_addr learned my addr 172.21.15.83:0/715303586 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b1889640 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d6690 0x562e0c7d9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b0887640 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d5d70 0x562e0c848570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b1088640 1 -- 172.21.15.83:0/715303586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d5d70 msgr2=0x562e0c848570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b1088640 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d5d70 0x562e0c848570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b1088640 1 -- 172.21.15.83:0/715303586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d6690 msgr2=0x562e0c7d9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b1088640 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d6690 0x562e0c7d9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b1088640 1 -- 172.21.15.83:0/715303586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e0c65bf70 con 0x562e0c78c830 2024-03-30T13:10:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b1088640 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 0x562e0c848030 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff9a801b160 tx=0x7ff9a8019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e9099ded49fc4a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff98bfff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff98bfff640 1 -- 172.21.15.83:0/715303586 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80ca040 con 0x562e0c78c830 2024-03-30T13:10:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff98bfff640 1 -- 172.21.15.83:0/715303586 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff9a80a7be0 con 0x562e0c78c830 2024-03-30T13:10:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 -- 172.21.15.83:0/715303586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9a80a7a30 con 0x562e0c78c830 2024-03-30T13:10:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff98bfff640 1 -- 172.21.15.83:0/715303586 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7ff9a80e0050 con 0x562e0c78c830 2024-03-30T13:10:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 10 client.5790 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 -- 172.21.15.83:0/715303586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x562e0c581760 con 0x562e0c78c830 2024-03-30T13:10:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff98bfff640 1 -- 172.21.15.83:0/715303586 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a80a7a30 con 0x562e0c78c830 2024-03-30T13:10:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff98bfff640 1 -- 172.21.15.83:0/715303586 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7ff9a80e3020 con 0x562e0c78c830 2024-03-30T13:10:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 10 client.5790 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 10 client.5790 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 20 client.5790 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562e0c7da490 0x562e0c7da8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 4 client.5790 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628331}] 2024-03-30T13:10:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 -- 172.21.15.83:0/715303586 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628331}) -- 0x562e0c5e7fe0 con 0x562e0c7da490 2024-03-30T13:10:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b0887640 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562e0c7da490 0x562e0c7da8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b0887640 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562e0c7da490 0x562e0c7da8a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12191516910af038 server_cookie=b3ce2e79fb64a2e4 in_seq=0 out_seq=0 2024-03-30T13:10:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff98bfff640 10 client.5790 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff98bfff640 1 -- 172.21.15.83:0/715303586 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3818 (crc 0 0 0) 0x562e0c5e7fe0 con 0x562e0c7da490 2024-03-30T13:10:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff98bfff640 10 client.5790 handle_command_reply: tid=0 2024-03-30T13:10:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 client.5790 shutdown 2024-03-30T13:10:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 -- 172.21.15.83:0/715303586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 msgr2=0x562e0c848030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 0x562e0c848030 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff9a801b160 tx=0x7ff9a8019850 comp rx=0 tx=0).stop 2024-03-30T13:10:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 -- 172.21.15.83:0/715303586 shutdown_connections 2024-03-30T13:10:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0c7d6690 0x562e0c7d9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562e0c7d5d70 0x562e0c848570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562e0c7da490 0x562e0c7da8a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 --2- 172.21.15.83:0/715303586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e0c78c830 0x562e0c848030 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff98bfff640 0 client.5790 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 -- 172.21.15.83:0/715303586 >> 172.21.15.83:0/715303586 conn(0x562e0c7887e0 msgr2=0x562e0c7ed620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 -- 172.21.15.83:0/715303586 shutdown_connections 2024-03-30T13:10:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 1 -- 172.21.15.83:0/715303586 wait complete. 2024-03-30T13:10:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b646e000 20 client.5790 trim_cache size 0 max 16384 2024-03-30T13:10:30.597 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:30.597 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/dcache.c", 2024-03-30T13:10:30.597 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628331, 2024-03-30T13:10:30.597 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:30.597 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.145059+0000", 2024-03-30T13:10:30.597 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.234745+0000", 2024-03-30T13:10:30.597 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 3670, 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.234745+0000", 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 4, 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:30.599 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 3670, 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:30.600 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.145059+0000" 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 3670, 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.145059+0000" 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 100, 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 8, 2024-03-30T13:10:30.601 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:30.602 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.603 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:30.604 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:30.605 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.606 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:30.607 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:30.608 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:30.608 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:30.608 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:30.608 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:30.608 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:30.608 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.608 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:30.608 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:30.608 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:30.608 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:30.608 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b32ec640 1 -- 172.21.15.83:0/1926383109 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff990067fc0 msgr2=0x7ff99006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b32ec640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff990067fc0 0x7ff99006a480 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80ad000 tx=0x7ff9a80b2040 comp rx=0 tx=0).stop 2024-03-30T13:10:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b32ec640 1 -- 172.21.15.83:0/1926383109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9ac14aad0 msgr2=0x7ff9ac152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b32ec640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9ac14aad0 0x7ff9ac152110 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac067570 tx=0x7ff9a400f4a0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b32ec640 1 -- 172.21.15.83:0/1926383109 shutdown_connections 2024-03-30T13:10:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b32ec640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff990067fc0 0x7ff99006a480 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b32ec640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9ac14aad0 0x7ff9ac152110 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b32ec640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9ac146f30 0x7ff9ac14a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b32ec640 1 --2- 172.21.15.83:0/1926383109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9980039c0 0x7ff9ac149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b32ec640 1 -- 172.21.15.83:0/1926383109 >> 172.21.15.83:0/1926383109 conn(0x7ff9ac072f00 msgr2=0x7ff9ac0b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b32ec640 1 -- 172.21.15.83:0/1926383109 shutdown_connections 2024-03-30T13:10:30.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.581+0000 7ff9b32ec640 1 -- 172.21.15.83:0/1926383109 wait complete. 2024-03-30T13:10:30.611 DEBUG:tasks.cephfs.test_uninlining:getting inode info #18 of 23:1099511628339 2024-03-30T13:10:30.611 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628339 2024-03-30T13:10:30.611 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628339 2024-03-30T13:10:30.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.709+0000 7fb5c99a7640 1 Processor -- start 2024-03-30T13:10:30.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.709+0000 7fb5c99a7640 1 -- start start 2024-03-30T13:10:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c406f8e0 0x7fb5c40ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb5c4162e20 0x7fb5c4162210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c40aec80 con 0x7fb5c406fcc0 2024-03-30T13:10:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c40af5d0 con 0x7fb5c4162e20 2024-03-30T13:10:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c40af870 con 0x7fb5c406f8e0 2024-03-30T13:10:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c27fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb5c4162e20 0x7fb5c4162210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c37fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fb5c406fcc0 0x7fb5c415ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36500/0 (socket says 172.21.15.83:36500) 2024-03-30T13:10:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c37fe640 1 -- 172.21.15.83:0/1914279868 learned_addr learned my addr 172.21.15.83:0/1914279868 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/1914279868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c406f8e0 0x7fb5c40ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c1ffb640 1 -- 172.21.15.83:0/1914279868 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040621098 0 0) 0x7fb5c40aec80 con 0x7fb5c406fcc0 2024-03-30T13:10:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c1ffb640 1 -- 172.21.15.83:0/1914279868 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5ac003530 con 0x7fb5c406fcc0 2024-03-30T13:10:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c27fc640 1 -- 172.21.15.83:0/1914279868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c406f8e0 msgr2=0x7fb5c40ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c27fc640 1 --2- 172.21.15.83:0/1914279868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c406f8e0 0x7fb5c40ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c27fc640 1 -- 172.21.15.83:0/1914279868 >> v1:172.21.15.83:6789/0 conn(0x7fb5c406fcc0 legacy=0x7fb5c415ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c27fc640 1 -- 172.21.15.83:0/1914279868 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c40afb50 con 0x7fb5c4162e20 2024-03-30T13:10:30.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/1914279868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c406f8e0 0x7fb5c40ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:30.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c27fc640 1 --2- 172.21.15.83:0/1914279868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c4162e20 0x7fb5c4162210 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80097c0 tx=0x7fb5b801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5478c422377abed server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c1ffb640 1 -- 172.21.15.83:0/1914279868 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b80b0070 con 0x7fb5c4162e20 2024-03-30T13:10:30.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c1ffb640 1 -- 172.21.15.83:0/1914279868 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b80ab600 con 0x7fb5c4162e20 2024-03-30T13:10:30.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c1ffb640 1 -- 172.21.15.83:0/1914279868 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b80ab9b0 con 0x7fb5c4162e20 2024-03-30T13:10:30.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 -- 172.21.15.83:0/1914279868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c4162e20 msgr2=0x7fb5c4162210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 --2- 172.21.15.83:0/1914279868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c4162e20 0x7fb5c4162210 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80097c0 tx=0x7fb5b801c410 comp rx=0 tx=0).stop 2024-03-30T13:10:30.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 -- 172.21.15.83:0/1914279868 shutdown_connections 2024-03-30T13:10:30.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 --2- 172.21.15.83:0/1914279868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c4162e20 0x7fb5c4162210 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 --2- 172.21.15.83:0/1914279868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c406f8e0 0x7fb5c40ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 -- 172.21.15.83:0/1914279868 >> 172.21.15.83:0/1914279868 conn(0x7fb5c4072f00 msgr2=0x7fb5c406b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 -- 172.21.15.83:0/1914279868 shutdown_connections 2024-03-30T13:10:30.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.713+0000 7fb5c99a7640 1 -- 172.21.15.83:0/1914279868 wait complete. 2024-03-30T13:10:30.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c99a7640 1 Processor -- start 2024-03-30T13:10:30.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c99a7640 1 -- start start 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c99a7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c406f8e0 0x7fb5c41faad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c99a7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c406fcc0 0x7fb5c4168ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c99a7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c4162e20 0x7fb5c4168040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c99a7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c416b7c0 con 0x7fb5c4162e20 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c99a7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c4162b60 con 0x7fb5c406f8e0 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c99a7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c416b940 con 0x7fb5c406fcc0 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c4162e20 0x7fb5c4168040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c4162e20 0x7fb5c4168040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38986/0 (socket says 172.21.15.83:38986) 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c37fe640 1 -- 172.21.15.83:0/3599183367 learned_addr learned my addr 172.21.15.83:0/3599183367 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c27fc640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c406fcc0 0x7fb5c4168ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c406f8e0 0x7fb5c41faad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c37fe640 1 -- 172.21.15.83:0/3599183367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c406fcc0 msgr2=0x7fb5c4168ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c37fe640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c406fcc0 0x7fb5c4168ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c37fe640 1 -- 172.21.15.83:0/3599183367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c406f8e0 msgr2=0x7fb5c41faad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c37fe640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c406f8e0 0x7fb5c41faad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c37fe640 1 -- 172.21.15.83:0/3599183367 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c41f7ca0 con 0x7fb5c4162e20 2024-03-30T13:10:30.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c27fc640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c406fcc0 0x7fb5c4168ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c37fe640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c4162e20 0x7fb5c4168040 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00cb40 tx=0x7fb5bc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5abfff640 1 -- 172.21.15.83:0/3599183367 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc017070 con 0x7fb5c4162e20 2024-03-30T13:10:30.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5abfff640 1 -- 172.21.15.83:0/3599183367 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5bc00aca0 con 0x7fb5c4162e20 2024-03-30T13:10:30.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c99a7640 1 -- 172.21.15.83:0/3599183367 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c4150be0 con 0x7fb5c4162e20 2024-03-30T13:10:30.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5abfff640 1 -- 172.21.15.83:0/3599183367 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc012620 con 0x7fb5c4162e20 2024-03-30T13:10:30.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5c99a7640 1 -- 172.21.15.83:0/3599183367 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c41511a0 con 0x7fb5c4162e20 2024-03-30T13:10:30.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.717+0000 7fb5abfff640 1 -- 172.21.15.83:0/3599183367 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb5bc01a070 con 0x7fb5c4162e20 2024-03-30T13:10:30.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5abfff640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb5b0067fc0 0x7fb5b006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb5b0067fc0 0x7fb5b006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5abfff640 1 -- 172.21.15.83:0/3599183367 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb5bc0862c0 con 0x7fb5c4162e20 2024-03-30T13:10:30.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb5b0067fc0 0x7fb5b006a480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40096d0 tx=0x7fb5b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5ccb29000 1 Processor -- start 2024-03-30T13:10:30.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5ccb29000 1 -- start start 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5ccb29000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6705c9d70 0x55c6705ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5ccb29000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 0x55c6705802f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5ccb29000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c670580830 0x55c670580c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5ccb29000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c6703ceaa0 con 0x55c6705c9d70 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5ccb29000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c670355af0 con 0x55c670580830 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5ccb29000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55c6703caa50 con 0x55c6705ca690 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6705c9d70 0x55c6705ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6705c9d70 0x55c6705ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38996/0 (socket says 172.21.15.83:38996) 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/1637446580 learned_addr learned my addr 172.21.15.83:0/1637446580 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/1637446580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 msgr2=0x55c6705802f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/1637446580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 0x55c6705802f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/1637446580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c670580830 msgr2=0x55c670580c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c37fe640 1 --2- 172.21.15.83:0/1637446580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c670580830 0x55c670580c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/1637446580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c670580830 0x55c670580c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/1637446580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c670353d00 con 0x55c6705c9d70 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c37fe640 1 --2- 172.21.15.83:0/1637446580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c670580830 0x55c670580c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.721+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/1637446580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6705c9d70 0x55c6705ca150 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400e830 tx=0x7fb5b4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5d8f8d6984aaf7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5a97fa640 1 -- 172.21.15.83:0/1637446580 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4025070 con 0x55c6705c9d70 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5a97fa640 1 -- 172.21.15.83:0/1637446580 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b4015640 con 0x55c6705c9d70 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5a97fa640 1 -- 172.21.15.83:0/1637446580 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b400f040 con 0x55c6705c9d70 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1637446580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6705c9d70 msgr2=0x55c6705ca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1637446580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6705c9d70 0x55c6705ca150 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400e830 tx=0x7fb5b4011000 comp rx=0 tx=0).stop 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1637446580 shutdown_connections 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1637446580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c670580830 0x55c670580c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1637446580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 0x55c6705802f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1637446580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6705c9d70 0x55c6705ca150 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1637446580 >> 172.21.15.83:0/1637446580 conn(0x55c67057c7e0 msgr2=0x55c67057ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1637446580 shutdown_connections 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1637446580 wait complete. 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 -- start start 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 Processor -- start 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c670585c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705c9d70 0x55c6705aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 0x55c6705af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c670396270 con 0x55c670580830 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c67038c6a0 con 0x55c6705c9d70 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55c670366880 con 0x55c6705ca690 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 10 client.0 _ll_register_callbacks cb 0x55c67056b490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c670585c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c670585c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38998/0 (socket says 172.21.15.83:38998) 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/2987663624 learned_addr learned my addr 172.21.15.83:0/2987663624 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c37fe640 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 0x55c6705af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c27fc640 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705c9d70 0x55c6705aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/2987663624 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 msgr2=0x55c6705af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 0x55c6705af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/2987663624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705c9d70 msgr2=0x55c6705aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705c9d70 0x55c6705aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/2987663624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c670393730 con 0x55c670580830 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c670585c80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4023040 tx=0x7fb5b4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2566ae6c5b2e67d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5a27fc640 1 -- 172.21.15.83:0/2987663624 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b402e060 con 0x55c670580830 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 -- 172.21.15.83:0/2987663624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5b4015640 con 0x55c670580830 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5a27fc640 1 -- 172.21.15.83:0/2987663624 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb5b4004270 con 0x55c670580830 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5a27fc640 1 -- 172.21.15.83:0/2987663624 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb5b4034050 con 0x55c670580830 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 10 client.5805 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 -- 172.21.15.83:0/2987663624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55c670386ca0 con 0x55c670580830 2024-03-30T13:10:30.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5a27fc640 1 -- 172.21.15.83:0/2987663624 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b4015640 con 0x55c670580830 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5a27fc640 1 -- 172.21.15.83:0/2987663624 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fb5b4028070 con 0x55c670580830 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 10 client.5805 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 10 client.5805 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 20 client.5805 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c6705d15d0 0x55c6705d19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 4 client.5805 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5ccb29000 1 -- 172.21.15.83:0/2987663624 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c670369c90 con 0x55c6705d15d0 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c27fc640 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c6705d15d0 0x55c6705d19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5c27fc640 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c6705d15d0 0x55c6705d19e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=724d9fc943360a3d server_cookie=74f0b73e7b5bb3c3 in_seq=0 out_seq=0 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.725+0000 7fb5a27fc640 10 client.5805 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5a27fc640 1 -- 172.21.15.83:0/2987663624 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55c670369c90 con 0x55c6705d15d0 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5a27fc640 10 client.5805 handle_command_reply: tid=0 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5ccb29000 1 client.5805 shutdown 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5ccb29000 1 -- 172.21.15.83:0/2987663624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 msgr2=0x55c670585c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c670585c80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4023040 tx=0x7fb5b4004740 comp rx=0 tx=0).stop 2024-03-30T13:10:30.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5ccb29000 1 -- 172.21.15.83:0/2987663624 shutdown_connections 2024-03-30T13:10:30.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 0x55c6705af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705c9d70 0x55c6705aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c6705d15d0 0x55c6705d19e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/2987663624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c670585c80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5a27fc640 0 client.5805 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5ccb29000 1 -- 172.21.15.83:0/2987663624 >> 172.21.15.83:0/2987663624 conn(0x55c67057c7e0 msgr2=0x55c67057f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5ccb29000 1 -- 172.21.15.83:0/2987663624 shutdown_connections 2024-03-30T13:10:30.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5ccb29000 1 -- 172.21.15.83:0/2987663624 wait complete. 2024-03-30T13:10:30.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.729+0000 7fb5ccb29000 20 client.5805 trim_cache size 0 max 16384 2024-03-30T13:10:30.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5ccb29000 1 Processor -- start 2024-03-30T13:10:30.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5ccb29000 1 -- start start 2024-03-30T13:10:30.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5ccb29000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c6705add50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5ccb29000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705c9d70 0x55c6705ae290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5ccb29000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705ca690 0x55c6705aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5ccb29000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c4203de0 con 0x55c670580830 2024-03-30T13:10:30.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5ccb29000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c4202dc0 con 0x55c6705ca690 2024-03-30T13:10:30.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5ccb29000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c4202250 con 0x55c6705c9d70 2024-03-30T13:10:30.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5c2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c6705add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5c2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c6705add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39002/0 (socket says 172.21.15.83:39002) 2024-03-30T13:10:30.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/1894301826 learned_addr learned my addr 172.21.15.83:0/1894301826 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/1894301826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705c9d70 msgr2=0x55c6705ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/1894301826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705c9d70 0x55c6705ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/1894301826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705ca690 msgr2=0x55c6705aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/1894301826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705ca690 0x55c6705aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/1894301826 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c670355d00 con 0x55c670580830 2024-03-30T13:10:30.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/1894301826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c6705add50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400ecf0 tx=0x7fb5b4027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2bcf652dcdb520 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5a8ff9640 1 -- 172.21.15.83:0/1894301826 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4025040 con 0x55c670580830 2024-03-30T13:10:30.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5a8ff9640 1 -- 172.21.15.83:0/1894301826 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b4038430 con 0x55c670580830 2024-03-30T13:10:30.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.741+0000 7fb5a8ff9640 1 -- 172.21.15.83:0/1894301826 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40387e0 con 0x55c670580830 2024-03-30T13:10:30.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1894301826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 msgr2=0x55c6705add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1894301826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c6705add50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400ecf0 tx=0x7fb5b4027000 comp rx=0 tx=0).stop 2024-03-30T13:10:30.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1894301826 shutdown_connections 2024-03-30T13:10:30.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1894301826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705ca690 0x55c6705aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1894301826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705c9d70 0x55c6705ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1894301826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c6705add50 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1894301826 >> 172.21.15.83:0/1894301826 conn(0x55c67057c7e0 msgr2=0x55c6705e0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1894301826 shutdown_connections 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1894301826 wait complete. 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- start start 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 Processor -- start 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c67063c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705c9d70 0x55c67063ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 0x55c670641120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c4202750 con 0x55c670580830 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c6705e1fb0 con 0x55c6705c9d70 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55c67048ab00 con 0x55c6705ca690 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 10 client.0 _ll_register_callbacks cb 0x7fb5b4023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5c2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c67063c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5c2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c67063c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39018/0 (socket says 172.21.15.83:39018) 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/1282720327 learned_addr learned my addr 172.21.15.83:0/1282720327 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/1282720327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 msgr2=0x55c670641120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5c27fc640 1 --2- 172.21.15.83:0/1282720327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705c9d70 0x55c67063ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/1282720327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 0x55c670641120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/1282720327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705c9d70 msgr2=0x55c67063ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/1282720327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705c9d70 0x55c67063ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5c2ffd640 1 -- 172.21.15.83:0/1282720327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c67044ff70 con 0x55c670580830 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5c2ffd640 1 --2- 172.21.15.83:0/1282720327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c67063c680 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400e310 tx=0x7fb5b4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e982ceff73892a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5a27fc640 1 -- 172.21.15.83:0/1282720327 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4025040 con 0x55c670580830 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5a27fc640 1 -- 172.21.15.83:0/1282720327 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb5b4038a70 con 0x55c670580830 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1282720327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5b4038430 con 0x55c670580830 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5a27fc640 1 -- 172.21.15.83:0/1282720327 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb5b402e020 con 0x55c670580830 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 10 client.5811 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1282720327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55c670375760 con 0x55c670580830 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5a27fc640 1 -- 172.21.15.83:0/1282720327 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b4038430 con 0x55c670580830 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5a27fc640 1 -- 172.21.15.83:0/1282720327 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fb5b4012030 con 0x55c670580830 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 10 client.5811 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 10 client.5811 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 20 client.5811 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1282720327 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c670641660 0x55c670643a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 4 client.5811 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628339}] 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1282720327 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628339}) -- 0x55c6703dbfe0 con 0x55c670641660 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5c27fc640 1 --2- 172.21.15.83:0/1282720327 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c670641660 0x55c670643a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5a27fc640 10 client.5811 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5c27fc640 1 --2- 172.21.15.83:0/1282720327 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c670641660 0x55c670643a50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c5bc11726563ca1 server_cookie=d2fe5993a55fc80d in_seq=0 out_seq=0 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5a27fc640 1 -- 172.21.15.83:0/1282720327 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3825 (crc 0 0 0) 0x55c6703dbfe0 con 0x55c670641660 2024-03-30T13:10:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5a27fc640 10 client.5811 handle_command_reply: tid=0 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 client.5811 shutdown 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1282720327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 msgr2=0x55c67063c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1282720327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c67063c680 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400e310 tx=0x7fb5b4014000 comp rx=0 tx=0).stop 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1282720327 shutdown_connections 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1282720327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6705ca690 0x55c670641120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1282720327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6705c9d70 0x55c67063ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1282720327 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c670641660 0x55c670643a50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 --2- 172.21.15.83:0/1282720327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c670580830 0x55c67063c680 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5a27fc640 0 client.5811 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1282720327 >> 172.21.15.83:0/1282720327 conn(0x55c67057c7e0 msgr2=0x55c6705e0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1282720327 shutdown_connections 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.745+0000 7fb5ccb29000 1 -- 172.21.15.83:0/1282720327 wait complete. 2024-03-30T13:10:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5ccb29000 20 client.5811 trim_cache size 0 max 16384 2024-03-30T13:10:30.760 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:30.760 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-bufmap.h", 2024-03-30T13:10:30.760 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628339, 2024-03-30T13:10:30.760 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:30.760 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.148031+0000", 2024-03-30T13:10:30.760 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.287565+0000", 2024-03-30T13:10:30.760 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:30.760 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:30.760 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:30.760 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:30.760 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 925, 2024-03-30T13:10:30.761 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.287565+0000", 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.762 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 925, 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.148031+0000" 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.763 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 925, 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.148031+0000" 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 104, 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 24, 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:30.764 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:30.765 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:30.766 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.767 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.768 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.769 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.770 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:30.771 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:30.771 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:30.771 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:30.771 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:30.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5c99a7640 1 -- 172.21.15.83:0/3599183367 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb5b0067fc0 msgr2=0x7fb5b006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5c99a7640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb5b0067fc0 0x7fb5b006a480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40096d0 tx=0x7fb5b4008040 comp rx=0 tx=0).stop 2024-03-30T13:10:30.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5c99a7640 1 -- 172.21.15.83:0/3599183367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c4162e20 msgr2=0x7fb5c4168040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5c99a7640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c4162e20 0x7fb5c4168040 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00cb40 tx=0x7fb5bc00a060 comp rx=0 tx=0).stop 2024-03-30T13:10:30.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5c99a7640 1 -- 172.21.15.83:0/3599183367 shutdown_connections 2024-03-30T13:10:30.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5c99a7640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb5b0067fc0 0x7fb5b006a480 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5c99a7640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5c4162e20 0x7fb5c4168040 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5c99a7640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5c406fcc0 0x7fb5c4168ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5c99a7640 1 --2- 172.21.15.83:0/3599183367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c406f8e0 0x7fb5c41faad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5c99a7640 1 -- 172.21.15.83:0/3599183367 >> 172.21.15.83:0/3599183367 conn(0x7fb5c4072f00 msgr2=0x7fb5c406e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5c99a7640 1 -- 172.21.15.83:0/3599183367 shutdown_connections 2024-03-30T13:10:30.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.749+0000 7fb5c99a7640 1 -- 172.21.15.83:0/3599183367 wait complete. 2024-03-30T13:10:30.776 DEBUG:tasks.cephfs.test_uninlining:getting inode info #19 of 23:1099511628343 2024-03-30T13:10:30.777 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628343 2024-03-30T13:10:30.777 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628343 2024-03-30T13:10:30.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.873+0000 7f33c99c4640 1 Processor -- start 2024-03-30T13:10:30.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.873+0000 7f33c99c4640 1 -- start start 2024-03-30T13:10:30.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c99c4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f33c406f4f0 0x7f33c415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c99c4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33c40cdcf0 0x7f33c4140090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c99c4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c415eec0 con 0x7f33c406f8d0 2024-03-30T13:10:30.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c99c4640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f33c415f160 con 0x7f33c406f4f0 2024-03-30T13:10:30.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c99c4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f33c415f440 con 0x7f33c40cdcf0 2024-03-30T13:10:30.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c37fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33c40cdcf0 0x7f33c4140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c2ffd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f33c406f4f0 0x7f33c415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c37fe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33c40cdcf0 0x7f33c4140090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:44456/0 (socket says 172.21.15.83:44456) 2024-03-30T13:10:30.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c37fe640 1 -- 172.21.15.83:0/3310316187 learned_addr learned my addr 172.21.15.83:0/3310316187 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c37fe640 1 -- 172.21.15.83:0/3310316187 >> v2:172.21.15.153:3300/0 conn(0x7f33c406f4f0 msgr2=0x7f33c415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c37fe640 1 --2- 172.21.15.83:0/3310316187 >> v2:172.21.15.153:3300/0 conn(0x7f33c406f4f0 0x7f33c415bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c37fe640 1 -- 172.21.15.83:0/3310316187 >> v1:172.21.15.153:6789/0 conn(0x7f33c406f8d0 legacy=0x7f33c415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c37fe640 1 -- 172.21.15.83:0/3310316187 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c415f720 con 0x7f33c40cdcf0 2024-03-30T13:10:30.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.877+0000 7f33c37fe640 1 --2- 172.21.15.83:0/3310316187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33c40cdcf0 0x7f33c4140090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009e50 tx=0x7f33bc01ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=909b1554a8c0c7cc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c1ffb640 1 -- 172.21.15.83:0/3310316187 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0a58f0 con 0x7f33c40cdcf0 2024-03-30T13:10:30.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c1ffb640 1 -- 172.21.15.83:0/3310316187 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33bc0a5a90 con 0x7f33c40cdcf0 2024-03-30T13:10:30.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c1ffb640 1 -- 172.21.15.83:0/3310316187 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0a5e60 con 0x7f33c40cdcf0 2024-03-30T13:10:30.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c99c4640 1 -- 172.21.15.83:0/3310316187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33c40cdcf0 msgr2=0x7f33c4140090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c99c4640 1 --2- 172.21.15.83:0/3310316187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33c40cdcf0 0x7f33c4140090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009e50 tx=0x7f33bc01ca00 comp rx=0 tx=0).stop 2024-03-30T13:10:30.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c99c4640 1 -- 172.21.15.83:0/3310316187 shutdown_connections 2024-03-30T13:10:30.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c99c4640 1 --2- 172.21.15.83:0/3310316187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33c40cdcf0 0x7f33c4140090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c99c4640 1 --2- 172.21.15.83:0/3310316187 >> v2:172.21.15.153:3300/0 conn(0x7f33c406f4f0 0x7f33c415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c99c4640 1 -- 172.21.15.83:0/3310316187 >> 172.21.15.83:0/3310316187 conn(0x7f33c4072f00 msgr2=0x7f33c406b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c99c4640 1 -- 172.21.15.83:0/3310316187 shutdown_connections 2024-03-30T13:10:30.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c99c4640 1 -- 172.21.15.83:0/3310316187 wait complete. 2024-03-30T13:10:30.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c99c4640 1 Processor -- start 2024-03-30T13:10:30.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.881+0000 7f33c99c4640 1 -- start start 2024-03-30T13:10:30.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c99c4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c406f4f0 0x7f33c41361e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c99c4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33c406f8d0 0x7f33c413c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c99c4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c40cdcf0 0x7f33c413cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c99c4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f33c4141170 con 0x7f33c40cdcf0 2024-03-30T13:10:30.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c99c4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f33c4140ff0 con 0x7f33c406f4f0 2024-03-30T13:10:30.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c99c4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f33c41412f0 con 0x7f33c406f8d0 2024-03-30T13:10:30.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c40cdcf0 0x7f33c413cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c40cdcf0 0x7f33c413cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39032/0 (socket says 172.21.15.83:39032) 2024-03-30T13:10:30.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c37fe640 1 -- 172.21.15.83:0/4248377636 learned_addr learned my addr 172.21.15.83:0/4248377636 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c406f4f0 0x7f33c41361e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c27fc640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33c406f8d0 0x7f33c413c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c37fe640 1 -- 172.21.15.83:0/4248377636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33c406f8d0 msgr2=0x7f33c413c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c37fe640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33c406f8d0 0x7f33c413c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c37fe640 1 -- 172.21.15.83:0/4248377636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c406f4f0 msgr2=0x7f33c41361e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c37fe640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c406f4f0 0x7f33c41361e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c37fe640 1 -- 172.21.15.83:0/4248377636 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c4142150 con 0x7f33c40cdcf0 2024-03-30T13:10:30.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c37fe640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c40cdcf0 0x7f33c413cd70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0af040 tx=0x7f33bc0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33abfff640 1 -- 172.21.15.83:0/4248377636 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0a58f0 con 0x7f33c40cdcf0 2024-03-30T13:10:30.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33abfff640 1 -- 172.21.15.83:0/4248377636 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33bc0b8440 con 0x7f33c40cdcf0 2024-03-30T13:10:30.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c99c4640 1 -- 172.21.15.83:0/4248377636 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c41423e0 con 0x7f33c40cdcf0 2024-03-30T13:10:30.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33abfff640 1 -- 172.21.15.83:0/4248377636 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc009510 con 0x7f33c40cdcf0 2024-03-30T13:10:30.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c99c4640 1 -- 172.21.15.83:0/4248377636 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c41429a0 con 0x7f33c40cdcf0 2024-03-30T13:10:30.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33abfff640 1 -- 172.21.15.83:0/4248377636 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f33bc0c1020 con 0x7f33c40cdcf0 2024-03-30T13:10:30.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33abfff640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f33b0067fc0 0x7f33b006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33abfff640 1 -- 172.21.15.83:0/4248377636 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f33bc121280 con 0x7f33c40cdcf0 2024-03-30T13:10:30.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f33b0067fc0 0x7f33b006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33ccb46000 1 Processor -- start 2024-03-30T13:10:30.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33ccb46000 1 -- start start 2024-03-30T13:10:30.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.885+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f33b0067fc0 0x7f33b006a480 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009af0 tx=0x7f33b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 0x5596a6589150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a6589690 0x5596a653f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a653f830 0x5596a653fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5596a638daa0 con 0x5596a6588d70 2024-03-30T13:10:30.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5596a6314af0 con 0x5596a653f830 2024-03-30T13:10:30.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5596a6389a50 con 0x5596a6589690 2024-03-30T13:10:30.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 0x5596a6589150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 0x5596a6589150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39046/0 (socket says 172.21.15.83:39046) 2024-03-30T13:10:30.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c2ffd640 1 -- 172.21.15.83:0/2023287353 learned_addr learned my addr 172.21.15.83:0/2023287353 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c37fe640 1 --2- 172.21.15.83:0/2023287353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a653f830 0x5596a653fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c27fc640 1 --2- 172.21.15.83:0/2023287353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a6589690 0x5596a653f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c2ffd640 1 -- 172.21.15.83:0/2023287353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a6589690 msgr2=0x5596a653f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/2023287353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a6589690 0x5596a653f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c2ffd640 1 -- 172.21.15.83:0/2023287353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a653f830 msgr2=0x5596a653fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/2023287353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a653f830 0x5596a653fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c2ffd640 1 -- 172.21.15.83:0/2023287353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a6312d00 con 0x5596a6588d70 2024-03-30T13:10:30.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c37fe640 1 --2- 172.21.15.83:0/2023287353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a653f830 0x5596a653fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/2023287353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 0x5596a6589150 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f33b4011dc0 tx=0x7f33b4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f41171057e232 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33a97fa640 1 -- 172.21.15.83:0/2023287353 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4011df0 con 0x5596a6588d70 2024-03-30T13:10:30.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33a97fa640 1 -- 172.21.15.83:0/2023287353 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b4026070 con 0x5596a6588d70 2024-03-30T13:10:30.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33a97fa640 1 -- 172.21.15.83:0/2023287353 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4021640 con 0x5596a6588d70 2024-03-30T13:10:30.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- 172.21.15.83:0/2023287353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 msgr2=0x5596a6589150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 --2- 172.21.15.83:0/2023287353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 0x5596a6589150 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f33b4011dc0 tx=0x7f33b4014000 comp rx=0 tx=0).stop 2024-03-30T13:10:30.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- 172.21.15.83:0/2023287353 shutdown_connections 2024-03-30T13:10:30.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 --2- 172.21.15.83:0/2023287353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a653f830 0x5596a653fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 --2- 172.21.15.83:0/2023287353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a6589690 0x5596a653f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 --2- 172.21.15.83:0/2023287353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 0x5596a6589150 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- 172.21.15.83:0/2023287353 >> 172.21.15.83:0/2023287353 conn(0x5596a653b7e0 msgr2=0x5596a653dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- 172.21.15.83:0/2023287353 shutdown_connections 2024-03-30T13:10:30.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- 172.21.15.83:0/2023287353 wait complete. 2024-03-30T13:10:30.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- start start 2024-03-30T13:10:30.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 Processor -- start 2024-03-30T13:10:30.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a653f830 0x5596a6544c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 0x5596a656dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a6589690 0x5596a656e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5596a6355270 con 0x5596a6588d70 2024-03-30T13:10:30.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5596a634b6a0 con 0x5596a6589690 2024-03-30T13:10:30.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5596a6325880 con 0x5596a653f830 2024-03-30T13:10:30.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 10 client.0 _ll_register_callbacks cb 0x5596a652a490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:30.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c27fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 0x5596a656dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c27fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 0x5596a656dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39058/0 (socket says 172.21.15.83:39058) 2024-03-30T13:10:30.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c27fc640 1 -- 172.21.15.83:0/1981313721 learned_addr learned my addr 172.21.15.83:0/1981313721 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a653f830 0x5596a6544c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c37fe640 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a6589690 0x5596a656e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c27fc640 1 -- 172.21.15.83:0/1981313721 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a653f830 msgr2=0x5596a6544c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c27fc640 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a653f830 0x5596a6544c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c27fc640 1 -- 172.21.15.83:0/1981313721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a6589690 msgr2=0x5596a656e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c27fc640 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a6589690 0x5596a656e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c27fc640 1 -- 172.21.15.83:0/1981313721 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596a6352730 con 0x5596a6588d70 2024-03-30T13:10:30.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33c27fc640 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 0x5596a656dda0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f33b8001d70 tx=0x7f33b800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fe8a6d4a6c7cd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:30.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33a27fc640 1 -- 172.21.15.83:0/1981313721 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b80050d0 con 0x5596a6588d70 2024-03-30T13:10:30.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33a27fc640 1 -- 172.21.15.83:0/1981313721 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f33b8005270 con 0x5596a6588d70 2024-03-30T13:10:30.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.889+0000 7f33ccb46000 1 -- 172.21.15.83:0/1981313721 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33b4026070 con 0x5596a6588d70 2024-03-30T13:10:30.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33a27fc640 1 -- 172.21.15.83:0/1981313721 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f33b8020050 con 0x5596a6588d70 2024-03-30T13:10:30.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 10 client.5820 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:30.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 -- 172.21.15.83:0/1981313721 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5596a6345ca0 con 0x5596a6588d70 2024-03-30T13:10:30.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33a27fc640 1 -- 172.21.15.83:0/1981313721 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b4026070 con 0x5596a6588d70 2024-03-30T13:10:30.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33a27fc640 1 -- 172.21.15.83:0/1981313721 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f33b8023020 con 0x5596a6588d70 2024-03-30T13:10:30.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 10 client.5820 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:30.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 10 client.5820 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:30.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 20 client.5820 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:30.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5596a65905d0 0x5596a65909b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 4 client.5820 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:30.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 -- 172.21.15.83:0/1981313721 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596a6328c90 con 0x5596a65905d0 2024-03-30T13:10:30.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5596a65905d0 0x5596a65909b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5596a65905d0 0x5596a65909b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=758f1531333635a4 server_cookie=193d7006bc165291 in_seq=0 out_seq=0 2024-03-30T13:10:30.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33a27fc640 10 client.5820 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33a27fc640 1 -- 172.21.15.83:0/1981313721 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5596a6328c90 con 0x5596a65905d0 2024-03-30T13:10:30.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33a27fc640 10 client.5820 handle_command_reply: tid=0 2024-03-30T13:10:30.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 client.5820 shutdown 2024-03-30T13:10:30.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 -- 172.21.15.83:0/1981313721 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 msgr2=0x5596a656dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 0x5596a656dda0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f33b8001d70 tx=0x7f33b800f5a0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 -- 172.21.15.83:0/1981313721 shutdown_connections 2024-03-30T13:10:30.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a6589690 0x5596a656e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5596a65905d0 0x5596a65909b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6588d70 0x5596a656dda0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 --2- 172.21.15.83:0/1981313721 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a653f830 0x5596a6544c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33a27fc640 0 client.5820 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 -- 172.21.15.83:0/1981313721 >> 172.21.15.83:0/1981313721 conn(0x5596a653b7e0 msgr2=0x5596a653e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 -- 172.21.15.83:0/1981313721 shutdown_connections 2024-03-30T13:10:30.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 1 -- 172.21.15.83:0/1981313721 wait complete. 2024-03-30T13:10:30.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.893+0000 7f33ccb46000 20 client.5820 trim_cache size 0 max 16384 2024-03-30T13:10:30.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 Processor -- start 2024-03-30T13:10:30.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- start start 2024-03-30T13:10:30.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a653f830 0x5596a653f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a6588d70 0x5596a653dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 0x5596a653e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f33c42013a0 con 0x5596a6589690 2024-03-30T13:10:30.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f33c42003c0 con 0x5596a6588d70 2024-03-30T13:10:30.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f33c41ff720 con 0x5596a653f830 2024-03-30T13:10:30.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33c37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 0x5596a653e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33c37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 0x5596a653e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39070/0 (socket says 172.21.15.83:39070) 2024-03-30T13:10:30.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33c37fe640 1 -- 172.21.15.83:0/3982776320 learned_addr learned my addr 172.21.15.83:0/3982776320 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/3982776320 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a653f830 0x5596a653f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33c27fc640 1 --2- 172.21.15.83:0/3982776320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a6588d70 0x5596a653dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33c37fe640 1 -- 172.21.15.83:0/3982776320 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a653f830 msgr2=0x5596a653f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33c37fe640 1 --2- 172.21.15.83:0/3982776320 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a653f830 0x5596a653f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33c37fe640 1 -- 172.21.15.83:0/3982776320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a6588d70 msgr2=0x5596a653dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33c37fe640 1 --2- 172.21.15.83:0/3982776320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a6588d70 0x5596a653dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33c37fe640 1 -- 172.21.15.83:0/3982776320 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a6314d00 con 0x5596a6589690 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/3982776320 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a653f830 0x5596a653f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33c37fe640 1 --2- 172.21.15.83:0/3982776320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 0x5596a653e110 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f33bc01a630 tx=0x7f33bc0ed5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c5d177055ec962 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33a8ff9640 1 -- 172.21.15.83:0/3982776320 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0f0c90 con 0x5596a6589690 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33a8ff9640 1 -- 172.21.15.83:0/3982776320 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33bc0a5a90 con 0x5596a6589690 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33a8ff9640 1 -- 172.21.15.83:0/3982776320 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc1210b0 con 0x5596a6589690 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- 172.21.15.83:0/3982776320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 msgr2=0x5596a653e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 --2- 172.21.15.83:0/3982776320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 0x5596a653e110 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f33bc01a630 tx=0x7f33bc0ed5d0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- 172.21.15.83:0/3982776320 shutdown_connections 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 --2- 172.21.15.83:0/3982776320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 0x5596a653e110 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 --2- 172.21.15.83:0/3982776320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a6588d70 0x5596a653dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 --2- 172.21.15.83:0/3982776320 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a653f830 0x5596a653f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- 172.21.15.83:0/3982776320 >> 172.21.15.83:0/3982776320 conn(0x5596a653b7e0 msgr2=0x5596a656c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- 172.21.15.83:0/3982776320 shutdown_connections 2024-03-30T13:10:30.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- 172.21.15.83:0/3982776320 wait complete. 2024-03-30T13:10:30.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- start start 2024-03-30T13:10:30.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 Processor -- start 2024-03-30T13:10:30.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a653f830 0x5596a656e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a6588d70 0x5596a65f9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 0x5596a65fa070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5596a634b6a0 con 0x5596a6589690 2024-03-30T13:10:30.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f33c41ffd70 con 0x5596a653f830 2024-03-30T13:10:30.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5596a638cdb0 con 0x5596a6588d70 2024-03-30T13:10:30.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.921+0000 7f33ccb46000 10 client.0 _ll_register_callbacks cb 0x7f33b8007d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:30.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 0x5596a65fa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 0x5596a65fa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39074/0 (socket says 172.21.15.83:39074) 2024-03-30T13:10:30.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c37fe640 1 -- 172.21.15.83:0/3182415024 learned_addr learned my addr 172.21.15.83:0/3182415024 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:30.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c37fe640 1 -- 172.21.15.83:0/3182415024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a6588d70 msgr2=0x5596a65f9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c37fe640 1 --2- 172.21.15.83:0/3182415024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a6588d70 0x5596a65f9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c37fe640 1 -- 172.21.15.83:0/3182415024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a653f830 msgr2=0x5596a656e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:30.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c37fe640 1 --2- 172.21.15.83:0/3182415024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a653f830 0x5596a656e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c37fe640 1 -- 172.21.15.83:0/3182415024 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596a640ef70 con 0x5596a6589690 2024-03-30T13:10:30.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c37fe640 1 --2- 172.21.15.83:0/3182415024 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 0x5596a65fa070 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f33bc01d2a0 tx=0x7f33bc009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767cd8a7a2f618b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:30.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:30.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33a27fc640 1 -- 172.21.15.83:0/3182415024 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0f1a30 con 0x5596a6589690 2024-03-30T13:10:30.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33a27fc640 1 -- 172.21.15.83:0/3182415024 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f33bc0f1590 con 0x5596a6589690 2024-03-30T13:10:30.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 -- 172.21.15.83:0/3182415024 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33bc0a5a90 con 0x5596a6589690 2024-03-30T13:10:30.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33a27fc640 1 -- 172.21.15.83:0/3182415024 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f33bc0f1330 con 0x5596a6589690 2024-03-30T13:10:30.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 10 client.5826 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:30.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 -- 172.21.15.83:0/3182415024 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5596a6334760 con 0x5596a6589690 2024-03-30T13:10:30.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33a27fc640 1 -- 172.21.15.83:0/3182415024 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33bc0a5a90 con 0x5596a6589690 2024-03-30T13:10:30.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33a27fc640 1 -- 172.21.15.83:0/3182415024 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f33bc11fbd0 con 0x5596a6589690 2024-03-30T13:10:30.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 10 client.5826 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:30.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 10 client.5826 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:30.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 20 client.5826 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:30.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 --2- 172.21.15.83:0/3182415024 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5596a65f67a0 0x5596a65f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:30.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 4 client.5826 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628343}] 2024-03-30T13:10:30.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 -- 172.21.15.83:0/3182415024 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628343}) -- 0x5596a639afe0 con 0x5596a65f67a0 2024-03-30T13:10:30.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/3182415024 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5596a65f67a0 0x5596a65f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:30.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/3182415024 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5596a65f67a0 0x5596a65f6bb0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8987ea474e2e6623 server_cookie=64c7cc49df4c595d in_seq=0 out_seq=0 2024-03-30T13:10:30.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33a27fc640 10 client.5826 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33a27fc640 1 -- 172.21.15.83:0/3182415024 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3826 (crc 0 0 0) 0x5596a639afe0 con 0x5596a65f67a0 2024-03-30T13:10:30.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33a27fc640 10 client.5826 handle_command_reply: tid=0 2024-03-30T13:10:30.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 client.5826 shutdown 2024-03-30T13:10:30.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 -- 172.21.15.83:0/3182415024 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 msgr2=0x5596a65fa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 --2- 172.21.15.83:0/3182415024 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 0x5596a65fa070 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f33bc01d2a0 tx=0x7f33bc009810 comp rx=0 tx=0).stop 2024-03-30T13:10:30.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 -- 172.21.15.83:0/3182415024 shutdown_connections 2024-03-30T13:10:30.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 --2- 172.21.15.83:0/3182415024 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5596a65f67a0 0x5596a65f6bb0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 --2- 172.21.15.83:0/3182415024 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5596a6589690 0x5596a65fa070 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 --2- 172.21.15.83:0/3182415024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5596a6588d70 0x5596a65f9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33a27fc640 0 client.5826 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:30.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 --2- 172.21.15.83:0/3182415024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596a653f830 0x5596a656e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 -- 172.21.15.83:0/3182415024 >> 172.21.15.83:0/3182415024 conn(0x5596a653b7e0 msgr2=0x5596a659f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 -- 172.21.15.83:0/3182415024 shutdown_connections 2024-03-30T13:10:30.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 1 -- 172.21.15.83:0/3182415024 wait complete. 2024-03-30T13:10:30.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33ccb46000 20 client.5826 trim_cache size 0 max 16384 2024-03-30T13:10:30.942 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:30.943 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-debugfs.h", 2024-03-30T13:10:30.943 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628343, 2024-03-30T13:10:30.943 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:30.943 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.177101+0000", 2024-03-30T13:10:30.943 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.296208+0000", 2024-03-30T13:10:30.943 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:30.943 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:30.943 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:30.943 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:30.944 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:30.944 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:30.944 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:30.944 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:30.944 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:30.944 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.944 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:30.944 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:30.944 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:30.944 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:30.945 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:30.945 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:30.945 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.945 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:30.945 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 311, 2024-03-30T13:10:30.945 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:30.945 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:30.945 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:30.945 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:30.945 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:30.946 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.296208+0000", 2024-03-30T13:10:30.946 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:30.946 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:30.946 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:30.946 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:30.946 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:30.946 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:30.946 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:30.946 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:30.946 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.947 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:30.947 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:30.947 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:30.947 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:30.947 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.947 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:30.947 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.948 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 311, 2024-03-30T13:10:30.948 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:30.948 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:30.948 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:30.948 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.177101+0000" 2024-03-30T13:10:30.948 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.948 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:30.948 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:30.948 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 311, 2024-03-30T13:10:30.948 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:30.949 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:30.949 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:30.949 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.177101+0000" 2024-03-30T13:10:30.949 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.949 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 124, 2024-03-30T13:10:30.949 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:30.949 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:30.949 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 32, 2024-03-30T13:10:30.949 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:30.949 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:30.949 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:30.950 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:30.950 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:30.950 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:30.950 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:30.950 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.950 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:30.950 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:30.950 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:30.950 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:30.951 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:30.951 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:30.951 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.951 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:30.951 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:30.951 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:30.951 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:30.951 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:30.951 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:30.951 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.951 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:30.952 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:30.953 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:30.953 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:30.953 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:30.953 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:30.953 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:30.953 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:30.953 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.953 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:30.953 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:30.953 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.953 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.954 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:30.954 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.954 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.954 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.954 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.954 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.954 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.954 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:30.955 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:30.955 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:30.955 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:30.955 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:30.955 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:30.955 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:30.955 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.955 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.955 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:30.955 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.956 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.956 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.956 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.956 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.956 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.956 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:30.956 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:30.956 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:30.956 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:30.956 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:30.956 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:30.958 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:30.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c99c4640 1 -- 172.21.15.83:0/4248377636 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f33b0067fc0 msgr2=0x7f33b006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c99c4640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f33b0067fc0 0x7f33b006a480 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009af0 tx=0x7f33b4008040 comp rx=0 tx=0).stop 2024-03-30T13:10:30.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c99c4640 1 -- 172.21.15.83:0/4248377636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c40cdcf0 msgr2=0x7f33c413cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:30.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c99c4640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c40cdcf0 0x7f33c413cd70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0af040 tx=0x7f33bc0197a0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c99c4640 1 -- 172.21.15.83:0/4248377636 shutdown_connections 2024-03-30T13:10:30.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c99c4640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f33b0067fc0 0x7f33b006a480 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c99c4640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c40cdcf0 0x7f33c413cd70 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c99c4640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33c406f8d0 0x7f33c413c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c99c4640 1 --2- 172.21.15.83:0/4248377636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c406f4f0 0x7f33c41361e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:30.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c99c4640 1 -- 172.21.15.83:0/4248377636 >> 172.21.15.83:0/4248377636 conn(0x7f33c4072f00 msgr2=0x7f33c40b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:30.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c99c4640 1 -- 172.21.15.83:0/4248377636 shutdown_connections 2024-03-30T13:10:30.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:30.925+0000 7f33c99c4640 1 -- 172.21.15.83:0/4248377636 wait complete. 2024-03-30T13:10:30.961 DEBUG:tasks.cephfs.test_uninlining:getting inode info #20 of 23:1099511628344 2024-03-30T13:10:30.961 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628344 2024-03-30T13:10:30.962 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628344 2024-03-30T13:10:31.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68dd629640 1 Processor -- start 2024-03-30T13:10:31.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68dd629640 1 -- start start 2024-03-30T13:10:31.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68dd629640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68d815e860 0x7f68d80b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68dd629640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f68d80b6320 0x7f68d806b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68dd629640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68d80b2080 con 0x7f68d806bba0 2024-03-30T13:10:31.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68dd629640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f68d80b2360 con 0x7f68d80b6320 2024-03-30T13:10:31.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68dd629640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f68d80b2640 con 0x7f68d815e860 2024-03-30T13:10:31.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68d67fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f68d80b6320 0x7f68d806b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68d67fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f68d80b6320 0x7f68d806b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39086/0 (socket says 172.21.15.83:39086) 2024-03-30T13:10:31.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68d67fc640 1 -- 172.21.15.83:0/3683675757 learned_addr learned my addr 172.21.15.83:0/3683675757 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68d6ffd640 1 --2- 172.21.15.83:0/3683675757 >> v2:172.21.15.153:3300/0 conn(0x7f68d815e860 0x7f68d80b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68d67fc640 1 -- 172.21.15.83:0/3683675757 >> v2:172.21.15.153:3300/0 conn(0x7f68d815e860 msgr2=0x7f68d80b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68d67fc640 1 --2- 172.21.15.83:0/3683675757 >> v2:172.21.15.153:3300/0 conn(0x7f68d815e860 0x7f68d80b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68d67fc640 1 -- 172.21.15.83:0/3683675757 >> v1:172.21.15.153:6789/0 conn(0x7f68d806bba0 legacy=0x7f68d80b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.065+0000 7f68d67fc640 1 -- 172.21.15.83:0/3683675757 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d80b2920 con 0x7f68d80b6320 2024-03-30T13:10:31.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68d67fc640 1 --2- 172.21.15.83:0/3683675757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68d80b6320 0x7f68d806b660 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f68d806d7c0 tx=0x7f68c801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79dcef1d486717d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68d5ffb640 1 -- 172.21.15.83:0/3683675757 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c80b5070 con 0x7f68d80b6320 2024-03-30T13:10:31.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68d5ffb640 1 -- 172.21.15.83:0/3683675757 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c80a89d0 con 0x7f68d80b6320 2024-03-30T13:10:31.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68d5ffb640 1 -- 172.21.15.83:0/3683675757 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c80a8da0 con 0x7f68d80b6320 2024-03-30T13:10:31.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68dd629640 1 -- 172.21.15.83:0/3683675757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68d80b6320 msgr2=0x7f68d806b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68dd629640 1 --2- 172.21.15.83:0/3683675757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68d80b6320 0x7f68d806b660 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f68d806d7c0 tx=0x7f68c801ecd0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68dd629640 1 -- 172.21.15.83:0/3683675757 shutdown_connections 2024-03-30T13:10:31.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68dd629640 1 --2- 172.21.15.83:0/3683675757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68d80b6320 0x7f68d806b660 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68dd629640 1 --2- 172.21.15.83:0/3683675757 >> v2:172.21.15.153:3300/0 conn(0x7f68d815e860 0x7f68d80b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68dd629640 1 -- 172.21.15.83:0/3683675757 >> 172.21.15.83:0/3683675757 conn(0x7f68d8072d30 msgr2=0x7f68d80b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68dd629640 1 -- 172.21.15.83:0/3683675757 shutdown_connections 2024-03-30T13:10:31.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68dd629640 1 -- 172.21.15.83:0/3683675757 wait complete. 2024-03-30T13:10:31.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68dd629640 1 Processor -- start 2024-03-30T13:10:31.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.069+0000 7f68dd629640 1 -- start start 2024-03-30T13:10:31.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68dd629640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68d806bba0 0x7f68d8154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68dd629640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68d80b6320 0x7f68d815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68dd629640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d815e860 0x7f68d80cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68dd629640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f68d80af5c0 con 0x7f68d806bba0 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68dd629640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68d80af440 con 0x7f68d815e860 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68dd629640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f68d80af740 con 0x7f68d80b6320 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68d806bba0 0x7f68d8154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68d806bba0 0x7f68d8154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39094/0 (socket says 172.21.15.83:39094) 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d6ffd640 1 -- 172.21.15.83:0/2068460461 learned_addr learned my addr 172.21.15.83:0/2068460461 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d67fc640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68d80b6320 0x7f68d815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d77fe640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d815e860 0x7f68d80cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d6ffd640 1 -- 172.21.15.83:0/2068460461 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68d80b6320 msgr2=0x7f68d815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d6ffd640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68d80b6320 0x7f68d815eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d6ffd640 1 -- 172.21.15.83:0/2068460461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d815e860 msgr2=0x7f68d80cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d6ffd640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d815e860 0x7f68d80cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d6ffd640 1 -- 172.21.15.83:0/2068460461 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d815f420 con 0x7f68d806bba0 2024-03-30T13:10:31.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d77fe640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d815e860 0x7f68d80cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:31.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d6ffd640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68d806bba0 0x7f68d8154370 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f68c000d620 tx=0x7f68c000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68cf7fe640 1 -- 172.21.15.83:0/2068460461 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c000b620 con 0x7f68d806bba0 2024-03-30T13:10:31.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68cf7fe640 1 -- 172.21.15.83:0/2068460461 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c0019070 con 0x7f68d806bba0 2024-03-30T13:10:31.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68dd629640 1 -- 172.21.15.83:0/2068460461 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d815f6c0 con 0x7f68d806bba0 2024-03-30T13:10:31.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68cf7fe640 1 -- 172.21.15.83:0/2068460461 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c000ba20 con 0x7f68d806bba0 2024-03-30T13:10:31.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68dd629640 1 -- 172.21.15.83:0/2068460461 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d815fc80 con 0x7f68d806bba0 2024-03-30T13:10:31.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68cf7fe640 1 -- 172.21.15.83:0/2068460461 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f68c000bbc0 con 0x7f68d806bba0 2024-03-30T13:10:31.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68cf7fe640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f68b8067fc0 0x7f68b806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d67fc640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f68b8067fc0 0x7f68b806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68cf7fe640 1 -- 172.21.15.83:0/2068460461 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f68c0086a00 con 0x7f68d806bba0 2024-03-30T13:10:31.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.073+0000 7f68d67fc640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f68b8067fc0 0x7f68b806a480 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f68c80b2000 tx=0x7f68c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 Processor -- start 2024-03-30T13:10:31.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 -- start start 2024-03-30T13:10:31.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff18d70 0x56463ff19150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463fecf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463fecf830 0x56463fecfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56463fd1daa0 con 0x56463ff19690 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56463fca4af0 con 0x56463ff18d70 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56463fd19a50 con 0x56463fecf830 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68d67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463fecf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68d67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463fecf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39100/0 (socket says 172.21.15.83:39100) 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68d67fc640 1 -- 172.21.15.83:0/2452853842 learned_addr learned my addr 172.21.15.83:0/2452853842 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68d67fc640 1 -- 172.21.15.83:0/2452853842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463fecf830 msgr2=0x56463fecfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68d67fc640 1 --2- 172.21.15.83:0/2452853842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463fecf830 0x56463fecfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68d67fc640 1 -- 172.21.15.83:0/2452853842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff18d70 msgr2=0x56463ff19150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68d6ffd640 1 --2- 172.21.15.83:0/2452853842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff18d70 0x56463ff19150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68d67fc640 1 --2- 172.21.15.83:0/2452853842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff18d70 0x56463ff19150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68d67fc640 1 -- 172.21.15.83:0/2452853842 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56463fca2d00 con 0x56463ff19690 2024-03-30T13:10:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68d67fc640 1 --2- 172.21.15.83:0/2452853842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463fecf2f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f68c80b3040 tx=0x7f68c8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7f86ad9ccac9eb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68ccff9640 1 -- 172.21.15.83:0/2452853842 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c80cb070 con 0x56463ff19690 2024-03-30T13:10:31.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68ccff9640 1 -- 172.21.15.83:0/2452853842 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c80b0500 con 0x56463ff19690 2024-03-30T13:10:31.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68ccff9640 1 -- 172.21.15.83:0/2452853842 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c80b5040 con 0x56463ff19690 2024-03-30T13:10:31.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 -- 172.21.15.83:0/2452853842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 msgr2=0x56463fecf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 --2- 172.21.15.83:0/2452853842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463fecf2f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f68c80b3040 tx=0x7f68c8004740 comp rx=0 tx=0).stop 2024-03-30T13:10:31.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 -- 172.21.15.83:0/2452853842 shutdown_connections 2024-03-30T13:10:31.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 --2- 172.21.15.83:0/2452853842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463fecf830 0x56463fecfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 --2- 172.21.15.83:0/2452853842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463fecf2f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 --2- 172.21.15.83:0/2452853842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff18d70 0x56463ff19150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 -- 172.21.15.83:0/2452853842 >> 172.21.15.83:0/2452853842 conn(0x56463fecb7e0 msgr2=0x56463fecdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 -- 172.21.15.83:0/2452853842 shutdown_connections 2024-03-30T13:10:31.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.077+0000 7f68e07ab000 1 -- 172.21.15.83:0/2452853842 wait complete. 2024-03-30T13:10:31.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 1 -- start start 2024-03-30T13:10:31.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 1 Processor -- start 2024-03-30T13:10:31.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463fecf830 0x56463fed4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463ff18d70 0x56463fefdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff19690 0x56463fefe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56463fce5270 con 0x56463fecf830 2024-03-30T13:10:31.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56463fcdb6a0 con 0x56463ff19690 2024-03-30T13:10:31.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56463fcb5880 con 0x56463ff18d70 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68d6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463fecf830 0x56463fed4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 10 client.0 _ll_register_callbacks cb 0x56463feba490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68d6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463fecf830 0x56463fed4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39112/0 (socket says 172.21.15.83:39112) 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68d6ffd640 1 -- 172.21.15.83:0/55151480 learned_addr learned my addr 172.21.15.83:0/55151480 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68d67fc640 1 --2- 172.21.15.83:0/55151480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463ff18d70 0x56463fefdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68d6ffd640 1 -- 172.21.15.83:0/55151480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463ff18d70 msgr2=0x56463fefdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68d6ffd640 1 --2- 172.21.15.83:0/55151480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463ff18d70 0x56463fefdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68d6ffd640 1 -- 172.21.15.83:0/55151480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff19690 msgr2=0x56463fefe2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68d6ffd640 1 --2- 172.21.15.83:0/55151480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff19690 0x56463fefe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68d6ffd640 1 -- 172.21.15.83:0/55151480 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56463fce2730 con 0x56463fecf830 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68d6ffd640 1 --2- 172.21.15.83:0/55151480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463fecf830 0x56463fed4c80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f68c005f150 tx=0x7f68c0056aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb273d55cdc7dc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68b5ffb640 1 -- 172.21.15.83:0/55151480 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c0083060 con 0x56463fecf830 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68b5ffb640 1 -- 172.21.15.83:0/55151480 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f68c005f1f0 con 0x56463fecf830 2024-03-30T13:10:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 1 -- 172.21.15.83:0/55151480 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68c80b0500 con 0x56463fecf830 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68b5ffb640 1 -- 172.21.15.83:0/55151480 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f68c005f3f0 con 0x56463fecf830 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 10 client.5838 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 1 -- 172.21.15.83:0/55151480 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x56463fcd5ca0 con 0x56463fecf830 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68b5ffb640 1 -- 172.21.15.83:0/55151480 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c80b0500 con 0x56463fecf830 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68b5ffb640 1 -- 172.21.15.83:0/55151480 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f68c0086050 con 0x56463fecf830 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 10 client.5838 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 10 client.5838 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 20 client.5838 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 1 --2- 172.21.15.83:0/55151480 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56463ff205d0 0x56463ff209e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 4 client.5838 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68e07ab000 1 -- 172.21.15.83:0/55151480 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56463fcb8c90 con 0x56463ff205d0 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68d67fc640 1 --2- 172.21.15.83:0/55151480 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56463ff205d0 0x56463ff209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68b5ffb640 10 client.5838 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.081+0000 7f68d67fc640 1 --2- 172.21.15.83:0/55151480 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56463ff205d0 0x56463ff209e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e23c54d044ed66b server_cookie=662045f60922cc1c in_seq=0 out_seq=0 2024-03-30T13:10:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68b5ffb640 1 -- 172.21.15.83:0/55151480 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x56463fcb8c90 con 0x56463ff205d0 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68b5ffb640 10 client.5838 handle_command_reply: tid=0 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68e07ab000 1 client.5838 shutdown 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68e07ab000 1 -- 172.21.15.83:0/55151480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463fecf830 msgr2=0x56463fed4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68e07ab000 1 --2- 172.21.15.83:0/55151480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463fecf830 0x56463fed4c80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f68c005f150 tx=0x7f68c0056aa0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68e07ab000 1 -- 172.21.15.83:0/55151480 shutdown_connections 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68e07ab000 1 --2- 172.21.15.83:0/55151480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff19690 0x56463fefe2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68e07ab000 1 --2- 172.21.15.83:0/55151480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463ff18d70 0x56463fefdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68e07ab000 1 --2- 172.21.15.83:0/55151480 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56463ff205d0 0x56463ff209e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68e07ab000 1 --2- 172.21.15.83:0/55151480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463fecf830 0x56463fed4c80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68b5ffb640 0 client.5838 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68e07ab000 1 -- 172.21.15.83:0/55151480 >> 172.21.15.83:0/55151480 conn(0x56463fecb7e0 msgr2=0x56463fece460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68e07ab000 1 -- 172.21.15.83:0/55151480 shutdown_connections 2024-03-30T13:10:31.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68e07ab000 1 -- 172.21.15.83:0/55151480 wait complete. 2024-03-30T13:10:31.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.085+0000 7f68e07ab000 20 client.5838 trim_cache size 0 max 16384 2024-03-30T13:10:31.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68e07ab000 1 Processor -- start 2024-03-30T13:10:31.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68e07ab000 1 -- start start 2024-03-30T13:10:31.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68e07ab000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463fecf830 0x56463fefe180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68e07ab000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff18d70 0x56463fecdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68e07ab000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463fece110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68e07ab000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8200a80 con 0x56463ff19690 2024-03-30T13:10:31.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68e07ab000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81ffaa0 con 0x56463ff18d70 2024-03-30T13:10:31.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68e07ab000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f68d81feed0 con 0x56463fecf830 2024-03-30T13:10:31.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463fece110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463fece110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39118/0 (socket says 172.21.15.83:39118) 2024-03-30T13:10:31.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68d77fe640 1 -- 172.21.15.83:0/507790597 learned_addr learned my addr 172.21.15.83:0/507790597 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68d77fe640 1 -- 172.21.15.83:0/507790597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463fecf830 msgr2=0x56463fefe180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68d77fe640 1 --2- 172.21.15.83:0/507790597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463fecf830 0x56463fefe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68d77fe640 1 -- 172.21.15.83:0/507790597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff18d70 msgr2=0x56463fecdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68d77fe640 1 --2- 172.21.15.83:0/507790597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff18d70 0x56463fecdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68d77fe640 1 -- 172.21.15.83:0/507790597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56463fca4d00 con 0x56463ff19690 2024-03-30T13:10:31.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68d77fe640 1 --2- 172.21.15.83:0/507790597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463fece110 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f68d0005390 tx=0x7f68d0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1c4ec550842c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68b7fff640 1 -- 172.21.15.83:0/507790597 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0016020 con 0x56463ff19690 2024-03-30T13:10:31.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68b7fff640 1 -- 172.21.15.83:0/507790597 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d000dc20 con 0x56463ff19690 2024-03-30T13:10:31.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.097+0000 7f68b7fff640 1 -- 172.21.15.83:0/507790597 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d00123f0 con 0x56463ff19690 2024-03-30T13:10:31.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 -- 172.21.15.83:0/507790597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 msgr2=0x56463fece110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 --2- 172.21.15.83:0/507790597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463fece110 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f68d0005390 tx=0x7f68d0005850 comp rx=0 tx=0).stop 2024-03-30T13:10:31.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 -- 172.21.15.83:0/507790597 shutdown_connections 2024-03-30T13:10:31.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 --2- 172.21.15.83:0/507790597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463fece110 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 --2- 172.21.15.83:0/507790597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463ff18d70 0x56463fecdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 --2- 172.21.15.83:0/507790597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463fecf830 0x56463fefe180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 -- 172.21.15.83:0/507790597 >> 172.21.15.83:0/507790597 conn(0x56463fecb7e0 msgr2=0x56463ff2ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 -- 172.21.15.83:0/507790597 shutdown_connections 2024-03-30T13:10:31.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 -- 172.21.15.83:0/507790597 wait complete. 2024-03-30T13:10:31.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 -- start start 2024-03-30T13:10:31.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 Processor -- start 2024-03-30T13:10:31.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463fecf830 0x56463ff87020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463ff18d70 0x56463ff1cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463ff1d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56463fcdb6a0 con 0x56463ff19690 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81ff450 con 0x56463fecf830 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56463fce5270 con 0x56463ff18d70 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 10 client.0 _ll_register_callbacks cb 0x7f68c000bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463ff1d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463ff1d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39126/0 (socket says 172.21.15.83:39126) 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68d77fe640 1 -- 172.21.15.83:0/258044521 learned_addr learned my addr 172.21.15.83:0/258044521 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68d6ffd640 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463fecf830 0x56463ff87020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68d67fc640 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463ff18d70 0x56463ff1cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68d77fe640 1 -- 172.21.15.83:0/258044521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463ff18d70 msgr2=0x56463ff1cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68d77fe640 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463ff18d70 0x56463ff1cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68d77fe640 1 -- 172.21.15.83:0/258044521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463fecf830 msgr2=0x56463ff87020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68d77fe640 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463fecf830 0x56463ff87020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68d77fe640 1 -- 172.21.15.83:0/258044521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56463fd9ef70 con 0x56463ff19690 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68d6ffd640 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463fecf830 0x56463ff87020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68d77fe640 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463ff1d010 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009010 tx=0x7f68d0003af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee3da3ba68c4848 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68b5ffb640 1 -- 172.21.15.83:0/258044521 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d002b060 con 0x56463ff19690 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68b5ffb640 1 -- 172.21.15.83:0/258044521 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f68d000da00 con 0x56463ff19690 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 -- 172.21.15.83:0/258044521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68d000dc20 con 0x56463ff19690 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68b5ffb640 1 -- 172.21.15.83:0/258044521 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f68d0031050 con 0x56463ff19690 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 10 client.5844 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 -- 172.21.15.83:0/258044521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x56463fcc4760 con 0x56463ff19690 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68b5ffb640 1 -- 172.21.15.83:0/258044521 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d000dc20 con 0x56463ff19690 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68b5ffb640 1 -- 172.21.15.83:0/258044521 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f68d0034020 con 0x56463ff19690 2024-03-30T13:10:31.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 10 client.5844 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 10 client.5844 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 20 client.5844 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56463ff1d550 0x56463ff1d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 4 client.5844 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628344}] 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.101+0000 7f68e07ab000 1 -- 172.21.15.83:0/258044521 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628344}) -- 0x56463fd2afe0 con 0x56463ff1d550 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68d6ffd640 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56463ff1d550 0x56463ff1d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68d6ffd640 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56463ff1d550 0x56463ff1d960 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=454abec9c73d906b server_cookie=22c862be9874ef4 in_seq=0 out_seq=0 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68b5ffb640 10 client.5844 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68b5ffb640 1 -- 172.21.15.83:0/258044521 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3831 (crc 0 0 0) 0x56463fd2afe0 con 0x56463ff1d550 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68b5ffb640 10 client.5844 handle_command_reply: tid=0 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68e07ab000 1 client.5844 shutdown 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68e07ab000 1 -- 172.21.15.83:0/258044521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 msgr2=0x56463ff1d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68e07ab000 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463ff1d010 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009010 tx=0x7f68d0003af0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68e07ab000 1 -- 172.21.15.83:0/258044521 shutdown_connections 2024-03-30T13:10:31.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68e07ab000 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56463ff1d550 0x56463ff1d960 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68e07ab000 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56463ff19690 0x56463ff1d010 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68e07ab000 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56463ff18d70 0x56463ff1cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68b5ffb640 0 client.5844 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68e07ab000 1 --2- 172.21.15.83:0/258044521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56463fecf830 0x56463ff87020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68e07ab000 1 -- 172.21.15.83:0/258044521 >> 172.21.15.83:0/258044521 conn(0x56463fecb7e0 msgr2=0x56463ff30620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68e07ab000 1 -- 172.21.15.83:0/258044521 shutdown_connections 2024-03-30T13:10:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68e07ab000 1 -- 172.21.15.83:0/258044521 wait complete. 2024-03-30T13:10:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68e07ab000 20 client.5844 trim_cache size 0 max 16384 2024-03-30T13:10:31.116 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:31.116 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-dev-proto.h", 2024-03-30T13:10:31.116 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628344, 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.185208+0000", 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.298338+0000", 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.117 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 2111, 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.298338+0000", 2024-03-30T13:10:31.118 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 4, 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:31.119 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 2111, 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.185208+0000" 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 2111, 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.185208+0000" 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.120 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 128, 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 34, 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:31.121 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:31.122 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:31.123 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.124 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:31.124 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:31.124 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:31.124 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:31.124 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:31.124 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:31.124 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:31.124 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:31.124 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:31.124 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:31.124 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.124 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.125 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:31.126 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:31.126 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:31.126 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:31.126 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:31.126 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:31.126 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:31.126 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:31.126 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:31.126 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:31.126 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:31.126 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.126 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:31.127 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:31.128 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:31.128 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:31.128 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:31.128 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:31.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68dd629640 1 -- 172.21.15.83:0/2068460461 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f68b8067fc0 msgr2=0x7f68b806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68dd629640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f68b8067fc0 0x7f68b806a480 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f68c80b2000 tx=0x7f68c8008040 comp rx=0 tx=0).stop 2024-03-30T13:10:31.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68dd629640 1 -- 172.21.15.83:0/2068460461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68d806bba0 msgr2=0x7f68d8154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68dd629640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68d806bba0 0x7f68d8154370 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f68c000d620 tx=0x7f68c000dae0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68dd629640 1 -- 172.21.15.83:0/2068460461 shutdown_connections 2024-03-30T13:10:31.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68dd629640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f68b8067fc0 0x7f68b806a480 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68dd629640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d815e860 0x7f68d80cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68dd629640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68d80b6320 0x7f68d815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68dd629640 1 --2- 172.21.15.83:0/2068460461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68d806bba0 0x7f68d8154370 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68dd629640 1 -- 172.21.15.83:0/2068460461 >> 172.21.15.83:0/2068460461 conn(0x7f68d8072d30 msgr2=0x7f68d80b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68dd629640 1 -- 172.21.15.83:0/2068460461 shutdown_connections 2024-03-30T13:10:31.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.105+0000 7f68dd629640 1 -- 172.21.15.83:0/2068460461 wait complete. 2024-03-30T13:10:31.130 DEBUG:tasks.cephfs.test_uninlining:getting inode info #21 of 23:1099511628329 2024-03-30T13:10:31.130 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628329 2024-03-30T13:10:31.131 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628329 2024-03-30T13:10:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.229+0000 7f7d326b9640 1 Processor -- start 2024-03-30T13:10:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.229+0000 7f7d326b9640 1 -- start start 2024-03-30T13:10:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.229+0000 7f7d326b9640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7d2c0b3de0 0x7f7d2c0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d326b9640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d2c15d610 con 0x7f7d2c159ca0 2024-03-30T13:10:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d326b9640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d2c0d0fe0 con 0x7f7d2c15c870 2024-03-30T13:10:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d326b9640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7d2c0d12c0 con 0x7f7d2c0b3de0 2024-03-30T13:10:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2bfff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f7d2c159ca0 0x7f7d2c0d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36506/0 (socket says 172.21.15.83:36506) 2024-03-30T13:10:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2bfff640 1 -- 172.21.15.83:0/693953142 learned_addr learned my addr 172.21.15.83:0/693953142 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d237fe640 1 --2- 172.21.15.83:0/693953142 >> v2:172.21.15.153:3300/0 conn(0x7f7d2c0b3de0 0x7f7d2c0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864777932 0 0) 0x7f7d2c15d610 con 0x7f7d2c159ca0 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d18003530 con 0x7f7d2c159ca0 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1087901838 0 0) 0x7f7d18003530 con 0x7f7d2c159ca0 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 >> v2:172.21.15.153:3300/0 conn(0x7f7d2c0b3de0 msgr2=0x7f7d2c0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 --2- 172.21.15.83:0/693953142 >> v2:172.21.15.153:3300/0 conn(0x7f7d2c0b3de0 0x7f7d2c0b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 >> v1:172.21.15.153:6789/0 conn(0x7f7d2c15c870 legacy=0x7f7d2c15cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2c0d15a0 con 0x7f7d2c159ca0 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f7d1c001680 con 0x7f7d2c159ca0 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 >> v1:172.21.15.83:6789/0 conn(0x7f7d2c159ca0 legacy=0x7f7d2c0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d180039c0 0x7f7d18003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 0x7f7d18004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d180051d0 0x7f7d1800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c0d12c0 con 0x7f7d18004810 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1800c070 con 0x7f7d180039c0 2024-03-30T13:10:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1800c270 con 0x7f7d180051d0 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d237fe640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 0x7f7d18004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d180039c0 0x7f7d18003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d30c56640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d180051d0 0x7f7d1800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d237fe640 1 -- 172.21.15.83:0/693953142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d180051d0 msgr2=0x7f7d1800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d237fe640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d180051d0 0x7f7d1800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d237fe640 1 -- 172.21.15.83:0/693953142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d180039c0 msgr2=0x7f7d18003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d237fe640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d180039c0 0x7f7d18003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d237fe640 1 -- 172.21.15.83:0/693953142 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d18003530 con 0x7f7d18004810 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d30c56640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d180051d0 0x7f7d1800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d180039c0 0x7f7d18003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d30c56640 1 -- 172.21.15.83:0/693953142 reap_dead start 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d237fe640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 0x7f7d18004c90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7d14009ac0 tx=0x7f7d1401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7874c16c90f93b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d140b2070 con 0x7f7d18004810 2024-03-30T13:10:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d140a5640 con 0x7f7d18004810 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d2b7fe640 1 -- 172.21.15.83:0/693953142 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d14009690 con 0x7f7d18004810 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d326b9640 1 -- 172.21.15.83:0/693953142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 msgr2=0x7f7d18004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d326b9640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 0x7f7d18004c90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7d14009ac0 tx=0x7f7d1401ca50 comp rx=0 tx=0).stop 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d326b9640 1 -- 172.21.15.83:0/693953142 shutdown_connections 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d326b9640 1 --2- 172.21.15.83:0/693953142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 0x7f7d18004c90 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.233+0000 7f7d326b9640 1 -- 172.21.15.83:0/693953142 >> 172.21.15.83:0/693953142 conn(0x7f7d2c0b7670 msgr2=0x7f7d2c0b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d326b9640 1 -- 172.21.15.83:0/693953142 shutdown_connections 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d326b9640 1 -- 172.21.15.83:0/693953142 wait complete. 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d326b9640 1 Processor -- start 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d326b9640 1 -- start start 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d326b9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 0x7f7d2c145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d326b9640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d2c1f81a0 0x7f7d2c1f8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d326b9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d2c1e6690 0x7f7d2c1e6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d326b9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c15a200 con 0x7f7d18004810 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d326b9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c15a080 con 0x7f7d2c1e6690 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d326b9640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2c0b4270 con 0x7f7d2c1f81a0 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 0x7f7d2c145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 0x7f7d2c145610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39148/0 (socket says 172.21.15.83:39148) 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d2bfff640 1 -- 172.21.15.83:0/2539076601 learned_addr learned my addr 172.21.15.83:0/2539076601 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d237fe640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d2c1f81a0 0x7f7d2c1f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d2bfff640 1 -- 172.21.15.83:0/2539076601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d2c1f81a0 msgr2=0x7f7d2c1f8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d2c1f81a0 0x7f7d2c1f8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d2bfff640 1 -- 172.21.15.83:0/2539076601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d2c1e6690 msgr2=0x7f7d2c1e6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d30c56640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d2c1e6690 0x7f7d2c1e6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d2c1e6690 0x7f7d2c1e6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d2bfff640 1 -- 172.21.15.83:0/2539076601 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2c1e7080 con 0x7f7d18004810 2024-03-30T13:10:31.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d237fe640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d2c1f81a0 0x7f7d2c1f8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:31.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 0x7f7d2c145610 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c010c10 tx=0x7f7d1c00e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d297fa640 1 -- 172.21.15.83:0/2539076601 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c01b070 con 0x7f7d18004810 2024-03-30T13:10:31.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d297fa640 1 -- 172.21.15.83:0/2539076601 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1c011040 con 0x7f7d18004810 2024-03-30T13:10:31.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d326b9640 1 -- 172.21.15.83:0/2539076601 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d2c1e7350 con 0x7f7d18004810 2024-03-30T13:10:31.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d297fa640 1 -- 172.21.15.83:0/2539076601 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0145c0 con 0x7f7d18004810 2024-03-30T13:10:31.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.237+0000 7f7d326b9640 1 -- 172.21.15.83:0/2539076601 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d2c145ea0 con 0x7f7d18004810 2024-03-30T13:10:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d297fa640 1 -- 172.21.15.83:0/2539076601 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f7d1c01e070 con 0x7f7d18004810 2024-03-30T13:10:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d297fa640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d0c067ff0 0x7f7d0c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d237fe640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d0c067ff0 0x7f7d0c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d297fa640 1 -- 172.21.15.83:0/2539076601 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7d1c0891b0 con 0x7f7d18004810 2024-03-30T13:10:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d237fe640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d0c067ff0 0x7f7d0c06a4b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7d140af000 tx=0x7f7d14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 Processor -- start 2024-03-30T13:10:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 -- start start 2024-03-30T13:10:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdeed70 0x561a0cdef150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdef690 0x561a0cda52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0cda5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561a0cbf3aa0 con 0x561a0cda5830 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561a0cb7aaf0 con 0x561a0cdeed70 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x561a0cbefa50 con 0x561a0cdef690 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d30c56640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0cda5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d30c56640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0cda5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39156/0 (socket says 172.21.15.83:39156) 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d30c56640 1 -- 172.21.15.83:0/2363850868 learned_addr learned my addr 172.21.15.83:0/2363850868 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/2363850868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdeed70 0x561a0cdef150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d30c56640 1 -- 172.21.15.83:0/2363850868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdef690 msgr2=0x561a0cda52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d237fe640 1 --2- 172.21.15.83:0/2363850868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdef690 0x561a0cda52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d30c56640 1 --2- 172.21.15.83:0/2363850868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdef690 0x561a0cda52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d30c56640 1 -- 172.21.15.83:0/2363850868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdeed70 msgr2=0x561a0cdef150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d30c56640 1 --2- 172.21.15.83:0/2363850868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdeed70 0x561a0cdef150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d30c56640 1 -- 172.21.15.83:0/2363850868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a0cb78d00 con 0x561a0cda5830 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d30c56640 1 --2- 172.21.15.83:0/2363850868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0cda5c10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c15cc50 tx=0x7f7d24001e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ca6fe00dc64c8e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d21ffb640 1 -- 172.21.15.83:0/2363850868 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d24003b90 con 0x561a0cda5830 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d21ffb640 1 -- 172.21.15.83:0/2363850868 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d24003d30 con 0x561a0cda5830 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d21ffb640 1 -- 172.21.15.83:0/2363850868 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d240052f0 con 0x561a0cda5830 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 -- 172.21.15.83:0/2363850868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 msgr2=0x561a0cda5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 --2- 172.21.15.83:0/2363850868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0cda5c10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c15cc50 tx=0x7f7d24001e20 comp rx=0 tx=0).stop 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 -- 172.21.15.83:0/2363850868 shutdown_connections 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 --2- 172.21.15.83:0/2363850868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0cda5c10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 --2- 172.21.15.83:0/2363850868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdef690 0x561a0cda52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 --2- 172.21.15.83:0/2363850868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdeed70 0x561a0cdef150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 -- 172.21.15.83:0/2363850868 >> 172.21.15.83:0/2363850868 conn(0x561a0cda17e0 msgr2=0x561a0cda3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 -- 172.21.15.83:0/2363850868 shutdown_connections 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.241+0000 7f7d3583b000 1 -- 172.21.15.83:0/2363850868 wait complete. 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 -- start start 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 Processor -- start 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cda5830 0x561a0cdaac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdeed70 0x561a0cdd3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cdef690 0x561a0cdd42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561a0cbbb270 con 0x561a0cdef690 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561a0cbb16a0 con 0x561a0cdeed70 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x561a0cb8b880 con 0x561a0cda5830 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 10 client.0 _ll_register_callbacks cb 0x561a0cd90490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d30c56640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cdef690 0x561a0cdd42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d30c56640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cdef690 0x561a0cdd42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39168/0 (socket says 172.21.15.83:39168) 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d30c56640 1 -- 172.21.15.83:0/1866909816 learned_addr learned my addr 172.21.15.83:0/1866909816 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d237fe640 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdeed70 0x561a0cdd3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cda5830 0x561a0cdaac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d30c56640 1 -- 172.21.15.83:0/1866909816 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cda5830 msgr2=0x561a0cdaac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d30c56640 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cda5830 0x561a0cdaac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d30c56640 1 -- 172.21.15.83:0/1866909816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdeed70 msgr2=0x561a0cdd3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d30c56640 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdeed70 0x561a0cdd3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d30c56640 1 -- 172.21.15.83:0/1866909816 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a0cbb8730 con 0x561a0cdef690 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d30c56640 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cdef690 0x561a0cdd42e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009010 tx=0x7f7d24001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1047a515de304cb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d0affd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d0affd640 1 -- 172.21.15.83:0/1866909816 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d24003b90 con 0x561a0cdef690 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d0affd640 1 -- 172.21.15.83:0/1866909816 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7d2400e980 con 0x561a0cdef690 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 -- 172.21.15.83:0/1866909816 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d24003d30 con 0x561a0cdef690 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d0affd640 1 -- 172.21.15.83:0/1866909816 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f7d2402d050 con 0x561a0cdef690 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 10 client.5856 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 -- 172.21.15.83:0/1866909816 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x561a0cbabca0 con 0x561a0cdef690 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d0affd640 1 -- 172.21.15.83:0/1866909816 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d24003d30 con 0x561a0cdef690 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d0affd640 1 -- 172.21.15.83:0/1866909816 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f7d24030020 con 0x561a0cdef690 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 10 client.5856 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 10 client.5856 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 20 client.5856 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561a0cdf65d0 0x561a0cdf69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 4 client.5856 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 -- 172.21.15.83:0/1866909816 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a0cb8ec90 con 0x561a0cdf65d0 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561a0cdf65d0 0x561a0cdf69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d0affd640 10 client.5856 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561a0cdf65d0 0x561a0cdf69e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2c0e970c33bc6bf server_cookie=2cfbce82db776c4f in_seq=0 out_seq=0 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d0affd640 1 -- 172.21.15.83:0/1866909816 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x561a0cb8ec90 con 0x561a0cdf65d0 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d0affd640 10 client.5856 handle_command_reply: tid=0 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 client.5856 shutdown 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 -- 172.21.15.83:0/1866909816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cdef690 msgr2=0x561a0cdd42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cdef690 0x561a0cdd42e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009010 tx=0x7f7d24001520 comp rx=0 tx=0).stop 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 -- 172.21.15.83:0/1866909816 shutdown_connections 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561a0cdf65d0 0x561a0cdf69e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cdef690 0x561a0cdd42e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d0affd640 0 client.5856 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdeed70 0x561a0cdd3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1866909816 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cda5830 0x561a0cdaac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 -- 172.21.15.83:0/1866909816 >> 172.21.15.83:0/1866909816 conn(0x561a0cda17e0 msgr2=0x561a0cda4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 -- 172.21.15.83:0/1866909816 shutdown_connections 2024-03-30T13:10:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 1 -- 172.21.15.83:0/1866909816 wait complete. 2024-03-30T13:10:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.245+0000 7f7d3583b000 20 client.5856 trim_cache size 0 max 16384 2024-03-30T13:10:31.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 Processor -- start 2024-03-30T13:10:31.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 -- start start 2024-03-30T13:10:31.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0cdd4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdeed70 0x561a0cda3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdef690 0x561a0cda4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c201080 con 0x561a0cda5830 2024-03-30T13:10:31.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c147a50 con 0x561a0cdef690 2024-03-30T13:10:31.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2c0b64c0 con 0x561a0cdeed70 2024-03-30T13:10:31.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0cdd4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0cdd4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39180/0 (socket says 172.21.15.83:39180) 2024-03-30T13:10:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d2bfff640 1 -- 172.21.15.83:0/1012961558 learned_addr learned my addr 172.21.15.83:0/1012961558 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d2bfff640 1 -- 172.21.15.83:0/1012961558 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdeed70 msgr2=0x561a0cda3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/1012961558 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdeed70 0x561a0cda3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d2bfff640 1 -- 172.21.15.83:0/1012961558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdef690 msgr2=0x561a0cda4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/1012961558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdef690 0x561a0cda4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d2bfff640 1 -- 172.21.15.83:0/1012961558 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a0cb7ad00 con 0x561a0cda5830 2024-03-30T13:10:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/1012961558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0cdd4180 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00e9d0 tx=0x7f7d1c089040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fef37dc64bdc6b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d217fa640 1 -- 172.21.15.83:0/1012961558 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c07c070 con 0x561a0cda5830 2024-03-30T13:10:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d217fa640 1 -- 172.21.15.83:0/1012961558 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1c05d600 con 0x561a0cda5830 2024-03-30T13:10:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d217fa640 1 -- 172.21.15.83:0/1012961558 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c061e30 con 0x561a0cda5830 2024-03-30T13:10:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 -- 172.21.15.83:0/1012961558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 msgr2=0x561a0cdd4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1012961558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0cdd4180 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00e9d0 tx=0x7f7d1c089040 comp rx=0 tx=0).stop 2024-03-30T13:10:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 -- 172.21.15.83:0/1012961558 shutdown_connections 2024-03-30T13:10:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1012961558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdef690 0x561a0cda4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1012961558 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdeed70 0x561a0cda3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1012961558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0cdd4180 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 -- 172.21.15.83:0/1012961558 >> 172.21.15.83:0/1012961558 conn(0x561a0cda17e0 msgr2=0x561a0ce05f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 -- 172.21.15.83:0/1012961558 shutdown_connections 2024-03-30T13:10:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 -- 172.21.15.83:0/1012961558 wait complete. 2024-03-30T13:10:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 -- start start 2024-03-30T13:10:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.261+0000 7f7d3583b000 1 Processor -- start 2024-03-30T13:10:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0ce60600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdeed70 0x561a0cdf2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdef690 0x561a0cdf3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561a0cbf2db0 con 0x561a0cda5830 2024-03-30T13:10:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c147400 con 0x561a0cdef690 2024-03-30T13:10:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x561a0cbf3aa0 con 0x561a0cdeed70 2024-03-30T13:10:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 10 client.0 _ll_register_callbacks cb 0x7f7d24001860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0ce60600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0ce60600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39194/0 (socket says 172.21.15.83:39194) 2024-03-30T13:10:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d2bfff640 1 -- 172.21.15.83:0/1865901866 learned_addr learned my addr 172.21.15.83:0/1865901866 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d237fe640 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdeed70 0x561a0cdf2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d30c56640 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdef690 0x561a0cdf3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d2bfff640 1 -- 172.21.15.83:0/1865901866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdeed70 msgr2=0x561a0cdf2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdeed70 0x561a0cdf2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d2bfff640 1 -- 172.21.15.83:0/1865901866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdef690 msgr2=0x561a0cdf3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdef690 0x561a0cdf3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d2bfff640 1 -- 172.21.15.83:0/1865901866 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a0cc74f70 con 0x561a0cda5830 2024-03-30T13:10:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d2bfff640 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0ce60600 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0591e0 tx=0x7f7d1c06f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b4ba4b95964c8b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d0affd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d0affd640 1 -- 172.21.15.83:0/1865901866 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c084030 con 0x561a0cda5830 2024-03-30T13:10:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d0affd640 1 -- 172.21.15.83:0/1865901866 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7d1c087350 con 0x561a0cda5830 2024-03-30T13:10:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 -- 172.21.15.83:0/1865901866 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d1c05d600 con 0x561a0cda5830 2024-03-30T13:10:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d0affd640 1 -- 172.21.15.83:0/1865901866 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f7d1c077050 con 0x561a0cda5830 2024-03-30T13:10:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 10 client.5862 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 -- 172.21.15.83:0/1865901866 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x561a0cb9a760 con 0x561a0cda5830 2024-03-30T13:10:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d0affd640 1 -- 172.21.15.83:0/1865901866 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1c065020 con 0x561a0cda5830 2024-03-30T13:10:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d0affd640 1 -- 172.21.15.83:0/1865901866 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f7d1c0558c0 con 0x561a0cda5830 2024-03-30T13:10:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 10 client.5862 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 10 client.5862 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 20 client.5862 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561a0cdf3550 0x561a0cdf3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 4 client.5862 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628329}] 2024-03-30T13:10:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 -- 172.21.15.83:0/1865901866 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628329}) -- 0x561a0cc00fe0 con 0x561a0cdf3550 2024-03-30T13:10:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d237fe640 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561a0cdf3550 0x561a0cdf3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d0affd640 10 client.5862 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d237fe640 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561a0cdf3550 0x561a0cdf3960 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1718b0ca4fcfe70 server_cookie=528c258493b70112 in_seq=0 out_seq=0 2024-03-30T13:10:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d0affd640 1 -- 172.21.15.83:0/1865901866 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3815 (crc 0 0 0) 0x561a0cc00fe0 con 0x561a0cdf3550 2024-03-30T13:10:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d0affd640 10 client.5862 handle_command_reply: tid=0 2024-03-30T13:10:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 client.5862 shutdown 2024-03-30T13:10:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 -- 172.21.15.83:0/1865901866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 msgr2=0x561a0ce60600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0ce60600 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0591e0 tx=0x7f7d1c06f070 comp rx=0 tx=0).stop 2024-03-30T13:10:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 -- 172.21.15.83:0/1865901866 shutdown_connections 2024-03-30T13:10:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a0cdef690 0x561a0cdf3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561a0cdeed70 0x561a0cdf2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561a0cdf3550 0x561a0cdf3960 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 --2- 172.21.15.83:0/1865901866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a0cda5830 0x561a0ce60600 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 -- 172.21.15.83:0/1865901866 >> 172.21.15.83:0/1865901866 conn(0x561a0cda17e0 msgr2=0x561a0ce06620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d0affd640 0 client.5862 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 -- 172.21.15.83:0/1865901866 shutdown_connections 2024-03-30T13:10:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 1 -- 172.21.15.83:0/1865901866 wait complete. 2024-03-30T13:10:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d3583b000 20 client.5862 trim_cache size 0 max 16384 2024-03-30T13:10:31.281 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:31.281 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/Makefile", 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628329, 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.186742+0000", 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.225816+0000", 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:31.282 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 356, 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:31.283 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.225816+0000", 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:31.284 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 356, 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.186742+0000" 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 356, 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:31.285 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.186742+0000" 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 126, 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 4, 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:31.286 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:31.287 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:31.288 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:31.289 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:31.290 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:31.291 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:31.291 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:31.291 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.291 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:31.291 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:31.291 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:31.291 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:31.291 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:31.291 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:31.291 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:31.291 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:31.292 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:31.293 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:31.293 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:31.293 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:31.293 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:31.293 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:31.293 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:31.293 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:31.293 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:31.293 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:31.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d326b9640 1 -- 172.21.15.83:0/2539076601 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d0c067ff0 msgr2=0x7f7d0c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d326b9640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d0c067ff0 0x7f7d0c06a4b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7d140af000 tx=0x7f7d14008040 comp rx=0 tx=0).stop 2024-03-30T13:10:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d326b9640 1 -- 172.21.15.83:0/2539076601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 msgr2=0x7f7d2c145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d326b9640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 0x7f7d2c145610 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c010c10 tx=0x7f7d1c00e4d0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d326b9640 1 -- 172.21.15.83:0/2539076601 shutdown_connections 2024-03-30T13:10:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d326b9640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f7d0c067ff0 0x7f7d0c06a4b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d326b9640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d2c1e6690 0x7f7d2c1e6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d326b9640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d2c1f81a0 0x7f7d2c1f8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d326b9640 1 --2- 172.21.15.83:0/2539076601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d18004810 0x7f7d2c145610 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d326b9640 1 -- 172.21.15.83:0/2539076601 >> 172.21.15.83:0/2539076601 conn(0x7f7d2c0b7670 msgr2=0x7f7d2c0d19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d326b9640 1 -- 172.21.15.83:0/2539076601 shutdown_connections 2024-03-30T13:10:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.265+0000 7f7d326b9640 1 -- 172.21.15.83:0/2539076601 wait complete. 2024-03-30T13:10:31.296 DEBUG:tasks.cephfs.test_uninlining:getting inode info #22 of 23:1099511628352 2024-03-30T13:10:31.296 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628352 2024-03-30T13:10:31.296 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628352 2024-03-30T13:10:31.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.397+0000 7f3c82636640 1 Processor -- start 2024-03-30T13:10:31.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.397+0000 7f3c82636640 1 -- start start 2024-03-30T13:10:31.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.397+0000 7f3c82636640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3c7c0b5d20 0x7f3c7c0b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.397+0000 7f3c82636640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c7c0b6640 con 0x7f3c7c15c800 2024-03-30T13:10:31.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c82636640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c7c15d2a0 con 0x7f3c7c15cc80 2024-03-30T13:10:31.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c82636640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f3c7c15d860 con 0x7f3c7c0b5d20 2024-03-30T13:10:31.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c7bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3c7c0b5d20 0x7f3c7c0b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c7bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3c7c0b5d20 0x7f3c7c0b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39202/0 (socket says 172.21.15.83:39202) 2024-03-30T13:10:31.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c73fff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3c7c15c800 0x7f3c7c0ccc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36510/0 (socket says 172.21.15.83:36510) 2024-03-30T13:10:31.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c7bfff640 1 -- 172.21.15.83:0/336050218 learned_addr learned my addr 172.21.15.83:0/336050218 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c7bfff640 1 -- 172.21.15.83:0/336050218 >> v1:172.21.15.153:6789/0 conn(0x7f3c7c15cc80 legacy=0x7f3c7c06eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c7bfff640 1 -- 172.21.15.83:0/336050218 >> v1:172.21.15.83:6789/0 conn(0x7f3c7c15c800 legacy=0x7f3c7c0ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c7b7fe640 1 -- 172.21.15.83:0/336050218 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2574285708 0 0) 0x7f3c7c0b6640 con 0x7f3c7c15c800 2024-03-30T13:10:31.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c7bfff640 1 -- 172.21.15.83:0/336050218 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7c15d580 con 0x7f3c7c0b5d20 2024-03-30T13:10:31.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c7bfff640 1 --2- 172.21.15.83:0/336050218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c7c0b5d20 0x7f3c7c0b6100 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009870 tx=0x7f3c6c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e55a8c8ba231ce0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c7b7fe640 1 -- 172.21.15.83:0/336050218 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0aa650 con 0x7f3c7c0b5d20 2024-03-30T13:10:31.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c7b7fe640 1 -- 172.21.15.83:0/336050218 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c6c0af070 con 0x7f3c7c0b5d20 2024-03-30T13:10:31.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c7b7fe640 1 -- 172.21.15.83:0/336050218 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0aaa10 con 0x7f3c7c0b5d20 2024-03-30T13:10:31.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c82636640 1 -- 172.21.15.83:0/336050218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c7c0b5d20 msgr2=0x7f3c7c0b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c82636640 1 --2- 172.21.15.83:0/336050218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c7c0b5d20 0x7f3c7c0b6100 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009870 tx=0x7f3c6c01c4f0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c82636640 1 -- 172.21.15.83:0/336050218 shutdown_connections 2024-03-30T13:10:31.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c82636640 1 --2- 172.21.15.83:0/336050218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c7c0b5d20 0x7f3c7c0b6100 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c82636640 1 -- 172.21.15.83:0/336050218 >> 172.21.15.83:0/336050218 conn(0x7f3c7c072ea0 msgr2=0x7f3c7c06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c82636640 1 -- 172.21.15.83:0/336050218 shutdown_connections 2024-03-30T13:10:31.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.401+0000 7f3c82636640 1 -- 172.21.15.83:0/336050218 wait complete. 2024-03-30T13:10:31.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c82636640 1 Processor -- start 2024-03-30T13:10:31.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c82636640 1 -- start start 2024-03-30T13:10:31.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c82636640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c7c0b5d20 0x7f3c7c1665a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c82636640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c7c15c800 0x7f3c7c06b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c82636640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c7c15cc80 0x7f3c7c06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c82636640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c156d10 con 0x7f3c7c15c800 2024-03-30T13:10:31.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c82636640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c156b90 con 0x7f3c7c0b5d20 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c82636640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3c7c0706a0 con 0x7f3c7c15cc80 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c73fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c7c15c800 0x7f3c7c06b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c73fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c7c15c800 0x7f3c7c06b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39216/0 (socket says 172.21.15.83:39216) 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c73fff640 1 -- 172.21.15.83:0/955959344 learned_addr learned my addr 172.21.15.83:0/955959344 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c7bfff640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c7c0b5d20 0x7f3c7c1665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c73fff640 1 -- 172.21.15.83:0/955959344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c7c15cc80 msgr2=0x7f3c7c06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c73fff640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c7c15cc80 0x7f3c7c06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c73fff640 1 -- 172.21.15.83:0/955959344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c7c0b5d20 msgr2=0x7f3c7c1665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c73fff640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c7c0b5d20 0x7f3c7c1665a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c73fff640 1 -- 172.21.15.83:0/955959344 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7c158d30 con 0x7f3c7c15c800 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c73fff640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c7c15c800 0x7f3c7c06b660 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3c640011f0 tx=0x7f3c6400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c797fa640 1 -- 172.21.15.83:0/955959344 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64018070 con 0x7f3c7c15c800 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c797fa640 1 -- 172.21.15.83:0/955959344 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c640074e0 con 0x7f3c7c15c800 2024-03-30T13:10:31.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c82636640 1 -- 172.21.15.83:0/955959344 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7c159010 con 0x7f3c7c15c800 2024-03-30T13:10:31.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c797fa640 1 -- 172.21.15.83:0/955959344 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64004a10 con 0x7f3c7c15c800 2024-03-30T13:10:31.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.405+0000 7f3c82636640 1 -- 172.21.15.83:0/955959344 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c7c1595d0 con 0x7f3c7c15c800 2024-03-30T13:10:31.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c797fa640 1 -- 172.21.15.83:0/955959344 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f3c6401b070 con 0x7f3c7c15c800 2024-03-30T13:10:31.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c797fa640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3c5c067fc0 0x7f3c5c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c797fa640 1 -- 172.21.15.83:0/955959344 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3c64085820 con 0x7f3c7c15c800 2024-03-30T13:10:31.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c7bfff640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3c5c067fc0 0x7f3c5c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 Processor -- start 2024-03-30T13:10:31.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 -- start start 2024-03-30T13:10:31.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c7bfff640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3c5c067fc0 0x7f3c5c06a480 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0ae000 tx=0x7f3c6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc51fd70 0x5631fc520150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc520690 0x5631fc4d62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 0x5631fc4d6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5631fc324aa0 con 0x5631fc4d6830 2024-03-30T13:10:31.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5631fc2abaf0 con 0x5631fc51fd70 2024-03-30T13:10:31.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5631fc320a50 con 0x5631fc520690 2024-03-30T13:10:31.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c80bd3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 0x5631fc4d6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c80bd3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 0x5631fc4d6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39222/0 (socket says 172.21.15.83:39222) 2024-03-30T13:10:31.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c80bd3640 1 -- 172.21.15.83:0/3578374729 learned_addr learned my addr 172.21.15.83:0/3578374729 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c7bfff640 1 --2- 172.21.15.83:0/3578374729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc51fd70 0x5631fc520150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c80bd3640 1 -- 172.21.15.83:0/3578374729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc520690 msgr2=0x5631fc4d62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c80bd3640 1 --2- 172.21.15.83:0/3578374729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc520690 0x5631fc4d62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c80bd3640 1 -- 172.21.15.83:0/3578374729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc51fd70 msgr2=0x5631fc520150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c80bd3640 1 --2- 172.21.15.83:0/3578374729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc51fd70 0x5631fc520150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c80bd3640 1 -- 172.21.15.83:0/3578374729 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fc2a9d00 con 0x5631fc4d6830 2024-03-30T13:10:31.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c7bfff640 1 --2- 172.21.15.83:0/3578374729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc51fd70 0x5631fc520150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:31.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c80bd3640 1 --2- 172.21.15.83:0/3578374729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 0x5631fc4d6c10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009d00 tx=0x7f3c7400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cac8401716c422e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c71ffb640 1 -- 172.21.15.83:0/3578374729 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400bd40 con 0x5631fc4d6830 2024-03-30T13:10:31.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c71ffb640 1 -- 172.21.15.83:0/3578374729 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c74003980 con 0x5631fc4d6830 2024-03-30T13:10:31.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c71ffb640 1 -- 172.21.15.83:0/3578374729 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c74003bb0 con 0x5631fc4d6830 2024-03-30T13:10:31.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 -- 172.21.15.83:0/3578374729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 msgr2=0x5631fc4d6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 --2- 172.21.15.83:0/3578374729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 0x5631fc4d6c10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009d00 tx=0x7f3c7400b420 comp rx=0 tx=0).stop 2024-03-30T13:10:31.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 -- 172.21.15.83:0/3578374729 shutdown_connections 2024-03-30T13:10:31.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 --2- 172.21.15.83:0/3578374729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 0x5631fc4d6c10 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 --2- 172.21.15.83:0/3578374729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc520690 0x5631fc4d62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 --2- 172.21.15.83:0/3578374729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc51fd70 0x5631fc520150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 -- 172.21.15.83:0/3578374729 >> 172.21.15.83:0/3578374729 conn(0x5631fc4d27e0 msgr2=0x5631fc4d4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 -- 172.21.15.83:0/3578374729 shutdown_connections 2024-03-30T13:10:31.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 -- 172.21.15.83:0/3578374729 wait complete. 2024-03-30T13:10:31.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 -- start start 2024-03-30T13:10:31.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.409+0000 7f3c857b8000 1 Processor -- start 2024-03-30T13:10:31.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 0x5631fc4dbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc51fd70 0x5631fc504da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc520690 0x5631fc5052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5631fc2ec270 con 0x5631fc4d6830 2024-03-30T13:10:31.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5631fc2e26a0 con 0x5631fc520690 2024-03-30T13:10:31.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5631fc2bc880 con 0x5631fc51fd70 2024-03-30T13:10:31.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 10 client.0 _ll_register_callbacks cb 0x5631fc4c1490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:31.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c7bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 0x5631fc4dbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c7bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 0x5631fc4dbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39224/0 (socket says 172.21.15.83:39224) 2024-03-30T13:10:31.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c7bfff640 1 -- 172.21.15.83:0/3809193060 learned_addr learned my addr 172.21.15.83:0/3809193060 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c7bfff640 1 -- 172.21.15.83:0/3809193060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc51fd70 msgr2=0x5631fc504da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c7bfff640 1 --2- 172.21.15.83:0/3809193060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc51fd70 0x5631fc504da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c80bd3640 1 --2- 172.21.15.83:0/3809193060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc520690 0x5631fc5052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c7bfff640 1 -- 172.21.15.83:0/3809193060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc520690 msgr2=0x5631fc5052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c7bfff640 1 --2- 172.21.15.83:0/3809193060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc520690 0x5631fc5052e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c7bfff640 1 -- 172.21.15.83:0/3809193060 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631fc2e9730 con 0x5631fc4d6830 2024-03-30T13:10:31.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c7bfff640 1 --2- 172.21.15.83:0/3809193060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 0x5631fc4dbc50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c019100 tx=0x7f3c6c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66a97a8466edf1b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c5affd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:31.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c5affd640 1 -- 172.21.15.83:0/3809193060 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0b3b40 con 0x5631fc4d6830 2024-03-30T13:10:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 -- 172.21.15.83:0/3809193060 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c74003980 con 0x5631fc4d6830 2024-03-30T13:10:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c5affd640 1 -- 172.21.15.83:0/3809193060 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3c6c0b3ce0 con 0x5631fc4d6830 2024-03-30T13:10:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c5affd640 1 -- 172.21.15.83:0/3809193060 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3c6c0c9450 con 0x5631fc4d6830 2024-03-30T13:10:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 10 client.5877 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 -- 172.21.15.83:0/3809193060 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5631fc2dcca0 con 0x5631fc4d6830 2024-03-30T13:10:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c5affd640 1 -- 172.21.15.83:0/3809193060 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c74003980 con 0x5631fc4d6830 2024-03-30T13:10:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c5affd640 1 -- 172.21.15.83:0/3809193060 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f3c6c0c95f0 con 0x5631fc4d6830 2024-03-30T13:10:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 10 client.5877 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 10 client.5877 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 20 client.5877 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:31.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 --2- 172.21.15.83:0/3809193060 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5631fc5275d0 0x5631fc5279e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 4 client.5877 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:31.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 -- 172.21.15.83:0/3809193060 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631fc2bfc90 con 0x5631fc5275d0 2024-03-30T13:10:31.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c73fff640 1 --2- 172.21.15.83:0/3809193060 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5631fc5275d0 0x5631fc5279e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c5affd640 10 client.5877 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c73fff640 1 --2- 172.21.15.83:0/3809193060 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5631fc5275d0 0x5631fc5279e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f97a8d09d39cb4ee server_cookie=23873cfc794d7e3b in_seq=0 out_seq=0 2024-03-30T13:10:31.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c5affd640 1 -- 172.21.15.83:0/3809193060 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5631fc2bfc90 con 0x5631fc5275d0 2024-03-30T13:10:31.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c5affd640 10 client.5877 handle_command_reply: tid=0 2024-03-30T13:10:31.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 client.5877 shutdown 2024-03-30T13:10:31.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 -- 172.21.15.83:0/3809193060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 msgr2=0x5631fc4dbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 --2- 172.21.15.83:0/3809193060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 0x5631fc4dbc50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c019100 tx=0x7f3c6c0046d0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 -- 172.21.15.83:0/3809193060 shutdown_connections 2024-03-30T13:10:31.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 --2- 172.21.15.83:0/3809193060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc520690 0x5631fc5052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 --2- 172.21.15.83:0/3809193060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc51fd70 0x5631fc504da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 --2- 172.21.15.83:0/3809193060 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5631fc5275d0 0x5631fc5279e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 --2- 172.21.15.83:0/3809193060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc4d6830 0x5631fc4dbc50 secure :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c019100 tx=0x7f3c6c0046d0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 -- 172.21.15.83:0/3809193060 >> 172.21.15.83:0/3809193060 conn(0x5631fc4d27e0 msgr2=0x5631fc4d5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c5affd640 0 client.5877 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 -- 172.21.15.83:0/3809193060 shutdown_connections 2024-03-30T13:10:31.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 1 -- 172.21.15.83:0/3809193060 wait complete. 2024-03-30T13:10:31.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.413+0000 7f3c857b8000 20 client.5877 trim_cache size 0 max 16384 2024-03-30T13:10:31.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 Processor -- start 2024-03-30T13:10:31.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- start start 2024-03-30T13:10:31.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc51fd70 0x5631fc505180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc520690 0x5631fc522a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc522fc0 0x5631fc5233a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c203660 con 0x5631fc522fc0 2024-03-30T13:10:31.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c134950 con 0x5631fc520690 2024-03-30T13:10:31.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3c7c166180 con 0x5631fc51fd70 2024-03-30T13:10:31.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c80bd3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc522fc0 0x5631fc5233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c80bd3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc522fc0 0x5631fc5233a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39236/0 (socket says 172.21.15.83:39236) 2024-03-30T13:10:31.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c80bd3640 1 -- 172.21.15.83:0/2967743483 learned_addr learned my addr 172.21.15.83:0/2967743483 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c80bd3640 1 -- 172.21.15.83:0/2967743483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc51fd70 msgr2=0x5631fc505180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c80bd3640 1 --2- 172.21.15.83:0/2967743483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc51fd70 0x5631fc505180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c80bd3640 1 -- 172.21.15.83:0/2967743483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc520690 msgr2=0x5631fc522a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c80bd3640 1 --2- 172.21.15.83:0/2967743483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc520690 0x5631fc522a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c80bd3640 1 -- 172.21.15.83:0/2967743483 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fc2abd00 con 0x5631fc522fc0 2024-03-30T13:10:31.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c80bd3640 1 --2- 172.21.15.83:0/2967743483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc522fc0 0x5631fc5233a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3c74014040 tx=0x7f3c74010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a10f5bbb6a8a5ec server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c717fa640 1 -- 172.21.15.83:0/2967743483 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7401c450 con 0x5631fc522fc0 2024-03-30T13:10:31.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c717fa640 1 -- 172.21.15.83:0/2967743483 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c7401c5f0 con 0x5631fc522fc0 2024-03-30T13:10:31.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c717fa640 1 -- 172.21.15.83:0/2967743483 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7401ca20 con 0x5631fc522fc0 2024-03-30T13:10:31.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- 172.21.15.83:0/2967743483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc522fc0 msgr2=0x5631fc5233a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 --2- 172.21.15.83:0/2967743483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc522fc0 0x5631fc5233a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3c74014040 tx=0x7f3c74010000 comp rx=0 tx=0).stop 2024-03-30T13:10:31.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- 172.21.15.83:0/2967743483 shutdown_connections 2024-03-30T13:10:31.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 --2- 172.21.15.83:0/2967743483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc522fc0 0x5631fc5233a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 --2- 172.21.15.83:0/2967743483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc520690 0x5631fc522a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 --2- 172.21.15.83:0/2967743483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc51fd70 0x5631fc505180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- 172.21.15.83:0/2967743483 >> 172.21.15.83:0/2967743483 conn(0x5631fc4d27e0 msgr2=0x5631fc536f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- 172.21.15.83:0/2967743483 shutdown_connections 2024-03-30T13:10:31.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- 172.21.15.83:0/2967743483 wait complete. 2024-03-30T13:10:31.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- start start 2024-03-30T13:10:31.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 Processor -- start 2024-03-30T13:10:31.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc51fd70 0x5631fc5924c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc520690 0x5631fc592a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc522fc0 0x5631fc5243f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c134300 con 0x5631fc520690 2024-03-30T13:10:31.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5631fc321a20 con 0x5631fc51fd70 2024-03-30T13:10:31.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5631fc2e26a0 con 0x5631fc522fc0 2024-03-30T13:10:31.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c857b8000 10 client.0 _ll_register_callbacks cb 0x7f3c6c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:31.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c73fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc520690 0x5631fc592a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c73fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc520690 0x5631fc592a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39244/0 (socket says 172.21.15.83:39244) 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c73fff640 1 -- 172.21.15.83:0/232726882 learned_addr learned my addr 172.21.15.83:0/232726882 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c7bfff640 1 --2- 172.21.15.83:0/232726882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc51fd70 0x5631fc5924c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c73fff640 1 -- 172.21.15.83:0/232726882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc522fc0 msgr2=0x5631fc5243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c73fff640 1 --2- 172.21.15.83:0/232726882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc522fc0 0x5631fc5243f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c73fff640 1 -- 172.21.15.83:0/232726882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc51fd70 msgr2=0x5631fc5924c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c73fff640 1 --2- 172.21.15.83:0/232726882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc51fd70 0x5631fc5924c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.429+0000 7f3c73fff640 1 -- 172.21.15.83:0/232726882 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631fc3a5f70 con 0x5631fc520690 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c73fff640 1 --2- 172.21.15.83:0/232726882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc520690 0x5631fc592a00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3c640558f0 tx=0x7f3c64055ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fada92195bf51b52 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c5affd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c5affd640 1 -- 172.21.15.83:0/232726882 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64085040 con 0x5631fc520690 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c5affd640 1 -- 172.21.15.83:0/232726882 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3c64051fd0 con 0x5631fc520690 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 -- 172.21.15.83:0/232726882 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c7401c5f0 con 0x5631fc520690 2024-03-30T13:10:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c5affd640 1 -- 172.21.15.83:0/232726882 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3c6405c0c0 con 0x5631fc520690 2024-03-30T13:10:31.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 10 client.5883 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:31.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 -- 172.21.15.83:0/232726882 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5631fc2cb760 con 0x5631fc520690 2024-03-30T13:10:31.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c5affd640 1 -- 172.21.15.83:0/232726882 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c7401c5f0 con 0x5631fc520690 2024-03-30T13:10:31.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c5affd640 1 -- 172.21.15.83:0/232726882 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f3c64074120 con 0x5631fc520690 2024-03-30T13:10:31.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 10 client.5883 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:31.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 10 client.5883 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:31.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 20 client.5883 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:31.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 --2- 172.21.15.83:0/232726882 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5631fc525150 0x5631fc525560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 4 client.5883 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628352}] 2024-03-30T13:10:31.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 -- 172.21.15.83:0/232726882 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628352}) -- 0x5631fc331fe0 con 0x5631fc525150 2024-03-30T13:10:31.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c7bfff640 1 --2- 172.21.15.83:0/232726882 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5631fc525150 0x5631fc525560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c5affd640 10 client.5883 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c7bfff640 1 --2- 172.21.15.83:0/232726882 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5631fc525150 0x5631fc525560 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5d7056077ebad4a server_cookie=feabedeb18761ff1 in_seq=0 out_seq=0 2024-03-30T13:10:31.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c5affd640 1 -- 172.21.15.83:0/232726882 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3817 (crc 0 0 0) 0x5631fc331fe0 con 0x5631fc525150 2024-03-30T13:10:31.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c5affd640 10 client.5883 handle_command_reply: tid=0 2024-03-30T13:10:31.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 client.5883 shutdown 2024-03-30T13:10:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 -- 172.21.15.83:0/232726882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc520690 msgr2=0x5631fc592a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 --2- 172.21.15.83:0/232726882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc520690 0x5631fc592a00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3c640558f0 tx=0x7f3c64055ac0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 -- 172.21.15.83:0/232726882 shutdown_connections 2024-03-30T13:10:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 --2- 172.21.15.83:0/232726882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5631fc522fc0 0x5631fc5243f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 --2- 172.21.15.83:0/232726882 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5631fc525150 0x5631fc525560 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 --2- 172.21.15.83:0/232726882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631fc520690 0x5631fc592a00 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c5affd640 0 client.5883 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 --2- 172.21.15.83:0/232726882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631fc51fd70 0x5631fc5924c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 -- 172.21.15.83:0/232726882 >> 172.21.15.83:0/232726882 conn(0x5631fc4d27e0 msgr2=0x5631fc537620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 -- 172.21.15.83:0/232726882 shutdown_connections 2024-03-30T13:10:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 1 -- 172.21.15.83:0/232726882 wait complete. 2024-03-30T13:10:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c857b8000 20 client.5883 trim_cache size 0 max 16384 2024-03-30T13:10:31.448 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:31.448 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/symlink.c", 2024-03-30T13:10:31.448 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628352, 2024-03-30T13:10:31.448 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:31.448 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.188138+0000", 2024-03-30T13:10:31.448 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.331838+0000", 2024-03-30T13:10:31.448 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:31.448 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:31.448 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:31.449 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:31.450 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.450 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:31.450 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 497, 2024-03-30T13:10:31.450 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:31.451 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:31.451 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:31.451 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:31.451 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:31.451 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.331838+0000", 2024-03-30T13:10:31.451 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:31.451 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:31.452 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:31.452 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:31.452 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:31.452 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:31.452 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:31.452 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:31.452 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:31.452 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:31.452 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:31.452 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:31.452 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:31.452 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.453 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:31.453 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:31.453 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 497, 2024-03-30T13:10:31.453 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:31.453 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:31.453 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:31.453 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.188138+0000" 2024-03-30T13:10:31.453 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.453 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:31.454 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:31.454 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 497, 2024-03-30T13:10:31.454 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:31.454 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:31.454 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:31.454 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.188138+0000" 2024-03-30T13:10:31.454 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.454 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 130, 2024-03-30T13:10:31.454 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:31.454 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:31.454 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 50, 2024-03-30T13:10:31.454 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:31.455 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:31.456 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:31.457 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:31.458 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:31.459 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:31.460 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:31.461 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:31.462 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:31.462 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:31.462 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:31.462 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:31.462 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:31.462 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:31.462 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:31.462 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:31.462 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:31.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c82636640 1 -- 172.21.15.83:0/955959344 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3c5c067fc0 msgr2=0x7f3c5c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c82636640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3c5c067fc0 0x7f3c5c06a480 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0ae000 tx=0x7f3c6c008040 comp rx=0 tx=0).stop 2024-03-30T13:10:31.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c82636640 1 -- 172.21.15.83:0/955959344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c7c15c800 msgr2=0x7f3c7c06b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c82636640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c7c15c800 0x7f3c7c06b660 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3c640011f0 tx=0x7f3c6400c9b0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c82636640 1 -- 172.21.15.83:0/955959344 shutdown_connections 2024-03-30T13:10:31.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c82636640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3c5c067fc0 0x7f3c5c06a480 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c82636640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c7c15cc80 0x7f3c7c06bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c82636640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c7c15c800 0x7f3c7c06b660 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c82636640 1 --2- 172.21.15.83:0/955959344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c7c0b5d20 0x7f3c7c1665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c82636640 1 -- 172.21.15.83:0/955959344 >> 172.21.15.83:0/955959344 conn(0x7f3c7c072ea0 msgr2=0x7f3c7c15a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c82636640 1 -- 172.21.15.83:0/955959344 shutdown_connections 2024-03-30T13:10:31.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.433+0000 7f3c82636640 1 -- 172.21.15.83:0/955959344 wait complete. 2024-03-30T13:10:31.465 DEBUG:tasks.cephfs.test_uninlining:getting inode info #23 of 23:1099511628334 2024-03-30T13:10:31.465 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628334 2024-03-30T13:10:31.465 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628334 2024-03-30T13:10:31.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.565+0000 7fb68d20d640 1 Processor -- start 2024-03-30T13:10:31.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68d20d640 1 -- start start 2024-03-30T13:10:31.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68d20d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb68806bd70 0x7fb688169420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68d20d640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6880b2080 con 0x7fb68815e860 2024-03-30T13:10:31.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68d20d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6880b2360 con 0x7fb6880b1bf0 2024-03-30T13:10:31.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68d20d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb6880b2640 con 0x7fb68806bd70 2024-03-30T13:10:31.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb686d9d640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fb68815e860 0x7fb6880b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36512/0 (socket says 172.21.15.83:36512) 2024-03-30T13:10:31.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb686d9d640 1 -- 172.21.15.83:0/2224995358 learned_addr learned my addr 172.21.15.83:0/2224995358 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:31.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68759e640 1 --2- 172.21.15.83:0/2224995358 >> v2:172.21.15.153:3300/0 conn(0x7fb68806bd70 0x7fb688169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1341174199 0 0) 0x7fb6880b2080 con 0x7fb68815e860 2024-03-30T13:10:31.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb670003530 con 0x7fb68815e860 2024-03-30T13:10:31.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 203738840 0 0) 0x7fb670003530 con 0x7fb68815e860 2024-03-30T13:10:31.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 >> v2:172.21.15.153:3300/0 conn(0x7fb68806bd70 msgr2=0x7fb688169420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 --2- 172.21.15.83:0/2224995358 >> v2:172.21.15.153:3300/0 conn(0x7fb68806bd70 0x7fb688169420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 >> v1:172.21.15.153:6789/0 conn(0x7fb6880b1bf0 legacy=0x7fb68806b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6880b2920 con 0x7fb68815e860 2024-03-30T13:10:31.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fb678001680 con 0x7fb68815e860 2024-03-30T13:10:31.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 >> v1:172.21.15.83:6789/0 conn(0x7fb68815e860 legacy=0x7fb6880b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 --2- 172.21.15.83:0/2224995358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700039c0 0x7fb670003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 --2- 172.21.15.83:0/2224995358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb670004810 0x7fb670004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 --2- 172.21.15.83:0/2224995358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6700051d0 0x7fb67000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb6880b2640 con 0x7fb6700051d0 2024-03-30T13:10:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb67000c080 con 0x7fb670004810 2024-03-30T13:10:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb67000c280 con 0x7fb6700039c0 2024-03-30T13:10:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68759e640 1 --2- 172.21.15.83:0/2224995358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6700051d0 0x7fb67000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68659c640 1 --2- 172.21.15.83:0/2224995358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb670004810 0x7fb670004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68759e640 1 -- 172.21.15.83:0/2224995358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700039c0 msgr2=0x7fb670003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb686d9d640 1 --2- 172.21.15.83:0/2224995358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700039c0 0x7fb670003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68759e640 1 --2- 172.21.15.83:0/2224995358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700039c0 0x7fb670003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68759e640 1 -- 172.21.15.83:0/2224995358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb670004810 msgr2=0x7fb670004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68759e640 1 --2- 172.21.15.83:0/2224995358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb670004810 0x7fb670004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68759e640 1 -- 172.21.15.83:0/2224995358 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb670003530 con 0x7fb6700051d0 2024-03-30T13:10:31.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.569+0000 7fb68659c640 1 --2- 172.21.15.83:0/2224995358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb670004810 0x7fb670004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:31.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68759e640 1 -- 172.21.15.83:0/2224995358 reap_dead start 2024-03-30T13:10:31.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68759e640 1 --2- 172.21.15.83:0/2224995358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6700051d0 0x7fb67000b9d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb688073af0 tx=0x7fb68001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44becf258361043 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6800b2070 con 0x7fb6700051d0 2024-03-30T13:10:31.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6800a5d10 con 0x7fb6700051d0 2024-03-30T13:10:31.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb685d9b640 1 -- 172.21.15.83:0/2224995358 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680009bf0 con 0x7fb6700051d0 2024-03-30T13:10:31.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 -- 172.21.15.83:0/2224995358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6700051d0 msgr2=0x7fb67000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 --2- 172.21.15.83:0/2224995358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6700051d0 0x7fb67000b9d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb688073af0 tx=0x7fb68001cc40 comp rx=0 tx=0).stop 2024-03-30T13:10:31.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 -- 172.21.15.83:0/2224995358 shutdown_connections 2024-03-30T13:10:31.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 --2- 172.21.15.83:0/2224995358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6700051d0 0x7fb67000b9d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 -- 172.21.15.83:0/2224995358 >> 172.21.15.83:0/2224995358 conn(0x7fb688072d30 msgr2=0x7fb6880b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 -- 172.21.15.83:0/2224995358 shutdown_connections 2024-03-30T13:10:31.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 -- 172.21.15.83:0/2224995358 wait complete. 2024-03-30T13:10:31.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 Processor -- start 2024-03-30T13:10:31.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 -- start start 2024-03-30T13:10:31.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700051d0 0x7fb6881598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb688158340 0x7fb6881439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb688146230 0x7fb6881466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb68806b7e0 con 0x7fb688146230 2024-03-30T13:10:31.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb68806b660 con 0x7fb688158340 2024-03-30T13:10:31.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb68806b960 con 0x7fb6700051d0 2024-03-30T13:10:31.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb688146230 0x7fb6881466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb688146230 0x7fb6881466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39262/0 (socket says 172.21.15.83:39262) 2024-03-30T13:10:31.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68759e640 1 -- 172.21.15.83:0/208794120 learned_addr learned my addr 172.21.15.83:0/208794120 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb686d9d640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700051d0 0x7fb6881598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68659c640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb688158340 0x7fb6881439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68759e640 1 -- 172.21.15.83:0/208794120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700051d0 msgr2=0x7fb6881598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68759e640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700051d0 0x7fb6881598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68759e640 1 -- 172.21.15.83:0/208794120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb688158340 msgr2=0x7fb6881439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68759e640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb688158340 0x7fb6881439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68759e640 1 -- 172.21.15.83:0/208794120 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb688158840 con 0x7fb688146230 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68759e640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb688146230 0x7fb6881466b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb68001d4e0 tx=0x7fb680009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb66f7fe640 1 -- 172.21.15.83:0/208794120 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6800b2040 con 0x7fb688146230 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb66f7fe640 1 -- 172.21.15.83:0/208794120 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6800099f0 con 0x7fb688146230 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 -- 172.21.15.83:0/208794120 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb688158b20 con 0x7fb688146230 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb66f7fe640 1 -- 172.21.15.83:0/208794120 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680009bf0 con 0x7fb688146230 2024-03-30T13:10:31.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.573+0000 7fb68d20d640 1 -- 172.21.15.83:0/208794120 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6881590e0 con 0x7fb688146230 2024-03-30T13:10:31.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb66f7fe640 1 -- 172.21.15.83:0/208794120 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb6800a5d10 con 0x7fb688146230 2024-03-30T13:10:31.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb66f7fe640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb674067ff0 0x7fb67406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb66f7fe640 1 -- 172.21.15.83:0/208794120 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb680120e30 con 0x7fb688146230 2024-03-30T13:10:31.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb69038f000 1 Processor -- start 2024-03-30T13:10:31.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb686d9d640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb674067ff0 0x7fb67406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb69038f000 1 -- start start 2024-03-30T13:10:31.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb686d9d640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb674067ff0 0x7fb67406a4b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb678001ec0 tx=0x7fb678009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb69038f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e4138abd70 0x55e4138ac150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb69038f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138ac690 0x55e4138622f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb69038f000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 0x55e413862c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb69038f000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e4136b0aa0 con 0x55e413862830 2024-03-30T13:10:31.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb69038f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e413637af0 con 0x55e4138ac690 2024-03-30T13:10:31.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb69038f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55e4136aca50 con 0x55e4138abd70 2024-03-30T13:10:31.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb68759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 0x55e413862c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb68759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 0x55e413862c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39272/0 (socket says 172.21.15.83:39272) 2024-03-30T13:10:31.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb68759e640 1 -- 172.21.15.83:0/934126278 learned_addr learned my addr 172.21.15.83:0/934126278 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb68659c640 1 --2- 172.21.15.83:0/934126278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138ac690 0x55e4138622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb686d9d640 1 --2- 172.21.15.83:0/934126278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e4138abd70 0x55e4138ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb68759e640 1 -- 172.21.15.83:0/934126278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e4138abd70 msgr2=0x55e4138ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb68759e640 1 --2- 172.21.15.83:0/934126278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e4138abd70 0x55e4138ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb68759e640 1 -- 172.21.15.83:0/934126278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138ac690 msgr2=0x55e4138622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb68759e640 1 --2- 172.21.15.83:0/934126278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138ac690 0x55e4138622f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb68759e640 1 -- 172.21.15.83:0/934126278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e413635d00 con 0x55e413862830 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb68759e640 1 --2- 172.21.15.83:0/934126278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 0x55e413862c10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb68011f380 tx=0x7fb6800f0870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df63b4e61867b3c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb66cff9640 1 -- 172.21.15.83:0/934126278 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6800f5200 con 0x55e413862830 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb66cff9640 1 -- 172.21.15.83:0/934126278 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6800f3070 con 0x55e413862830 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.577+0000 7fb66cff9640 1 -- 172.21.15.83:0/934126278 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6800f9ac0 con 0x55e413862830 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 -- 172.21.15.83:0/934126278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 msgr2=0x55e413862c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 --2- 172.21.15.83:0/934126278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 0x55e413862c10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb68011f380 tx=0x7fb6800f0870 comp rx=0 tx=0).stop 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 -- 172.21.15.83:0/934126278 shutdown_connections 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 --2- 172.21.15.83:0/934126278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 0x55e413862c10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 --2- 172.21.15.83:0/934126278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138ac690 0x55e4138622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 --2- 172.21.15.83:0/934126278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e4138abd70 0x55e4138ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 -- 172.21.15.83:0/934126278 >> 172.21.15.83:0/934126278 conn(0x55e41385e7e0 msgr2=0x55e413860bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 -- 172.21.15.83:0/934126278 shutdown_connections 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 -- 172.21.15.83:0/934126278 wait complete. 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 -- start start 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 Processor -- start 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e413862830 0x55e413867c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138abd70 0x55e413890da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138ac690 0x55e4138912e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e413678270 con 0x55e4138ac690 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e41366e6a0 con 0x55e4138abd70 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55e413648880 con 0x55e413862830 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 10 client.0 _ll_register_callbacks cb 0x55e41384d490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb68759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138ac690 0x55e4138912e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb68759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138ac690 0x55e4138912e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39282/0 (socket says 172.21.15.83:39282) 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb68759e640 1 -- 172.21.15.83:0/1986330781 learned_addr learned my addr 172.21.15.83:0/1986330781 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb68659c640 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138abd70 0x55e413890da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb686d9d640 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e413862830 0x55e413867c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb68759e640 1 -- 172.21.15.83:0/1986330781 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e413862830 msgr2=0x55e413867c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb68759e640 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e413862830 0x55e413867c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb68759e640 1 -- 172.21.15.83:0/1986330781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138abd70 msgr2=0x55e413890da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb68759e640 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138abd70 0x55e413890da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb68759e640 1 -- 172.21.15.83:0/1986330781 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e413675730 con 0x55e4138ac690 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb68759e640 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138ac690 0x55e4138912e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb68001c6b0 tx=0x7fb68000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179c7f5d686a0366 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb665ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb665ffb640 1 -- 172.21.15.83:0/1986330781 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68011c070 con 0x55e4138ac690 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb665ffb640 1 -- 172.21.15.83:0/1986330781 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb6800f9830 con 0x55e4138ac690 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 -- 172.21.15.83:0/1986330781 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6800f3070 con 0x55e4138ac690 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb665ffb640 1 -- 172.21.15.83:0/1986330781 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb680109020 con 0x55e4138ac690 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 10 client.5895 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 -- 172.21.15.83:0/1986330781 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55e413668ca0 con 0x55e4138ac690 2024-03-30T13:10:31.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb665ffb640 1 -- 172.21.15.83:0/1986330781 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6800f3070 con 0x55e4138ac690 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb665ffb640 1 -- 172.21.15.83:0/1986330781 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fb6800b5030 con 0x55e4138ac690 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 10 client.5895 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 10 client.5895 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 20 client.5895 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e4138b35d0 0x55e4138b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 4 client.5895 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb69038f000 1 -- 172.21.15.83:0/1986330781 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e41364bc90 con 0x55e4138b35d0 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb686d9d640 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e4138b35d0 0x55e4138b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb665ffb640 10 client.5895 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.581+0000 7fb686d9d640 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e4138b35d0 0x55e4138b39e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b16bb66d6793465 server_cookie=1b50017355dee38e in_seq=0 out_seq=0 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb665ffb640 1 -- 172.21.15.83:0/1986330781 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55e41364bc90 con 0x55e4138b35d0 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb665ffb640 10 client.5895 handle_command_reply: tid=0 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb69038f000 1 client.5895 shutdown 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb69038f000 1 -- 172.21.15.83:0/1986330781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138ac690 msgr2=0x55e4138912e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb69038f000 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138ac690 0x55e4138912e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb68001c6b0 tx=0x7fb68000b040 comp rx=0 tx=0).stop 2024-03-30T13:10:31.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb69038f000 1 -- 172.21.15.83:0/1986330781 shutdown_connections 2024-03-30T13:10:31.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb69038f000 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e4138b35d0 0x55e4138b39e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb69038f000 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138ac690 0x55e4138912e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb69038f000 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138abd70 0x55e413890da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb665ffb640 0 client.5895 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb69038f000 1 --2- 172.21.15.83:0/1986330781 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e413862830 0x55e413867c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb69038f000 1 -- 172.21.15.83:0/1986330781 >> 172.21.15.83:0/1986330781 conn(0x55e41385e7e0 msgr2=0x55e413861460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb69038f000 1 -- 172.21.15.83:0/1986330781 shutdown_connections 2024-03-30T13:10:31.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb69038f000 1 -- 172.21.15.83:0/1986330781 wait complete. 2024-03-30T13:10:31.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.585+0000 7fb69038f000 20 client.5895 trim_cache size 0 max 16384 2024-03-30T13:10:31.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb69038f000 1 Processor -- start 2024-03-30T13:10:31.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb69038f000 1 -- start start 2024-03-30T13:10:31.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb69038f000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 0x55e413860bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb69038f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138abd70 0x55e413861110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb69038f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e4138ac690 0x55e413861650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb69038f000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb688200f20 con 0x55e413862830 2024-03-30T13:10:31.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb69038f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb6881fffc0 con 0x55e4138abd70 2024-03-30T13:10:31.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb69038f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb688156fe0 con 0x55e4138ac690 2024-03-30T13:10:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb686d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 0x55e413860bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb686d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 0x55e413860bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39294/0 (socket says 172.21.15.83:39294) 2024-03-30T13:10:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb686d9d640 1 -- 172.21.15.83:0/3165776868 learned_addr learned my addr 172.21.15.83:0/3165776868 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb686d9d640 1 -- 172.21.15.83:0/3165776868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e4138ac690 msgr2=0x55e413861650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb686d9d640 1 --2- 172.21.15.83:0/3165776868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e4138ac690 0x55e413861650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb686d9d640 1 -- 172.21.15.83:0/3165776868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138abd70 msgr2=0x55e413861110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb686d9d640 1 --2- 172.21.15.83:0/3165776868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138abd70 0x55e413861110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb686d9d640 1 -- 172.21.15.83:0/3165776868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e413637d00 con 0x55e413862830 2024-03-30T13:10:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb686d9d640 1 --2- 172.21.15.83:0/3165776868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 0x55e413860bd0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb678000f70 tx=0x7fb678012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3640d26e5a6c1a64 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb667fff640 1 -- 172.21.15.83:0/3165776868 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678025e60 con 0x55e413862830 2024-03-30T13:10:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb667fff640 1 -- 172.21.15.83:0/3165776868 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb678005040 con 0x55e413862830 2024-03-30T13:10:31.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb667fff640 1 -- 172.21.15.83:0/3165776868 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678019040 con 0x55e413862830 2024-03-30T13:10:31.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb69038f000 1 -- 172.21.15.83:0/3165776868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 msgr2=0x55e413860bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.597+0000 7fb69038f000 1 --2- 172.21.15.83:0/3165776868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 0x55e413860bd0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb678000f70 tx=0x7fb678012000 comp rx=0 tx=0).stop 2024-03-30T13:10:31.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 -- 172.21.15.83:0/3165776868 shutdown_connections 2024-03-30T13:10:31.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 --2- 172.21.15.83:0/3165776868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e4138ac690 0x55e413861650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 --2- 172.21.15.83:0/3165776868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138abd70 0x55e413861110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 --2- 172.21.15.83:0/3165776868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e413862830 0x55e413860bd0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 -- 172.21.15.83:0/3165776868 >> 172.21.15.83:0/3165776868 conn(0x55e41385e7e0 msgr2=0x55e4138c2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 -- 172.21.15.83:0/3165776868 shutdown_connections 2024-03-30T13:10:31.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 -- 172.21.15.83:0/3165776868 wait complete. 2024-03-30T13:10:31.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 -- start start 2024-03-30T13:10:31.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 Processor -- start 2024-03-30T13:10:31.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e413862830 0x55e41391d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138abd70 0x55e41391dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138ac690 0x55e4138afad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e413678270 con 0x55e4138abd70 2024-03-30T13:10:31.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb688157630 con 0x55e4138ac690 2024-03-30T13:10:31.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55e4138c3fb0 con 0x55e413862830 2024-03-30T13:10:31.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 10 client.0 _ll_register_callbacks cb 0x7fb6800f0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:31.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb68659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138abd70 0x55e41391dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb68659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138abd70 0x55e41391dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39300/0 (socket says 172.21.15.83:39300) 2024-03-30T13:10:31.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb68659c640 1 -- 172.21.15.83:0/2262343799 learned_addr learned my addr 172.21.15.83:0/2262343799 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:31.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb686d9d640 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e413862830 0x55e41391d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb68659c640 1 -- 172.21.15.83:0/2262343799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e413862830 msgr2=0x55e41391d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb68759e640 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138ac690 0x55e4138afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb68659c640 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e413862830 0x55e41391d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb68659c640 1 -- 172.21.15.83:0/2262343799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138ac690 msgr2=0x55e4138afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:31.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb68659c640 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138ac690 0x55e4138afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb68659c640 1 -- 172.21.15.83:0/2262343799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e413731f70 con 0x55e4138abd70 2024-03-30T13:10:31.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb68659c640 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138abd70 0x55e41391dd70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb67c001d80 tx=0x7fb67c011680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8a8f1ae54986fe server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:31.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb665ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:31.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb665ffb640 1 -- 172.21.15.83:0/2262343799 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c018020 con 0x55e4138abd70 2024-03-30T13:10:31.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb665ffb640 1 -- 172.21.15.83:0/2262343799 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb67c0052d0 con 0x55e4138abd70 2024-03-30T13:10:31.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 -- 172.21.15.83:0/2262343799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb678005040 con 0x55e4138abd70 2024-03-30T13:10:31.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb665ffb640 1 -- 172.21.15.83:0/2262343799 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb67c022050 con 0x55e4138abd70 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 10 client.5901 fetch_fsmap learned FSMap version 17 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 -- 172.21.15.83:0/2262343799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55e413657760 con 0x55e4138abd70 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb665ffb640 1 -- 172.21.15.83:0/2262343799 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb678005040 con 0x55e4138abd70 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb665ffb640 1 -- 172.21.15.83:0/2262343799 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fb67c025020 con 0x55e4138abd70 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 10 client.5901 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 10 client.5901 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 20 client.5901 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e4138b0920 0x55e4138b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 4 client.5901 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628334}] 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb69038f000 1 -- 172.21.15.83:0/2262343799 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628334}) -- 0x55e4136bdfe0 con 0x55e4138b0920 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.601+0000 7fb686d9d640 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e4138b0920 0x55e4138b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb686d9d640 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e4138b0920 0x55e4138b0d30 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f108423fe64dafe0 server_cookie=465a5dac940fa820 in_seq=0 out_seq=0 2024-03-30T13:10:31.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb665ffb640 10 client.5901 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb665ffb640 1 -- 172.21.15.83:0/2262343799 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3821 (crc 0 0 0) 0x55e4136bdfe0 con 0x55e4138b0920 2024-03-30T13:10:31.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb665ffb640 10 client.5901 handle_command_reply: tid=0 2024-03-30T13:10:31.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb69038f000 1 client.5901 shutdown 2024-03-30T13:10:31.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb69038f000 1 -- 172.21.15.83:0/2262343799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138abd70 msgr2=0x55e41391dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb69038f000 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138abd70 0x55e41391dd70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb67c001d80 tx=0x7fb67c011680 comp rx=0 tx=0).stop 2024-03-30T13:10:31.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb69038f000 1 -- 172.21.15.83:0/2262343799 shutdown_connections 2024-03-30T13:10:31.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb69038f000 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4138ac690 0x55e4138afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb69038f000 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e4138b0920 0x55e4138b0d30 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb69038f000 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4138abd70 0x55e41391dd70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb69038f000 1 --2- 172.21.15.83:0/2262343799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e413862830 0x55e41391d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb665ffb640 0 client.5901 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:31.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb69038f000 1 -- 172.21.15.83:0/2262343799 >> 172.21.15.83:0/2262343799 conn(0x55e41385e7e0 msgr2=0x55e4138c2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb69038f000 1 -- 172.21.15.83:0/2262343799 shutdown_connections 2024-03-30T13:10:31.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb69038f000 1 -- 172.21.15.83:0/2262343799 wait complete. 2024-03-30T13:10:31.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb69038f000 20 client.5901 trim_cache size 0 max 16384 2024-03-30T13:10:31.618 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:31.618 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/downcall.h", 2024-03-30T13:10:31.618 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628334, 2024-03-30T13:10:31.618 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:10:31.618 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:09:56.190213+0000", 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:09:54.247432+0000", 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:10:31.619 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 2953, 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:09:54.247432+0000", 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:10:31.620 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:31.621 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 2953, 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.190213+0000" 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 2953, 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:09:56.190213+0000" 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.622 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 132, 2024-03-30T13:10:31.623 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:10:31.623 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:10:31.623 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 14, 2024-03-30T13:10:31.623 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:10:31.623 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:10:31.623 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:10:31.623 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:10:31.623 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:10:31.624 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:10:31.625 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:10:31.626 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:31.627 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:10:31.628 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:10:31.629 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:10:31.630 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:31.630 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:10:31.630 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:10:31.630 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:10:31.630 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:10:31.630 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:10:31.630 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:31.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb68d20d640 1 -- 172.21.15.83:0/208794120 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb674067ff0 msgr2=0x7fb67406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb68d20d640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb674067ff0 0x7fb67406a4b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb678001ec0 tx=0x7fb678009040 comp rx=0 tx=0).stop 2024-03-30T13:10:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb68d20d640 1 -- 172.21.15.83:0/208794120 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb688146230 msgr2=0x7fb6881466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb68d20d640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb688146230 0x7fb6881466b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb68001d4e0 tx=0x7fb680009750 comp rx=0 tx=0).stop 2024-03-30T13:10:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb68d20d640 1 -- 172.21.15.83:0/208794120 shutdown_connections 2024-03-30T13:10:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb68d20d640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb674067ff0 0x7fb67406a4b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb68d20d640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb688146230 0x7fb6881466b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb68d20d640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb688158340 0x7fb6881439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb68d20d640 1 --2- 172.21.15.83:0/208794120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700051d0 0x7fb6881598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb68d20d640 1 -- 172.21.15.83:0/208794120 >> 172.21.15.83:0/208794120 conn(0x7fb688072d30 msgr2=0x7fb6880d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb68d20d640 1 -- 172.21.15.83:0/208794120 shutdown_connections 2024-03-30T13:10:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:31.605+0000 7fb68d20d640 1 -- 172.21.15.83:0/208794120 wait complete. 2024-03-30T13:10:31.633 DEBUG:tasks.cephfs.test_uninlining:removing dir linux-5.4 2024-03-30T13:10:31.633 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && rm -rf linux-5.4/ 2024-03-30T13:10:31.907 INFO:tasks.cephfs.test_uninlining:Found 23 files with inline_data_length == 0 2024-03-30T13:10:31.907 INFO:tasks.cephfs.test_uninlining:Found 23 files with inline_data_version == CEPH_INLINE_NONE 2024-03-30T13:10:31.907 INFO:tasks.cephfs.test_uninlining:Running Data Uninlining test with: without clearing cache, without unmount client, without mount.open_background, without multimds, with snapshots 2024-03-30T13:10:31.907 DEBUG:tasks.cephfs.test_uninlining:setting max_mds:1 2024-03-30T13:10:31.907 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-03-30T13:10:32.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.009+0000 7fd82f4a2640 1 Processor -- start 2024-03-30T13:10:32.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.009+0000 7fd82f4a2640 1 -- start start 2024-03-30T13:10:32.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.009+0000 7fd82f4a2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd82815c7f0 0x7fd8280d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:32.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.009+0000 7fd82f4a2640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd82809b870 con 0x7fd828160140 2024-03-30T13:10:32.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.009+0000 7fd82f4a2640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8280aff40 con 0x7fd8281605a0 2024-03-30T13:10:32.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.009+0000 7fd82f4a2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd8280b0fe0 con 0x7fd82815c7f0 2024-03-30T13:10:32.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.009+0000 7fd82ca3d640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd828160140 0x7fd82809aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36516/0 (socket says 172.21.15.83:36516) 2024-03-30T13:10:32.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.009+0000 7fd82ca3d640 1 -- 172.21.15.83:0/1682429581 learned_addr learned my addr 172.21.15.83:0/1682429581 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:32.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd82d23e640 1 --2- 172.21.15.83:0/1682429581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd82815c7f0 0x7fd8280d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:32.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1257558667 0 0) 0x7fd82809b870 con 0x7fd828160140 2024-03-30T13:10:32.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd814003530 con 0x7fd828160140 2024-03-30T13:10:32.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1922184857 0 0) 0x7fd814003530 con 0x7fd828160140 2024-03-30T13:10:32.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd82815c7f0 msgr2=0x7fd8280d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:32.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 --2- 172.21.15.83:0/1682429581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd82815c7f0 0x7fd8280d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:32.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 >> v1:172.21.15.153:6789/0 conn(0x7fd8281605a0 legacy=0x7fd82809b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:32.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8280b0220 con 0x7fd828160140 2024-03-30T13:10:32.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fd818001680 con 0x7fd828160140 2024-03-30T13:10:32.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 >> v1:172.21.15.83:6789/0 conn(0x7fd828160140 legacy=0x7fd82809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:32.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 --2- 172.21.15.83:0/1682429581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8140039f0 0x7fd814003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:32.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 --2- 172.21.15.83:0/1682429581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd82815c7f0 0x7fd814004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:32.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 --2- 172.21.15.83:0/1682429581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd814004d50 0x7fd8140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:32.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd81400ba80 con 0x7fd814004d50 2024-03-30T13:10:32.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd81400bc00 con 0x7fd8140039f0 2024-03-30T13:10:32.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd81400be00 con 0x7fd82815c7f0 2024-03-30T13:10:32.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd82da3f640 1 --2- 172.21.15.83:0/1682429581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd814004d50 0x7fd8140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:32.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd82d23e640 1 --2- 172.21.15.83:0/1682429581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8140039f0 0x7fd814003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:32.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd82da3f640 1 -- 172.21.15.83:0/1682429581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd82815c7f0 msgr2=0x7fd814004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:32.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd82da3f640 1 --2- 172.21.15.83:0/1682429581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd82815c7f0 0x7fd814004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:32.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd82da3f640 1 -- 172.21.15.83:0/1682429581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8140039f0 msgr2=0x7fd814003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:32.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd82da3f640 1 --2- 172.21.15.83:0/1682429581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8140039f0 0x7fd814003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:32.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.013+0000 7fd82da3f640 1 -- 172.21.15.83:0/1682429581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd814003530 con 0x7fd814004d50 2024-03-30T13:10:32.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82da3f640 1 --2- 172.21.15.83:0/1682429581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd814004d50 0x7fd8140051d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd824001750 tx=0x7fd82401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c02efbbd98847cb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8240013a0 con 0x7fd814004d50 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8240052f0 con 0x7fd814004d50 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd81ffff640 1 -- 172.21.15.83:0/1682429581 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824003840 con 0x7fd814004d50 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 -- 172.21.15.83:0/1682429581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd814004d50 msgr2=0x7fd8140051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 --2- 172.21.15.83:0/1682429581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd814004d50 0x7fd8140051d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd824001750 tx=0x7fd82401c3e0 comp rx=0 tx=0).stop 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82da3f640 1 -- 172.21.15.83:0/1682429581 reap_dead start 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 -- 172.21.15.83:0/1682429581 shutdown_connections 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 -- 172.21.15.83:0/1682429581 >> 172.21.15.83:0/1682429581 conn(0x7fd8280b3e70 msgr2=0x7fd8280b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 -- 172.21.15.83:0/1682429581 shutdown_connections 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 -- 172.21.15.83:0/1682429581 wait complete. 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 Processor -- start 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 -- start start 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd814004d50 0x7fd82815edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd828151ac0 0x7fd8280cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd828150e50 0x7fd8281512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd8280b0b50 con 0x7fd828151ac0 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd8280b3ca0 con 0x7fd814004d50 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82f4a2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd8280b07e0 con 0x7fd828150e50 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82ca3d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd828151ac0 0x7fd8280cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82ca3d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd828151ac0 0x7fd8280cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39320/0 (socket says 172.21.15.83:39320) 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82ca3d640 1 -- 172.21.15.83:0/2910149123 learned_addr learned my addr 172.21.15.83:0/2910149123 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82d23e640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd814004d50 0x7fd82815edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82da3f640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd828150e50 0x7fd8281512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82ca3d640 1 -- 172.21.15.83:0/2910149123 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd828150e50 msgr2=0x7fd8281512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82ca3d640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd828150e50 0x7fd8281512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82ca3d640 1 -- 172.21.15.83:0/2910149123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd814004d50 msgr2=0x7fd82815edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82ca3d640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd814004d50 0x7fd82815edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82ca3d640 1 -- 172.21.15.83:0/2910149123 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8281522a0 con 0x7fd828151ac0 2024-03-30T13:10:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.017+0000 7fd82ca3d640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd828151ac0 0x7fd8280cf5d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd81800c700 tx=0x7fd81800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.021+0000 7fd81dffb640 1 -- 172.21.15.83:0/2910149123 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd818018070 con 0x7fd828151ac0 2024-03-30T13:10:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.021+0000 7fd81dffb640 1 -- 172.21.15.83:0/2910149123 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8180074e0 con 0x7fd828151ac0 2024-03-30T13:10:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.021+0000 7fd81dffb640 1 -- 172.21.15.83:0/2910149123 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd818004a30 con 0x7fd828151ac0 2024-03-30T13:10:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.021+0000 7fd82f4a2640 1 -- 172.21.15.83:0/2910149123 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd828152580 con 0x7fd828151ac0 2024-03-30T13:10:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.021+0000 7fd82f4a2640 1 -- 172.21.15.83:0/2910149123 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd828152b40 con 0x7fd828151ac0 2024-03-30T13:10:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.021+0000 7fd82f4a2640 1 -- 172.21.15.83:0/2910149123 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8280a04d0 con 0x7fd828151ac0 2024-03-30T13:10:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.021+0000 7fd81dffb640 1 -- 172.21.15.83:0/2910149123 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fd81801b070 con 0x7fd828151ac0 2024-03-30T13:10:32.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.021+0000 7fd81dffb640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd80c067fc0 0x7fd80c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:32.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.021+0000 7fd81dffb640 1 -- 172.21.15.83:0/2910149123 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd8180859a0 con 0x7fd828151ac0 2024-03-30T13:10:32.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.021+0000 7fd82d23e640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd80c067fc0 0x7fd80c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:32.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.021+0000 7fd82d23e640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd80c067fc0 0x7fd80c06a480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd820009fd0 tx=0x7fd82000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:32.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.025+0000 7fd81dffb640 1 -- 172.21.15.83:0/2910149123 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fd8180561e0 con 0x7fd828151ac0 2024-03-30T13:10:32.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.209+0000 7fd82f4a2640 1 -- 172.21.15.83:0/2910149123 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7fd82804f9e0 con 0x7fd828151ac0 2024-03-30T13:10:32.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.349+0000 7fd81dffb640 1 -- 172.21.15.83:0/2910149123 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fd818055ae0 con 0x7fd828151ac0 2024-03-30T13:10:32.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.353+0000 7fd82f4a2640 1 -- 172.21.15.83:0/2910149123 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd80c067fc0 msgr2=0x7fd80c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:32.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.353+0000 7fd82f4a2640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd80c067fc0 0x7fd80c06a480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd820009fd0 tx=0x7fd82000b040 comp rx=0 tx=0).stop 2024-03-30T13:10:32.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.353+0000 7fd82f4a2640 1 -- 172.21.15.83:0/2910149123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd828151ac0 msgr2=0x7fd8280cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:32.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.353+0000 7fd82f4a2640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd828151ac0 0x7fd8280cf5d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd81800c700 tx=0x7fd81800cbc0 comp rx=0 tx=0).stop 2024-03-30T13:10:32.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.353+0000 7fd82f4a2640 1 -- 172.21.15.83:0/2910149123 shutdown_connections 2024-03-30T13:10:32.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.353+0000 7fd82f4a2640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd80c067fc0 0x7fd80c06a480 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:32.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.353+0000 7fd82f4a2640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd828150e50 0x7fd8281512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:32.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.353+0000 7fd82f4a2640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd828151ac0 0x7fd8280cf5d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:32.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.353+0000 7fd82f4a2640 1 --2- 172.21.15.83:0/2910149123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd814004d50 0x7fd82815edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:32.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.353+0000 7fd82f4a2640 1 -- 172.21.15.83:0/2910149123 >> 172.21.15.83:0/2910149123 conn(0x7fd8280b3e70 msgr2=0x7fd8280af150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:32.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.353+0000 7fd82f4a2640 1 -- 172.21.15.83:0/2910149123 shutdown_connections 2024-03-30T13:10:32.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:32.353+0000 7fd82f4a2640 1 -- 172.21.15.83:0/2910149123 wait complete. 2024-03-30T13:10:32.376 DEBUG:tasks.cephfs.test_uninlining:getting client_max_inline_size 2024-03-30T13:10:32.376 DEBUG:tasks.cephfs.test_uninlining:got client_max_inline_size:4096 2024-03-30T13:10:32.376 DEBUG:tasks.cephfs.test_uninlining:starting snapshotter thread 2024-03-30T13:10:32.376 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4 2024-03-30T13:10:32.391 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_0 2024-03-30T13:10:32.392 DEBUG:tasks.cephfs.test_uninlining:extracting tarball 2024-03-30T13:10:32.392 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && tar -x -z -f linux-5.4.tar.gz linux-5.4/fs/ceph linux-5.4/fs/orangefs linux-5.4/fs/ext2 2024-03-30T13:10:33.458 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_1 2024-03-30T13:10:34.479 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_2 2024-03-30T13:10:35.503 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_3 2024-03-30T13:10:36.524 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_4 2024-03-30T13:10:37.053 DEBUG:tasks.cephfs.test_uninlining:fetching dir list 2024-03-30T13:10:37.053 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -mindepth 2 -maxdepth 2 -type d 2024-03-30T13:10:37.068 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph 2024-03-30T13:10:37.068 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2 2024-03-30T13:10:37.068 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs 2024-03-30T13:10:37.069 DEBUG:tasks.cephfs.test_uninlining:distributing dir pins 2024-03-30T13:10:37.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:10:37.069 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ceph) 2024-03-30T13:10:37.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:10:37.120 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ext2) 2024-03-30T13:10:37.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:10:37.172 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/orangefs) 2024-03-30T13:10:37.220 DEBUG:tasks.cephfs.test_uninlining:listing files with size <= 4096 2024-03-30T13:10:37.220 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -type f -size -4097c 2024-03-30T13:10:37.326 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:10:37.326 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/Makefile 2024-03-30T13:10:37.326 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:10:37.326 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/io.h 2024-03-30T13:10:37.326 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:10:37.326 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:10:37.326 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:10:37.326 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:10:37.326 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/Makefile 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/acl.h 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:10:37.327 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:10:37.328 INFO:tasks.cephfs.test_uninlining:Found 23 inlined files 2024-03-30T13:10:37.328 DEBUG:tasks.cephfs.test_uninlining:starting scrub 2024-03-30T13:10:37.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:10:37.328 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive 2024-03-30T13:10:37.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30dd4af640 1 Processor -- start 2024-03-30T13:10:37.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30dd4af640 1 -- start start 2024-03-30T13:10:37.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30dd4af640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f30d80cdf30 0x7f30d80b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30dd4af640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f30d81620b0 0x7f30d80af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30dd4af640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30d80b42f0 con 0x7f30d80cebc0 2024-03-30T13:10:37.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30dd4af640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f30d80ae2d0 con 0x7f30d81620b0 2024-03-30T13:10:37.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30dd4af640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f30d80b1f50 con 0x7f30d80cdf30 2024-03-30T13:10:37.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30d67fc640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f30d80cebc0 0x7f30d81619a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36424/0 (socket says 172.21.15.83:36424) 2024-03-30T13:10:37.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30d67fc640 1 -- 172.21.15.83:0/4185477543 learned_addr learned my addr 172.21.15.83:0/4185477543 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:10:37.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30d77fe640 1 --2- 172.21.15.83:0/4185477543 >> v2:172.21.15.83:3300/0 conn(0x7f30d81620b0 0x7f30d80af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30d6ffd640 1 --2- 172.21.15.83:0/4185477543 >> v2:172.21.15.153:3300/0 conn(0x7f30d80cdf30 0x7f30d80b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30d5ffb640 1 -- 172.21.15.83:0/4185477543 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126470334 0 0) 0x7f30c8001120 con 0x7f30d80cebc0 2024-03-30T13:10:37.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30d5ffb640 1 -- 172.21.15.83:0/4185477543 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30c0003530 con 0x7f30d80cebc0 2024-03-30T13:10:37.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30d77fe640 1 -- 172.21.15.83:0/4185477543 >> v2:172.21.15.153:3300/0 conn(0x7f30d80cdf30 msgr2=0x7f30d80b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30d77fe640 1 --2- 172.21.15.83:0/4185477543 >> v2:172.21.15.153:3300/0 conn(0x7f30d80cdf30 0x7f30d80b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30d77fe640 1 -- 172.21.15.83:0/4185477543 >> v1:172.21.15.83:6789/0 conn(0x7f30d80cebc0 legacy=0x7f30d81619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.445+0000 7f30d77fe640 1 -- 172.21.15.83:0/4185477543 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d80ae520 con 0x7f30d81620b0 2024-03-30T13:10:37.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30d77fe640 1 --2- 172.21.15.83:0/4185477543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d81620b0 0x7f30d80af000 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f30d80b2fc0 tx=0x7f30d001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78679d23d396c53 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30d5ffb640 1 -- 172.21.15.83:0/4185477543 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d00b2070 con 0x7f30d81620b0 2024-03-30T13:10:37.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30d5ffb640 1 -- 172.21.15.83:0/4185477543 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d00a57f0 con 0x7f30d81620b0 2024-03-30T13:10:37.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30d5ffb640 1 -- 172.21.15.83:0/4185477543 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d00a5bc0 con 0x7f30d81620b0 2024-03-30T13:10:37.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30dd4af640 1 -- 172.21.15.83:0/4185477543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d81620b0 msgr2=0x7f30d80af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30dd4af640 1 --2- 172.21.15.83:0/4185477543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d81620b0 0x7f30d80af000 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f30d80b2fc0 tx=0x7f30d001c930 comp rx=0 tx=0).stop 2024-03-30T13:10:37.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30dd4af640 1 -- 172.21.15.83:0/4185477543 shutdown_connections 2024-03-30T13:10:37.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30dd4af640 1 --2- 172.21.15.83:0/4185477543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d81620b0 0x7f30d80af000 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30dd4af640 1 --2- 172.21.15.83:0/4185477543 >> v2:172.21.15.153:3300/0 conn(0x7f30d80cdf30 0x7f30d80b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30dd4af640 1 -- 172.21.15.83:0/4185477543 >> 172.21.15.83:0/4185477543 conn(0x7f30d80b6810 msgr2=0x7f30d80b6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:37.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30dd4af640 1 -- 172.21.15.83:0/4185477543 shutdown_connections 2024-03-30T13:10:37.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30dd4af640 1 -- 172.21.15.83:0/4185477543 wait complete. 2024-03-30T13:10:37.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30dd4af640 1 Processor -- start 2024-03-30T13:10:37.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.449+0000 7f30dd4af640 1 -- start start 2024-03-30T13:10:37.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30dd4af640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30d80cdf30 0x7f30d80cf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30dd4af640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d80cebc0 0x7f30d813e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30dd4af640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30d81620b0 0x7f30d8159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30dd4af640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f30d80aff60 con 0x7f30d80cebc0 2024-03-30T13:10:37.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30dd4af640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30d80b1d30 con 0x7f30d80cdf30 2024-03-30T13:10:37.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30dd4af640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f30d80b00e0 con 0x7f30d81620b0 2024-03-30T13:10:37.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d80cebc0 0x7f30d813e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d80cebc0 0x7f30d813e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36060/0 (socket says 172.21.15.83:36060) 2024-03-30T13:10:37.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d67fc640 1 -- 172.21.15.83:0/181486434 learned_addr learned my addr 172.21.15.83:0/181486434 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:37.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d6ffd640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30d80cdf30 0x7f30d80cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d77fe640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30d81620b0 0x7f30d8159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d67fc640 1 -- 172.21.15.83:0/181486434 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30d81620b0 msgr2=0x7f30d8159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d67fc640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30d81620b0 0x7f30d8159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d67fc640 1 -- 172.21.15.83:0/181486434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30d80cdf30 msgr2=0x7f30d80cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d67fc640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30d80cdf30 0x7f30d80cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d67fc640 1 -- 172.21.15.83:0/181486434 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d8150a20 con 0x7f30d80cebc0 2024-03-30T13:10:37.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d77fe640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30d81620b0 0x7f30d8159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:37.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d67fc640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d80cebc0 0x7f30d813e3f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f30c800c730 tx=0x7f30c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30bf7fe640 1 -- 172.21.15.83:0/181486434 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8017070 con 0x7f30d80cebc0 2024-03-30T13:10:37.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30bf7fe640 1 -- 172.21.15.83:0/181486434 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c8005ae0 con 0x7f30d80cebc0 2024-03-30T13:10:37.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30dd4af640 1 -- 172.21.15.83:0/181486434 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d8150d00 con 0x7f30d80cebc0 2024-03-30T13:10:37.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30bf7fe640 1 -- 172.21.15.83:0/181486434 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8007e30 con 0x7f30d80cebc0 2024-03-30T13:10:37.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30dd4af640 1 -- 172.21.15.83:0/181486434 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d8160260 con 0x7f30d80cebc0 2024-03-30T13:10:37.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30bf7fe640 1 -- 172.21.15.83:0/181486434 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f30c801a070 con 0x7f30d80cebc0 2024-03-30T13:10:37.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30bf7fe640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f30c4067fc0 0x7f30c406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30d6ffd640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f30c4067fc0 0x7f30c406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.453+0000 7f30bf7fe640 1 -- 172.21.15.83:0/181486434 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f30c80859a0 con 0x7f30d80cebc0 2024-03-30T13:10:37.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d6ffd640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f30c4067fc0 0x7f30c406a480 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009790 tx=0x7f30cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 Processor -- start 2024-03-30T13:10:37.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 -- start start 2024-03-30T13:10:37.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58000 0x562590d583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d58920 0x562590d0e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d0e850 0x562590d0ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562590b5cc60 con 0x562590d0e850 2024-03-30T13:10:37.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562590af9b80 con 0x562590d58920 2024-03-30T13:10:37.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x562590b58c10 con 0x562590d58000 2024-03-30T13:10:37.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d0e850 0x562590d0ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d0e850 0x562590d0ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36068/0 (socket says 172.21.15.83:36068) 2024-03-30T13:10:37.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d77fe640 1 -- 172.21.15.83:0/2839087736 learned_addr learned my addr 172.21.15.83:0/2839087736 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d6ffd640 1 --2- 172.21.15.83:0/2839087736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58000 0x562590d583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d67fc640 1 --2- 172.21.15.83:0/2839087736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d58920 0x562590d0e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d77fe640 1 -- 172.21.15.83:0/2839087736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58000 msgr2=0x562590d583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d77fe640 1 --2- 172.21.15.83:0/2839087736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58000 0x562590d583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d77fe640 1 -- 172.21.15.83:0/2839087736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d58920 msgr2=0x562590d0e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d77fe640 1 --2- 172.21.15.83:0/2839087736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d58920 0x562590d0e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d77fe640 1 -- 172.21.15.83:0/2839087736 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562590c03f10 con 0x562590d0e850 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d67fc640 1 --2- 172.21.15.83:0/2839087736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d58920 0x562590d0e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30d77fe640 1 --2- 172.21.15.83:0/2839087736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d0e850 0x562590d0ec30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f30d0019540 tx=0x7f30d0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a799d09e2bf1c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30bcff9640 1 -- 172.21.15.83:0/2839087736 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d00b2040 con 0x562590d0e850 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30bcff9640 1 -- 172.21.15.83:0/2839087736 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d00a55f0 con 0x562590d0e850 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30bcff9640 1 -- 172.21.15.83:0/2839087736 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d00a59e0 con 0x562590d0e850 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 -- 172.21.15.83:0/2839087736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d0e850 msgr2=0x562590d0ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 --2- 172.21.15.83:0/2839087736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d0e850 0x562590d0ec30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f30d0019540 tx=0x7f30d0004ac0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 -- 172.21.15.83:0/2839087736 shutdown_connections 2024-03-30T13:10:37.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 --2- 172.21.15.83:0/2839087736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d0e850 0x562590d0ec30 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 --2- 172.21.15.83:0/2839087736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d58920 0x562590d0e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 --2- 172.21.15.83:0/2839087736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58000 0x562590d583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 -- 172.21.15.83:0/2839087736 >> 172.21.15.83:0/2839087736 conn(0x562590b09bd0 msgr2=0x562590d0cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:37.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 -- 172.21.15.83:0/2839087736 shutdown_connections 2024-03-30T13:10:37.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.457+0000 7f30e0631000 1 -- 172.21.15.83:0/2839087736 wait complete. 2024-03-30T13:10:37.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 1 -- start start 2024-03-30T13:10:37.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 1 Processor -- start 2024-03-30T13:10:37.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d0e850 0x562590d12de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 0x562590d3c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58920 0x562590d3c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562590b1a2a0 con 0x562590d58000 2024-03-30T13:10:37.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562590b1b760 con 0x562590d0e850 2024-03-30T13:10:37.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x562590b5bf70 con 0x562590d58920 2024-03-30T13:10:37.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 10 client.0 _ll_register_callbacks cb 0x562590cf9af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:37.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 0x562590d3c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 0x562590d3c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36074/0 (socket says 172.21.15.83:36074) 2024-03-30T13:10:37.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d67fc640 1 -- 172.21.15.83:0/2600624561 learned_addr learned my addr 172.21.15.83:0/2600624561 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:37.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d77fe640 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58920 0x562590d3c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d6ffd640 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d0e850 0x562590d12de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d67fc640 1 -- 172.21.15.83:0/2600624561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58920 msgr2=0x562590d3c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d67fc640 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58920 0x562590d3c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d67fc640 1 -- 172.21.15.83:0/2600624561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d0e850 msgr2=0x562590d12de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d67fc640 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d0e850 0x562590d12de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d67fc640 1 -- 172.21.15.83:0/2600624561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562590b368d0 con 0x562590d58000 2024-03-30T13:10:37.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d67fc640 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 0x562590d3c400 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f30c805e100 tx=0x7f30c8059e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e477885cb5587cb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30b5ffb640 1 -- 172.21.15.83:0/2600624561 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8082060 con 0x562590d58000 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30b5ffb640 1 -- 172.21.15.83:0/2600624561 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f30c8054e10 con 0x562590d58000 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 1 -- 172.21.15.83:0/2600624561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30d00a55f0 con 0x562590d58000 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30b5ffb640 1 -- 172.21.15.83:0/2600624561 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f30c8073050 con 0x562590d58000 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 10 client.5922 fetch_fsmap learned FSMap version 18 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 1 -- 172.21.15.83:0/2600624561 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x562590ba20d0 con 0x562590d58000 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30b5ffb640 1 -- 172.21.15.83:0/2600624561 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d00a55f0 con 0x562590d58000 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30b5ffb640 1 -- 172.21.15.83:0/2600624561 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f30c8085040 con 0x562590d58000 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 10 client.5922 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 10 client.5922 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 20 client.5922 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:37.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562590d5e640 0x562590d5ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 4 client.5922 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:37.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30e0631000 1 -- 172.21.15.83:0/2600624561 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562590af7f70 con 0x562590d5e640 2024-03-30T13:10:37.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d6ffd640 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562590d5e640 0x562590d5ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30d6ffd640 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562590d5e640 0x562590d5ea20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dcfd435f7ac606f server_cookie=c0bd255000c80f51 in_seq=0 out_seq=0 2024-03-30T13:10:37.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.461+0000 7f30b5ffb640 10 client.5922 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:37.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30b5ffb640 1 -- 172.21.15.83:0/2600624561 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x562590af7f70 con 0x562590d5e640 2024-03-30T13:10:37.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30b5ffb640 10 client.5922 handle_command_reply: tid=0 2024-03-30T13:10:37.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30e0631000 1 client.5922 shutdown 2024-03-30T13:10:37.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30e0631000 1 -- 172.21.15.83:0/2600624561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 msgr2=0x562590d3c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30e0631000 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 0x562590d3c400 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f30c805e100 tx=0x7f30c8059e30 comp rx=0 tx=0).stop 2024-03-30T13:10:37.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30e0631000 1 -- 172.21.15.83:0/2600624561 shutdown_connections 2024-03-30T13:10:37.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30e0631000 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58920 0x562590d3c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30e0631000 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562590d5e640 0x562590d5ea20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30e0631000 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 0x562590d3c400 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30e0631000 1 --2- 172.21.15.83:0/2600624561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d0e850 0x562590d12de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30b5ffb640 0 client.5922 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:37.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30e0631000 1 -- 172.21.15.83:0/2600624561 >> 172.21.15.83:0/2600624561 conn(0x562590b09bd0 msgr2=0x562590d0cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:37.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30e0631000 1 -- 172.21.15.83:0/2600624561 shutdown_connections 2024-03-30T13:10:37.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30e0631000 1 -- 172.21.15.83:0/2600624561 wait complete. 2024-03-30T13:10:37.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.465+0000 7f30e0631000 20 client.5922 trim_cache size 0 max 16384 2024-03-30T13:10:37.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30e0631000 1 Processor -- start 2024-03-30T13:10:37.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30e0631000 1 -- start start 2024-03-30T13:10:37.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30e0631000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d0e850 0x562590d64c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30e0631000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58000 0x562590d6e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30e0631000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58920 0x562590d6ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30e0631000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f30d815eb40 con 0x562590d58920 2024-03-30T13:10:37.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30e0631000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30d815dea0 con 0x562590d0e850 2024-03-30T13:10:37.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30e0631000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f30d815e4f0 con 0x562590d58000 2024-03-30T13:10:37.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58920 0x562590d6ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58920 0x562590d6ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36076/0 (socket says 172.21.15.83:36076) 2024-03-30T13:10:37.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30d77fe640 1 -- 172.21.15.83:0/2267540617 learned_addr learned my addr 172.21.15.83:0/2267540617 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30d67fc640 1 --2- 172.21.15.83:0/2267540617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58000 0x562590d6e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30d77fe640 1 -- 172.21.15.83:0/2267540617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58000 msgr2=0x562590d6e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30d77fe640 1 --2- 172.21.15.83:0/2267540617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58000 0x562590d6e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30d6ffd640 1 --2- 172.21.15.83:0/2267540617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d0e850 0x562590d64c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30d77fe640 1 -- 172.21.15.83:0/2267540617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d0e850 msgr2=0x562590d64c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30d77fe640 1 --2- 172.21.15.83:0/2267540617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d0e850 0x562590d64c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.481+0000 7f30d77fe640 1 -- 172.21.15.83:0/2267540617 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562590b2a410 con 0x562590d58920 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30d77fe640 1 --2- 172.21.15.83:0/2267540617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58920 0x562590d6ec40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f30d000c090 tx=0x7f30d00a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bde05b9eb1d9d11 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30b7fff640 1 -- 172.21.15.83:0/2267540617 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d00b2040 con 0x562590d58920 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30b7fff640 1 -- 172.21.15.83:0/2267540617 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d00a55f0 con 0x562590d58920 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30b7fff640 1 -- 172.21.15.83:0/2267540617 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d00a59c0 con 0x562590d58920 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 -- 172.21.15.83:0/2267540617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58920 msgr2=0x562590d6ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 --2- 172.21.15.83:0/2267540617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58920 0x562590d6ec40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f30d000c090 tx=0x7f30d00a7000 comp rx=0 tx=0).stop 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 -- 172.21.15.83:0/2267540617 shutdown_connections 2024-03-30T13:10:37.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 --2- 172.21.15.83:0/2267540617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58920 0x562590d6ec40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 --2- 172.21.15.83:0/2267540617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d58000 0x562590d6e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 --2- 172.21.15.83:0/2267540617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d0e850 0x562590d64c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 -- 172.21.15.83:0/2267540617 >> 172.21.15.83:0/2267540617 conn(0x562590b09bd0 msgr2=0x562590d5cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:37.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 -- 172.21.15.83:0/2267540617 shutdown_connections 2024-03-30T13:10:37.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 -- 172.21.15.83:0/2267540617 wait complete. 2024-03-30T13:10:37.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 -- start start 2024-03-30T13:10:37.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 Processor -- start 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d0e850 0x562590d0c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 0x562590d0ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d58920 0x562590d0cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562590c185f0 con 0x562590d58000 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562590b61290 con 0x562590d58920 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x562590b1dee0 con 0x562590d0e850 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 10 client.0 _ll_register_callbacks cb 0x7f30c80561b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30d67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 0x562590d0ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30d67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 0x562590d0ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36092/0 (socket says 172.21.15.83:36092) 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30d67fc640 1 -- 172.21.15.83:0/2678915248 learned_addr learned my addr 172.21.15.83:0/2678915248 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30d67fc640 1 -- 172.21.15.83:0/2678915248 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d0e850 msgr2=0x562590d0c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30d67fc640 1 --2- 172.21.15.83:0/2678915248 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d0e850 0x562590d0c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30d67fc640 1 -- 172.21.15.83:0/2678915248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d58920 msgr2=0x562590d0cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30d67fc640 1 --2- 172.21.15.83:0/2678915248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d58920 0x562590d0cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30d67fc640 1 -- 172.21.15.83:0/2678915248 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562590bde1e0 con 0x562590d58000 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30d67fc640 1 --2- 172.21.15.83:0/2678915248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 0x562590d0ca80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f30c80012c0 tx=0x7f30c8083da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d8627d96f45f70 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30b5ffb640 1 -- 172.21.15.83:0/2678915248 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8078060 con 0x562590d58000 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30b5ffb640 1 -- 172.21.15.83:0/2678915248 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f30c8051710 con 0x562590d58000 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 -- 172.21.15.83:0/2678915248 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30d00a55f0 con 0x562590d58000 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30b5ffb640 1 -- 172.21.15.83:0/2678915248 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f30c8051930 con 0x562590d58000 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 10 client.5928 fetch_fsmap learned FSMap version 18 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 -- 172.21.15.83:0/2678915248 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5625908183b0 con 0x562590d58000 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30b5ffb640 1 -- 172.21.15.83:0/2678915248 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d00a55f0 con 0x562590d58000 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30b5ffb640 1 -- 172.21.15.83:0/2678915248 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f30c8085040 con 0x562590d58000 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 10 client.5928 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 10 client.5928 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:37.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 20 client.5928 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 --2- 172.21.15.83:0/2678915248 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562590d0d500 0x562590d0d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 4 client.5928 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30e0631000 1 -- 172.21.15.83:0/2678915248 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x562590b6a1a0 con 0x562590d0d500 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.485+0000 7f30d6ffd640 1 --2- 172.21.15.83:0/2678915248 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562590d0d500 0x562590d0d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30b5ffb640 10 client.5928 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30d6ffd640 1 --2- 172.21.15.83:0/2678915248 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562590d0d500 0x562590d0d910 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2ab006d06a89a8e server_cookie=d6cf2fb79d521e5f in_seq=0 out_seq=0 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30b5ffb640 1 -- 172.21.15.83:0/2678915248 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562590b6a1a0 con 0x562590d0d500 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30b5ffb640 10 client.5928 handle_command_reply: tid=0 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30e0631000 1 client.5928 shutdown 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30e0631000 1 -- 172.21.15.83:0/2678915248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 msgr2=0x562590d0ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30e0631000 1 --2- 172.21.15.83:0/2678915248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 0x562590d0ca80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f30c80012c0 tx=0x7f30c8083da0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30e0631000 1 -- 172.21.15.83:0/2678915248 shutdown_connections 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30e0631000 1 --2- 172.21.15.83:0/2678915248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562590d58920 0x562590d0cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30e0631000 1 --2- 172.21.15.83:0/2678915248 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x562590d0d500 0x562590d0d910 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30e0631000 1 --2- 172.21.15.83:0/2678915248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562590d58000 0x562590d0ca80 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30e0631000 1 --2- 172.21.15.83:0/2678915248 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562590d0e850 0x562590d0c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30e0631000 1 -- 172.21.15.83:0/2678915248 >> 172.21.15.83:0/2678915248 conn(0x562590b09bd0 msgr2=0x562590d13980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:37.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30b5ffb640 0 client.5928 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:37.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30e0631000 1 -- 172.21.15.83:0/2678915248 shutdown_connections 2024-03-30T13:10:37.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30e0631000 1 -- 172.21.15.83:0/2678915248 wait complete. 2024-03-30T13:10:37.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30e0631000 20 client.5928 trim_cache size 0 max 16384 2024-03-30T13:10:37.500 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:37.500 INFO:teuthology.orchestra.run.smithi083.stdout: "return_code": 0, 2024-03-30T13:10:37.500 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_tag": "59d9f844-2347-4db3-988a-63cf85449874", 2024-03-30T13:10:37.501 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": "asynchronous" 2024-03-30T13:10:37.501 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:37.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30dd4af640 1 -- 172.21.15.83:0/181486434 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f30c4067fc0 msgr2=0x7f30c406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30dd4af640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f30c4067fc0 0x7f30c406a480 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009790 tx=0x7f30cc008040 comp rx=0 tx=0).stop 2024-03-30T13:10:37.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30dd4af640 1 -- 172.21.15.83:0/181486434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d80cebc0 msgr2=0x7f30d813e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30dd4af640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d80cebc0 0x7f30d813e3f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f30c800c730 tx=0x7f30c800cbf0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30dd4af640 1 -- 172.21.15.83:0/181486434 shutdown_connections 2024-03-30T13:10:37.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30dd4af640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f30c4067fc0 0x7f30c406a480 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30dd4af640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30d81620b0 0x7f30d8159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30dd4af640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d80cebc0 0x7f30d813e3f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30dd4af640 1 --2- 172.21.15.83:0/181486434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30d80cdf30 0x7f30d80cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30dd4af640 1 -- 172.21.15.83:0/181486434 >> 172.21.15.83:0/181486434 conn(0x7f30d80b6810 msgr2=0x7f30d815aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:37.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30dd4af640 1 -- 172.21.15.83:0/181486434 shutdown_connections 2024-03-30T13:10:37.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.489+0000 7f30dd4af640 1 -- 172.21.15.83:0/181486434 wait complete. 2024-03-30T13:10:37.520 DEBUG:tasks.cephfs.test_uninlining:scrub start response: {'return_code': 0, 'scrub_tag': '59d9f844-2347-4db3-988a-63cf85449874', 'mode': 'asynchronous'} 2024-03-30T13:10:37.520 DEBUG:tasks.cephfs.test_uninlining:waiting for scrub to complete 2024-03-30T13:10:37.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:10:37.521 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-30T13:10:37.609 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_5 2024-03-30T13:10:37.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.661+0000 7fce17846640 1 Processor -- start 2024-03-30T13:10:37.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.661+0000 7fce17846640 1 -- start start 2024-03-30T13:10:37.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce1015e4f0 0x7fce100b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fce100ad8c0 0x7fce100ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fce100ae730 0x7fce10162140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fce100aeb90 con 0x7fce100ae730 2024-03-30T13:10:37.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fce1006df50 con 0x7fce100ad8c0 2024-03-30T13:10:37.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fce100b54a0 con 0x7fce1015e4f0 2024-03-30T13:10:37.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce15de3640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fce100ae730 0x7fce10162140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce15de3640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fce100ae730 0x7fce10162140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36098/0 (socket says 172.21.15.83:36098) 2024-03-30T13:10:37.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce15de3640 1 -- 172.21.15.83:0/2577210600 learned_addr learned my addr 172.21.15.83:0/2577210600 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:37.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce15de3640 1 -- 172.21.15.83:0/2577210600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce1015e4f0 msgr2=0x7fce100b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce15de3640 1 --2- 172.21.15.83:0/2577210600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce1015e4f0 0x7fce100b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce15de3640 1 -- 172.21.15.83:0/2577210600 >> v2:172.21.15.153:3300/0 conn(0x7fce100ad8c0 msgr2=0x7fce100ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce15de3640 1 --2- 172.21.15.83:0/2577210600 >> v2:172.21.15.153:3300/0 conn(0x7fce100ad8c0 0x7fce100ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce15de3640 1 -- 172.21.15.83:0/2577210600 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce100b5740 con 0x7fce100ae730 2024-03-30T13:10:37.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce15de3640 1 --2- 172.21.15.83:0/2577210600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce100ae730 0x7fce10162140 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fce10073370 tx=0x7fce0801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ba55712d973434 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce07fff640 1 -- 172.21.15.83:0/2577210600 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce080ac020 con 0x7fce100ae730 2024-03-30T13:10:37.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce07fff640 1 -- 172.21.15.83:0/2577210600 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce080a6420 con 0x7fce100ae730 2024-03-30T13:10:37.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce07fff640 1 -- 172.21.15.83:0/2577210600 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce080a67f0 con 0x7fce100ae730 2024-03-30T13:10:37.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 -- 172.21.15.83:0/2577210600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce100ae730 msgr2=0x7fce10162140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 --2- 172.21.15.83:0/2577210600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce100ae730 0x7fce10162140 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fce10073370 tx=0x7fce0801c6a0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 -- 172.21.15.83:0/2577210600 shutdown_connections 2024-03-30T13:10:37.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 --2- 172.21.15.83:0/2577210600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce100ae730 0x7fce10162140 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 --2- 172.21.15.83:0/2577210600 >> v2:172.21.15.153:3300/0 conn(0x7fce100ad8c0 0x7fce100ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 --2- 172.21.15.83:0/2577210600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce1015e4f0 0x7fce100b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 -- 172.21.15.83:0/2577210600 >> 172.21.15.83:0/2577210600 conn(0x7fce100d0d20 msgr2=0x7fce100d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:37.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.665+0000 7fce17846640 1 -- 172.21.15.83:0/2577210600 shutdown_connections 2024-03-30T13:10:37.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce17846640 1 -- 172.21.15.83:0/2577210600 wait complete. 2024-03-30T13:10:37.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce17846640 1 Processor -- start 2024-03-30T13:10:37.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce17846640 1 -- start start 2024-03-30T13:10:37.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce17846640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce100ad8c0 0x7fce10159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce17846640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce100ae730 0x7fce10150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce17846640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce1015e4f0 0x7fce1014da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce17846640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fce1015e8d0 con 0x7fce100ad8c0 2024-03-30T13:10:37.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce17846640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce1006b9e0 con 0x7fce100ae730 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce17846640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fce1006bf00 con 0x7fce1015e4f0 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce155e2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce100ad8c0 0x7fce10159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce155e2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce100ad8c0 0x7fce10159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36100/0 (socket says 172.21.15.83:36100) 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce155e2640 1 -- 172.21.15.83:0/2713746552 learned_addr learned my addr 172.21.15.83:0/2713746552 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce15de3640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce1015e4f0 0x7fce1014da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce14de1640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce100ae730 0x7fce10150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce155e2640 1 -- 172.21.15.83:0/2713746552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce1015e4f0 msgr2=0x7fce1014da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce155e2640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce1015e4f0 0x7fce1014da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce155e2640 1 -- 172.21.15.83:0/2713746552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce100ae730 msgr2=0x7fce10150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce155e2640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce100ae730 0x7fce10150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce155e2640 1 -- 172.21.15.83:0/2713746552 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce10151260 con 0x7fce100ad8c0 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce14de1640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce100ae730 0x7fce10150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce15de3640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce1015e4f0 0x7fce1014da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:37.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce155e2640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce100ad8c0 0x7fce10159db0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00b410 tx=0x7fce0c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce05ffb640 1 -- 172.21.15.83:0/2713746552 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c015020 con 0x7fce100ad8c0 2024-03-30T13:10:37.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce05ffb640 1 -- 172.21.15.83:0/2713746552 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c011830 con 0x7fce100ad8c0 2024-03-30T13:10:37.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce05ffb640 1 -- 172.21.15.83:0/2713746552 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c011c20 con 0x7fce100ad8c0 2024-03-30T13:10:37.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce17846640 1 -- 172.21.15.83:0/2713746552 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce10151500 con 0x7fce100ad8c0 2024-03-30T13:10:37.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.669+0000 7fce17846640 1 -- 172.21.15.83:0/2713746552 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce10151ac0 con 0x7fce100ad8c0 2024-03-30T13:10:37.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce05ffb640 1 -- 172.21.15.83:0/2713746552 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fce0c018020 con 0x7fce100ad8c0 2024-03-30T13:10:37.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce05ffb640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcdf4067fc0 0x7fcdf406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce05ffb640 1 -- 172.21.15.83:0/2713746552 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fce0c0863a0 con 0x7fce100ad8c0 2024-03-30T13:10:37.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce14de1640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcdf4067fc0 0x7fcdf406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce14de1640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcdf4067fc0 0x7fcdf406a480 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fce00006fd0 tx=0x7fce00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 Processor -- start 2024-03-30T13:10:37.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 -- start start 2024-03-30T13:10:37.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19600 0x564f01a199e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19f20 0x564f019cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f019ccce0 0x564f019cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564f018b5e20 con 0x564f01a19600 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564f0181eb00 con 0x564f01a19f20 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564f017bb940 con 0x564f019ccce0 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce155e2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19600 0x564f01a199e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce155e2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19600 0x564f01a199e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36102/0 (socket says 172.21.15.83:36102) 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce155e2640 1 -- 172.21.15.83:0/2906172697 learned_addr learned my addr 172.21.15.83:0/2906172697 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce155e2640 1 -- 172.21.15.83:0/2906172697 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f019ccce0 msgr2=0x564f019cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce155e2640 1 --2- 172.21.15.83:0/2906172697 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f019ccce0 0x564f019cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce155e2640 1 -- 172.21.15.83:0/2906172697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19f20 msgr2=0x564f019cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce14de1640 1 --2- 172.21.15.83:0/2906172697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19f20 0x564f019cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce155e2640 1 --2- 172.21.15.83:0/2906172697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19f20 0x564f019cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce155e2640 1 -- 172.21.15.83:0/2906172697 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f017a4380 con 0x564f01a19600 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce155e2640 1 --2- 172.21.15.83:0/2906172697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19600 0x564f01a199e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fce0c05eb90 tx=0x7fce0c056d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cec48b54593b47 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fcdf2ffd640 1 -- 172.21.15.83:0/2906172697 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c06e020 con 0x564f01a19600 2024-03-30T13:10:37.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fcdf2ffd640 1 -- 172.21.15.83:0/2906172697 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c05f0c0 con 0x564f01a19600 2024-03-30T13:10:37.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fcdf2ffd640 1 -- 172.21.15.83:0/2906172697 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0547e0 con 0x564f01a19600 2024-03-30T13:10:37.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 -- 172.21.15.83:0/2906172697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19600 msgr2=0x564f01a199e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/2906172697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19600 0x564f01a199e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fce0c05eb90 tx=0x7fce0c056d20 comp rx=0 tx=0).stop 2024-03-30T13:10:37.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 -- 172.21.15.83:0/2906172697 shutdown_connections 2024-03-30T13:10:37.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/2906172697 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f019ccce0 0x564f019cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/2906172697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19f20 0x564f019cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/2906172697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19600 0x564f01a199e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 -- 172.21.15.83:0/2906172697 >> 172.21.15.83:0/2906172697 conn(0x564f019fa3a0 msgr2=0x564f019fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:37.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 -- 172.21.15.83:0/2906172697 shutdown_connections 2024-03-30T13:10:37.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.673+0000 7fce1a9c8000 1 -- 172.21.15.83:0/2906172697 wait complete. 2024-03-30T13:10:37.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 1 -- start start 2024-03-30T13:10:37.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 1 Processor -- start 2024-03-30T13:10:37.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f019ccce0 0x564f01a20750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 0x564f01a20c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19f20 0x564f019d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564f017dc1e0 con 0x564f01a19f20 2024-03-30T13:10:37.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564f0181aab0 con 0x564f01a19600 2024-03-30T13:10:37.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564f0181de10 con 0x564f019ccce0 2024-03-30T13:10:37.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 10 client.0 _ll_register_callbacks cb 0x564f019ba6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:37.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce15de3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19f20 0x564f019d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce15de3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19f20 0x564f019d2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36112/0 (socket says 172.21.15.83:36112) 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce15de3640 1 -- 172.21.15.83:0/1727173226 learned_addr learned my addr 172.21.15.83:0/1727173226 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce14de1640 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 0x564f01a20c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce155e2640 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f019ccce0 0x564f01a20750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce15de3640 1 -- 172.21.15.83:0/1727173226 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f019ccce0 msgr2=0x564f01a20750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce15de3640 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f019ccce0 0x564f01a20750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce15de3640 1 -- 172.21.15.83:0/1727173226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 msgr2=0x564f01a20c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce15de3640 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 0x564f01a20c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce15de3640 1 -- 172.21.15.83:0/1727173226 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f017dab70 con 0x564f01a19f20 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce15de3640 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19f20 0x564f019d2430 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fce0801c6e0 tx=0x7fce08019440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee2371c0f98999b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fcdebfff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fcdebfff640 1 -- 172.21.15.83:0/1727173226 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce080c0060 con 0x564f01a19f20 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fcdebfff640 1 -- 172.21.15.83:0/1727173226 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fce08009110 con 0x564f01a19f20 2024-03-30T13:10:37.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 1 -- 172.21.15.83:0/1727173226 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce0c05f0c0 con 0x564f01a19f20 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fcdebfff640 1 -- 172.21.15.83:0/1727173226 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fce080c6050 con 0x564f01a19f20 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 10 client.5940 fetch_fsmap learned FSMap version 18 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 1 -- 172.21.15.83:0/1727173226 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564f017bbb90 con 0x564f01a19f20 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fcdebfff640 1 -- 172.21.15.83:0/1727173226 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c05f0c0 con 0x564f01a19f20 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fcdebfff640 1 -- 172.21.15.83:0/1727173226 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fce080c9020 con 0x564f01a19f20 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 10 client.5940 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 10 client.5940 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 20 client.5940 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564f019d31a0 0x564f019d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 4 client.5940 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce1a9c8000 1 -- 172.21.15.83:0/1727173226 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f017b9dd0 con 0x564f019d31a0 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce155e2640 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564f019d31a0 0x564f019d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fcdebfff640 10 client.5940 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:37.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.677+0000 7fce155e2640 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564f019d31a0 0x564f019d35b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6d7d962eea5dc12 server_cookie=17dbfddbf87f4fb8 in_seq=0 out_seq=0 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fcdebfff640 1 -- 172.21.15.83:0/1727173226 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x7fce0c07bad0 con 0x564f019d31a0 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fcdebfff640 10 client.5940 handle_command_reply: tid=0 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fce1a9c8000 1 client.5940 shutdown 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fce1a9c8000 1 -- 172.21.15.83:0/1727173226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19f20 msgr2=0x564f019d2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19f20 0x564f019d2430 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fce0801c6e0 tx=0x7fce08019440 comp rx=0 tx=0).stop 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fce1a9c8000 1 -- 172.21.15.83:0/1727173226 shutdown_connections 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564f019d31a0 0x564f019d35b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f01a19f20 0x564f019d2430 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 0x564f01a20c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/1727173226 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f019ccce0 0x564f01a20750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fce1a9c8000 1 -- 172.21.15.83:0/1727173226 >> 172.21.15.83:0/1727173226 conn(0x564f019fa3a0 msgr2=0x564f019cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fcdebfff640 0 client.5940 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fce1a9c8000 1 -- 172.21.15.83:0/1727173226 shutdown_connections 2024-03-30T13:10:37.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fce1a9c8000 1 -- 172.21.15.83:0/1727173226 wait complete. 2024-03-30T13:10:37.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.681+0000 7fce1a9c8000 20 client.5940 trim_cache size 0 max 16384 2024-03-30T13:10:37.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.701+0000 7fce1a9c8000 1 Processor -- start 2024-03-30T13:10:37.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.701+0000 7fce1a9c8000 1 -- start start 2024-03-30T13:10:37.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.701+0000 7fce1a9c8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 0x564f01a188d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.701+0000 7fce1a9c8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 0x564f01a18e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.701+0000 7fce1a9c8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f01a19f20 0x564f019d31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.701+0000 7fce1a9c8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fce10203bb0 con 0x564f019ccce0 2024-03-30T13:10:37.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.701+0000 7fce1a9c8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce10202c40 con 0x564f01a19600 2024-03-30T13:10:37.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.701+0000 7fce1a9c8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fce101538a0 con 0x564f01a19f20 2024-03-30T13:10:37.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.701+0000 7fce155e2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 0x564f01a188d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce155e2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 0x564f01a188d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36126/0 (socket says 172.21.15.83:36126) 2024-03-30T13:10:37.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce155e2640 1 -- 172.21.15.83:0/3021840851 learned_addr learned my addr 172.21.15.83:0/3021840851 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:37.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce15de3640 1 --2- 172.21.15.83:0/3021840851 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f01a19f20 0x564f019d31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce14de1640 1 --2- 172.21.15.83:0/3021840851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 0x564f01a18e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce155e2640 1 -- 172.21.15.83:0/3021840851 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f01a19f20 msgr2=0x564f019d31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce155e2640 1 --2- 172.21.15.83:0/3021840851 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f01a19f20 0x564f019d31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce155e2640 1 -- 172.21.15.83:0/3021840851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 msgr2=0x564f01a18e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce155e2640 1 --2- 172.21.15.83:0/3021840851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 0x564f01a18e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce155e2640 1 -- 172.21.15.83:0/3021840851 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f0189f470 con 0x564f019ccce0 2024-03-30T13:10:37.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce155e2640 1 --2- 172.21.15.83:0/3021840851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 0x564f01a188d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fce0c052940 tx=0x7fce0c086000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbe46c5433aa56c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fcdf27fc640 1 -- 172.21.15.83:0/3021840851 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c06e040 con 0x564f019ccce0 2024-03-30T13:10:37.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fcdf27fc640 1 -- 172.21.15.83:0/3021840851 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564f017b9dd0 con 0x564f019ccce0 2024-03-30T13:10:37.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fcdf27fc640 1 -- 172.21.15.83:0/3021840851 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c086070 con 0x564f019ccce0 2024-03-30T13:10:37.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3021840851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 msgr2=0x564f01a188d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/3021840851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 0x564f01a188d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fce0c052940 tx=0x7fce0c086000 comp rx=0 tx=0).stop 2024-03-30T13:10:37.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3021840851 shutdown_connections 2024-03-30T13:10:37.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/3021840851 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f01a19f20 0x564f019d31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/3021840851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 0x564f01a18e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/3021840851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 0x564f01a188d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3021840851 >> 172.21.15.83:0/3021840851 conn(0x564f019fa3a0 msgr2=0x564f01a26e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:37.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3021840851 shutdown_connections 2024-03-30T13:10:37.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.705+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3021840851 wait complete. 2024-03-30T13:10:37.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 1 -- start start 2024-03-30T13:10:37.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 1 Processor -- start 2024-03-30T13:10:37.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 0x564f019d44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 0x564f01a86f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f01a19f20 0x564f01a874a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564f01823130 con 0x564f019ccce0 2024-03-30T13:10:37.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce102025f0 con 0x564f01a19600 2024-03-30T13:10:37.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564f017dc1e0 con 0x564f01a19f20 2024-03-30T13:10:37.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 10 client.0 _ll_register_callbacks cb 0x7fce08009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:10:37.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce155e2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 0x564f019d44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce155e2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 0x564f019d44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36140/0 (socket says 172.21.15.83:36140) 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce155e2640 1 -- 172.21.15.83:0/3811148957 learned_addr learned my addr 172.21.15.83:0/3811148957 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce14de1640 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 0x564f01a86f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce15de3640 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f01a19f20 0x564f01a874a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce155e2640 1 -- 172.21.15.83:0/3811148957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f01a19f20 msgr2=0x564f01a874a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce155e2640 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f01a19f20 0x564f01a874a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce155e2640 1 -- 172.21.15.83:0/3811148957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 msgr2=0x564f01a86f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce155e2640 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 0x564f01a86f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce155e2640 1 -- 172.21.15.83:0/3811148957 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f017ad1e0 con 0x564f019ccce0 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce15de3640 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f01a19f20 0x564f01a874a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce155e2640 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 0x564f019d44a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0561e0 tx=0x7fce0c01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a247da712d8fab50 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fcdebfff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fcdebfff640 1 -- 172.21.15.83:0/3811148957 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c072070 con 0x564f019ccce0 2024-03-30T13:10:37.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fcdebfff640 1 -- 172.21.15.83:0/3811148957 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fce0c0860c0 con 0x564f019ccce0 2024-03-30T13:10:37.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3811148957 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564f017b9dd0 con 0x564f019ccce0 2024-03-30T13:10:37.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fcdebfff640 1 -- 172.21.15.83:0/3811148957 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fce0c05f0c0 con 0x564f019ccce0 2024-03-30T13:10:37.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 10 client.5946 fetch_fsmap learned FSMap version 18 2024-03-30T13:10:37.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3811148957 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564f017b27b0 con 0x564f019ccce0 2024-03-30T13:10:37.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fcdebfff640 1 -- 172.21.15.83:0/3811148957 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564f017b9dd0 con 0x564f019ccce0 2024-03-30T13:10:37.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fcdebfff640 1 -- 172.21.15.83:0/3811148957 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fce0c052b50 con 0x564f019ccce0 2024-03-30T13:10:37.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 10 client.5946 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:10:37.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 10 client.5946 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:10:37.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 20 client.5946 populate_metadata read hostname 'smithi083' 2024-03-30T13:10:37.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564f01a879e0 0x564f01a87df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:37.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 4 client.5946 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-30T13:10:37.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3811148957 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564f0182c040 con 0x564f01a879e0 2024-03-30T13:10:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.709+0000 7fce14de1640 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564f01a879e0 0x564f01a87df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.713+0000 7fcdebfff640 10 client.5946 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.713+0000 7fce14de1640 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564f01a879e0 0x564f01a87df0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9b328007b453107 server_cookie=42b11108e2e790f6 in_seq=0 out_seq=0 2024-03-30T13:10:37.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.713+0000 7fcdebfff640 1 -- 172.21.15.83:0/3811148957 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+850 (crc 0 0 0) 0x564f0182c040 con 0x564f01a879e0 2024-03-30T13:10:37.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.713+0000 7fcdebfff640 10 client.5946 handle_command_reply: tid=0 2024-03-30T13:10:37.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.713+0000 7fce1a9c8000 1 client.5946 shutdown 2024-03-30T13:10:37.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.713+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3811148957 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 msgr2=0x564f019d44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.713+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 0x564f019d44a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0561e0 tx=0x7fce0c01c040 comp rx=0 tx=0).stop 2024-03-30T13:10:37.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.713+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3811148957 shutdown_connections 2024-03-30T13:10:37.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.713+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564f01a19f20 0x564f01a874a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.713+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f01a19600 0x564f01a86f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.713+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564f01a879e0 0x564f01a87df0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.713+0000 7fce1a9c8000 1 --2- 172.21.15.83:0/3811148957 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564f019ccce0 0x564f019d44a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3811148957 >> 172.21.15.83:0/3811148957 conn(0x564f019fa3a0 msgr2=0x564f01a2f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:37.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fcdebfff640 0 client.5946 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:10:37.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3811148957 shutdown_connections 2024-03-30T13:10:37.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce1a9c8000 1 -- 172.21.15.83:0/3811148957 wait complete. 2024-03-30T13:10:37.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce1a9c8000 20 client.5946 trim_cache size 0 max 16384 2024-03-30T13:10:37.724 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:10:37.724 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-30T13:10:37.724 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": { 2024-03-30T13:10:37.724 INFO:teuthology.orchestra.run.smithi083.stdout: "59d9f844-2347-4db3-988a-63cf85449874": { 2024-03-30T13:10:37.725 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-03-30T13:10:37.725 INFO:teuthology.orchestra.run.smithi083.stdout: "tag": "59d9f844-2347-4db3-988a-63cf85449874", 2024-03-30T13:10:37.725 INFO:teuthology.orchestra.run.smithi083.stdout: "options": "recursive" 2024-03-30T13:10:37.725 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:37.725 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:37.725 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_stats": { 2024-03-30T13:10:37.725 INFO:teuthology.orchestra.run.smithi083.stdout: "59d9f844-2347-4db3-988a-63cf85449874": { 2024-03-30T13:10:37.725 INFO:teuthology.orchestra.run.smithi083.stdout: "start_time": "2024-03-30T13:10:37.489455+0000", 2024-03-30T13:10:37.725 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-03-30T13:10:37.725 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_started": 0, 2024-03-30T13:10:37.725 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_passed": 0, 2024-03-30T13:10:37.725 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_failed": 0, 2024-03-30T13:10:37.726 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_skipped": 0 2024-03-30T13:10:37.726 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:10:37.726 INFO:teuthology.orchestra.run.smithi083.stdout: "5c4d6a0f-7247-4376-817a-ceb5e259597b": { 2024-03-30T13:10:37.726 INFO:teuthology.orchestra.run.smithi083.stdout: "start_time": "2024-03-30T13:09:55.970459+0000", 2024-03-30T13:10:37.726 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-03-30T13:10:37.726 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_started": 23, 2024-03-30T13:10:37.726 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_passed": 23, 2024-03-30T13:10:37.726 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_failed": 0, 2024-03-30T13:10:37.726 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_skipped": 0 2024-03-30T13:10:37.726 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:37.726 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:10:37.726 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:10:37.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce17846640 1 -- 172.21.15.83:0/2713746552 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcdf4067fc0 msgr2=0x7fcdf406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce17846640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcdf4067fc0 0x7fcdf406a480 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fce00006fd0 tx=0x7fce00008040 comp rx=0 tx=0).stop 2024-03-30T13:10:37.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce17846640 1 -- 172.21.15.83:0/2713746552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce100ad8c0 msgr2=0x7fce10159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:37.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce17846640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce100ad8c0 0x7fce10159db0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00b410 tx=0x7fce0c00b8d0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce17846640 1 -- 172.21.15.83:0/2713746552 shutdown_connections 2024-03-30T13:10:37.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce17846640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fcdf4067fc0 0x7fcdf406a480 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce17846640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce1015e4f0 0x7fce1014da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce17846640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce100ae730 0x7fce10150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce17846640 1 --2- 172.21.15.83:0/2713746552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce100ad8c0 0x7fce10159db0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:37.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce17846640 1 -- 172.21.15.83:0/2713746552 >> 172.21.15.83:0/2713746552 conn(0x7fce100d0d20 msgr2=0x7fce100b4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:37.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce17846640 1 -- 172.21.15.83:0/2713746552 shutdown_connections 2024-03-30T13:10:37.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:10:37.717+0000 7fce17846640 1 -- 172.21.15.83:0/2713746552 wait complete. 2024-03-30T13:10:37.747 INFO:tasks.cephfs.filesystem:scrub status for tag:59d9f844-2347-4db3-988a-63cf85449874 - {'path': '/', 'tag': '59d9f844-2347-4db3-988a-63cf85449874', 'options': 'recursive'} 2024-03-30T13:10:38.704 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_6 2024-03-30T13:10:39.736 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_7 2024-03-30T13:10:40.760 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_8 2024-03-30T13:10:41.782 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_9 2024-03-30T13:10:55.022 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:55.025 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:11:07.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:07.748 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-30T13:11:07.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.864+0000 7fa5864f7640 1 Processor -- start 2024-03-30T13:11:07.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.864+0000 7fa5864f7640 1 -- start start 2024-03-30T13:11:07.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa5864f7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5800d4230 0x7fa5800d4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa5864f7640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5800d3280 con 0x7fa5800d1a20 2024-03-30T13:11:07.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa5864f7640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5800d3560 con 0x7fa58015e880 2024-03-30T13:11:07.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa5864f7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa5800b4580 con 0x7fa5800d4230 2024-03-30T13:11:07.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa577fff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fa5800d1a20 0x7fa5800cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57392/0 (socket says 172.21.15.83:57392) 2024-03-30T13:11:07.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa577fff640 1 -- 172.21.15.83:0/499752702 learned_addr learned my addr 172.21.15.83:0/499752702 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:07.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309975651 0 0) 0x7fa5800d3280 con 0x7fa5800d1a20 2024-03-30T13:11:07.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa584a94640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5800d4230 0x7fa5800d4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa56c003530 con 0x7fa5800d1a20 2024-03-30T13:11:07.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3126551423 0 0) 0x7fa56c003530 con 0x7fa5800d1a20 2024-03-30T13:11:07.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5800d4230 msgr2=0x7fa5800d4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5800d4230 0x7fa5800d4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 >> v1:172.21.15.153:6789/0 conn(0x7fa58015e880 legacy=0x7fa5800d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5800b3f30 con 0x7fa5800d1a20 2024-03-30T13:11:07.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fa570001800 con 0x7fa5800d1a20 2024-03-30T13:11:07.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 >> v1:172.21.15.83:6789/0 conn(0x7fa5800d1a20 legacy=0x7fa5800cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5800d4230 0x7fa56c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa56c003fc0 0x7fa56c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa56c004d50 0x7fa56c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa5800b4580 con 0x7fa56c004d50 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c00bbc0 con 0x7fa56c003fc0 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa56c00bdc0 con 0x7fa5800d4230 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa584a94640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa56c004d50 0x7fa56c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa577fff640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa56c003fc0 0x7fa56c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57ffff640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5800d4230 0x7fa56c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa584a94640 1 -- 172.21.15.83:0/499752702 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5800d4230 msgr2=0x7fa56c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa584a94640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5800d4230 0x7fa56c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa584a94640 1 -- 172.21.15.83:0/499752702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa56c003fc0 msgr2=0x7fa56c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa584a94640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa56c003fc0 0x7fa56c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa584a94640 1 -- 172.21.15.83:0/499752702 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c003530 con 0x7fa56c004d50 2024-03-30T13:11:07.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.868+0000 7fa57ffff640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa5800d4230 0x7fa56c0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa584a94640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa56c004d50 0x7fa56c0051d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa578009fc0 tx=0x7fa57801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c3a5c21663e8c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5780b2070 con 0x7fa56c004d50 2024-03-30T13:11:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5780a5c60 con 0x7fa56c004d50 2024-03-30T13:11:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa57f7fe640 1 -- 172.21.15.83:0/499752702 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578009c10 con 0x7fa56c004d50 2024-03-30T13:11:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 -- 172.21.15.83:0/499752702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa56c004d50 msgr2=0x7fa56c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 --2- 172.21.15.83:0/499752702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa56c004d50 0x7fa56c0051d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa578009fc0 tx=0x7fa57801cc80 comp rx=0 tx=0).stop 2024-03-30T13:11:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa584a94640 1 -- 172.21.15.83:0/499752702 reap_dead start 2024-03-30T13:11:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 -- 172.21.15.83:0/499752702 shutdown_connections 2024-03-30T13:11:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 -- 172.21.15.83:0/499752702 >> 172.21.15.83:0/499752702 conn(0x7fa58009d7c0 msgr2=0x7fa58008bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 -- 172.21.15.83:0/499752702 shutdown_connections 2024-03-30T13:11:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 -- 172.21.15.83:0/499752702 wait complete. 2024-03-30T13:11:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 Processor -- start 2024-03-30T13:11:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 -- start start 2024-03-30T13:11:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa580149880 0x7fa58014a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa58015d7d0 0x7fa58015ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa58015f1a0 0x7fa5800ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa5800d4790 con 0x7fa580149880 2024-03-30T13:11:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa5800d4610 con 0x7fa58015d7d0 2024-03-30T13:11:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa5864f7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa5800d4910 con 0x7fa58015f1a0 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa57ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa580149880 0x7fa58014a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa57ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa580149880 0x7fa58014a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37104/0 (socket says 172.21.15.83:37104) 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa57ffff640 1 -- 172.21.15.83:0/1887458811 learned_addr learned my addr 172.21.15.83:0/1887458811 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa577fff640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa58015d7d0 0x7fa58015ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa584a94640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa58015f1a0 0x7fa5800ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa57ffff640 1 -- 172.21.15.83:0/1887458811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa58015f1a0 msgr2=0x7fa5800ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa57ffff640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa58015f1a0 0x7fa5800ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa57ffff640 1 -- 172.21.15.83:0/1887458811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa58015d7d0 msgr2=0x7fa58015ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa57ffff640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa58015d7d0 0x7fa58015ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.872+0000 7fa57ffff640 1 -- 172.21.15.83:0/1887458811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58015f620 con 0x7fa580149880 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa57ffff640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa580149880 0x7fa58014a060 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa56800d770 tx=0x7fa56800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa57d7fa640 1 -- 172.21.15.83:0/1887458811 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568005270 con 0x7fa580149880 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa57d7fa640 1 -- 172.21.15.83:0/1887458811 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa568017070 con 0x7fa580149880 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa5864f7640 1 -- 172.21.15.83:0/1887458811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58015f900 con 0x7fa580149880 2024-03-30T13:11:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa57d7fa640 1 -- 172.21.15.83:0/1887458811 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56800b6b0 con 0x7fa580149880 2024-03-30T13:11:07.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa5864f7640 1 -- 172.21.15.83:0/1887458811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa580149c60 con 0x7fa580149880 2024-03-30T13:11:07.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa57d7fa640 1 -- 172.21.15.83:0/1887458811 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa56800b850 con 0x7fa580149880 2024-03-30T13:11:07.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa57d7fa640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa560067fc0 0x7fa56006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa57d7fa640 1 -- 172.21.15.83:0/1887458811 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa568086440 con 0x7fa580149880 2024-03-30T13:11:07.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa577fff640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa560067fc0 0x7fa56006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa589679000 1 Processor -- start 2024-03-30T13:11:07.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa589679000 1 -- start start 2024-03-30T13:11:07.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.876+0000 7fa577fff640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa560067fc0 0x7fa56006a480 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa570001ec0 tx=0x7fa570009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740b600 0x56508740b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56508740bf20 0x5650873be7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650873bece0 0x5650873bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5650872a7e20 con 0x56508740b600 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565087210b00 con 0x5650873bece0 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5650871ad940 con 0x56508740bf20 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa57ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740b600 0x56508740b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa57ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740b600 0x56508740b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37110/0 (socket says 172.21.15.83:37110) 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa57ffff640 1 -- 172.21.15.83:0/1225706101 learned_addr learned my addr 172.21.15.83:0/1225706101 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa577fff640 1 --2- 172.21.15.83:0/1225706101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56508740bf20 0x5650873be7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa584a94640 1 --2- 172.21.15.83:0/1225706101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650873bece0 0x5650873bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa57ffff640 1 -- 172.21.15.83:0/1225706101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56508740bf20 msgr2=0x5650873be7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa57ffff640 1 --2- 172.21.15.83:0/1225706101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56508740bf20 0x5650873be7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa57ffff640 1 -- 172.21.15.83:0/1225706101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650873bece0 msgr2=0x5650873bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa57ffff640 1 --2- 172.21.15.83:0/1225706101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650873bece0 0x5650873bf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa57ffff640 1 -- 172.21.15.83:0/1225706101 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565087196380 con 0x56508740b600 2024-03-30T13:11:07.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa584a94640 1 --2- 172.21.15.83:0/1225706101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650873bece0 0x5650873bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:07.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa57ffff640 1 --2- 172.21.15.83:0/1225706101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740b600 0x56508740b9e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa568056470 tx=0x7fa568056be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b5960ada455c34 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa575ffb640 1 -- 172.21.15.83:0/1225706101 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56806e020 con 0x56508740b600 2024-03-30T13:11:07.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa575ffb640 1 -- 172.21.15.83:0/1225706101 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa56805a890 con 0x56508740b600 2024-03-30T13:11:07.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa575ffb640 1 -- 172.21.15.83:0/1225706101 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56805f0c0 con 0x56508740b600 2024-03-30T13:11:07.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- 172.21.15.83:0/1225706101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740b600 msgr2=0x56508740b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 --2- 172.21.15.83:0/1225706101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740b600 0x56508740b9e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa568056470 tx=0x7fa568056be0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- 172.21.15.83:0/1225706101 shutdown_connections 2024-03-30T13:11:07.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 --2- 172.21.15.83:0/1225706101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650873bece0 0x5650873bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 --2- 172.21.15.83:0/1225706101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56508740bf20 0x5650873be7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 --2- 172.21.15.83:0/1225706101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740b600 0x56508740b9e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- 172.21.15.83:0/1225706101 >> 172.21.15.83:0/1225706101 conn(0x5650873ec3a0 msgr2=0x5650873ee790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:07.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- 172.21.15.83:0/1225706101 shutdown_connections 2024-03-30T13:11:07.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- 172.21.15.83:0/1225706101 wait complete. 2024-03-30T13:11:07.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- start start 2024-03-30T13:11:07.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 Processor -- start 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650873bece0 0x565087412960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740b600 0x565087412ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 0x5650873c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5650871ce1e0 con 0x56508740bf20 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56508720cab0 con 0x56508740b600 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x565087215130 con 0x5650873bece0 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 10 client.0 _ll_register_callbacks cb 0x5650873ac6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa584a94640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 0x5650873c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa584a94640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 0x5650873c38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37118/0 (socket says 172.21.15.83:37118) 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa584a94640 1 -- 172.21.15.83:0/3927513542 learned_addr learned my addr 172.21.15.83:0/3927513542 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa57ffff640 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650873bece0 0x565087412960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa577fff640 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740b600 0x565087412ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa584a94640 1 -- 172.21.15.83:0/3927513542 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650873bece0 msgr2=0x565087412960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa584a94640 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650873bece0 0x565087412960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa584a94640 1 -- 172.21.15.83:0/3927513542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740b600 msgr2=0x565087412ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa584a94640 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740b600 0x565087412ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa584a94640 1 -- 172.21.15.83:0/3927513542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650871ccb70 con 0x56508740bf20 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa584a94640 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 0x5650873c38e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa578098780 tx=0x7fa56c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e93c71575cfd52 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa55effd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa55effd640 1 -- 172.21.15.83:0/3927513542 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5780b2040 con 0x56508740bf20 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa55effd640 1 -- 172.21.15.83:0/3927513542 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa578009c10 con 0x56508740bf20 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.880+0000 7fa589679000 1 -- 172.21.15.83:0/3927513542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa56805a890 con 0x56508740bf20 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa55effd640 1 -- 172.21.15.83:0/3927513542 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fa5780a7e60 con 0x56508740bf20 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 10 client.5958 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 -- 172.21.15.83:0/3927513542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5650871adb90 con 0x56508740bf20 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa55effd640 1 -- 172.21.15.83:0/3927513542 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa56805a890 con 0x56508740bf20 2024-03-30T13:11:07.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa55effd640 1 -- 172.21.15.83:0/3927513542 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fa5780a5a60 con 0x56508740bf20 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 10 client.5958 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 10 client.5958 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 20 client.5958 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5650873c4650 0x5650873c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 4 client.5958 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 -- 172.21.15.83:0/3927513542 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650871abdd0 con 0x5650873c4650 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa57ffff640 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5650873c4650 0x5650873c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa55effd640 10 client.5958 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa57ffff640 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5650873c4650 0x5650873c4a30 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31617e9b29f89fc1 server_cookie=50707fe151f6b4cb in_seq=0 out_seq=0 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa55effd640 1 -- 172.21.15.83:0/3927513542 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x7fa56807bad0 con 0x5650873c4650 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa55effd640 10 client.5958 handle_command_reply: tid=0 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 client.5958 shutdown 2024-03-30T13:11:07.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 -- 172.21.15.83:0/3927513542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 msgr2=0x5650873c38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 0x5650873c38e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa578098780 tx=0x7fa56c005840 comp rx=0 tx=0).stop 2024-03-30T13:11:07.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 -- 172.21.15.83:0/3927513542 shutdown_connections 2024-03-30T13:11:07.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5650873c4650 0x5650873c4a30 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 0x5650873c38e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740b600 0x565087412ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa55effd640 0 client.5958 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:07.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 --2- 172.21.15.83:0/3927513542 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650873bece0 0x565087412960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 -- 172.21.15.83:0/3927513542 >> 172.21.15.83:0/3927513542 conn(0x5650873ec3a0 msgr2=0x5650873ee790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:07.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 -- 172.21.15.83:0/3927513542 shutdown_connections 2024-03-30T13:11:07.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 1 -- 172.21.15.83:0/3927513542 wait complete. 2024-03-30T13:11:07.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.884+0000 7fa589679000 20 client.5958 trim_cache size 0 max 16384 2024-03-30T13:11:07.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.900+0000 7fa589679000 1 Processor -- start 2024-03-30T13:11:07.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.900+0000 7fa589679000 1 -- start start 2024-03-30T13:11:07.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650873bece0 0x5650874096b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740b600 0x565087409bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 0x56508740a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa5801ffb50 con 0x56508740bf20 2024-03-30T13:11:07.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa580200040 con 0x56508740b600 2024-03-30T13:11:07.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56508720fe10 con 0x5650873bece0 2024-03-30T13:11:07.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa584a94640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 0x56508740a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa584a94640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 0x56508740a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37120/0 (socket says 172.21.15.83:37120) 2024-03-30T13:11:07.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa584a94640 1 -- 172.21.15.83:0/512348826 learned_addr learned my addr 172.21.15.83:0/512348826 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:07.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa584a94640 1 -- 172.21.15.83:0/512348826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650873bece0 msgr2=0x5650874096b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa584a94640 1 --2- 172.21.15.83:0/512348826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650873bece0 0x5650874096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa584a94640 1 -- 172.21.15.83:0/512348826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740b600 msgr2=0x565087409bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa584a94640 1 --2- 172.21.15.83:0/512348826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740b600 0x565087409bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa584a94640 1 -- 172.21.15.83:0/512348826 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565087291470 con 0x56508740bf20 2024-03-30T13:11:07.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa584a94640 1 --2- 172.21.15.83:0/512348826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 0x56508740a130 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa57801ccc0 tx=0x7fa5780b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac31d62dc703ef78 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa5757fa640 1 -- 172.21.15.83:0/512348826 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5780b2040 con 0x56508740bf20 2024-03-30T13:11:07.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa5757fa640 1 -- 172.21.15.83:0/512348826 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa578009c10 con 0x56508740bf20 2024-03-30T13:11:07.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa5757fa640 1 -- 172.21.15.83:0/512348826 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5780a7030 con 0x56508740bf20 2024-03-30T13:11:07.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 -- 172.21.15.83:0/512348826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 msgr2=0x56508740a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 --2- 172.21.15.83:0/512348826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 0x56508740a130 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa57801ccc0 tx=0x7fa5780b6000 comp rx=0 tx=0).stop 2024-03-30T13:11:07.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 -- 172.21.15.83:0/512348826 shutdown_connections 2024-03-30T13:11:07.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 --2- 172.21.15.83:0/512348826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56508740bf20 0x56508740a130 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 --2- 172.21.15.83:0/512348826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740b600 0x565087409bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 --2- 172.21.15.83:0/512348826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650873bece0 0x5650874096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 -- 172.21.15.83:0/512348826 >> 172.21.15.83:0/512348826 conn(0x5650873ec3a0 msgr2=0x565087421af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 -- 172.21.15.83:0/512348826 shutdown_connections 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 -- 172.21.15.83:0/512348826 wait complete. 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 -- start start 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 Processor -- start 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650873bece0 0x56508747e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56508740b600 0x56508747e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740bf20 0x56508740f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5650871c7750 con 0x5650873bece0 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5650871dc150 con 0x56508740bf20 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5650872df750 con 0x56508740b600 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa589679000 10 client.0 _ll_register_callbacks cb 0x7fa5780b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:07.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa57ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650873bece0 0x56508747e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa57ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650873bece0 0x56508747e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37124/0 (socket says 172.21.15.83:37124) 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa57ffff640 1 -- 172.21.15.83:0/3918047500 learned_addr learned my addr 172.21.15.83:0/3918047500 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa584a94640 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740bf20 0x56508740f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa577fff640 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56508740b600 0x56508747e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa57ffff640 1 -- 172.21.15.83:0/3918047500 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56508740b600 msgr2=0x56508747e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa57ffff640 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56508740b600 0x56508747e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa57ffff640 1 -- 172.21.15.83:0/3918047500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740bf20 msgr2=0x56508740f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa57ffff640 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740bf20 0x56508740f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa57ffff640 1 -- 172.21.15.83:0/3918047500 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56508719f1e0 con 0x5650873bece0 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa584a94640 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740bf20 0x56508740f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa57ffff640 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650873bece0 0x56508747e0b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa56801b000 tx=0x7fa568084830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c73ba8a11e93ac9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.904+0000 7fa55effd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa55effd640 1 -- 172.21.15.83:0/3918047500 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56806e050 con 0x5650873bece0 2024-03-30T13:11:07.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa55effd640 1 -- 172.21.15.83:0/3918047500 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa568052b50 con 0x5650873bece0 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 -- 172.21.15.83:0/3918047500 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa578009c10 con 0x5650873bece0 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa55effd640 1 -- 172.21.15.83:0/3918047500 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fa568052780 con 0x5650873bece0 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 10 client.5964 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 -- 172.21.15.83:0/3918047500 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5650871a47b0 con 0x5650873bece0 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa55effd640 1 -- 172.21.15.83:0/3918047500 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa578009c10 con 0x5650873bece0 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa55effd640 1 -- 172.21.15.83:0/3918047500 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fa568079080 con 0x5650873bece0 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 10 client.5964 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 10 client.5964 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 20 client.5964 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56508740f8a0 0x56508740fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 4 client.5964 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 -- 172.21.15.83:0/3918047500 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56508721e040 con 0x56508740f8a0 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa577fff640 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56508740f8a0 0x56508740fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa55effd640 10 client.5964 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:07.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa577fff640 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56508740f8a0 0x56508740fcb0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24bbdf13c1761f1d server_cookie=bdb18f33319d8f28 in_seq=0 out_seq=0 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa55effd640 1 -- 172.21.15.83:0/3918047500 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+662 (crc 0 0 0) 0x56508721e040 con 0x56508740f8a0 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa55effd640 10 client.5964 handle_command_reply: tid=0 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 client.5964 shutdown 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 -- 172.21.15.83:0/3918047500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650873bece0 msgr2=0x56508747e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650873bece0 0x56508747e0b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa56801b000 tx=0x7fa568084830 comp rx=0 tx=0).stop 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 -- 172.21.15.83:0/3918047500 shutdown_connections 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56508740bf20 0x56508740f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56508740b600 0x56508747e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56508740f8a0 0x56508740fcb0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 --2- 172.21.15.83:0/3918047500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650873bece0 0x56508747e0b0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa55effd640 0 client.5964 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 -- 172.21.15.83:0/3918047500 >> 172.21.15.83:0/3918047500 conn(0x5650873ec3a0 msgr2=0x5650873c3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 -- 172.21.15.83:0/3918047500 shutdown_connections 2024-03-30T13:11:07.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 1 -- 172.21.15.83:0/3918047500 wait complete. 2024-03-30T13:11:07.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa589679000 20 client.5964 trim_cache size 0 max 16384 2024-03-30T13:11:07.921 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:07.921 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "no active scrubs running", 2024-03-30T13:11:07.921 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": {}, 2024-03-30T13:11:07.921 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_stats": { 2024-03-30T13:11:07.921 INFO:teuthology.orchestra.run.smithi083.stdout: "59d9f844-2347-4db3-988a-63cf85449874": { 2024-03-30T13:11:07.921 INFO:teuthology.orchestra.run.smithi083.stdout: "start_time": "2024-03-30T13:10:37.489455+0000", 2024-03-30T13:11:07.921 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-03-30T13:11:07.921 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_started": 23, 2024-03-30T13:11:07.921 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_passed": 23, 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_failed": 0, 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_skipped": 0 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout: "5c4d6a0f-7247-4376-817a-ceb5e259597b": { 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout: "start_time": "2024-03-30T13:09:55.970459+0000", 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_started": 23, 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_passed": 23, 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_failed": 0, 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_skipped": 0 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:07.922 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:07.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa5864f7640 1 -- 172.21.15.83:0/1887458811 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa560067fc0 msgr2=0x7fa56006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa5864f7640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa560067fc0 0x7fa56006a480 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa570001ec0 tx=0x7fa570009040 comp rx=0 tx=0).stop 2024-03-30T13:11:07.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa5864f7640 1 -- 172.21.15.83:0/1887458811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa580149880 msgr2=0x7fa58014a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa5864f7640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa580149880 0x7fa58014a060 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa56800d770 tx=0x7fa56800dc30 comp rx=0 tx=0).stop 2024-03-30T13:11:07.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa5864f7640 1 -- 172.21.15.83:0/1887458811 shutdown_connections 2024-03-30T13:11:07.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa5864f7640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fa560067fc0 0x7fa56006a480 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa5864f7640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa58015f1a0 0x7fa5800ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa5864f7640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa58015d7d0 0x7fa58015ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa5864f7640 1 --2- 172.21.15.83:0/1887458811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa580149880 0x7fa58014a060 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa5864f7640 1 -- 172.21.15.83:0/1887458811 >> 172.21.15.83:0/1887458811 conn(0x7fa58009d7c0 msgr2=0x7fa5800d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:07.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa5864f7640 1 -- 172.21.15.83:0/1887458811 shutdown_connections 2024-03-30T13:11:07.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:07.908+0000 7fa5864f7640 1 -- 172.21.15.83:0/1887458811 wait complete. 2024-03-30T13:11:07.932 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-30T13:11:07.932 DEBUG:tasks.cephfs.test_uninlining:joining snapshotter thread 2024-03-30T13:11:07.933 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_0 2024-03-30T13:11:07.951 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_1 2024-03-30T13:11:08.014 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_2 2024-03-30T13:11:08.074 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_3 2024-03-30T13:11:08.136 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_4 2024-03-30T13:11:08.200 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_5 2024-03-30T13:11:08.263 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_6 2024-03-30T13:11:08.325 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_7 2024-03-30T13:11:08.391 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_8 2024-03-30T13:11:08.456 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_9 2024-03-30T13:11:08.526 DEBUG:tasks.cephfs.test_uninlining:extracting inodes 2024-03-30T13:11:08.526 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:11:08.527 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Kconfig 2024-03-30T13:11:08.536 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628358 linux-5.4/fs/ceph/Kconfig 2024-03-30T13:11:08.536 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Makefile 2024-03-30T13:11:08.537 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Makefile 2024-03-30T13:11:08.586 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628359 linux-5.4/fs/ceph/Makefile 2024-03-30T13:11:08.586 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:11:08.587 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:11:08.642 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628365 linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:11:08.643 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/io.h 2024-03-30T13:11:08.643 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/io.h 2024-03-30T13:11:08.694 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628372 linux-5.4/fs/ceph/io.h 2024-03-30T13:11:08.695 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:11:08.695 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:11:08.747 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628374 linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:11:08.747 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:11:08.747 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Kconfig 2024-03-30T13:11:08.798 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628386 linux-5.4/fs/ext2/Kconfig 2024-03-30T13:11:08.798 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:11:08.798 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:11:08.849 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628404 linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:11:08.850 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:11:08.850 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:11:08.902 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628402 linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:11:08.902 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Makefile 2024-03-30T13:11:08.903 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Makefile 2024-03-30T13:11:08.954 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628387 linux-5.4/fs/ext2/Makefile 2024-03-30T13:11:08.954 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:11:08.954 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/symlink.c 2024-03-30T13:11:09.006 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628399 linux-5.4/fs/ext2/symlink.c 2024-03-30T13:11:09.006 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/acl.h 2024-03-30T13:11:09.006 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/acl.h 2024-03-30T13:11:09.059 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628389 linux-5.4/fs/ext2/acl.h 2024-03-30T13:11:09.059 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:11:09.059 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:11:09.110 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628403 linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:11:09.110 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:11:09.111 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr.h 2024-03-30T13:11:09.162 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628401 linux-5.4/fs/ext2/xattr.h 2024-03-30T13:11:09.163 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:11:09.163 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:11:09.214 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628406 linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:11:09.214 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:11:09.215 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:11:09.267 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628419 linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:11:09.268 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:11:09.268 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:11:09.319 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628426 linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:11:09.319 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:11:09.320 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:11:09.370 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628409 linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:11:09.370 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:11:09.370 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:11:09.422 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628417 linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:11:09.422 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:11:09.423 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:11:09.473 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628421 linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:11:09.474 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:11:09.474 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:11:09.526 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628422 linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:11:09.526 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:11:09.526 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Makefile 2024-03-30T13:11:09.578 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628407 linux-5.4/fs/orangefs/Makefile 2024-03-30T13:11:09.578 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:11:09.578 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:11:09.629 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628430 linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:11:09.630 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:11:09.630 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:11:09.681 INFO:teuthology.orchestra.run.smithi083.stdout:1099511628412 linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:11:09.681 DEBUG:tasks.cephfs.test_uninlining:getting inline data info 2024-03-30T13:11:09.681 DEBUG:tasks.cephfs.test_uninlining:getting inode info #1 of 23:1099511628358 2024-03-30T13:11:09.682 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628358 2024-03-30T13:11:09.682 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628358 2024-03-30T13:11:09.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.840+0000 7f6e634bf640 1 Processor -- start 2024-03-30T13:11:09.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.840+0000 7f6e634bf640 1 -- start start 2024-03-30T13:11:09.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e634bf640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6e5c15ebc0 0x7f6e5c06ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e634bf640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5c0cc930 con 0x7f6e5c06dce0 2024-03-30T13:11:09.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e634bf640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5c06e280 con 0x7f6e5c09b160 2024-03-30T13:11:09.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e634bf640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f6e5c15efa0 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e6125b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6e5c15ebc0 0x7f6e5c06ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e60a5a640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f6e5c06dce0 0x7f6e5c09aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57404/0 (socket says 172.21.15.83:57404) 2024-03-30T13:11:09.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e60a5a640 1 -- 172.21.15.83:0/1982557070 learned_addr learned my addr 172.21.15.83:0/1982557070 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:09.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e6125b640 1 --2- 172.21.15.83:0/1982557070 >> v2:172.21.15.83:3300/0 conn(0x7f6e5c15ebc0 0x7f6e5c06ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37128/0 (socket says 172.21.15.83:37128) 2024-03-30T13:11:09.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e6125b640 1 -- 172.21.15.83:0/1982557070 >> v1:172.21.15.153:6789/0 conn(0x7f6e5c09b160 legacy=0x7f6e5c0cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e6125b640 1 -- 172.21.15.83:0/1982557070 >> v1:172.21.15.83:6789/0 conn(0x7f6e5c06dce0 legacy=0x7f6e5c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e6125b640 1 -- 172.21.15.83:0/1982557070 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c0ccbf0 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e6125b640 1 --2- 172.21.15.83:0/1982557070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e5c15ebc0 0x7f6e5c06ccf0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6e580097c0 tx=0x7f6e5801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea7677706567024 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e53fff640 1 -- 172.21.15.83:0/1982557070 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e580ab650 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e53fff640 1 -- 172.21.15.83:0/1982557070 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e580b0070 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e53fff640 1 -- 172.21.15.83:0/1982557070 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e580aba10 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e634bf640 1 -- 172.21.15.83:0/1982557070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e5c15ebc0 msgr2=0x7f6e5c06ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.844+0000 7f6e634bf640 1 --2- 172.21.15.83:0/1982557070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e5c15ebc0 0x7f6e5c06ccf0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6e580097c0 tx=0x7f6e5801c430 comp rx=0 tx=0).stop 2024-03-30T13:11:09.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 -- 172.21.15.83:0/1982557070 shutdown_connections 2024-03-30T13:11:09.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 --2- 172.21.15.83:0/1982557070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e5c15ebc0 0x7f6e5c06ccf0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 -- 172.21.15.83:0/1982557070 >> 172.21.15.83:0/1982557070 conn(0x7f6e5c0b3dd0 msgr2=0x7f6e5c0b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:09.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 -- 172.21.15.83:0/1982557070 shutdown_connections 2024-03-30T13:11:09.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 -- 172.21.15.83:0/1982557070 wait complete. 2024-03-30T13:11:09.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 Processor -- start 2024-03-30T13:11:09.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 -- start start 2024-03-30T13:11:09.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e5c06dce0 0x7f6e5c0b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e5c09b160 0x7f6e5c14ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e5c15ebc0 0x7f6e5c0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c0b4b00 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c0b4980 con 0x7f6e5c06dce0 2024-03-30T13:11:09.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5c16c6a0 con 0x7f6e5c09b160 2024-03-30T13:11:09.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e61a5c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e5c15ebc0 0x7f6e5c0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e61a5c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e5c15ebc0 0x7f6e5c0cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37140/0 (socket says 172.21.15.83:37140) 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e61a5c640 1 -- 172.21.15.83:0/2867803315 learned_addr learned my addr 172.21.15.83:0/2867803315 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e6125b640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e5c06dce0 0x7f6e5c0b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e60a5a640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e5c09b160 0x7f6e5c14ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e61a5c640 1 -- 172.21.15.83:0/2867803315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e5c09b160 msgr2=0x7f6e5c14ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e61a5c640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e5c09b160 0x7f6e5c14ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e61a5c640 1 -- 172.21.15.83:0/2867803315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e5c06dce0 msgr2=0x7f6e5c0b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e61a5c640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e5c06dce0 0x7f6e5c0b7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e61a5c640 1 -- 172.21.15.83:0/2867803315 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c0b6480 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e61a5c640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e5c15ebc0 0x7f6e5c0cb790 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400c7b0 tx=0x7f6e5400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e51ffb640 1 -- 172.21.15.83:0/2867803315 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54004b70 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e51ffb640 1 -- 172.21.15.83:0/2867803315 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e54004d10 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e51ffb640 1 -- 172.21.15.83:0/2867803315 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5400aa90 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 -- 172.21.15.83:0/2867803315 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5c0b6760 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.848+0000 7f6e634bf640 1 -- 172.21.15.83:0/2867803315 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e5c0b6d20 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e51ffb640 1 -- 172.21.15.83:0/2867803315 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6e5400ac30 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e51ffb640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6e40067fc0 0x7f6e4006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e51ffb640 1 -- 172.21.15.83:0/2867803315 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6e54086730 con 0x7f6e5c15ebc0 2024-03-30T13:11:09.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e6125b640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6e40067fc0 0x7f6e4006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e6125b640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6e40067fc0 0x7f6e4006a480 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6e580af000 tx=0x7f6e580a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e66641000 1 Processor -- start 2024-03-30T13:11:09.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e66641000 1 -- start start 2024-03-30T13:11:09.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e66641000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 0x564a301f8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e66641000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 0x564a301ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e66641000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301ae830 0x564a301aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e66641000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564a2fffcaa0 con 0x564a301f8690 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e66641000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564a2ff83af0 con 0x564a301ae830 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e66641000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564a2fff8a50 con 0x564a301f7d70 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e60a5a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 0x564a301ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e60a5a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 0x564a301ae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37146/0 (socket says 172.21.15.83:37146) 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e60a5a640 1 -- 172.21.15.83:0/1505196140 learned_addr learned my addr 172.21.15.83:0/1505196140 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e6125b640 1 --2- 172.21.15.83:0/1505196140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 0x564a301f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e61a5c640 1 --2- 172.21.15.83:0/1505196140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301ae830 0x564a301aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e60a5a640 1 -- 172.21.15.83:0/1505196140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 msgr2=0x564a301f8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e60a5a640 1 --2- 172.21.15.83:0/1505196140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 0x564a301f8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e60a5a640 1 -- 172.21.15.83:0/1505196140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301ae830 msgr2=0x564a301aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e60a5a640 1 --2- 172.21.15.83:0/1505196140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301ae830 0x564a301aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e60a5a640 1 -- 172.21.15.83:0/1505196140 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a2ff81d00 con 0x564a301f8690 2024-03-30T13:11:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e61a5c640 1 --2- 172.21.15.83:0/1505196140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301ae830 0x564a301aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.852+0000 7f6e60a5a640 1 --2- 172.21.15.83:0/1505196140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 0x564a301ae2f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c005830 tx=0x7f6e4c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477e183fb0dcd0c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e3effd640 1 -- 172.21.15.83:0/1505196140 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c019070 con 0x564a301f8690 2024-03-30T13:11:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e3effd640 1 -- 172.21.15.83:0/1505196140 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4c005880 con 0x564a301f8690 2024-03-30T13:11:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e3effd640 1 -- 172.21.15.83:0/1505196140 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c005c70 con 0x564a301f8690 2024-03-30T13:11:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 -- 172.21.15.83:0/1505196140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 msgr2=0x564a301ae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 --2- 172.21.15.83:0/1505196140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 0x564a301ae2f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c005830 tx=0x7f6e4c001a20 comp rx=0 tx=0).stop 2024-03-30T13:11:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 -- 172.21.15.83:0/1505196140 shutdown_connections 2024-03-30T13:11:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 --2- 172.21.15.83:0/1505196140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301ae830 0x564a301aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 --2- 172.21.15.83:0/1505196140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 0x564a301ae2f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 --2- 172.21.15.83:0/1505196140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 0x564a301f8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 -- 172.21.15.83:0/1505196140 >> 172.21.15.83:0/1505196140 conn(0x564a301aa7e0 msgr2=0x564a301acbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:09.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 -- 172.21.15.83:0/1505196140 shutdown_connections 2024-03-30T13:11:09.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 -- 172.21.15.83:0/1505196140 wait complete. 2024-03-30T13:11:09.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 -- start start 2024-03-30T13:11:09.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 Processor -- start 2024-03-30T13:11:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 0x564a301b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 0x564a301dcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301f8690 0x564a301dd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564a2ffc4270 con 0x564a301ae830 2024-03-30T13:11:09.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564a2ffba6a0 con 0x564a301f8690 2024-03-30T13:11:09.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564a2ff94880 con 0x564a301f7d70 2024-03-30T13:11:09.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e6125b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 0x564a301b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 10 client.0 _ll_register_callbacks cb 0x564a30199490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:09.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e6125b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 0x564a301b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37152/0 (socket says 172.21.15.83:37152) 2024-03-30T13:11:09.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e6125b640 1 -- 172.21.15.83:0/3384036985 learned_addr learned my addr 172.21.15.83:0/3384036985 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:09.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e60a5a640 1 --2- 172.21.15.83:0/3384036985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 0x564a301dcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e6125b640 1 -- 172.21.15.83:0/3384036985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 msgr2=0x564a301dcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e6125b640 1 --2- 172.21.15.83:0/3384036985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 0x564a301dcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e6125b640 1 -- 172.21.15.83:0/3384036985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301f8690 msgr2=0x564a301dd2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-30T13:11:09.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e6125b640 1 --2- 172.21.15.83:0/3384036985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301f8690 0x564a301dd2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e6125b640 1 -- 172.21.15.83:0/3384036985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a2ffc1730 con 0x564a301ae830 2024-03-30T13:11:09.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e6125b640 1 --2- 172.21.15.83:0/3384036985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 0x564a301b3c80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6e5801a060 tx=0x7f6e5801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe33474bb86d43f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e37fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:09.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e37fff640 1 -- 172.21.15.83:0/3384036985 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e580cd060 con 0x564a301ae830 2024-03-30T13:11:09.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e37fff640 1 -- 172.21.15.83:0/3384036985 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6e580bf990 con 0x564a301ae830 2024-03-30T13:11:09.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 -- 172.21.15.83:0/3384036985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e4c005880 con 0x564a301ae830 2024-03-30T13:11:09.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e37fff640 1 -- 172.21.15.83:0/3384036985 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f6e580d3050 con 0x564a301ae830 2024-03-30T13:11:09.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 10 client.5979 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:09.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 -- 172.21.15.83:0/3384036985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564a2ffb4ca0 con 0x564a301ae830 2024-03-30T13:11:09.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e37fff640 1 -- 172.21.15.83:0/3384036985 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4c005880 con 0x564a301ae830 2024-03-30T13:11:09.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e37fff640 1 -- 172.21.15.83:0/3384036985 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f6e580d6020 con 0x564a301ae830 2024-03-30T13:11:09.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 10 client.5979 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:09.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 10 client.5979 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:09.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 20 client.5979 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:09.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 --2- 172.21.15.83:0/3384036985 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564a301ff5d0 0x564a301ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 4 client.5979 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:09.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e66641000 1 -- 172.21.15.83:0/3384036985 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a2ff97c90 con 0x564a301ff5d0 2024-03-30T13:11:09.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.856+0000 7f6e60a5a640 1 --2- 172.21.15.83:0/3384036985 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564a301ff5d0 0x564a301ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e60a5a640 1 --2- 172.21.15.83:0/3384036985 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564a301ff5d0 0x564a301ff9e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f063a86c7c0b38f server_cookie=57bd8f765d367c5a in_seq=0 out_seq=0 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e37fff640 10 client.5979 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e37fff640 1 -- 172.21.15.83:0/3384036985 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x564a2ff97c90 con 0x564a301ff5d0 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e37fff640 10 client.5979 handle_command_reply: tid=0 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e66641000 1 client.5979 shutdown 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e66641000 1 -- 172.21.15.83:0/3384036985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 msgr2=0x564a301b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e66641000 1 --2- 172.21.15.83:0/3384036985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 0x564a301b3c80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6e5801a060 tx=0x7f6e5801ac70 comp rx=0 tx=0).stop 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e66641000 1 -- 172.21.15.83:0/3384036985 shutdown_connections 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e66641000 1 --2- 172.21.15.83:0/3384036985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301f8690 0x564a301dd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e66641000 1 --2- 172.21.15.83:0/3384036985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 0x564a301dcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e66641000 1 --2- 172.21.15.83:0/3384036985 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564a301ff5d0 0x564a301ff9e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e66641000 1 --2- 172.21.15.83:0/3384036985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 0x564a301b3c80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e37fff640 0 client.5979 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:09.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e66641000 1 -- 172.21.15.83:0/3384036985 >> 172.21.15.83:0/3384036985 conn(0x564a301aa7e0 msgr2=0x564a301ad460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:09.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e66641000 1 -- 172.21.15.83:0/3384036985 shutdown_connections 2024-03-30T13:11:09.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e66641000 1 -- 172.21.15.83:0/3384036985 wait complete. 2024-03-30T13:11:09.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.860+0000 7f6e66641000 20 client.5979 trim_cache size 0 max 16384 2024-03-30T13:11:09.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 Processor -- start 2024-03-30T13:11:09.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- start start 2024-03-30T13:11:09.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301ae830 0x564a301dd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 0x564a301faa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 0x564a301fafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c203e20 con 0x564a301f8690 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c202ec0 con 0x564a301ae830 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5c0b5710 con 0x564a301f7d70 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e61a5c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 0x564a301fafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e61a5c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 0x564a301fafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37164/0 (socket says 172.21.15.83:37164) 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e61a5c640 1 -- 172.21.15.83:0/3993510375 learned_addr learned my addr 172.21.15.83:0/3993510375 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e6125b640 1 --2- 172.21.15.83:0/3993510375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301ae830 0x564a301dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e61a5c640 1 -- 172.21.15.83:0/3993510375 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 msgr2=0x564a301faa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e61a5c640 1 --2- 172.21.15.83:0/3993510375 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 0x564a301faa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e61a5c640 1 -- 172.21.15.83:0/3993510375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301ae830 msgr2=0x564a301dd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e61a5c640 1 --2- 172.21.15.83:0/3993510375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301ae830 0x564a301dd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e61a5c640 1 -- 172.21.15.83:0/3993510375 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a2ff83d00 con 0x564a301f8690 2024-03-30T13:11:09.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e61a5c640 1 --2- 172.21.15.83:0/3993510375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 0x564a301fafc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6e5405ef20 tx=0x7f6e54056290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8184126205c52a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e3e7fc640 1 -- 172.21.15.83:0/3993510375 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54083070 con 0x564a301f8690 2024-03-30T13:11:09.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e3e7fc640 1 -- 172.21.15.83:0/3993510375 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5405ac20 con 0x564a301f8690 2024-03-30T13:11:09.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e3e7fc640 1 -- 172.21.15.83:0/3993510375 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5405f450 con 0x564a301f8690 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- 172.21.15.83:0/3993510375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 msgr2=0x564a301fafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 --2- 172.21.15.83:0/3993510375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 0x564a301fafc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6e5405ef20 tx=0x7f6e54056290 comp rx=0 tx=0).stop 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- 172.21.15.83:0/3993510375 shutdown_connections 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 --2- 172.21.15.83:0/3993510375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301f8690 0x564a301fafc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 --2- 172.21.15.83:0/3993510375 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f7d70 0x564a301faa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 --2- 172.21.15.83:0/3993510375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301ae830 0x564a301dd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- 172.21.15.83:0/3993510375 >> 172.21.15.83:0/3993510375 conn(0x564a301aa7e0 msgr2=0x564a3020ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- 172.21.15.83:0/3993510375 shutdown_connections 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- 172.21.15.83:0/3993510375 wait complete. 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- start start 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 Processor -- start 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 0x564a30269ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301f7d70 0x564a3026a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f8690 0x564a301fbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564a2ffc4270 con 0x564a301ae830 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c0b5d60 con 0x564a301f7d70 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564a300b8b00 con 0x564a301f8690 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e66641000 10 client.0 _ll_register_callbacks cb 0x7f6e58009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e6125b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 0x564a30269ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e6125b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 0x564a30269ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37166/0 (socket says 172.21.15.83:37166) 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.876+0000 7f6e6125b640 1 -- 172.21.15.83:0/2795692389 learned_addr learned my addr 172.21.15.83:0/2795692389 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e60a5a640 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301f7d70 0x564a3026a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e61a5c640 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f8690 0x564a301fbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e6125b640 1 -- 172.21.15.83:0/2795692389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f8690 msgr2=0x564a301fbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e6125b640 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f8690 0x564a301fbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e6125b640 1 -- 172.21.15.83:0/2795692389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301f7d70 msgr2=0x564a3026a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e6125b640 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301f7d70 0x564a3026a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e6125b640 1 -- 172.21.15.83:0/2795692389 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a3007df70 con 0x564a301ae830 2024-03-30T13:11:09.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e6125b640 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 0x564a30269ec0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6e580097c0 tx=0x7f6e58008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfc4d0cdc5f4f83 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e37fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:09.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e37fff640 1 -- 172.21.15.83:0/2795692389 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e580bb070 con 0x564a301ae830 2024-03-30T13:11:09.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e37fff640 1 -- 172.21.15.83:0/2795692389 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6e580d8aa0 con 0x564a301ae830 2024-03-30T13:11:09.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 -- 172.21.15.83:0/2795692389 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e5405ac20 con 0x564a301ae830 2024-03-30T13:11:09.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e37fff640 1 -- 172.21.15.83:0/2795692389 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f6e580bfd30 con 0x564a301ae830 2024-03-30T13:11:09.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 10 client.5985 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:09.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 -- 172.21.15.83:0/2795692389 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564a2ffa3760 con 0x564a301ae830 2024-03-30T13:11:09.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e37fff640 1 -- 172.21.15.83:0/2795692389 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5405ac20 con 0x564a301ae830 2024-03-30T13:11:09.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e37fff640 1 -- 172.21.15.83:0/2795692389 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f6e580d0070 con 0x564a301ae830 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 10 client.5985 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 10 client.5985 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 20 client.5985 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564a301fc8d0 0x564a301fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 4 client.5985 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628358}] 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 -- 172.21.15.83:0/2795692389 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628358}) -- 0x564a30009fe0 con 0x564a301fc8d0 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e60a5a640 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564a301fc8d0 0x564a301fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e37fff640 10 client.5985 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e60a5a640 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564a301fc8d0 0x564a301fcce0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=865b2391798e11eb server_cookie=7d83263a647ac566 in_seq=0 out_seq=0 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e37fff640 1 -- 172.21.15.83:0/2795692389 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3794 (crc 0 0 0) 0x564a30009fe0 con 0x564a301fc8d0 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e37fff640 10 client.5985 handle_command_reply: tid=0 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 client.5985 shutdown 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 -- 172.21.15.83:0/2795692389 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 msgr2=0x564a30269ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 0x564a30269ec0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6e580097c0 tx=0x7f6e58008040 comp rx=0 tx=0).stop 2024-03-30T13:11:09.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 -- 172.21.15.83:0/2795692389 shutdown_connections 2024-03-30T13:11:09.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564a301f8690 0x564a301fbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a301f7d70 0x564a3026a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564a301fc8d0 0x564a301fcce0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 --2- 172.21.15.83:0/2795692389 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564a301ae830 0x564a30269ec0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e37fff640 0 client.5985 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:09.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 -- 172.21.15.83:0/2795692389 >> 172.21.15.83:0/2795692389 conn(0x564a301aa7e0 msgr2=0x564a3020f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:09.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 -- 172.21.15.83:0/2795692389 shutdown_connections 2024-03-30T13:11:09.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 1 -- 172.21.15.83:0/2795692389 wait complete. 2024-03-30T13:11:09.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e66641000 20 client.5985 trim_cache size 0 max 16384 2024-03-30T13:11:09.894 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ceph/Kconfig", 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628358, 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.515697+0000", 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:35.812559+0000", 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 1481, 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:35.812559+0000", 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1481, 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.515697+0000" 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1481, 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.515697+0000" 2024-03-30T13:11:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 138, 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 2, 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:09.906 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:09.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e634bf640 1 -- 172.21.15.83:0/2867803315 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6e40067fc0 msgr2=0x7f6e4006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e634bf640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6e40067fc0 0x7f6e4006a480 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6e580af000 tx=0x7f6e580a7000 comp rx=0 tx=0).stop 2024-03-30T13:11:09.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e634bf640 1 -- 172.21.15.83:0/2867803315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e5c15ebc0 msgr2=0x7f6e5c0cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e634bf640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e5c15ebc0 0x7f6e5c0cb790 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400c7b0 tx=0x7f6e5400cc70 comp rx=0 tx=0).stop 2024-03-30T13:11:09.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e634bf640 1 -- 172.21.15.83:0/2867803315 shutdown_connections 2024-03-30T13:11:09.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e634bf640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6e40067fc0 0x7f6e4006a480 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e634bf640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e5c15ebc0 0x7f6e5c0cb790 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e634bf640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e5c09b160 0x7f6e5c14ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e634bf640 1 --2- 172.21.15.83:0/2867803315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e5c06dce0 0x7f6e5c0b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e634bf640 1 -- 172.21.15.83:0/2867803315 >> 172.21.15.83:0/2867803315 conn(0x7f6e5c0b3dd0 msgr2=0x7f6e5c0cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:09.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e634bf640 1 -- 172.21.15.83:0/2867803315 shutdown_connections 2024-03-30T13:11:09.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:09.880+0000 7f6e634bf640 1 -- 172.21.15.83:0/2867803315 wait complete. 2024-03-30T13:11:09.909 DEBUG:tasks.cephfs.test_uninlining:getting inode info #2 of 23:1099511628359 2024-03-30T13:11:09.909 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628359 2024-03-30T13:11:09.909 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628359 2024-03-30T13:11:10.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f8e4f1640 1 Processor -- start 2024-03-30T13:11:10.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f8e4f1640 1 -- start start 2024-03-30T13:11:10.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f8e4f1640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8f8815b570 0x7f8f880ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f8e4f1640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8f880b5080 0x7f8f880b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f8e4f1640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f880b37a0 con 0x7f8f880aec70 2024-03-30T13:11:10.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f8e4f1640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f8f880b0af0 con 0x7f8f8815b570 2024-03-30T13:11:10.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f8e4f1640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8f880b59f0 con 0x7f8f880b5080 2024-03-30T13:11:10.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f87fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8f8815b570 0x7f8f880ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f877fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f8f880aec70 0x7f8f880b0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57406/0 (socket says 172.21.15.83:57406) 2024-03-30T13:11:10.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f877fe640 1 -- 172.21.15.83:0/1644736550 learned_addr learned my addr 172.21.15.83:0/1644736550 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:10.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f8ca8e640 1 --2- 172.21.15.83:0/1644736550 >> v2:172.21.15.153:3300/0 conn(0x7f8f880b5080 0x7f8f880b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f87fff640 1 -- 172.21.15.83:0/1644736550 >> v2:172.21.15.153:3300/0 conn(0x7f8f880b5080 msgr2=0x7f8f880b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f87fff640 1 --2- 172.21.15.83:0/1644736550 >> v2:172.21.15.153:3300/0 conn(0x7f8f880b5080 0x7f8f880b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f87fff640 1 -- 172.21.15.83:0/1644736550 >> v1:172.21.15.83:6789/0 conn(0x7f8f880aec70 legacy=0x7f8f880b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f87fff640 1 -- 172.21.15.83:0/1644736550 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8815b950 con 0x7f8f8815b570 2024-03-30T13:11:10.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.016+0000 7f8f86ffd640 1 -- 172.21.15.83:0/1644736550 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881447712 0 0) 0x7f8f880b37a0 con 0x7f8f880aec70 2024-03-30T13:11:10.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f87fff640 1 --2- 172.21.15.83:0/1644736550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f8815b570 0x7f8f880ae730 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8f88072b60 tx=0x7f8f7801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29db9ee57bcc0d13 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f86ffd640 1 -- 172.21.15.83:0/1644736550 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f780ab650 con 0x7f8f8815b570 2024-03-30T13:11:10.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f86ffd640 1 -- 172.21.15.83:0/1644736550 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f780b0070 con 0x7f8f8815b570 2024-03-30T13:11:10.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f86ffd640 1 -- 172.21.15.83:0/1644736550 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f780aba10 con 0x7f8f8815b570 2024-03-30T13:11:10.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/1644736550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f8815b570 msgr2=0x7f8f880ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 --2- 172.21.15.83:0/1644736550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f8815b570 0x7f8f880ae730 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8f88072b60 tx=0x7f8f7801c450 comp rx=0 tx=0).stop 2024-03-30T13:11:10.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/1644736550 shutdown_connections 2024-03-30T13:11:10.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 --2- 172.21.15.83:0/1644736550 >> v2:172.21.15.153:3300/0 conn(0x7f8f880b5080 0x7f8f880b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 --2- 172.21.15.83:0/1644736550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f8815b570 0x7f8f880ae730 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/1644736550 >> 172.21.15.83:0/1644736550 conn(0x7f8f88072d30 msgr2=0x7f8f880b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/1644736550 shutdown_connections 2024-03-30T13:11:10.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/1644736550 wait complete. 2024-03-30T13:11:10.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 Processor -- start 2024-03-30T13:11:10.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 -- start start 2024-03-30T13:11:10.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f880aec70 0x7f8f88142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f880b5080 0x7f8f88142e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f8815b570 0x7f8f8815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8f880af070 con 0x7f8f880b5080 2024-03-30T13:11:10.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8f880afd30 con 0x7f8f8815b570 2024-03-30T13:11:10.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8e4f1640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8f880af1f0 con 0x7f8f880aec70 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f877fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f880b5080 0x7f8f88142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f877fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f880b5080 0x7f8f88142e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37182/0 (socket says 172.21.15.83:37182) 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f877fe640 1 -- 172.21.15.83:0/499599534 learned_addr learned my addr 172.21.15.83:0/499599534 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f87fff640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f880aec70 0x7f8f88142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f877fe640 1 -- 172.21.15.83:0/499599534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f880aec70 msgr2=0x7f8f88142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f8ca8e640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f8815b570 0x7f8f8815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f877fe640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f880aec70 0x7f8f88142150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f877fe640 1 -- 172.21.15.83:0/499599534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f8815b570 msgr2=0x7f8f8815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f877fe640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f8815b570 0x7f8f8815ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f877fe640 1 -- 172.21.15.83:0/499599534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f881459c0 con 0x7f8f880b5080 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.020+0000 7f8f877fe640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f880b5080 0x7f8f88142e70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0011f0 tx=0x7f8f7c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f84ff9640 1 -- 172.21.15.83:0/499599534 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c018070 con 0x7f8f880b5080 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f84ff9640 1 -- 172.21.15.83:0/499599534 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f7c0074e0 con 0x7f8f880b5080 2024-03-30T13:11:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/499599534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f88145ca0 con 0x7f8f880b5080 2024-03-30T13:11:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f84ff9640 1 -- 172.21.15.83:0/499599534 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c004a10 con 0x7f8f880b5080 2024-03-30T13:11:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/499599534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8815c650 con 0x7f8f880b5080 2024-03-30T13:11:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f84ff9640 1 -- 172.21.15.83:0/499599534 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f8f7c01b070 con 0x7f8f880b5080 2024-03-30T13:11:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f84ff9640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8f74067fc0 0x7f8f7406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f84ff9640 1 -- 172.21.15.83:0/499599534 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8f7c0858b0 con 0x7f8f880b5080 2024-03-30T13:11:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f87fff640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8f74067fc0 0x7f8f7406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f91673000 1 Processor -- start 2024-03-30T13:11:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f91673000 1 -- start start 2024-03-30T13:11:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f87fff640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8f74067fc0 0x7f8f7406a480 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f780af000 tx=0x7f8f78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f91673000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 0x55574c9ff380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f91673000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9ff8c0 0x55574c9b5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f91673000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9b5a40 0x55574c9b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f91673000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55574c801aa0 con 0x55574c9fefa0 2024-03-30T13:11:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f91673000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55574c788af0 con 0x55574c9ff8c0 2024-03-30T13:11:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.024+0000 7f8f91673000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55574c7fda50 con 0x55574c9b5a40 2024-03-30T13:11:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 0x55574c9ff380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 0x55574c9ff380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37184/0 (socket says 172.21.15.83:37184) 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 -- 172.21.15.83:0/2538446222 learned_addr learned my addr 172.21.15.83:0/2538446222 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f8ca8e640 1 --2- 172.21.15.83:0/2538446222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9b5a40 0x55574c9b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f877fe640 1 --2- 172.21.15.83:0/2538446222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9ff8c0 0x55574c9b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 -- 172.21.15.83:0/2538446222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9b5a40 msgr2=0x55574c9b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 --2- 172.21.15.83:0/2538446222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9b5a40 0x55574c9b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 -- 172.21.15.83:0/2538446222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9ff8c0 msgr2=0x55574c9b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 --2- 172.21.15.83:0/2538446222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9ff8c0 0x55574c9b5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 -- 172.21.15.83:0/2538446222 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55574c786d00 con 0x55574c9fefa0 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 --2- 172.21.15.83:0/2538446222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 0x55574c9ff380 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8f7801c490 tx=0x7f8f78004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f018b81d8d601971 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f6dffb640 1 -- 172.21.15.83:0/2538446222 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f780b58d0 con 0x55574c9fefa0 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f6dffb640 1 -- 172.21.15.83:0/2538446222 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f780c5070 con 0x55574c9fefa0 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f6dffb640 1 -- 172.21.15.83:0/2538446222 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f780b5c70 con 0x55574c9fefa0 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 -- 172.21.15.83:0/2538446222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 msgr2=0x55574c9ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 --2- 172.21.15.83:0/2538446222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 0x55574c9ff380 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8f7801c490 tx=0x7f8f78004740 comp rx=0 tx=0).stop 2024-03-30T13:11:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 -- 172.21.15.83:0/2538446222 shutdown_connections 2024-03-30T13:11:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 --2- 172.21.15.83:0/2538446222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9b5a40 0x55574c9b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 --2- 172.21.15.83:0/2538446222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9ff8c0 0x55574c9b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 --2- 172.21.15.83:0/2538446222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 0x55574c9ff380 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 -- 172.21.15.83:0/2538446222 >> 172.21.15.83:0/2538446222 conn(0x55574c9af7e0 msgr2=0x55574c9b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 -- 172.21.15.83:0/2538446222 shutdown_connections 2024-03-30T13:11:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 -- 172.21.15.83:0/2538446222 wait complete. 2024-03-30T13:11:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 -- start start 2024-03-30T13:11:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 Processor -- start 2024-03-30T13:11:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 0x55574ca06510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9fefa0 0x55574ca06a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 0x55574c9e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55574c7c9270 con 0x55574c9b5a40 2024-03-30T13:11:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55574c7bf6a0 con 0x55574c9fefa0 2024-03-30T13:11:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55574c799880 con 0x55574c9ff8c0 2024-03-30T13:11:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 10 client.0 _ll_register_callbacks cb 0x55574c99e490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 0x55574ca06510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 0x55574ca06510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37194/0 (socket says 172.21.15.83:37194) 2024-03-30T13:11:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 -- 172.21.15.83:0/2014048039 learned_addr learned my addr 172.21.15.83:0/2014048039 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f877fe640 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9fefa0 0x55574ca06a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f8ca8e640 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 0x55574c9e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 -- 172.21.15.83:0/2014048039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 msgr2=0x55574c9e2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 0x55574c9e2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 -- 172.21.15.83:0/2014048039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9fefa0 msgr2=0x55574ca06a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9fefa0 0x55574ca06a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 -- 172.21.15.83:0/2014048039 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55574c7c6730 con 0x55574c9b5a40 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f8ca8e640 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 0x55574c9e2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f87fff640 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 0x55574ca06510 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8f780c2040 tx=0x7f8f7801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b981ed241beb0587 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f66ffd640 1 -- 172.21.15.83:0/2014048039 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f780c06d0 con 0x55574c9b5a40 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f66ffd640 1 -- 172.21.15.83:0/2014048039 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8f780c0870 con 0x55574c9b5a40 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.028+0000 7f8f91673000 1 -- 172.21.15.83:0/2014048039 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f780c5070 con 0x55574c9b5a40 2024-03-30T13:11:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f66ffd640 1 -- 172.21.15.83:0/2014048039 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8f780c0a70 con 0x55574c9b5a40 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 10 client.6000 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 -- 172.21.15.83:0/2014048039 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55574c7b9ca0 con 0x55574c9b5a40 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f66ffd640 1 -- 172.21.15.83:0/2014048039 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f780c5070 con 0x55574c9b5a40 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f66ffd640 1 -- 172.21.15.83:0/2014048039 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f8f780c0c10 con 0x55574c9b5a40 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 10 client.6000 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 10 client.6000 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 20 client.6000 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55574c9e3cc0 0x55574c9e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 4 client.6000 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 -- 172.21.15.83:0/2014048039 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55574c79cc90 con 0x55574c9e3cc0 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f877fe640 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55574c9e3cc0 0x55574c9e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f66ffd640 10 client.6000 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f877fe640 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55574c9e3cc0 0x55574c9e40a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1526bf04f12bca2 server_cookie=457a726e3df4aba9 in_seq=0 out_seq=0 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f66ffd640 1 -- 172.21.15.83:0/2014048039 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55574c79cc90 con 0x55574c9e3cc0 2024-03-30T13:11:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f66ffd640 10 client.6000 handle_command_reply: tid=0 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 client.6000 shutdown 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 -- 172.21.15.83:0/2014048039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 msgr2=0x55574ca06510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 0x55574ca06510 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8f780c2040 tx=0x7f8f7801ac90 comp rx=0 tx=0).stop 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 -- 172.21.15.83:0/2014048039 shutdown_connections 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 0x55574c9e2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9fefa0 0x55574ca06a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55574c9e3cc0 0x55574c9e40a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 --2- 172.21.15.83:0/2014048039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 0x55574ca06510 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f66ffd640 0 client.6000 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 -- 172.21.15.83:0/2014048039 >> 172.21.15.83:0/2014048039 conn(0x55574c9af7e0 msgr2=0x55574c9b86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 -- 172.21.15.83:0/2014048039 shutdown_connections 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 1 -- 172.21.15.83:0/2014048039 wait complete. 2024-03-30T13:11:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.032+0000 7f8f91673000 20 client.6000 trim_cache size 0 max 16384 2024-03-30T13:11:10.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 Processor -- start 2024-03-30T13:11:10.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 -- start start 2024-03-30T13:11:10.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 0x55574ca16ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9fefa0 0x55574ca04ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 0x55574ca05220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881ff0d0 con 0x55574c9b5a40 2024-03-30T13:11:10.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881fe240 con 0x55574c9fefa0 2024-03-30T13:11:10.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8f88141650 con 0x55574c9ff8c0 2024-03-30T13:11:10.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 0x55574ca16ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 0x55574ca16ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37198/0 (socket says 172.21.15.83:37198) 2024-03-30T13:11:10.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f87fff640 1 -- 172.21.15.83:0/1865769496 learned_addr learned my addr 172.21.15.83:0/1865769496 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f87fff640 1 -- 172.21.15.83:0/1865769496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 msgr2=0x55574ca05220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f87fff640 1 --2- 172.21.15.83:0/1865769496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 0x55574ca05220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f87fff640 1 -- 172.21.15.83:0/1865769496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9fefa0 msgr2=0x55574ca04ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f87fff640 1 --2- 172.21.15.83:0/1865769496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9fefa0 0x55574ca04ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f87fff640 1 -- 172.21.15.83:0/1865769496 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55574c9ff6f0 con 0x55574c9b5a40 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f87fff640 1 --2- 172.21.15.83:0/1865769496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 0x55574ca16ad0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8f780a4f00 tx=0x7f8f780cb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb248024665ed90 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f6d7fa640 1 -- 172.21.15.83:0/1865769496 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f780c0c10 con 0x55574c9b5a40 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f6d7fa640 1 -- 172.21.15.83:0/1865769496 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f780c5070 con 0x55574c9b5a40 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f6d7fa640 1 -- 172.21.15.83:0/1865769496 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f780c05f0 con 0x55574c9b5a40 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 -- 172.21.15.83:0/1865769496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 msgr2=0x55574ca16ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 --2- 172.21.15.83:0/1865769496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 0x55574ca16ad0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8f780a4f00 tx=0x7f8f780cb000 comp rx=0 tx=0).stop 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 -- 172.21.15.83:0/1865769496 shutdown_connections 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 --2- 172.21.15.83:0/1865769496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 0x55574ca05220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 --2- 172.21.15.83:0/1865769496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9fefa0 0x55574ca04ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 --2- 172.21.15.83:0/1865769496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9b5a40 0x55574ca16ad0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 -- 172.21.15.83:0/1865769496 >> 172.21.15.83:0/1865769496 conn(0x55574c9af7e0 msgr2=0x55574c9dfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 -- 172.21.15.83:0/1865769496 shutdown_connections 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 -- 172.21.15.83:0/1865769496 wait complete. 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 -- start start 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 Processor -- start 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.048+0000 7f8f91673000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9b5a40 0x55574ca71e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 0x55574c9ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 0x55574ca001e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8806bff0 con 0x55574c9fefa0 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55574c7cb450 con 0x55574c9b5a40 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55574c7bf6a0 con 0x55574c9ff8c0 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 10 client.0 _ll_register_callbacks cb 0x7f8f780ab770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f877fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 0x55574c9ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f877fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 0x55574c9ffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37212/0 (socket says 172.21.15.83:37212) 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f877fe640 1 -- 172.21.15.83:0/1407748804 learned_addr learned my addr 172.21.15.83:0/1407748804 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f87fff640 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9b5a40 0x55574ca71e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8ca8e640 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 0x55574ca001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f877fe640 1 -- 172.21.15.83:0/1407748804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 msgr2=0x55574ca001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f877fe640 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 0x55574ca001e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f877fe640 1 -- 172.21.15.83:0/1407748804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9b5a40 msgr2=0x55574ca71e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f877fe640 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9b5a40 0x55574ca71e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f877fe640 1 -- 172.21.15.83:0/1407748804 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55574c788d00 con 0x55574c9fefa0 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f87fff640 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9b5a40 0x55574ca71e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f877fe640 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 0x55574c9ffca0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c055660 tx=0x7f8f7c007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9dba85c80a9c241 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f66ffd640 1 -- 172.21.15.83:0/1407748804 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c05c0b0 con 0x55574c9fefa0 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 -- 172.21.15.83:0/1407748804 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f780c5070 con 0x55574c9fefa0 2024-03-30T13:11:10.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f66ffd640 1 -- 172.21.15.83:0/1407748804 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8f7c07edf0 con 0x55574c9fefa0 2024-03-30T13:11:10.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f66ffd640 1 -- 172.21.15.83:0/1407748804 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8f7c05c250 con 0x55574c9fefa0 2024-03-30T13:11:10.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 10 client.6006 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:10.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 -- 172.21.15.83:0/1407748804 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55574c882f70 con 0x55574c9fefa0 2024-03-30T13:11:10.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f66ffd640 1 -- 172.21.15.83:0/1407748804 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f780c5070 con 0x55574c9fefa0 2024-03-30T13:11:10.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f66ffd640 1 -- 172.21.15.83:0/1407748804 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f8f7c004bb0 con 0x55574c9fefa0 2024-03-30T13:11:10.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 10 client.6006 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:10.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 10 client.6006 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 20 client.6006 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55574ca00f90 0x55574ca7b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 4 client.6006 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628359}] 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 -- 172.21.15.83:0/1407748804 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628359}) -- 0x55574c80efe0 con 0x55574ca00f90 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f87fff640 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55574ca00f90 0x55574ca7b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f66ffd640 10 client.6006 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f87fff640 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55574ca00f90 0x55574ca7b590 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b82cc0e8a3a9c876 server_cookie=6c3dc9a2e80c6964 in_seq=0 out_seq=0 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f66ffd640 1 -- 172.21.15.83:0/1407748804 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3792 (crc 0 0 0) 0x55574c80efe0 con 0x55574ca00f90 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f66ffd640 10 client.6006 handle_command_reply: tid=0 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 client.6006 shutdown 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 -- 172.21.15.83:0/1407748804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 msgr2=0x55574c9ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 0x55574c9ffca0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c055660 tx=0x7f8f7c007710 comp rx=0 tx=0).stop 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 -- 172.21.15.83:0/1407748804 shutdown_connections 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55574c9ff8c0 0x55574ca001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55574ca00f90 0x55574ca7b590 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55574c9fefa0 0x55574c9ffca0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 --2- 172.21.15.83:0/1407748804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55574c9b5a40 0x55574ca71e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f66ffd640 0 client.6006 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 -- 172.21.15.83:0/1407748804 >> 172.21.15.83:0/1407748804 conn(0x55574c9af7e0 msgr2=0x55574c9e02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 -- 172.21.15.83:0/1407748804 shutdown_connections 2024-03-30T13:11:10.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 1 -- 172.21.15.83:0/1407748804 wait complete. 2024-03-30T13:11:10.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f91673000 20 client.6006 trim_cache size 0 max 16384 2024-03-30T13:11:10.069 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ceph/Makefile", 2024-03-30T13:11:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628359, 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.555367+0000", 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:35.815880+0000", 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 356, 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:35.815880+0000", 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 356, 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.555367+0000" 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 356, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.555367+0000" 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 166, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 4, 2024-03-30T13:11:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:10.083 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:10.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/499599534 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8f74067fc0 msgr2=0x7f8f7406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8e4f1640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8f74067fc0 0x7f8f7406a480 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f780af000 tx=0x7f8f78008040 comp rx=0 tx=0).stop 2024-03-30T13:11:10.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/499599534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f880b5080 msgr2=0x7f8f88142e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8e4f1640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f880b5080 0x7f8f88142e70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0011f0 tx=0x7f8f7c00c9b0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/499599534 shutdown_connections 2024-03-30T13:11:10.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8e4f1640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8f74067fc0 0x7f8f7406a480 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8e4f1640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f8815b570 0x7f8f8815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8e4f1640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f880b5080 0x7f8f88142e70 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8e4f1640 1 --2- 172.21.15.83:0/499599534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f880aec70 0x7f8f88142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/499599534 >> 172.21.15.83:0/499599534 conn(0x7f8f88072d30 msgr2=0x7f8f880747a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/499599534 shutdown_connections 2024-03-30T13:11:10.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.052+0000 7f8f8e4f1640 1 -- 172.21.15.83:0/499599534 wait complete. 2024-03-30T13:11:10.086 DEBUG:tasks.cephfs.test_uninlining:getting inode info #3 of 23:1099511628365 2024-03-30T13:11:10.086 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628365 2024-03-30T13:11:10.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628365 2024-03-30T13:11:10.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe959cf640 1 Processor -- start 2024-03-30T13:11:10.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe959cf640 1 -- start start 2024-03-30T13:11:10.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe959cf640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe90159ca0 0x7efe900d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe959cf640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900b3de0 0x7efe900b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe959cf640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe900d2000 con 0x7efe9015c870 2024-03-30T13:11:10.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe959cf640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efe9015d610 con 0x7efe90159ca0 2024-03-30T13:11:10.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe959cf640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe900d0fe0 con 0x7efe900b3de0 2024-03-30T13:11:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe8effd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe90159ca0 0x7efe900d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe87fff640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900b3de0 0x7efe900b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe8effd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe90159ca0 0x7efe900d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:46858/0 (socket says 172.21.15.83:46858) 2024-03-30T13:11:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe8effd640 1 -- 172.21.15.83:0/2194960918 learned_addr learned my addr 172.21.15.83:0/2194960918 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe8f7fe640 1 --1- 172.21.15.83:0/2194960918 >> v1:172.21.15.153:6789/0 conn(0x7efe9015c870 0x7efe9015cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:53034/0 (socket says 172.21.15.83:53034) 2024-03-30T13:11:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe8effd640 1 -- 172.21.15.83:0/2194960918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900b3de0 msgr2=0x7efe900b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe8effd640 1 --2- 172.21.15.83:0/2194960918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900b3de0 0x7efe900b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe8effd640 1 -- 172.21.15.83:0/2194960918 >> v1:172.21.15.153:6789/0 conn(0x7efe9015c870 legacy=0x7efe9015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.196+0000 7efe8effd640 1 -- 172.21.15.83:0/2194960918 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe900d12c0 con 0x7efe90159ca0 2024-03-30T13:11:10.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe8effd640 1 --2- 172.21.15.83:0/2194960918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe90159ca0 0x7efe900d1ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efe80009870 tx=0x7efe8001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88e3437b5d3c0c28 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe8e7fc640 1 -- 172.21.15.83:0/2194960918 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800b2070 con 0x7efe90159ca0 2024-03-30T13:11:10.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe8e7fc640 1 -- 172.21.15.83:0/2194960918 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe800a9070 con 0x7efe90159ca0 2024-03-30T13:11:10.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe8e7fc640 1 -- 172.21.15.83:0/2194960918 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800ad880 con 0x7efe90159ca0 2024-03-30T13:11:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 -- 172.21.15.83:0/2194960918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe90159ca0 msgr2=0x7efe900d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 --2- 172.21.15.83:0/2194960918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe90159ca0 0x7efe900d1ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efe80009870 tx=0x7efe8001c560 comp rx=0 tx=0).stop 2024-03-30T13:11:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 -- 172.21.15.83:0/2194960918 shutdown_connections 2024-03-30T13:11:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 --2- 172.21.15.83:0/2194960918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900b3de0 0x7efe900b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 --2- 172.21.15.83:0/2194960918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe90159ca0 0x7efe900d1ac0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 -- 172.21.15.83:0/2194960918 >> 172.21.15.83:0/2194960918 conn(0x7efe900b7670 msgr2=0x7efe900b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 -- 172.21.15.83:0/2194960918 shutdown_connections 2024-03-30T13:11:10.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 -- 172.21.15.83:0/2194960918 wait complete. 2024-03-30T13:11:10.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 Processor -- start 2024-03-30T13:11:10.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 -- start start 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900b3de0 0x7efe9015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe90159ca0 0x7efe901f7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe9015c870 0x7efe901f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efe900b5dd0 con 0x7efe90159ca0 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe9006e780 con 0x7efe9015c870 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.200+0000 7efe959cf640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe900b5f50 con 0x7efe900b3de0 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe90159ca0 0x7efe901f7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe90159ca0 0x7efe901f7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37228/0 (socket says 172.21.15.83:37228) 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe87fff640 1 -- 172.21.15.83:0/2351156770 learned_addr learned my addr 172.21.15.83:0/2351156770 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe8f7fe640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe9015c870 0x7efe901f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe8effd640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900b3de0 0x7efe9015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe87fff640 1 -- 172.21.15.83:0/2351156770 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900b3de0 msgr2=0x7efe9015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe87fff640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900b3de0 0x7efe9015af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe87fff640 1 -- 172.21.15.83:0/2351156770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe9015c870 msgr2=0x7efe901f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe87fff640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe9015c870 0x7efe901f8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe87fff640 1 -- 172.21.15.83:0/2351156770 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9014dbc0 con 0x7efe90159ca0 2024-03-30T13:11:10.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe87fff640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe90159ca0 0x7efe901f7fc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7efe7800e930 tx=0x7efe7800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe8cff9640 1 -- 172.21.15.83:0/2351156770 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78017070 con 0x7efe90159ca0 2024-03-30T13:11:10.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe8cff9640 1 -- 172.21.15.83:0/2351156770 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7800ca00 con 0x7efe90159ca0 2024-03-30T13:11:10.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe8cff9640 1 -- 172.21.15.83:0/2351156770 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7800cdb0 con 0x7efe90159ca0 2024-03-30T13:11:10.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe959cf640 1 -- 172.21.15.83:0/2351156770 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9014dea0 con 0x7efe90159ca0 2024-03-30T13:11:10.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe959cf640 1 -- 172.21.15.83:0/2351156770 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9014e460 con 0x7efe90159ca0 2024-03-30T13:11:10.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe98b51000 1 Processor -- start 2024-03-30T13:11:10.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.204+0000 7efe98b51000 1 -- start start 2024-03-30T13:11:10.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 0x56273c61f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61f690 0x56273c5d52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c5d5830 0x56273c5d5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56273c423aa0 con 0x56273c61ed70 2024-03-30T13:11:10.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56273c3aaaf0 con 0x56273c5d5830 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56273c41fa50 con 0x56273c61f690 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 0x56273c61f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 0x56273c61f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37244/0 (socket says 172.21.15.83:37244) 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8f7fe640 1 -- 172.21.15.83:0/299184448 learned_addr learned my addr 172.21.15.83:0/299184448 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8cff9640 1 -- 172.21.15.83:0/2351156770 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7efe7801a070 con 0x7efe90159ca0 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8f7fe640 1 -- 172.21.15.83:0/299184448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61f690 msgr2=0x56273c5d52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8effd640 1 --2- 172.21.15.83:0/299184448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61f690 0x56273c5d52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8f7fe640 1 --2- 172.21.15.83:0/299184448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61f690 0x56273c5d52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8f7fe640 1 -- 172.21.15.83:0/299184448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c5d5830 msgr2=0x56273c5d5c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8f7fe640 1 --2- 172.21.15.83:0/299184448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c5d5830 0x56273c5d5c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8f7fe640 1 -- 172.21.15.83:0/299184448 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273c3a8d00 con 0x56273c61ed70 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8effd640 1 --2- 172.21.15.83:0/299184448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61f690 0x56273c5d52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8f7fe640 1 --2- 172.21.15.83:0/299184448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 0x56273c61f150 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efe88001b70 tx=0x7efe88002030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19451674a876b865 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe857fa640 1 -- 172.21.15.83:0/299184448 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88007850 con 0x56273c61ed70 2024-03-30T13:11:10.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8cff9640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efe70067fc0 0x7efe7006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe857fa640 1 -- 172.21.15.83:0/299184448 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe88018070 con 0x56273c61ed70 2024-03-30T13:11:10.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe857fa640 1 -- 172.21.15.83:0/299184448 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe880133f0 con 0x56273c61ed70 2024-03-30T13:11:10.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8effd640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efe70067fc0 0x7efe7006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8cff9640 1 -- 172.21.15.83:0/2351156770 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efe78086540 con 0x7efe90159ca0 2024-03-30T13:11:10.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe8effd640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efe70067fc0 0x7efe7006a480 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efe800af000 tx=0x7efe800a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 -- 172.21.15.83:0/299184448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 msgr2=0x56273c61f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 --2- 172.21.15.83:0/299184448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 0x56273c61f150 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efe88001b70 tx=0x7efe88002030 comp rx=0 tx=0).stop 2024-03-30T13:11:10.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 -- 172.21.15.83:0/299184448 shutdown_connections 2024-03-30T13:11:10.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 --2- 172.21.15.83:0/299184448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c5d5830 0x56273c5d5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 --2- 172.21.15.83:0/299184448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61f690 0x56273c5d52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 --2- 172.21.15.83:0/299184448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 0x56273c61f150 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 -- 172.21.15.83:0/299184448 >> 172.21.15.83:0/299184448 conn(0x56273c5d17e0 msgr2=0x56273c5d3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 -- 172.21.15.83:0/299184448 shutdown_connections 2024-03-30T13:11:10.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 -- 172.21.15.83:0/299184448 wait complete. 2024-03-30T13:11:10.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 -- start start 2024-03-30T13:11:10.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.208+0000 7efe98b51000 1 Processor -- start 2024-03-30T13:11:10.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c5d5830 0x56273c5dac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61ed70 0x56273c603da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c61f690 0x56273c6042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56273c3eb270 con 0x56273c5d5830 2024-03-30T13:11:10.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56273c3e16a0 con 0x56273c61f690 2024-03-30T13:11:10.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56273c3bb880 con 0x56273c61ed70 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 10 client.0 _ll_register_callbacks cb 0x56273c5c0490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe8effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c5d5830 0x56273c5dac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe8effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c5d5830 0x56273c5dac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37246/0 (socket says 172.21.15.83:37246) 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe8effd640 1 -- 172.21.15.83:0/1440381597 learned_addr learned my addr 172.21.15.83:0/1440381597 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe87fff640 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61ed70 0x56273c603da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe8f7fe640 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c61f690 0x56273c6042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe8effd640 1 -- 172.21.15.83:0/1440381597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61ed70 msgr2=0x56273c603da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe8effd640 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61ed70 0x56273c603da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe8effd640 1 -- 172.21.15.83:0/1440381597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c61f690 msgr2=0x56273c6042e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe8effd640 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c61f690 0x56273c6042e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe8effd640 1 -- 172.21.15.83:0/1440381597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56273c3e8730 con 0x56273c5d5830 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe8f7fe640 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c61f690 0x56273c6042e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe8effd640 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c5d5830 0x56273c5dac10 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7efe80000c10 tx=0x7efe8001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ea9447ebb32f16 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:10.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe6e7fc640 1 -- 172.21.15.83:0/1440381597 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800b2040 con 0x56273c5d5830 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe6e7fc640 1 -- 172.21.15.83:0/1440381597 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efe800b7640 con 0x56273c5d5830 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 -- 172.21.15.83:0/1440381597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe88018070 con 0x56273c5d5830 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe6e7fc640 1 -- 172.21.15.83:0/1440381597 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7efe800b7840 con 0x56273c5d5830 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 10 client.6015 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 -- 172.21.15.83:0/1440381597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56273c3dbca0 con 0x56273c5d5830 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe6e7fc640 1 -- 172.21.15.83:0/1440381597 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe88018070 con 0x56273c5d5830 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe6e7fc640 1 -- 172.21.15.83:0/1440381597 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7efe800b79e0 con 0x56273c5d5830 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 10 client.6015 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 10 client.6015 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 20 client.6015 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56273c6265d0 0x56273c6269e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 4 client.6015 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 -- 172.21.15.83:0/1440381597 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56273c3bec90 con 0x56273c6265d0 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe87fff640 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56273c6265d0 0x56273c6269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe87fff640 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56273c6265d0 0x56273c6269e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a2acb1e7651bbff server_cookie=8af34902a8b1bc4b in_seq=0 out_seq=0 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe6e7fc640 10 client.6015 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe6e7fc640 1 -- 172.21.15.83:0/1440381597 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x56273c3bec90 con 0x56273c6265d0 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe6e7fc640 10 client.6015 handle_command_reply: tid=0 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 client.6015 shutdown 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 -- 172.21.15.83:0/1440381597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c5d5830 msgr2=0x56273c5dac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c5d5830 0x56273c5dac10 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7efe80000c10 tx=0x7efe8001ada0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 -- 172.21.15.83:0/1440381597 shutdown_connections 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c61f690 0x56273c6042e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61ed70 0x56273c603da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56273c6265d0 0x56273c6269e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 --2- 172.21.15.83:0/1440381597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c5d5830 0x56273c5dac10 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 -- 172.21.15.83:0/1440381597 >> 172.21.15.83:0/1440381597 conn(0x56273c5d17e0 msgr2=0x56273c5d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe6e7fc640 0 client.6015 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 -- 172.21.15.83:0/1440381597 shutdown_connections 2024-03-30T13:11:10.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 1 -- 172.21.15.83:0/1440381597 wait complete. 2024-03-30T13:11:10.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.212+0000 7efe98b51000 20 client.6015 trim_cache size 0 max 16384 2024-03-30T13:11:10.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe98b51000 1 Processor -- start 2024-03-30T13:11:10.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe98b51000 1 -- start start 2024-03-30T13:11:10.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe98b51000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c5d5830 0x56273c602d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe98b51000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 0x56273c603290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe98b51000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61f690 0x56273c6037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe98b51000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efe90203960 con 0x56273c61ed70 2024-03-30T13:11:10.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe98b51000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe90202990 con 0x56273c5d5830 2024-03-30T13:11:10.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe98b51000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe90150510 con 0x56273c61f690 2024-03-30T13:11:10.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 0x56273c603290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 0x56273c603290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37248/0 (socket says 172.21.15.83:37248) 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe87fff640 1 -- 172.21.15.83:0/2376205690 learned_addr learned my addr 172.21.15.83:0/2376205690 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe8effd640 1 --2- 172.21.15.83:0/2376205690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c5d5830 0x56273c602d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe8f7fe640 1 --2- 172.21.15.83:0/2376205690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61f690 0x56273c6037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe87fff640 1 -- 172.21.15.83:0/2376205690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61f690 msgr2=0x56273c6037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe87fff640 1 --2- 172.21.15.83:0/2376205690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61f690 0x56273c6037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe87fff640 1 -- 172.21.15.83:0/2376205690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c5d5830 msgr2=0x56273c602d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe87fff640 1 --2- 172.21.15.83:0/2376205690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c5d5830 0x56273c602d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe87fff640 1 -- 172.21.15.83:0/2376205690 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273c3aad00 con 0x56273c61ed70 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe8effd640 1 --2- 172.21.15.83:0/2376205690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c5d5830 0x56273c602d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.228+0000 7efe87fff640 1 --2- 172.21.15.83:0/2376205690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 0x56273c603290 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efe7805ed60 tx=0x7efe78086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef7447d3b88d5da server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe84ff9640 1 -- 172.21.15.83:0/2376205690 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78083070 con 0x56273c61ed70 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe84ff9640 1 -- 172.21.15.83:0/2376205690 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7805f290 con 0x56273c61ed70 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe84ff9640 1 -- 172.21.15.83:0/2376205690 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78021040 con 0x56273c61ed70 2024-03-30T13:11:10.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 -- 172.21.15.83:0/2376205690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 msgr2=0x56273c603290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 --2- 172.21.15.83:0/2376205690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 0x56273c603290 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efe7805ed60 tx=0x7efe78086040 comp rx=0 tx=0).stop 2024-03-30T13:11:10.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 -- 172.21.15.83:0/2376205690 shutdown_connections 2024-03-30T13:11:10.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 --2- 172.21.15.83:0/2376205690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c61f690 0x56273c6037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 --2- 172.21.15.83:0/2376205690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61ed70 0x56273c603290 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 --2- 172.21.15.83:0/2376205690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c5d5830 0x56273c602d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 -- 172.21.15.83:0/2376205690 >> 172.21.15.83:0/2376205690 conn(0x56273c5d17e0 msgr2=0x56273c6022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 -- 172.21.15.83:0/2376205690 shutdown_connections 2024-03-30T13:11:10.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 -- 172.21.15.83:0/2376205690 wait complete. 2024-03-30T13:11:10.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 -- start start 2024-03-30T13:11:10.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 Processor -- start 2024-03-30T13:11:10.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c5d5830 0x56273c604050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c61ed70 0x56273c622ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61f690 0x56273c623010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56273c422db0 con 0x56273c61f690 2024-03-30T13:11:10.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe90150b60 con 0x56273c61ed70 2024-03-30T13:11:10.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56273c6029c0 con 0x56273c5d5830 2024-03-30T13:11:10.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 10 client.0 _ll_register_callbacks cb 0x7efe78009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:10.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe8f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61f690 0x56273c623010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe8f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61f690 0x56273c623010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37264/0 (socket says 172.21.15.83:37264) 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe8f7fe640 1 -- 172.21.15.83:0/3040078217 learned_addr learned my addr 172.21.15.83:0/3040078217 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe8effd640 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c5d5830 0x56273c604050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe87fff640 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c61ed70 0x56273c622ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe8f7fe640 1 -- 172.21.15.83:0/3040078217 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c5d5830 msgr2=0x56273c604050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe8f7fe640 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c5d5830 0x56273c604050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe8f7fe640 1 -- 172.21.15.83:0/3040078217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c61ed70 msgr2=0x56273c622ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe8f7fe640 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c61ed70 0x56273c622ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe8f7fe640 1 -- 172.21.15.83:0/3040078217 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56273c4a4f70 con 0x56273c61f690 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe8effd640 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c5d5830 0x56273c604050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe8f7fe640 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61f690 0x56273c623010 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7efe88014000 tx=0x7efe88001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3963122248eba3a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe6e7fc640 1 -- 172.21.15.83:0/3040078217 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8801fb60 con 0x56273c61f690 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe6e7fc640 1 -- 172.21.15.83:0/3040078217 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efe88004e00 con 0x56273c61f690 2024-03-30T13:11:10.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 -- 172.21.15.83:0/3040078217 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe7805f290 con 0x56273c61f690 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe6e7fc640 1 -- 172.21.15.83:0/3040078217 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7efe88030050 con 0x56273c61f690 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 10 client.6021 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 -- 172.21.15.83:0/3040078217 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56273c3ca760 con 0x56273c61f690 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe6e7fc640 1 -- 172.21.15.83:0/3040078217 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7805f290 con 0x56273c61f690 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe6e7fc640 1 -- 172.21.15.83:0/3040078217 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7efe88033020 con 0x56273c61f690 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 10 client.6021 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 10 client.6021 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 20 client.6021 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56273c623550 0x56273c690d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 4 client.6021 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628365}] 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe98b51000 1 -- 172.21.15.83:0/3040078217 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628365}) -- 0x56273c430fe0 con 0x56273c623550 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.232+0000 7efe8effd640 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56273c623550 0x56273c690d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe6e7fc640 10 client.6021 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe8effd640 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56273c623550 0x56273c690d50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cbd6da0bddd7fdc server_cookie=d990c8497a5af167 in_seq=0 out_seq=0 2024-03-30T13:11:10.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe6e7fc640 1 -- 172.21.15.83:0/3040078217 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3796 (crc 0 0 0) 0x56273c430fe0 con 0x56273c623550 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe6e7fc640 10 client.6021 handle_command_reply: tid=0 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe98b51000 1 client.6021 shutdown 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe98b51000 1 -- 172.21.15.83:0/3040078217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61f690 msgr2=0x56273c623010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe98b51000 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61f690 0x56273c623010 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7efe88014000 tx=0x7efe88001260 comp rx=0 tx=0).stop 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe98b51000 1 -- 172.21.15.83:0/3040078217 shutdown_connections 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe98b51000 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56273c623550 0x56273c690d50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe6e7fc640 0 client.6021 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe98b51000 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56273c61f690 0x56273c623010 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe98b51000 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56273c61ed70 0x56273c622ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe98b51000 1 --2- 172.21.15.83:0/3040078217 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56273c5d5830 0x56273c604050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe98b51000 1 -- 172.21.15.83:0/3040078217 >> 172.21.15.83:0/3040078217 conn(0x56273c5d17e0 msgr2=0x56273c635680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe98b51000 1 -- 172.21.15.83:0/3040078217 shutdown_connections 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe98b51000 1 -- 172.21.15.83:0/3040078217 wait complete. 2024-03-30T13:11:10.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe98b51000 20 client.6021 trim_cache size 0 max 16384 2024-03-30T13:11:10.249 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ceph/ceph_frag.c", 2024-03-30T13:11:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628365, 2024-03-30T13:11:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.576038+0000", 2024-03-30T13:11:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:35.844879+0000", 2024-03-30T13:11:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:10.250 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:10.250 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:10.250 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:10.250 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:10.250 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.250 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 401, 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:35.844879+0000", 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:10.252 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 401, 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.576038+0000" 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.253 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 401, 2024-03-30T13:11:10.254 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:10.254 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:10.254 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:10.254 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.576038+0000" 2024-03-30T13:11:10.254 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.254 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 168, 2024-03-30T13:11:10.254 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:10.254 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:10.254 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 16, 2024-03-30T13:11:10.254 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:10.254 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:10.254 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.255 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:10.257 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:10.258 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.258 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:10.258 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:10.258 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.258 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.258 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:10.258 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.258 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.258 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.258 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.258 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.258 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.259 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.260 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.261 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.261 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.261 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:10.261 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:10.261 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:10.261 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:10.261 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:10.261 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.261 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:10.261 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:10.261 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:10.261 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:10.262 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:10.262 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:10.262 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:10.262 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:10.262 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.262 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:10.262 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:10.262 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:10.262 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:10.262 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:10.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe959cf640 1 -- 172.21.15.83:0/2351156770 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efe70067fc0 msgr2=0x7efe7006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe959cf640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efe70067fc0 0x7efe7006a480 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efe800af000 tx=0x7efe800a7000 comp rx=0 tx=0).stop 2024-03-30T13:11:10.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe959cf640 1 -- 172.21.15.83:0/2351156770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe90159ca0 msgr2=0x7efe901f7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe959cf640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe90159ca0 0x7efe901f7fc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7efe7800e930 tx=0x7efe7800edf0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe959cf640 1 -- 172.21.15.83:0/2351156770 shutdown_connections 2024-03-30T13:11:10.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe959cf640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efe70067fc0 0x7efe7006a480 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe959cf640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe9015c870 0x7efe901f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe959cf640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe90159ca0 0x7efe901f7fc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe959cf640 1 --2- 172.21.15.83:0/2351156770 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900b3de0 0x7efe9015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe959cf640 1 -- 172.21.15.83:0/2351156770 >> 172.21.15.83:0/2351156770 conn(0x7efe900b7670 msgr2=0x7efe9006f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe959cf640 1 -- 172.21.15.83:0/2351156770 shutdown_connections 2024-03-30T13:11:10.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.236+0000 7efe959cf640 1 -- 172.21.15.83:0/2351156770 wait complete. 2024-03-30T13:11:10.266 DEBUG:tasks.cephfs.test_uninlining:getting inode info #4 of 23:1099511628372 2024-03-30T13:11:10.266 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628372 2024-03-30T13:11:10.266 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628372 2024-03-30T13:11:10.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c72748640 1 Processor -- start 2024-03-30T13:11:10.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c72748640 1 -- start start 2024-03-30T13:11:10.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c72748640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6c6c0b0080 0x7f6c6c0b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c72748640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c15da30 0x7f6c6c06e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c72748640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c6c070720 con 0x7f6c6c0b6340 2024-03-30T13:11:10.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c72748640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6c6c0b67a0 con 0x7f6c6c0b0080 2024-03-30T13:11:10.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c72748640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6c06fb10 con 0x7f6c6c15da30 2024-03-30T13:11:10.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c70ce5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c15da30 0x7f6c6c06e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c70ce5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c15da30 0x7f6c6c06e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:34140/0 (socket says 172.21.15.83:34140) 2024-03-30T13:11:10.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c6bfff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6c6c0b0080 0x7f6c6c0b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c70ce5640 1 -- 172.21.15.83:0/1986009866 learned_addr learned my addr 172.21.15.83:0/1986009866 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c6bfff640 1 -- 172.21.15.83:0/1986009866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c15da30 msgr2=0x7f6c6c06e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/1986009866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c15da30 0x7f6c6c06e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c6bfff640 1 -- 172.21.15.83:0/1986009866 >> v1:172.21.15.153:6789/0 conn(0x7f6c6c0b6340 legacy=0x7f6c6c15d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c6bfff640 1 -- 172.21.15.83:0/1986009866 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c06fdf0 con 0x7f6c6c0b0080 2024-03-30T13:11:10.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.376+0000 7f6c70ce5640 1 --2- 172.21.15.83:0/1986009866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c15da30 0x7f6c6c06e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:10.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.380+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/1986009866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c6c0b0080 0x7f6c6c0b5e00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6c540097c0 tx=0x7f6c5401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c431165dd4a87b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.380+0000 7f6c6affd640 1 -- 172.21.15.83:0/1986009866 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c540a7070 con 0x7f6c6c0b0080 2024-03-30T13:11:10.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.380+0000 7f6c6affd640 1 -- 172.21.15.83:0/1986009866 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c540b0070 con 0x7f6c6c0b0080 2024-03-30T13:11:10.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.380+0000 7f6c6affd640 1 -- 172.21.15.83:0/1986009866 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c540ab890 con 0x7f6c6c0b0080 2024-03-30T13:11:10.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.380+0000 7f6c72748640 1 -- 172.21.15.83:0/1986009866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c6c0b0080 msgr2=0x7f6c6c0b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.380+0000 7f6c72748640 1 --2- 172.21.15.83:0/1986009866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c6c0b0080 0x7f6c6c0b5e00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6c540097c0 tx=0x7f6c5401c470 comp rx=0 tx=0).stop 2024-03-30T13:11:10.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.380+0000 7f6c72748640 1 -- 172.21.15.83:0/1986009866 shutdown_connections 2024-03-30T13:11:10.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.380+0000 7f6c72748640 1 --2- 172.21.15.83:0/1986009866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c15da30 0x7f6c6c06e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.380+0000 7f6c72748640 1 --2- 172.21.15.83:0/1986009866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c6c0b0080 0x7f6c6c0b5e00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.380+0000 7f6c72748640 1 -- 172.21.15.83:0/1986009866 >> 172.21.15.83:0/1986009866 conn(0x7f6c6c072f00 msgr2=0x7f6c6c06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.380+0000 7f6c72748640 1 -- 172.21.15.83:0/1986009866 shutdown_connections 2024-03-30T13:11:10.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.380+0000 7f6c72748640 1 -- 172.21.15.83:0/1986009866 wait complete. 2024-03-30T13:11:10.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c72748640 1 Processor -- start 2024-03-30T13:11:10.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c72748640 1 -- start start 2024-03-30T13:11:10.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c72748640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c0b0080 0x7f6c6c152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c72748640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c6c0b6340 0x7f6c6c0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c72748640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c6c15da30 0x7f6c6c15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c72748640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c15cbb0 con 0x7f6c6c15da30 2024-03-30T13:11:10.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c72748640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c15de40 con 0x7f6c6c0b6340 2024-03-30T13:11:10.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c72748640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6c15cd30 con 0x7f6c6c0b0080 2024-03-30T13:11:10.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c70ce5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c6c15da30 0x7f6c6c15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c70ce5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c6c15da30 0x7f6c6c15b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37266/0 (socket says 172.21.15.83:37266) 2024-03-30T13:11:10.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c70ce5640 1 -- 172.21.15.83:0/2659623668 learned_addr learned my addr 172.21.15.83:0/2659623668 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c0b0080 0x7f6c6c152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c6b7fe640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c6c0b6340 0x7f6c6c0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c70ce5640 1 -- 172.21.15.83:0/2659623668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c0b0080 msgr2=0x7f6c6c152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c70ce5640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c0b0080 0x7f6c6c152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c70ce5640 1 -- 172.21.15.83:0/2659623668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c6c0b6340 msgr2=0x7f6c6c0b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c70ce5640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c6c0b6340 0x7f6c6c0b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c70ce5640 1 -- 172.21.15.83:0/2659623668 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c0b5e10 con 0x7f6c6c15da30 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c6b7fe640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c6c0b6340 0x7f6c6c0b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c0b0080 0x7f6c6c152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c70ce5640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c6c15da30 0x7f6c6c15b3c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400efc0 tx=0x7f6c6400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c68ff9640 1 -- 172.21.15.83:0/2659623668 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6400cbe0 con 0x7f6c6c15da30 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c68ff9640 1 -- 172.21.15.83:0/2659623668 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6400cd80 con 0x7f6c6c15da30 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c68ff9640 1 -- 172.21.15.83:0/2659623668 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64003bc0 con 0x7f6c6c15da30 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c72748640 1 -- 172.21.15.83:0/2659623668 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6c152fc0 con 0x7f6c6c15da30 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.384+0000 7f6c72748640 1 -- 172.21.15.83:0/2659623668 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6c153580 con 0x7f6c6c15da30 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c68ff9640 1 -- 172.21.15.83:0/2659623668 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6c6401b030 con 0x7f6c6c15da30 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c68ff9640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c4c067fc0 0x7f6c4c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 Processor -- start 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 -- start start 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c4c067fc0 0x7f6c4c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c68ff9640 1 -- 172.21.15.83:0/2659623668 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c640869b0 con 0x7f6c6c15da30 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c4c067fc0 0x7f6c4c06a480 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6c540af000 tx=0x7f6c540a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a56742150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 0x555a566f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a566f8830 0x555a566f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555a56546aa0 con 0x555a56742690 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555a564cdaf0 con 0x555a56741d70 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x555a56542a50 con 0x555a566f8830 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c6b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 0x555a566f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c6b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 0x555a566f82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37282/0 (socket says 172.21.15.83:37282) 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c6b7fe640 1 -- 172.21.15.83:0/184510529 learned_addr learned my addr 172.21.15.83:0/184510529 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/184510529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a56742150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c70ce5640 1 --2- 172.21.15.83:0/184510529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a566f8830 0x555a566f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c6b7fe640 1 -- 172.21.15.83:0/184510529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a566f8830 msgr2=0x555a566f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c6b7fe640 1 --2- 172.21.15.83:0/184510529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a566f8830 0x555a566f8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c6b7fe640 1 -- 172.21.15.83:0/184510529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 msgr2=0x555a56742150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c6b7fe640 1 --2- 172.21.15.83:0/184510529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a56742150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c6b7fe640 1 -- 172.21.15.83:0/184510529 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a564cbd00 con 0x555a56742690 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c6b7fe640 1 --2- 172.21.15.83:0/184510529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 0x555a566f82f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c001570 tx=0x7f6c5c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa6f6a1167957e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c61ffb640 1 -- 172.21.15.83:0/184510529 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c019070 con 0x555a56742690 2024-03-30T13:11:10.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c61ffb640 1 -- 172.21.15.83:0/184510529 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c5c0050d0 con 0x555a56742690 2024-03-30T13:11:10.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c61ffb640 1 -- 172.21.15.83:0/184510529 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0054a0 con 0x555a56742690 2024-03-30T13:11:10.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 -- 172.21.15.83:0/184510529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 msgr2=0x555a566f82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 --2- 172.21.15.83:0/184510529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 0x555a566f82f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c001570 tx=0x7f6c5c001a30 comp rx=0 tx=0).stop 2024-03-30T13:11:10.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 -- 172.21.15.83:0/184510529 shutdown_connections 2024-03-30T13:11:10.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 --2- 172.21.15.83:0/184510529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a566f8830 0x555a566f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 --2- 172.21.15.83:0/184510529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 0x555a566f82f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 --2- 172.21.15.83:0/184510529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a56742150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 -- 172.21.15.83:0/184510529 >> 172.21.15.83:0/184510529 conn(0x555a566f47e0 msgr2=0x555a566f6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 -- 172.21.15.83:0/184510529 shutdown_connections 2024-03-30T13:11:10.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.388+0000 7f6c758ca000 1 -- 172.21.15.83:0/184510529 wait complete. 2024-03-30T13:11:10.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 1 -- start start 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 1 Processor -- start 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 0x555a566fdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a56726da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56742690 0x555a567272e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555a5650e270 con 0x555a566f8830 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555a565046a0 con 0x555a56741d70 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x555a564de880 con 0x555a56742690 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 10 client.0 _ll_register_callbacks cb 0x555a566e3490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 0x555a566fdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 0x555a566fdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37292/0 (socket says 172.21.15.83:37292) 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6bfff640 1 -- 172.21.15.83:0/2008744216 learned_addr learned my addr 172.21.15.83:0/2008744216 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6b7fe640 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a56726da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6bfff640 1 -- 172.21.15.83:0/2008744216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56742690 msgr2=0x555a567272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56742690 0x555a567272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6bfff640 1 -- 172.21.15.83:0/2008744216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 msgr2=0x555a56726da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a56726da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6bfff640 1 -- 172.21.15.83:0/2008744216 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a5650b730 con 0x555a566f8830 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6b7fe640 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a56726da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 0x555a566fdc80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6c5401ab20 tx=0x7f6c5401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124d34fbcc6e9945 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c4affd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c4affd640 1 -- 172.21.15.83:0/2008744216 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c540cd060 con 0x555a566f8830 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c4affd640 1 -- 172.21.15.83:0/2008744216 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c540bf9d0 con 0x555a566f8830 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 1 -- 172.21.15.83:0/2008744216 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c5c0050d0 con 0x555a566f8830 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c4affd640 1 -- 172.21.15.83:0/2008744216 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f6c540d3050 con 0x555a566f8830 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 10 client.6030 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 1 -- 172.21.15.83:0/2008744216 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x555a564feca0 con 0x555a566f8830 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c4affd640 1 -- 172.21.15.83:0/2008744216 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c5c0050d0 con 0x555a566f8830 2024-03-30T13:11:10.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c4affd640 1 -- 172.21.15.83:0/2008744216 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f6c540d6020 con 0x555a566f8830 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 10 client.6030 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 10 client.6030 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 20 client.6030 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555a567495d0 0x555a567499b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 4 client.6030 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c758ca000 1 -- 172.21.15.83:0/2008744216 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a564e1c90 con 0x555a567495d0 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6b7fe640 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555a567495d0 0x555a567499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c6b7fe640 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555a567495d0 0x555a567499b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6963e56e954991ca server_cookie=76d0d18cb3997be1 in_seq=0 out_seq=0 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.392+0000 7f6c4affd640 10 client.6030 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c4affd640 1 -- 172.21.15.83:0/2008744216 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x555a564e1c90 con 0x555a567495d0 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c4affd640 10 client.6030 handle_command_reply: tid=0 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c758ca000 1 client.6030 shutdown 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c758ca000 1 -- 172.21.15.83:0/2008744216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 msgr2=0x555a566fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c758ca000 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 0x555a566fdc80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6c5401ab20 tx=0x7f6c5401acb0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c758ca000 1 -- 172.21.15.83:0/2008744216 shutdown_connections 2024-03-30T13:11:10.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c758ca000 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56742690 0x555a567272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c758ca000 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a56726da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c758ca000 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555a567495d0 0x555a567499b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c758ca000 1 --2- 172.21.15.83:0/2008744216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 0x555a566fdc80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c4affd640 0 client.6030 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c758ca000 1 -- 172.21.15.83:0/2008744216 >> 172.21.15.83:0/2008744216 conn(0x555a566f47e0 msgr2=0x555a566f7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c758ca000 1 -- 172.21.15.83:0/2008744216 shutdown_connections 2024-03-30T13:11:10.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c758ca000 1 -- 172.21.15.83:0/2008744216 wait complete. 2024-03-30T13:11:10.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.396+0000 7f6c758ca000 20 client.6030 trim_cache size 0 max 16384 2024-03-30T13:11:10.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c758ca000 1 Processor -- start 2024-03-30T13:11:10.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c758ca000 1 -- start start 2024-03-30T13:11:10.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c758ca000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 0x555a56727180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c758ca000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a566f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c758ca000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56742690 0x555a566f7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c758ca000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c203a50 con 0x555a566f8830 2024-03-30T13:11:10.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c758ca000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c202a70 con 0x555a56741d70 2024-03-30T13:11:10.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c758ca000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6c201e60 con 0x555a56742690 2024-03-30T13:11:10.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c6bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 0x555a56727180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c6bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 0x555a56727180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37308/0 (socket says 172.21.15.83:37308) 2024-03-30T13:11:10.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c6bfff640 1 -- 172.21.15.83:0/438107256 learned_addr learned my addr 172.21.15.83:0/438107256 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c70ce5640 1 --2- 172.21.15.83:0/438107256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56742690 0x555a566f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c6b7fe640 1 --2- 172.21.15.83:0/438107256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a566f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c6bfff640 1 -- 172.21.15.83:0/438107256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56742690 msgr2=0x555a566f7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/438107256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56742690 0x555a566f7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c6bfff640 1 -- 172.21.15.83:0/438107256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 msgr2=0x555a566f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/438107256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a566f6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c6bfff640 1 -- 172.21.15.83:0/438107256 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a564cdd00 con 0x555a566f8830 2024-03-30T13:11:10.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.424+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/438107256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 0x555a56727180 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6c54019080 tx=0x7f6c540c4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986a1cb9db61e3a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c617fa640 1 -- 172.21.15.83:0/438107256 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c540dc070 con 0x555a566f8830 2024-03-30T13:11:10.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c617fa640 1 -- 172.21.15.83:0/438107256 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c540b0040 con 0x555a566f8830 2024-03-30T13:11:10.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c617fa640 1 -- 172.21.15.83:0/438107256 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c540bb070 con 0x555a566f8830 2024-03-30T13:11:10.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 -- 172.21.15.83:0/438107256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 msgr2=0x555a56727180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 --2- 172.21.15.83:0/438107256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 0x555a56727180 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6c54019080 tx=0x7f6c540c4000 comp rx=0 tx=0).stop 2024-03-30T13:11:10.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 -- 172.21.15.83:0/438107256 shutdown_connections 2024-03-30T13:11:10.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 --2- 172.21.15.83:0/438107256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56742690 0x555a566f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 --2- 172.21.15.83:0/438107256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a56741d70 0x555a566f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 --2- 172.21.15.83:0/438107256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a566f8830 0x555a56727180 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 -- 172.21.15.83:0/438107256 >> 172.21.15.83:0/438107256 conn(0x555a566f47e0 msgr2=0x555a56758f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 -- 172.21.15.83:0/438107256 shutdown_connections 2024-03-30T13:11:10.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 -- 172.21.15.83:0/438107256 wait complete. 2024-03-30T13:11:10.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 -- start start 2024-03-30T13:11:10.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 Processor -- start 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a566f8830 0x555a567b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56741d70 0x555a567b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 0x555a56745ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555a56545db0 con 0x555a56742690 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c202420 con 0x555a566f8830 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x555a56602b00 con 0x555a56741d70 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c758ca000 10 client.0 _ll_register_callbacks cb 0x7f6c640096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c70ce5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 0x555a56745ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c70ce5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 0x555a56745ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37312/0 (socket says 172.21.15.83:37312) 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c70ce5640 1 -- 172.21.15.83:0/1701300922 learned_addr learned my addr 172.21.15.83:0/1701300922 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a566f8830 0x555a567b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c6b7fe640 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56741d70 0x555a567b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c70ce5640 1 -- 172.21.15.83:0/1701300922 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56741d70 msgr2=0x555a567b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c70ce5640 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56741d70 0x555a567b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c70ce5640 1 -- 172.21.15.83:0/1701300922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a566f8830 msgr2=0x555a567b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c70ce5640 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a566f8830 0x555a567b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c70ce5640 1 -- 172.21.15.83:0/1701300922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a565c7f70 con 0x555a56742690 2024-03-30T13:11:10.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c70ce5640 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 0x555a56745ad0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400c990 tx=0x7f6c64015e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1864bed09b39a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.428+0000 7f6c4affd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:10.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c4affd640 1 -- 172.21.15.83:0/1701300922 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64008030 con 0x555a56742690 2024-03-30T13:11:10.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 -- 172.21.15.83:0/1701300922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c540b0040 con 0x555a56742690 2024-03-30T13:11:10.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c4affd640 1 -- 172.21.15.83:0/1701300922 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c6405d0b0 con 0x555a56742690 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c4affd640 1 -- 172.21.15.83:0/1701300922 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f6c64056a50 con 0x555a56742690 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 10 client.6036 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 -- 172.21.15.83:0/1701300922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x555a564ed760 con 0x555a56742690 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c4affd640 1 -- 172.21.15.83:0/1701300922 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c540b0040 con 0x555a56742690 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c4affd640 1 -- 172.21.15.83:0/1701300922 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f6c64055ea0 con 0x555a56742690 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 10 client.6036 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 10 client.6036 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 20 client.6036 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555a56746830 0x555a56746c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 4 client.6036 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628372}] 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 -- 172.21.15.83:0/1701300922 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628372}) -- 0x555a56553fe0 con 0x555a56746830 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555a56746830 0x555a56746c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c4affd640 10 client.6036 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c6bfff640 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555a56746830 0x555a56746c40 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27e72120cec3e11f server_cookie=bb29a8c7eb6beefc in_seq=0 out_seq=0 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c4affd640 1 -- 172.21.15.83:0/1701300922 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3789 (crc 0 0 0) 0x555a56553fe0 con 0x555a56746830 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c4affd640 10 client.6036 handle_command_reply: tid=0 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 client.6036 shutdown 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 -- 172.21.15.83:0/1701300922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 msgr2=0x555a56745ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 0x555a56745ad0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400c990 tx=0x7f6c64015e20 comp rx=0 tx=0).stop 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 -- 172.21.15.83:0/1701300922 shutdown_connections 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x555a56746830 0x555a56746c40 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555a56742690 0x555a56745ad0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x555a56741d70 0x555a567b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 --2- 172.21.15.83:0/1701300922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555a566f8830 0x555a567b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c4affd640 0 client.6036 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 -- 172.21.15.83:0/1701300922 >> 172.21.15.83:0/1701300922 conn(0x555a566f47e0 msgr2=0x555a56759620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 -- 172.21.15.83:0/1701300922 shutdown_connections 2024-03-30T13:11:10.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 1 -- 172.21.15.83:0/1701300922 wait complete. 2024-03-30T13:11:10.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c758ca000 20 client.6036 trim_cache size 0 max 16384 2024-03-30T13:11:10.446 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:10.446 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ceph/io.h", 2024-03-30T13:11:10.446 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628372, 2024-03-30T13:11:10.446 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:10.446 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.579456+0000", 2024-03-30T13:11:10.446 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:35.881916+0000", 2024-03-30T13:11:10.446 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:10.446 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:10.447 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:10.447 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:10.447 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:10.447 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:10.447 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:10.447 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:10.447 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:10.447 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.447 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:10.447 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:10.447 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:10.447 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:10.448 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:10.448 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:10.448 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.448 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:10.448 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 387, 2024-03-30T13:11:10.448 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:10.448 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:10.448 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:10.448 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:10.448 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:10.448 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:35.881916+0000", 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:10.449 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 387, 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.579456+0000" 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 387, 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:10.450 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.579456+0000" 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 170, 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 30, 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:10.452 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:10.453 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.454 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.455 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.456 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:10.457 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:10.458 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.458 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:10.458 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:10.458 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:10.458 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:10.458 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c72748640 1 -- 172.21.15.83:0/2659623668 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c4c067fc0 msgr2=0x7f6c4c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c72748640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c4c067fc0 0x7f6c4c06a480 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6c540af000 tx=0x7f6c540a7000 comp rx=0 tx=0).stop 2024-03-30T13:11:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c72748640 1 -- 172.21.15.83:0/2659623668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c6c15da30 msgr2=0x7f6c6c15b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c72748640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c6c15da30 0x7f6c6c15b3c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400efc0 tx=0x7f6c6400c490 comp rx=0 tx=0).stop 2024-03-30T13:11:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c72748640 1 -- 172.21.15.83:0/2659623668 shutdown_connections 2024-03-30T13:11:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c72748640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c4c067fc0 0x7f6c4c06a480 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c72748640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c6c15da30 0x7f6c6c15b3c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c72748640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c6c0b6340 0x7f6c6c0b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.432+0000 7f6c72748640 1 --2- 172.21.15.83:0/2659623668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c6c0b0080 0x7f6c6c152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.436+0000 7f6c72748640 1 -- 172.21.15.83:0/2659623668 >> 172.21.15.83:0/2659623668 conn(0x7f6c6c072f00 msgr2=0x7f6c6c0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.436+0000 7f6c72748640 1 -- 172.21.15.83:0/2659623668 shutdown_connections 2024-03-30T13:11:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.436+0000 7f6c72748640 1 -- 172.21.15.83:0/2659623668 wait complete. 2024-03-30T13:11:10.461 DEBUG:tasks.cephfs.test_uninlining:getting inode info #5 of 23:1099511628374 2024-03-30T13:11:10.461 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628374 2024-03-30T13:11:10.461 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628374 2024-03-30T13:11:10.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.564+0000 7f38068b6640 1 Processor -- start 2024-03-30T13:11:10.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.564+0000 7f38068b6640 1 -- start start 2024-03-30T13:11:10.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f38068b6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f380015b3e0 0x7f38000ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f38068b6640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f38000b5300 0x7f380006ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f38068b6640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38000af010 con 0x7f38000b0560 2024-03-30T13:11:10.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f38068b6640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f38000b01a0 con 0x7f38000b5300 2024-03-30T13:11:10.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f38068b6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38000af2f0 con 0x7f380015b3e0 2024-03-30T13:11:10.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f3804e53640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f38000b5300 0x7f380006ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f37ff7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f38000b0560 0x7f38000b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57420/0 (socket says 172.21.15.83:57420) 2024-03-30T13:11:10.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f37ff7fe640 1 -- 172.21.15.83:0/4140884699 learned_addr learned my addr 172.21.15.83:0/4140884699 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:10.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f37feffd640 1 -- 172.21.15.83:0/4140884699 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3856312304 0 0) 0x7f38000af010 con 0x7f38000b0560 2024-03-30T13:11:10.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f37fffff640 1 --2- 172.21.15.83:0/4140884699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f380015b3e0 0x7f38000ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f37feffd640 1 -- 172.21.15.83:0/4140884699 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37e8003530 con 0x7f38000b0560 2024-03-30T13:11:10.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f3804e53640 1 -- 172.21.15.83:0/4140884699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f380015b3e0 msgr2=0x7f38000ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f3804e53640 1 --2- 172.21.15.83:0/4140884699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f380015b3e0 0x7f38000ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f3804e53640 1 -- 172.21.15.83:0/4140884699 >> v1:172.21.15.83:6789/0 conn(0x7f38000b0560 legacy=0x7f38000b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f3804e53640 1 -- 172.21.15.83:0/4140884699 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38000af5d0 con 0x7f38000b5300 2024-03-30T13:11:10.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f3804e53640 1 --2- 172.21.15.83:0/4140884699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000b5300 0x7f380006ec10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009d90 tx=0x7f37f801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00e3f278e722949 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f37feffd640 1 -- 172.21.15.83:0/4140884699 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80b2070 con 0x7f38000b5300 2024-03-30T13:11:10.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f37feffd640 1 -- 172.21.15.83:0/4140884699 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f80a5940 con 0x7f38000b5300 2024-03-30T13:11:10.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.568+0000 7f37feffd640 1 -- 172.21.15.83:0/4140884699 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80a5d10 con 0x7f38000b5300 2024-03-30T13:11:10.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 -- 172.21.15.83:0/4140884699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000b5300 msgr2=0x7f380006ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 --2- 172.21.15.83:0/4140884699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000b5300 0x7f380006ec10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009d90 tx=0x7f37f801c8e0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 -- 172.21.15.83:0/4140884699 shutdown_connections 2024-03-30T13:11:10.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 --2- 172.21.15.83:0/4140884699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000b5300 0x7f380006ec10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 --2- 172.21.15.83:0/4140884699 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f380015b3e0 0x7f38000ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 -- 172.21.15.83:0/4140884699 >> 172.21.15.83:0/4140884699 conn(0x7f38000b6600 msgr2=0x7f38000b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 -- 172.21.15.83:0/4140884699 shutdown_connections 2024-03-30T13:11:10.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 -- 172.21.15.83:0/4140884699 wait complete. 2024-03-30T13:11:10.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 Processor -- start 2024-03-30T13:11:10.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 -- start start 2024-03-30T13:11:10.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000b0560 0x7f3800163d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38000b5300 0x7f3800151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f380015b3e0 0x7f38001fab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f380006fae0 con 0x7f38000b0560 2024-03-30T13:11:10.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f380006f960 con 0x7f38000b5300 2024-03-30T13:11:10.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f380006fc60 con 0x7f380015b3e0 2024-03-30T13:11:10.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f37fffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000b0560 0x7f3800163d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f37fffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000b0560 0x7f3800163d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37318/0 (socket says 172.21.15.83:37318) 2024-03-30T13:11:10.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f37fffff640 1 -- 172.21.15.83:0/199961485 learned_addr learned my addr 172.21.15.83:0/199961485 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f37fffff640 1 -- 172.21.15.83:0/199961485 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f380015b3e0 msgr2=0x7f38001fab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f37fffff640 1 --2- 172.21.15.83:0/199961485 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f380015b3e0 0x7f38001fab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f37fffff640 1 -- 172.21.15.83:0/199961485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38000b5300 msgr2=0x7f3800151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f37fffff640 1 --2- 172.21.15.83:0/199961485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38000b5300 0x7f3800151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f37fffff640 1 -- 172.21.15.83:0/199961485 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38001645a0 con 0x7f38000b0560 2024-03-30T13:11:10.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f37fffff640 1 --2- 172.21.15.83:0/199961485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000b0560 0x7f3800163d50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f37f000d5f0 tx=0x7f37f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f37fcff9640 1 -- 172.21.15.83:0/199961485 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f00125f0 con 0x7f38000b0560 2024-03-30T13:11:10.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f37fcff9640 1 -- 172.21.15.83:0/199961485 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f0019070 con 0x7f38000b0560 2024-03-30T13:11:10.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 -- 172.21.15.83:0/199961485 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38000b2d00 con 0x7f38000b0560 2024-03-30T13:11:10.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f37fcff9640 1 -- 172.21.15.83:0/199961485 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f00129b0 con 0x7f38000b0560 2024-03-30T13:11:10.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.572+0000 7f38068b6640 1 -- 172.21.15.83:0/199961485 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3800164290 con 0x7f38000b0560 2024-03-30T13:11:10.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f37fcff9640 1 -- 172.21.15.83:0/199961485 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f37f0012b50 con 0x7f38000b0560 2024-03-30T13:11:10.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f37fcff9640 1 --2- 172.21.15.83:0/199961485 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f37ec067fc0 0x7f37ec06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f37fcff9640 1 -- 172.21.15.83:0/199961485 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f37f00868b0 con 0x7f38000b0560 2024-03-30T13:11:10.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f37ff7fe640 1 --2- 172.21.15.83:0/199961485 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f37ec067fc0 0x7f37ec06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f37ff7fe640 1 --2- 172.21.15.83:0/199961485 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f37ec067fc0 0x7f37ec06a480 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f37f4007fd0 tx=0x7f37f4007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f3809a38000 1 Processor -- start 2024-03-30T13:11:10.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f3809a38000 1 -- start start 2024-03-30T13:11:10.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f3809a38000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 0x55f6b2389150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f3809a38000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b233f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f3809a38000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b233fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f3809a38000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f6b218daa0 con 0x55f6b233f830 2024-03-30T13:11:10.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f3809a38000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f6b2114af0 con 0x55f6b2389690 2024-03-30T13:11:10.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.576+0000 7f3809a38000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f6b2189a50 con 0x55f6b2388d70 2024-03-30T13:11:10.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3804e53640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b233fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3804e53640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b233fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37334/0 (socket says 172.21.15.83:37334) 2024-03-30T13:11:10.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3804e53640 1 -- 172.21.15.83:0/475529849 learned_addr learned my addr 172.21.15.83:0/475529849 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f37ff7fe640 1 --2- 172.21.15.83:0/475529849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b233f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f37fffff640 1 --2- 172.21.15.83:0/475529849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 0x55f6b2389150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3804e53640 1 -- 172.21.15.83:0/475529849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 msgr2=0x55f6b2389150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3804e53640 1 --2- 172.21.15.83:0/475529849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 0x55f6b2389150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3804e53640 1 -- 172.21.15.83:0/475529849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 msgr2=0x55f6b233f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3804e53640 1 --2- 172.21.15.83:0/475529849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b233f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3804e53640 1 -- 172.21.15.83:0/475529849 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6b2112d00 con 0x55f6b233f830 2024-03-30T13:11:10.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3804e53640 1 --2- 172.21.15.83:0/475529849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b233fc10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f37f80b0040 tx=0x7f37f8004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfd1504c2ecc38e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f37e5ffb640 1 -- 172.21.15.83:0/475529849 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80b2040 con 0x55f6b233f830 2024-03-30T13:11:10.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f37e5ffb640 1 -- 172.21.15.83:0/475529849 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f80be070 con 0x55f6b233f830 2024-03-30T13:11:10.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f37e5ffb640 1 -- 172.21.15.83:0/475529849 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80a5bc0 con 0x55f6b233f830 2024-03-30T13:11:10.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3809a38000 1 -- 172.21.15.83:0/475529849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 msgr2=0x55f6b233fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3809a38000 1 --2- 172.21.15.83:0/475529849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b233fc10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f37f80b0040 tx=0x7f37f8004a50 comp rx=0 tx=0).stop 2024-03-30T13:11:10.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3809a38000 1 -- 172.21.15.83:0/475529849 shutdown_connections 2024-03-30T13:11:10.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3809a38000 1 --2- 172.21.15.83:0/475529849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b233fc10 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3809a38000 1 --2- 172.21.15.83:0/475529849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b233f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3809a38000 1 --2- 172.21.15.83:0/475529849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 0x55f6b2389150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3809a38000 1 -- 172.21.15.83:0/475529849 >> 172.21.15.83:0/475529849 conn(0x55f6b233b7e0 msgr2=0x55f6b233dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3809a38000 1 -- 172.21.15.83:0/475529849 shutdown_connections 2024-03-30T13:11:10.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3809a38000 1 -- 172.21.15.83:0/475529849 wait complete. 2024-03-30T13:11:10.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3809a38000 1 -- start start 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.580+0000 7f3809a38000 1 Processor -- start 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b2344c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 0x55f6b236dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b236e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f6b2155270 con 0x55f6b233f830 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f6b214b6a0 con 0x55f6b2389690 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f6b2125880 con 0x55f6b2388d70 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37fffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b2344c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 10 client.0 _ll_register_callbacks cb 0x55f6b232a490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37fffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b2344c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37342/0 (socket says 172.21.15.83:37342) 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37fffff640 1 -- 172.21.15.83:0/24470965 learned_addr learned my addr 172.21.15.83:0/24470965 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3804e53640 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b236e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37ff7fe640 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 0x55f6b236dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37fffff640 1 -- 172.21.15.83:0/24470965 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 msgr2=0x55f6b236dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37fffff640 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 0x55f6b236dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37fffff640 1 -- 172.21.15.83:0/24470965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 msgr2=0x55f6b236e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37fffff640 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b236e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37fffff640 1 -- 172.21.15.83:0/24470965 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6b2152730 con 0x55f6b233f830 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3804e53640 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b236e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37deffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37fffff640 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b2344c10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f37f000d5c0 tx=0x7f37f0052d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de5c111963820a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37deffd640 1 -- 172.21.15.83:0/24470965 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f0083060 con 0x55f6b233f830 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37deffd640 1 -- 172.21.15.83:0/24470965 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f37f0053060 con 0x55f6b233f830 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 -- 172.21.15.83:0/24470965 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37f80be070 con 0x55f6b233f830 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37deffd640 1 -- 172.21.15.83:0/24470965 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f37f0073050 con 0x55f6b233f830 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 10 client.6051 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 -- 172.21.15.83:0/24470965 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55f6b2145ca0 con 0x55f6b233f830 2024-03-30T13:11:10.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37deffd640 1 -- 172.21.15.83:0/24470965 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f80be070 con 0x55f6b233f830 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37deffd640 1 -- 172.21.15.83:0/24470965 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f37f0013070 con 0x55f6b233f830 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 10 client.6051 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 10 client.6051 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 20 client.6051 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f6b23905d0 0x55f6b23909b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 4 client.6051 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 -- 172.21.15.83:0/24470965 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6b2128c90 con 0x55f6b23905d0 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37ff7fe640 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f6b23905d0 0x55f6b23909b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37ff7fe640 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f6b23905d0 0x55f6b23909b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cdae7e7fbf3725f server_cookie=5af8f5cfb1c1e20a in_seq=0 out_seq=0 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37deffd640 10 client.6051 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37deffd640 1 -- 172.21.15.83:0/24470965 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55f6b2128c90 con 0x55f6b23905d0 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37deffd640 10 client.6051 handle_command_reply: tid=0 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 client.6051 shutdown 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 -- 172.21.15.83:0/24470965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 msgr2=0x55f6b2344c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b2344c10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f37f000d5c0 tx=0x7f37f0052d80 comp rx=0 tx=0).stop 2024-03-30T13:11:10.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 -- 172.21.15.83:0/24470965 shutdown_connections 2024-03-30T13:11:10.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b236e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 0x55f6b236dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f6b23905d0 0x55f6b23909b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 --2- 172.21.15.83:0/24470965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b2344c10 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f37deffd640 0 client.6051 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 -- 172.21.15.83:0/24470965 >> 172.21.15.83:0/24470965 conn(0x55f6b233b7e0 msgr2=0x55f6b233e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 -- 172.21.15.83:0/24470965 shutdown_connections 2024-03-30T13:11:10.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 1 -- 172.21.15.83:0/24470965 wait complete. 2024-03-30T13:11:10.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.584+0000 7f3809a38000 20 client.6051 trim_cache size 0 max 16384 2024-03-30T13:11:10.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 Processor -- start 2024-03-30T13:11:10.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- start start 2024-03-30T13:11:10.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b236df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 0x55f6b233dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b233e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3800203700 con 0x55f6b233f830 2024-03-30T13:11:10.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3800202700 con 0x55f6b2389690 2024-03-30T13:11:10.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38000b2970 con 0x55f6b2388d70 2024-03-30T13:11:10.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37fffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b236df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37fffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b236df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37348/0 (socket says 172.21.15.83:37348) 2024-03-30T13:11:10.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37fffff640 1 -- 172.21.15.83:0/3722494503 learned_addr learned my addr 172.21.15.83:0/3722494503 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3804e53640 1 --2- 172.21.15.83:0/3722494503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b233e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37ff7fe640 1 --2- 172.21.15.83:0/3722494503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 0x55f6b233dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37fffff640 1 -- 172.21.15.83:0/3722494503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 msgr2=0x55f6b233dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37fffff640 1 --2- 172.21.15.83:0/3722494503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 0x55f6b233dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37fffff640 1 -- 172.21.15.83:0/3722494503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 msgr2=0x55f6b233e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37fffff640 1 --2- 172.21.15.83:0/3722494503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b233e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37fffff640 1 -- 172.21.15.83:0/3722494503 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6b2114d00 con 0x55f6b233f830 2024-03-30T13:11:10.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3804e53640 1 --2- 172.21.15.83:0/3722494503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b233e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:10.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37fffff640 1 --2- 172.21.15.83:0/3722494503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b236df70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f37f000dfb0 tx=0x7f37f00568f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37a95ed9c2aa471 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37e57fa640 1 -- 172.21.15.83:0/3722494503 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f005f620 con 0x55f6b233f830 2024-03-30T13:11:10.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37e57fa640 1 -- 172.21.15.83:0/3722494503 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f00752f0 con 0x55f6b233f830 2024-03-30T13:11:10.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37e57fa640 1 -- 172.21.15.83:0/3722494503 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f007e450 con 0x55f6b233f830 2024-03-30T13:11:10.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- 172.21.15.83:0/3722494503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 msgr2=0x55f6b236df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 --2- 172.21.15.83:0/3722494503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b236df70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f37f000dfb0 tx=0x7f37f00568f0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- 172.21.15.83:0/3722494503 shutdown_connections 2024-03-30T13:11:10.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 --2- 172.21.15.83:0/3722494503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2389690 0x55f6b233e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 --2- 172.21.15.83:0/3722494503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2388d70 0x55f6b233dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 --2- 172.21.15.83:0/3722494503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b236df70 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- 172.21.15.83:0/3722494503 >> 172.21.15.83:0/3722494503 conn(0x55f6b233b7e0 msgr2=0x55f6b239ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- 172.21.15.83:0/3722494503 shutdown_connections 2024-03-30T13:11:10.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- 172.21.15.83:0/3722494503 wait complete. 2024-03-30T13:11:10.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- start start 2024-03-30T13:11:10.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 Processor -- start 2024-03-30T13:11:10.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b2403a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2388d70 0x55f6b2403f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2389690 0x55f6b238cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f6b214b6a0 con 0x55f6b233f830 2024-03-30T13:11:10.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38002020b0 con 0x55f6b2388d70 2024-03-30T13:11:10.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55f6b2155270 con 0x55f6b2389690 2024-03-30T13:11:10.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f3809a38000 10 client.0 _ll_register_callbacks cb 0x7f37f0056840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:10.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37fffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b2403a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.600+0000 7f37fffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b2403a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37354/0 (socket says 172.21.15.83:37354) 2024-03-30T13:11:10.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37fffff640 1 -- 172.21.15.83:0/3715319746 learned_addr learned my addr 172.21.15.83:0/3715319746 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3804e53640 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2389690 0x55f6b238cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37fffff640 1 -- 172.21.15.83:0/3715319746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2389690 msgr2=0x55f6b238cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37fffff640 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2389690 0x55f6b238cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37fffff640 1 -- 172.21.15.83:0/3715319746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2388d70 msgr2=0x55f6b2403f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37fffff640 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2388d70 0x55f6b2403f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37fffff640 1 -- 172.21.15.83:0/3715319746 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6b220ef70 con 0x55f6b233f830 2024-03-30T13:11:10.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3804e53640 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2389690 0x55f6b238cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:10.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37fffff640 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b2403a50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f37f0054ca0 tx=0x7f37f0020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec5472c5873c02c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37deffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:10.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37deffd640 1 -- 172.21.15.83:0/3715319746 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f0063070 con 0x55f6b233f830 2024-03-30T13:11:10.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37deffd640 1 -- 172.21.15.83:0/3715319746 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f37f005f350 con 0x55f6b233f830 2024-03-30T13:11:10.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 -- 172.21.15.83:0/3715319746 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37f00752f0 con 0x55f6b233f830 2024-03-30T13:11:10.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37deffd640 1 -- 172.21.15.83:0/3715319746 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f37f005f5d0 con 0x55f6b233f830 2024-03-30T13:11:10.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 10 client.6057 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:10.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 -- 172.21.15.83:0/3715319746 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55f6b2134760 con 0x55f6b233f830 2024-03-30T13:11:10.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37deffd640 1 -- 172.21.15.83:0/3715319746 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f00752f0 con 0x55f6b233f830 2024-03-30T13:11:10.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37deffd640 1 -- 172.21.15.83:0/3715319746 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f37f0066020 con 0x55f6b233f830 2024-03-30T13:11:10.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 10 client.6057 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:10.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 10 client.6057 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:10.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 20 client.6057 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:10.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f6b238d490 0x55f6b238d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 4 client.6057 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628374}] 2024-03-30T13:11:10.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 -- 172.21.15.83:0/3715319746 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628374}) -- 0x55f6b219afe0 con 0x55f6b238d490 2024-03-30T13:11:10.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37ff7fe640 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f6b238d490 0x55f6b238d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37ff7fe640 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f6b238d490 0x55f6b238d870 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22d2abf8dee68659 server_cookie=afcf8af1061a3e31 in_seq=0 out_seq=0 2024-03-30T13:11:10.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37deffd640 10 client.6057 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37deffd640 1 -- 172.21.15.83:0/3715319746 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3795 (crc 0 0 0) 0x55f6b219afe0 con 0x55f6b238d490 2024-03-30T13:11:10.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37deffd640 10 client.6057 handle_command_reply: tid=0 2024-03-30T13:11:10.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 client.6057 shutdown 2024-03-30T13:11:10.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 -- 172.21.15.83:0/3715319746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 msgr2=0x55f6b2403a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b2403a50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f37f0054ca0 tx=0x7f37f0020040 comp rx=0 tx=0).stop 2024-03-30T13:11:10.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 -- 172.21.15.83:0/3715319746 shutdown_connections 2024-03-30T13:11:10.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55f6b2389690 0x55f6b238cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6b2388d70 0x55f6b2403f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55f6b238d490 0x55f6b238d870 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 --2- 172.21.15.83:0/3715319746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f6b233f830 0x55f6b2403a50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f37deffd640 0 client.6057 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 -- 172.21.15.83:0/3715319746 >> 172.21.15.83:0/3715319746 conn(0x55f6b233b7e0 msgr2=0x55f6b23a0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 -- 172.21.15.83:0/3715319746 shutdown_connections 2024-03-30T13:11:10.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 1 -- 172.21.15.83:0/3715319746 wait complete. 2024-03-30T13:11:10.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f3809a38000 20 client.6057 trim_cache size 0 max 16384 2024-03-30T13:11:10.632 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:10.632 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ceph/ioctl.h", 2024-03-30T13:11:10.633 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628374, 2024-03-30T13:11:10.633 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:10.633 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.585156+0000", 2024-03-30T13:11:10.633 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:35.886388+0000", 2024-03-30T13:11:10.633 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:10.634 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:10.634 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:10.634 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:10.634 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:10.634 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:10.634 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:10.635 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:10.635 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:10.635 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.635 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:10.635 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:10.635 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:10.636 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:10.636 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:10.636 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:10.636 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.636 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:10.636 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 3724, 2024-03-30T13:11:10.636 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:10.637 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:10.637 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:10.637 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:10.637 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:10.637 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:35.886388+0000", 2024-03-30T13:11:10.637 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:10.638 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:10.638 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:10.638 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:10.638 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:10.638 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:10.638 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:10.639 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:10.639 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.639 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:10.639 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:10.639 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:10.639 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:10.639 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.640 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:10.640 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.640 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 3724, 2024-03-30T13:11:10.640 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:10.640 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:10.640 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:10.641 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.585156+0000" 2024-03-30T13:11:10.641 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.641 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:10.641 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.641 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 3724, 2024-03-30T13:11:10.641 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:10.641 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:10.641 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:10.642 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.585156+0000" 2024-03-30T13:11:10.642 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.642 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 172, 2024-03-30T13:11:10.642 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:10.642 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:10.642 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 34, 2024-03-30T13:11:10.642 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:10.642 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:10.643 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:10.643 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:10.643 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:10.643 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:10.643 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:10.643 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.643 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:10.643 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:10.643 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:10.644 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:10.644 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:10.644 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:10.644 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.644 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:10.644 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:10.644 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:10.645 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:10.645 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:10.645 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:10.646 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.646 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:10.646 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:10.646 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:10.646 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:10.647 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.647 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:10.647 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.647 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:10.647 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:10.647 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:10.648 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:10.648 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:10.648 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:10.648 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:10.648 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:10.648 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:10.648 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:10.649 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:10.649 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:10.649 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:10.649 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.649 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:10.649 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:10.650 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.650 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.650 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:10.650 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.650 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.650 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.650 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.651 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.651 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.651 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:10.651 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:10.651 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:10.651 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:10.651 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:10.651 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:10.651 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:10.651 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.651 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.651 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.652 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:10.654 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:10.654 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:10.654 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.654 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:10.654 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:10.654 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:10.654 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:10.654 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:10.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f38068b6640 1 -- 172.21.15.83:0/199961485 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f37ec067fc0 msgr2=0x7f37ec06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f38068b6640 1 --2- 172.21.15.83:0/199961485 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f37ec067fc0 0x7f37ec06a480 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f37f4007fd0 tx=0x7f37f4007900 comp rx=0 tx=0).stop 2024-03-30T13:11:10.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f38068b6640 1 -- 172.21.15.83:0/199961485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000b0560 msgr2=0x7f3800163d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f38068b6640 1 --2- 172.21.15.83:0/199961485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000b0560 0x7f3800163d50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f37f000d5f0 tx=0x7f37f000dab0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f38068b6640 1 -- 172.21.15.83:0/199961485 shutdown_connections 2024-03-30T13:11:10.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f38068b6640 1 --2- 172.21.15.83:0/199961485 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f37ec067fc0 0x7f37ec06a480 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f38068b6640 1 --2- 172.21.15.83:0/199961485 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f380015b3e0 0x7f38001fab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f38068b6640 1 --2- 172.21.15.83:0/199961485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38000b5300 0x7f3800151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f38068b6640 1 --2- 172.21.15.83:0/199961485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000b0560 0x7f3800163d50 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f38068b6640 1 -- 172.21.15.83:0/199961485 >> 172.21.15.83:0/199961485 conn(0x7f38000b6600 msgr2=0x7f3800159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f38068b6640 1 -- 172.21.15.83:0/199961485 shutdown_connections 2024-03-30T13:11:10.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.604+0000 7f38068b6640 1 -- 172.21.15.83:0/199961485 wait complete. 2024-03-30T13:11:10.657 DEBUG:tasks.cephfs.test_uninlining:getting inode info #6 of 23:1099511628386 2024-03-30T13:11:10.657 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628386 2024-03-30T13:11:10.657 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628386 2024-03-30T13:11:10.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.768+0000 7f0dcd350640 1 Processor -- start 2024-03-30T13:11:10.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.768+0000 7f0dcd350640 1 -- start start 2024-03-30T13:11:10.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dcd350640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0dc8160140 0x7f0dc81605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dcd350640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dc80aff40 con 0x7f0dc815c7f0 2024-03-30T13:11:10.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dcd350640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dc80b0220 con 0x7f0dc80b1b60 2024-03-30T13:11:10.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dcd350640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc80b0fe0 con 0x7f0dc8160140 2024-03-30T13:11:10.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dc67fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0dc8160140 0x7f0dc81605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dc6ffd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f0dc815c7f0 0x7f0dc80d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57430/0 (socket says 172.21.15.83:57430) 2024-03-30T13:11:10.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dc6ffd640 1 -- 172.21.15.83:0/2872294356 learned_addr learned my addr 172.21.15.83:0/2872294356 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:10.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dc67fc640 1 -- 172.21.15.83:0/2872294356 >> v1:172.21.15.153:6789/0 conn(0x7f0dc80b1b60 legacy=0x7f0dc80b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dc67fc640 1 -- 172.21.15.83:0/2872294356 >> v1:172.21.15.83:6789/0 conn(0x7f0dc815c7f0 legacy=0x7f0dc80d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dc67fc640 1 -- 172.21.15.83:0/2872294356 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc80b0500 con 0x7f0dc8160140 2024-03-30T13:11:10.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dc67fc640 1 --2- 172.21.15.83:0/2872294356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dc8160140 0x7f0dc81605a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0097c0 tx=0x7f0dbc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e1809da003da20 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dc5ffb640 1 -- 172.21.15.83:0/2872294356 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0b0070 con 0x7f0dc8160140 2024-03-30T13:11:10.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dc5ffb640 1 -- 172.21.15.83:0/2872294356 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dbc0ab600 con 0x7f0dc8160140 2024-03-30T13:11:10.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.772+0000 7f0dc5ffb640 1 -- 172.21.15.83:0/2872294356 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0ab9d0 con 0x7f0dc8160140 2024-03-30T13:11:10.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 -- 172.21.15.83:0/2872294356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dc8160140 msgr2=0x7f0dc81605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 --2- 172.21.15.83:0/2872294356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dc8160140 0x7f0dc81605a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0097c0 tx=0x7f0dbc01c460 comp rx=0 tx=0).stop 2024-03-30T13:11:10.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 -- 172.21.15.83:0/2872294356 shutdown_connections 2024-03-30T13:11:10.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 --2- 172.21.15.83:0/2872294356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dc8160140 0x7f0dc81605a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 -- 172.21.15.83:0/2872294356 >> 172.21.15.83:0/2872294356 conn(0x7f0dc80b3e70 msgr2=0x7f0dc80b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 -- 172.21.15.83:0/2872294356 shutdown_connections 2024-03-30T13:11:10.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 -- 172.21.15.83:0/2872294356 wait complete. 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 Processor -- start 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 -- start start 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0dc80b1b60 0x7f0dc8151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0dc815c7f0 0x7f0dc80d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dc8160140 0x7f0dc80d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc80b0b50 con 0x7f0dc8160140 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc80b3ca0 con 0x7f0dc815c7f0 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc80b2ad0 con 0x7f0dc80b1b60 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dc8160140 0x7f0dc80d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dc8160140 0x7f0dc80d27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37370/0 (socket says 172.21.15.83:37370) 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dc77fe640 1 -- 172.21.15.83:0/509150342 learned_addr learned my addr 172.21.15.83:0/509150342 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dc6ffd640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0dc80b1b60 0x7f0dc8151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dc67fc640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0dc815c7f0 0x7f0dc80d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dc77fe640 1 -- 172.21.15.83:0/509150342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0dc80b1b60 msgr2=0x7f0dc8151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dc77fe640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0dc80b1b60 0x7f0dc8151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dc77fe640 1 -- 172.21.15.83:0/509150342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0dc815c7f0 msgr2=0x7f0dc80d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dc77fe640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0dc815c7f0 0x7f0dc80d22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dc77fe640 1 -- 172.21.15.83:0/509150342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc815f450 con 0x7f0dc8160140 2024-03-30T13:11:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dc77fe640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dc8160140 0x7f0dc80d27e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0db800c3f0 tx=0x7f0db800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0daf7fe640 1 -- 172.21.15.83:0/509150342 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8011790 con 0x7f0dc8160140 2024-03-30T13:11:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0daf7fe640 1 -- 172.21.15.83:0/509150342 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db8017070 con 0x7f0dc8160140 2024-03-30T13:11:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0daf7fe640 1 -- 172.21.15.83:0/509150342 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8011b70 con 0x7f0dc8160140 2024-03-30T13:11:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 -- 172.21.15.83:0/509150342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc815f730 con 0x7f0dc8160140 2024-03-30T13:11:10.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.776+0000 7f0dcd350640 1 -- 172.21.15.83:0/509150342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc8159390 con 0x7f0dc8160140 2024-03-30T13:11:10.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0daf7fe640 1 -- 172.21.15.83:0/509150342 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f0db8011d10 con 0x7f0dc8160140 2024-03-30T13:11:10.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0daf7fe640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0db4067fc0 0x7f0db406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0daf7fe640 1 -- 172.21.15.83:0/509150342 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0db8086360 con 0x7f0dc8160140 2024-03-30T13:11:10.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dc6ffd640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0db4067fc0 0x7f0db406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dc6ffd640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0db4067fc0 0x7f0db406a480 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00012f0 tx=0x7f0dc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dd04d2000 1 Processor -- start 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dd04d2000 1 -- start start 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dd04d2000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b9076320 0x5586b9076700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dd04d2000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b907ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dd04d2000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907d230 0x5586b90bff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dd04d2000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5586b8ec0aa0 con 0x5586b907c910 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dd04d2000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5586b8e47af0 con 0x5586b907d230 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dd04d2000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5586b8ebca50 con 0x5586b9076320 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dc67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b907ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dc67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b907ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37382/0 (socket says 172.21.15.83:37382) 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dc67fc640 1 -- 172.21.15.83:0/1911416177 learned_addr learned my addr 172.21.15.83:0/1911416177 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dc6ffd640 1 --2- 172.21.15.83:0/1911416177 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b9076320 0x5586b9076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dc67fc640 1 -- 172.21.15.83:0/1911416177 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b9076320 msgr2=0x5586b9076700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dc67fc640 1 --2- 172.21.15.83:0/1911416177 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b9076320 0x5586b9076700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dc67fc640 1 -- 172.21.15.83:0/1911416177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907d230 msgr2=0x5586b90bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dc67fc640 1 --2- 172.21.15.83:0/1911416177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907d230 0x5586b90bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dc67fc640 1 -- 172.21.15.83:0/1911416177 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b8e45d00 con 0x5586b907c910 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dc67fc640 1 --2- 172.21.15.83:0/1911416177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b907ccf0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc019070 tx=0x7f0dbc0a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44278517ec88cbcc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dacff9640 1 -- 172.21.15.83:0/1911416177 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0bc070 con 0x5586b907c910 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.780+0000 7f0dacff9640 1 -- 172.21.15.83:0/1911416177 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dbc0b1040 con 0x5586b907c910 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dacff9640 1 -- 172.21.15.83:0/1911416177 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0b0050 con 0x5586b907c910 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 -- 172.21.15.83:0/1911416177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 msgr2=0x5586b907ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/1911416177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b907ccf0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc019070 tx=0x7f0dbc0a6000 comp rx=0 tx=0).stop 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 -- 172.21.15.83:0/1911416177 shutdown_connections 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/1911416177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907d230 0x5586b90bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/1911416177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b907ccf0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/1911416177 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b9076320 0x5586b9076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 -- 172.21.15.83:0/1911416177 >> 172.21.15.83:0/1911416177 conn(0x5586b9077b80 msgr2=0x5586b9074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 -- 172.21.15.83:0/1911416177 shutdown_connections 2024-03-30T13:11:10.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 -- 172.21.15.83:0/1911416177 wait complete. 2024-03-30T13:11:10.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 -- start start 2024-03-30T13:11:10.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 Processor -- start 2024-03-30T13:11:10.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b9076320 0x5586b90c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b90c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b907d230 0x5586b90aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5586b8e7c510 con 0x5586b907c910 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5586b8e7e6a0 con 0x5586b9076320 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5586b8f7cb00 con 0x5586b907d230 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 10 client.0 _ll_register_callbacks cb 0x5586b905d490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b90c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b90c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37396/0 (socket says 172.21.15.83:37396) 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc67fc640 1 -- 172.21.15.83:0/3946103190 learned_addr learned my addr 172.21.15.83:0/3946103190 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc6ffd640 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b9076320 0x5586b90c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc77fe640 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b907d230 0x5586b90aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc67fc640 1 -- 172.21.15.83:0/3946103190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b907d230 msgr2=0x5586b90aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc67fc640 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b907d230 0x5586b90aaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc67fc640 1 -- 172.21.15.83:0/3946103190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b9076320 msgr2=0x5586b90c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc67fc640 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b9076320 0x5586b90c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc67fc640 1 -- 172.21.15.83:0/3946103190 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586b8e85730 con 0x5586b907c910 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc67fc640 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b90c7800 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc01a090 tx=0x7f0dbc01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbcfe60cecd8b32 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0da5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0da5ffb640 1 -- 172.21.15.83:0/3946103190 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0b0050 con 0x5586b907c910 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0da5ffb640 1 -- 172.21.15.83:0/3946103190 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0dbc003620 con 0x5586b907c910 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3946103190 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dbc0b1040 con 0x5586b907c910 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0da5ffb640 1 -- 172.21.15.83:0/3946103190 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f0dbc0cc050 con 0x5586b907c910 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 10 client.6072 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3946103190 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5586b8e78ca0 con 0x5586b907c910 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0da5ffb640 1 -- 172.21.15.83:0/3946103190 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dbc0b1040 con 0x5586b907c910 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0da5ffb640 1 -- 172.21.15.83:0/3946103190 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f0dbc0cf020 con 0x5586b907c910 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 10 client.6072 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 10 client.6072 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 20 client.6072 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5586b90ab940 0x5586b90abd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 4 client.6072 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3946103190 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586b8e5bc90 con 0x5586b90ab940 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc6ffd640 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5586b90ab940 0x5586b90abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0da5ffb640 10 client.6072 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.784+0000 7f0dc6ffd640 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5586b90ab940 0x5586b90abd20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c878edefd4dc527 server_cookie=72445603ffc6a69c in_seq=0 out_seq=0 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0da5ffb640 1 -- 172.21.15.83:0/3946103190 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5586b8e5bc90 con 0x5586b90ab940 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0da5ffb640 10 client.6072 handle_command_reply: tid=0 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0dd04d2000 1 client.6072 shutdown 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3946103190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 msgr2=0x5586b90c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b90c7800 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc01a090 tx=0x7f0dbc01aca0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3946103190 shutdown_connections 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b907d230 0x5586b90aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5586b90ab940 0x5586b90abd20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b90c7800 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/3946103190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b9076320 0x5586b90c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3946103190 >> 172.21.15.83:0/3946103190 conn(0x5586b9077b80 msgr2=0x5586b9076f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0da5ffb640 0 client.6072 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3946103190 shutdown_connections 2024-03-30T13:11:10.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3946103190 wait complete. 2024-03-30T13:11:10.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.788+0000 7f0dd04d2000 20 client.6072 trim_cache size 0 max 16384 2024-03-30T13:11:10.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dd04d2000 1 Processor -- start 2024-03-30T13:11:10.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dd04d2000 1 -- start start 2024-03-30T13:11:10.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dd04d2000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b9076320 0x5586b90a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dd04d2000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907c910 0x5586b90a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dd04d2000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b907d230 0x5586b90cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dd04d2000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc806d530 con 0x5586b9076320 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dd04d2000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc806c890 con 0x5586b907c910 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dd04d2000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc806cee0 con 0x5586b907d230 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dc6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b9076320 0x5586b90a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dc6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b9076320 0x5586b90a99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37412/0 (socket says 172.21.15.83:37412) 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dc6ffd640 1 -- 172.21.15.83:0/60091867 learned_addr learned my addr 172.21.15.83:0/60091867 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dc6ffd640 1 -- 172.21.15.83:0/60091867 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b907d230 msgr2=0x5586b90cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dc6ffd640 1 --2- 172.21.15.83:0/60091867 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b907d230 0x5586b90cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dc67fc640 1 --2- 172.21.15.83:0/60091867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907c910 0x5586b90a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dc6ffd640 1 -- 172.21.15.83:0/60091867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907c910 msgr2=0x5586b90a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dc6ffd640 1 --2- 172.21.15.83:0/60091867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907c910 0x5586b90a9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.800+0000 7f0dc6ffd640 1 -- 172.21.15.83:0/60091867 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b907d060 con 0x5586b9076320 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dc6ffd640 1 --2- 172.21.15.83:0/60091867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b9076320 0x5586b90a99c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0001e90 tx=0x7f0dc0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a8afbf68b38ed7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0da7fff640 1 -- 172.21.15.83:0/60091867 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0025440 con 0x5586b9076320 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0da7fff640 1 -- 172.21.15.83:0/60091867 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dc00255e0 con 0x5586b9076320 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0da7fff640 1 -- 172.21.15.83:0/60091867 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0012410 con 0x5586b9076320 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 -- 172.21.15.83:0/60091867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b9076320 msgr2=0x5586b90a99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/60091867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b9076320 0x5586b90a99c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0001e90 tx=0x7f0dc0011000 comp rx=0 tx=0).stop 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 -- 172.21.15.83:0/60091867 shutdown_connections 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/60091867 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b907d230 0x5586b90cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/60091867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907c910 0x5586b90a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/60091867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b9076320 0x5586b90a99c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 -- 172.21.15.83:0/60091867 >> 172.21.15.83:0/60091867 conn(0x5586b9077b80 msgr2=0x5586b9074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 -- 172.21.15.83:0/60091867 shutdown_connections 2024-03-30T13:11:10.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 -- 172.21.15.83:0/60091867 wait complete. 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 -- start start 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 Processor -- start 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b9076320 0x5586b9132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b9134670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907d230 0x5586b9136bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5586b8e58880 con 0x5586b907c910 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5586b8ebfdb0 con 0x5586b907d230 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5586b8e88270 con 0x5586b9076320 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 10 client.0 _ll_register_callbacks cb 0x7f0dbc0ba070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dc67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b9134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dc67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b9134670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37428/0 (socket says 172.21.15.83:37428) 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dc67fc640 1 -- 172.21.15.83:0/3813772214 learned_addr learned my addr 172.21.15.83:0/3813772214 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dc77fe640 1 --2- 172.21.15.83:0/3813772214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907d230 0x5586b9136bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dc67fc640 1 -- 172.21.15.83:0/3813772214 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b9076320 msgr2=0x5586b9132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dc67fc640 1 --2- 172.21.15.83:0/3813772214 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b9076320 0x5586b9132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dc67fc640 1 -- 172.21.15.83:0/3813772214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907d230 msgr2=0x5586b9136bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dc67fc640 1 --2- 172.21.15.83:0/3813772214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907d230 0x5586b9136bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dc67fc640 1 -- 172.21.15.83:0/3813772214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586b8e47d00 con 0x5586b907c910 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dc67fc640 1 --2- 172.21.15.83:0/3813772214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b9134670 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc01c4a0 tx=0x7f0dbc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9311b27d1175f188 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0da5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0da5ffb640 1 -- 172.21.15.83:0/3813772214 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0b0070 con 0x5586b907c910 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0da5ffb640 1 -- 172.21.15.83:0/3813772214 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0dbc0acb70 con 0x5586b907c910 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3813772214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dc00255e0 con 0x5586b907c910 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0da5ffb640 1 -- 172.21.15.83:0/3813772214 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f0dbc0bc040 con 0x5586b907c910 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 10 client.6078 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3813772214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5586b8f41f70 con 0x5586b907c910 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0da5ffb640 1 -- 172.21.15.83:0/3813772214 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dc00255e0 con 0x5586b907c910 2024-03-30T13:11:10.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0da5ffb640 1 -- 172.21.15.83:0/3813772214 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f0dbc0cf040 con 0x5586b907c910 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 10 client.6078 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 10 client.6078 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 20 client.6078 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/3813772214 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5586b9137100 0x5586b91394f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 4 client.6078 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628386}] 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3813772214 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628386}) -- 0x5586b8ecdfe0 con 0x5586b9137100 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.804+0000 7f0dc6ffd640 1 --2- 172.21.15.83:0/3813772214 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5586b9137100 0x5586b91394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dc6ffd640 1 --2- 172.21.15.83:0/3813772214 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5586b9137100 0x5586b91394f0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=483d020a99af473b server_cookie=cab602023ba6faff in_seq=0 out_seq=0 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0da5ffb640 10 client.6078 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0da5ffb640 1 -- 172.21.15.83:0/3813772214 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3794 (crc 0 0 0) 0x5586b8ecdfe0 con 0x5586b9137100 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0da5ffb640 10 client.6078 handle_command_reply: tid=0 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dd04d2000 1 client.6078 shutdown 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3813772214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 msgr2=0x5586b9134670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/3813772214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b9134670 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc01c4a0 tx=0x7f0dbc008040 comp rx=0 tx=0).stop 2024-03-30T13:11:10.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3813772214 shutdown_connections 2024-03-30T13:11:10.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/3813772214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b907d230 0x5586b9136bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/3813772214 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5586b9137100 0x5586b91394f0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/3813772214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5586b907c910 0x5586b9134670 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0da5ffb640 0 client.6078 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dd04d2000 1 --2- 172.21.15.83:0/3813772214 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5586b9076320 0x5586b9132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3813772214 >> 172.21.15.83:0/3813772214 conn(0x5586b9077b80 msgr2=0x5586b9075490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3813772214 shutdown_connections 2024-03-30T13:11:10.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dd04d2000 1 -- 172.21.15.83:0/3813772214 wait complete. 2024-03-30T13:11:10.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dd04d2000 20 client.6078 trim_cache size 0 max 16384 2024-03-30T13:11:10.819 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/Kconfig", 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628386, 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.594200+0000", 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:35.953427+0000", 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.820 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 1240, 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:35.953427+0000", 2024-03-30T13:11:10.821 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:10.822 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1240, 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.594200+0000" 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1240, 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.594200+0000" 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.823 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 108, 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 2, 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.825 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.826 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:10.827 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:10.828 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:10.829 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:10.830 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:10.830 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:10.830 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:10.830 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:10.830 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:10.830 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:10.830 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:10.830 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:10.830 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:10.830 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:10.830 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:10.830 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:10.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dcd350640 1 -- 172.21.15.83:0/509150342 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0db4067fc0 msgr2=0x7f0db406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dcd350640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0db4067fc0 0x7f0db406a480 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00012f0 tx=0x7f0dc0009040 comp rx=0 tx=0).stop 2024-03-30T13:11:10.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dcd350640 1 -- 172.21.15.83:0/509150342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dc8160140 msgr2=0x7f0dc80d27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dcd350640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dc8160140 0x7f0dc80d27e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0db800c3f0 tx=0x7f0db800c8b0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dcd350640 1 -- 172.21.15.83:0/509150342 shutdown_connections 2024-03-30T13:11:10.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dcd350640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0db4067fc0 0x7f0db406a480 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dcd350640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dc8160140 0x7f0dc80d27e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dcd350640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0dc815c7f0 0x7f0dc80d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dcd350640 1 --2- 172.21.15.83:0/509150342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0dc80b1b60 0x7f0dc8151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dcd350640 1 -- 172.21.15.83:0/509150342 >> 172.21.15.83:0/509150342 conn(0x7f0dc80b3e70 msgr2=0x7f0dc8155050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dcd350640 1 -- 172.21.15.83:0/509150342 shutdown_connections 2024-03-30T13:11:10.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.808+0000 7f0dcd350640 1 -- 172.21.15.83:0/509150342 wait complete. 2024-03-30T13:11:10.833 DEBUG:tasks.cephfs.test_uninlining:getting inode info #7 of 23:1099511628404 2024-03-30T13:11:10.833 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628404 2024-03-30T13:11:10.833 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628404 2024-03-30T13:11:10.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a9ab1e640 1 Processor -- start 2024-03-30T13:11:10.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a9ab1e640 1 -- start start 2024-03-30T13:11:10.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a9ab1e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1a9415c7f0 0x7f1a940d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a9ab1e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a94160140 0x7f1a941605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a9ab1e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a940aff40 con 0x7f1a9409aa50 2024-03-30T13:11:10.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a9ab1e640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f1a940b0fe0 con 0x7f1a9415c7f0 2024-03-30T13:11:10.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a9ab1e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1a94160ae0 con 0x7f1a94160140 2024-03-30T13:11:10.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a988ba640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1a9415c7f0 0x7f1a940d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a988ba640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1a9415c7f0 0x7f1a940d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37436/0 (socket says 172.21.15.83:37436) 2024-03-30T13:11:10.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a988ba640 1 -- 172.21.15.83:0/658054569 learned_addr learned my addr 172.21.15.83:0/658054569 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a93fff640 1 --2- 172.21.15.83:0/658054569 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a94160140 0x7f1a941605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a988ba640 1 -- 172.21.15.83:0/658054569 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a94160140 msgr2=0x7f1a941605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a988ba640 1 --2- 172.21.15.83:0/658054569 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a94160140 0x7f1a941605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a988ba640 1 -- 172.21.15.83:0/658054569 >> v1:172.21.15.153:6789/0 conn(0x7f1a9409aa50 legacy=0x7f1a9409aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a988ba640 1 -- 172.21.15.83:0/658054569 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a940b0220 con 0x7f1a9415c7f0 2024-03-30T13:11:10.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.940+0000 7f1a988ba640 1 --2- 172.21.15.83:0/658054569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a9415c7f0 0x7f1a940d19a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009870 tx=0x7f1a8801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8d1853f43c6338 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a937fe640 1 -- 172.21.15.83:0/658054569 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880b2070 con 0x7f1a9415c7f0 2024-03-30T13:11:10.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a937fe640 1 -- 172.21.15.83:0/658054569 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a880a9070 con 0x7f1a9415c7f0 2024-03-30T13:11:10.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a937fe640 1 -- 172.21.15.83:0/658054569 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880ad880 con 0x7f1a9415c7f0 2024-03-30T13:11:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/658054569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a9415c7f0 msgr2=0x7f1a940d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 --2- 172.21.15.83:0/658054569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a9415c7f0 0x7f1a940d19a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009870 tx=0x7f1a8801c560 comp rx=0 tx=0).stop 2024-03-30T13:11:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/658054569 shutdown_connections 2024-03-30T13:11:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 --2- 172.21.15.83:0/658054569 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a94160140 0x7f1a941605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 --2- 172.21.15.83:0/658054569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a9415c7f0 0x7f1a940d19a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/658054569 >> 172.21.15.83:0/658054569 conn(0x7f1a940b3e70 msgr2=0x7f1a940b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/658054569 shutdown_connections 2024-03-30T13:11:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/658054569 wait complete. 2024-03-30T13:11:10.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 Processor -- start 2024-03-30T13:11:10.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 -- start start 2024-03-30T13:11:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a9409aa50 0x7f1a9415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a9415c7f0 0x7f1a94147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a94160140 0x7f1a9406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1a940afb60 con 0x7f1a94160140 2024-03-30T13:11:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a940d1ee0 con 0x7f1a9409aa50 2024-03-30T13:11:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1a940afce0 con 0x7f1a9415c7f0 2024-03-30T13:11:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a990bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a94160140 0x7f1a9406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a990bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a94160140 0x7f1a9406cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37446/0 (socket says 172.21.15.83:37446) 2024-03-30T13:11:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a990bb640 1 -- 172.21.15.83:0/2260622140 learned_addr learned my addr 172.21.15.83:0/2260622140 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a988ba640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a9409aa50 0x7f1a9415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a93fff640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a9415c7f0 0x7f1a94147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a990bb640 1 -- 172.21.15.83:0/2260622140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a9415c7f0 msgr2=0x7f1a94147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a990bb640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a9415c7f0 0x7f1a94147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a990bb640 1 -- 172.21.15.83:0/2260622140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a9409aa50 msgr2=0x7f1a9415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a990bb640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a9409aa50 0x7f1a9415d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a990bb640 1 -- 172.21.15.83:0/2260622140 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a941656f0 con 0x7f1a94160140 2024-03-30T13:11:10.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a990bb640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a94160140 0x7f1a9406cff0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c760 tx=0x7f1a8c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a917fa640 1 -- 172.21.15.83:0/2260622140 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c003b80 con 0x7f1a94160140 2024-03-30T13:11:10.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a917fa640 1 -- 172.21.15.83:0/2260622140 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c003d20 con 0x7f1a94160140 2024-03-30T13:11:10.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/2260622140 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a941659d0 con 0x7f1a94160140 2024-03-30T13:11:10.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a917fa640 1 -- 172.21.15.83:0/2260622140 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00aa30 con 0x7f1a94160140 2024-03-30T13:11:10.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.944+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/2260622140 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a94165f90 con 0x7f1a94160140 2024-03-30T13:11:10.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a917fa640 1 -- 172.21.15.83:0/2260622140 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f1a8c00abd0 con 0x7f1a94160140 2024-03-30T13:11:10.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a917fa640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1a78067ff0 0x7f1a7806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a917fa640 1 -- 172.21.15.83:0/2260622140 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1a8c086300 con 0x7f1a94160140 2024-03-30T13:11:10.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a988ba640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1a78067ff0 0x7f1a7806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a988ba640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1a78067ff0 0x7f1a7806a4b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1a880af000 tx=0x7f1a880a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a9dca0000 1 Processor -- start 2024-03-30T13:11:10.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a9dca0000 1 -- start start 2024-03-30T13:11:10.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a9dca0000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c2556150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a9dca0000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 0x5580c250c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a9dca0000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 0x5580c250cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a9dca0000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5580c235aaa0 con 0x5580c2555d70 2024-03-30T13:11:10.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a9dca0000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5580c22e1af0 con 0x5580c250c830 2024-03-30T13:11:10.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a9dca0000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5580c2356a50 con 0x5580c2556690 2024-03-30T13:11:10.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a988ba640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c2556150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a988ba640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c2556150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37454/0 (socket says 172.21.15.83:37454) 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a988ba640 1 -- 172.21.15.83:0/2874396331 learned_addr learned my addr 172.21.15.83:0/2874396331 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a990bb640 1 --2- 172.21.15.83:0/2874396331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 0x5580c250cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a93fff640 1 --2- 172.21.15.83:0/2874396331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 0x5580c250c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a988ba640 1 -- 172.21.15.83:0/2874396331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 msgr2=0x5580c250c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a988ba640 1 --2- 172.21.15.83:0/2874396331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 0x5580c250c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a988ba640 1 -- 172.21.15.83:0/2874396331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 msgr2=0x5580c250cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a988ba640 1 --2- 172.21.15.83:0/2874396331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 0x5580c250cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a988ba640 1 -- 172.21.15.83:0/2874396331 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c22dfd00 con 0x5580c2555d70 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.948+0000 7f1a990bb640 1 --2- 172.21.15.83:0/2874396331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 0x5580c250cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a988ba640 1 --2- 172.21.15.83:0/2874396331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c2556150 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1a8801a190 tx=0x7f1a88004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eeabc5b6e40267 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a7e7fc640 1 -- 172.21.15.83:0/2874396331 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880ca070 con 0x5580c2555d70 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a7e7fc640 1 -- 172.21.15.83:0/2874396331 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a880a9040 con 0x5580c2555d70 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a7e7fc640 1 -- 172.21.15.83:0/2874396331 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880b2040 con 0x5580c2555d70 2024-03-30T13:11:10.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2874396331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 msgr2=0x5580c2556150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/2874396331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c2556150 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1a8801a190 tx=0x7f1a88004740 comp rx=0 tx=0).stop 2024-03-30T13:11:10.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2874396331 shutdown_connections 2024-03-30T13:11:10.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/2874396331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 0x5580c250cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/2874396331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 0x5580c250c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/2874396331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c2556150 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2874396331 >> 172.21.15.83:0/2874396331 conn(0x5580c25087e0 msgr2=0x5580c250abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2874396331 shutdown_connections 2024-03-30T13:11:10.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2874396331 wait complete. 2024-03-30T13:11:10.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 -- start start 2024-03-30T13:11:10.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 Processor -- start 2024-03-30T13:11:10.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 0x5580c2511c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c253ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 0x5580c253b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5580c2322270 con 0x5580c2555d70 2024-03-30T13:11:10.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5580c23186a0 con 0x5580c250c830 2024-03-30T13:11:10.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5580c22f2880 con 0x5580c2556690 2024-03-30T13:11:10.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 10 client.0 _ll_register_callbacks cb 0x5580c24f7490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:10.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a93fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c253ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a93fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c253ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37462/0 (socket says 172.21.15.83:37462) 2024-03-30T13:11:10.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a93fff640 1 -- 172.21.15.83:0/2626376510 learned_addr learned my addr 172.21.15.83:0/2626376510 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a93fff640 1 -- 172.21.15.83:0/2626376510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 msgr2=0x5580c253b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a990bb640 1 --2- 172.21.15.83:0/2626376510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 0x5580c253b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a93fff640 1 --2- 172.21.15.83:0/2626376510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 0x5580c253b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a93fff640 1 -- 172.21.15.83:0/2626376510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 msgr2=0x5580c2511c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a93fff640 1 --2- 172.21.15.83:0/2626376510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 0x5580c2511c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a93fff640 1 -- 172.21.15.83:0/2626376510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c231f730 con 0x5580c2555d70 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a93fff640 1 --2- 172.21.15.83:0/2626376510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c253ada0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1a80010250 tx=0x7f1a80010710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8060f849bb17b0f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a737fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a737fe640 1 -- 172.21.15.83:0/2626376510 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8000f040 con 0x5580c2555d70 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a737fe640 1 -- 172.21.15.83:0/2626376510 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1a80014800 con 0x5580c2555d70 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2626376510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a880a9040 con 0x5580c2555d70 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a737fe640 1 -- 172.21.15.83:0/2626376510 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f1a80024050 con 0x5580c2555d70 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 10 client.6090 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:10.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2626376510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5580c2312ca0 con 0x5580c2555d70 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a737fe640 1 -- 172.21.15.83:0/2626376510 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a880a9040 con 0x5580c2555d70 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a737fe640 1 -- 172.21.15.83:0/2626376510 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f1a80027020 con 0x5580c2555d70 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 10 client.6090 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 10 client.6090 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 20 client.6090 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/2626376510 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580c255d5d0 0x5580c255d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 4 client.6090 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2626376510 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580c22f5c90 con 0x5580c255d5d0 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a988ba640 1 --2- 172.21.15.83:0/2626376510 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580c255d5d0 0x5580c255d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a737fe640 10 client.6090 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.952+0000 7f1a988ba640 1 --2- 172.21.15.83:0/2626376510 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580c255d5d0 0x5580c255d9e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf25660b6441d8d server_cookie=49d0cf66307e77cc in_seq=0 out_seq=0 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a737fe640 1 -- 172.21.15.83:0/2626376510 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5580c22f5c90 con 0x5580c255d5d0 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a737fe640 10 client.6090 handle_command_reply: tid=0 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a9dca0000 1 client.6090 shutdown 2024-03-30T13:11:10.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2626376510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 msgr2=0x5580c253ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/2626376510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c253ada0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1a80010250 tx=0x7f1a80010710 comp rx=0 tx=0).stop 2024-03-30T13:11:10.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2626376510 shutdown_connections 2024-03-30T13:11:10.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/2626376510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 0x5580c253b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/2626376510 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580c255d5d0 0x5580c255d9e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/2626376510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c253ada0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/2626376510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 0x5580c2511c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a737fe640 0 client.6090 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:10.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2626376510 >> 172.21.15.83:0/2626376510 conn(0x5580c25087e0 msgr2=0x5580c250b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2626376510 shutdown_connections 2024-03-30T13:11:10.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a9dca0000 1 -- 172.21.15.83:0/2626376510 wait complete. 2024-03-30T13:11:10.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.956+0000 7f1a9dca0000 20 client.6090 trim_cache size 0 max 16384 2024-03-30T13:11:10.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.980+0000 7f1a9dca0000 1 Processor -- start 2024-03-30T13:11:10.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.980+0000 7f1a9dca0000 1 -- start start 2024-03-30T13:11:10.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 0x5580c253b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c250abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 0x5580c250b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1a94203f40 con 0x5580c2555d70 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941fbd50 con 0x5580c250c830 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1a94166f30 con 0x5580c2556690 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a93fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c250abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a93fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c250abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37476/0 (socket says 172.21.15.83:37476) 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a93fff640 1 -- 172.21.15.83:0/1620876969 learned_addr learned my addr 172.21.15.83:0/1620876969 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a988ba640 1 --2- 172.21.15.83:0/1620876969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 0x5580c253b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a93fff640 1 -- 172.21.15.83:0/1620876969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 msgr2=0x5580c250b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a93fff640 1 --2- 172.21.15.83:0/1620876969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 0x5580c250b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a93fff640 1 -- 172.21.15.83:0/1620876969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 msgr2=0x5580c253b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a93fff640 1 --2- 172.21.15.83:0/1620876969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 0x5580c253b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a93fff640 1 -- 172.21.15.83:0/1620876969 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c22e1d00 con 0x5580c2555d70 2024-03-30T13:11:10.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a93fff640 1 --2- 172.21.15.83:0/1620876969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c250abd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1a80001ec0 tx=0x7f1a80006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391da470adb8198d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a7dffb640 1 -- 172.21.15.83:0/1620876969 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8002c070 con 0x5580c2555d70 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a7dffb640 1 -- 172.21.15.83:0/1620876969 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a80014600 con 0x5580c2555d70 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a7dffb640 1 -- 172.21.15.83:0/1620876969 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a80004040 con 0x5580c2555d70 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 -- 172.21.15.83:0/1620876969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 msgr2=0x5580c250abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/1620876969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c250abd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1a80001ec0 tx=0x7f1a80006f90 comp rx=0 tx=0).stop 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 -- 172.21.15.83:0/1620876969 shutdown_connections 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/1620876969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2556690 0x5580c250b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/1620876969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c2555d70 0x5580c250abd0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/1620876969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c250c830 0x5580c253b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 -- 172.21.15.83:0/1620876969 >> 172.21.15.83:0/1620876969 conn(0x5580c25087e0 msgr2=0x5580c256cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 -- 172.21.15.83:0/1620876969 shutdown_connections 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 -- 172.21.15.83:0/1620876969 wait complete. 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 -- start start 2024-03-30T13:11:10.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.984+0000 7f1a9dca0000 1 Processor -- start 2024-03-30T13:11:10.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c250c830 0x5580c25c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2555d70 0x5580c25c8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c2556690 0x5580c2559ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5580c2416b00 con 0x5580c250c830 2024-03-30T13:11:10.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941fb700 con 0x5580c2556690 2024-03-30T13:11:10.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5580c2322270 con 0x5580c2555d70 2024-03-30T13:11:10.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 10 client.0 _ll_register_callbacks cb 0x7f1a8000e170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a988ba640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c250c830 0x5580c25c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a988ba640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c250c830 0x5580c25c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37490/0 (socket says 172.21.15.83:37490) 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a988ba640 1 -- 172.21.15.83:0/211958012 learned_addr learned my addr 172.21.15.83:0/211958012 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a988ba640 1 -- 172.21.15.83:0/211958012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2555d70 msgr2=0x5580c25c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a990bb640 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c2556690 0x5580c2559ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a93fff640 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2555d70 0x5580c25c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a988ba640 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2555d70 0x5580c25c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a988ba640 1 -- 172.21.15.83:0/211958012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c2556690 msgr2=0x5580c2559ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a988ba640 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c2556690 0x5580c2559ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a988ba640 1 -- 172.21.15.83:0/211958012 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c23dbf70 con 0x5580c250c830 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a988ba640 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c250c830 0x5580c25c8010 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009870 tx=0x7f1a8801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce65337172b8ef8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a737fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a737fe640 1 -- 172.21.15.83:0/211958012 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880ca040 con 0x5580c250c830 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a737fe640 1 -- 172.21.15.83:0/211958012 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1a880d1ae0 con 0x5580c250c830 2024-03-30T13:11:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 -- 172.21.15.83:0/211958012 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a80014600 con 0x5580c250c830 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a737fe640 1 -- 172.21.15.83:0/211958012 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f1a880b2040 con 0x5580c250c830 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 10 client.6096 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 -- 172.21.15.83:0/211958012 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5580c2301760 con 0x5580c250c830 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a737fe640 1 -- 172.21.15.83:0/211958012 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a80014600 con 0x5580c250c830 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a737fe640 1 -- 172.21.15.83:0/211958012 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f1a880d8050 con 0x5580c250c830 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 10 client.6096 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 10 client.6096 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 20 client.6096 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580c255a750 0x5580c255ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 4 client.6096 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628404}] 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 -- 172.21.15.83:0/211958012 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628404}) -- 0x5580c2367fe0 con 0x5580c255a750 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a93fff640 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580c255a750 0x5580c255ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a737fe640 10 client.6096 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a93fff640 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580c255a750 0x5580c255ab60 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d432d7535b05f43 server_cookie=1bbbae008e4aebbe in_seq=0 out_seq=0 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a737fe640 1 -- 172.21.15.83:0/211958012 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3800 (crc 0 0 0) 0x5580c2367fe0 con 0x5580c255a750 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a737fe640 10 client.6096 handle_command_reply: tid=0 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 client.6096 shutdown 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 -- 172.21.15.83:0/211958012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c250c830 msgr2=0x5580c25c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c250c830 0x5580c25c8010 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009870 tx=0x7f1a8801ada0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 -- 172.21.15.83:0/211958012 shutdown_connections 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580c2556690 0x5580c2559ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580c2555d70 0x5580c25c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580c255a750 0x5580c255ab60 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 --2- 172.21.15.83:0/211958012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580c250c830 0x5580c25c8010 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 -- 172.21.15.83:0/211958012 >> 172.21.15.83:0/211958012 conn(0x5580c25087e0 msgr2=0x5580c256d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a737fe640 0 client.6096 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 -- 172.21.15.83:0/211958012 shutdown_connections 2024-03-30T13:11:11.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 1 -- 172.21.15.83:0/211958012 wait complete. 2024-03-30T13:11:11.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9dca0000 20 client.6096 trim_cache size 0 max 16384 2024-03-30T13:11:11.003 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:11.003 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/xattr_user.c", 2024-03-30T13:11:11.003 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628404, 2024-03-30T13:11:11.003 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:11.003 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.596405+0000", 2024-03-30T13:11:11.003 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.012027+0000", 2024-03-30T13:11:11.003 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:11.003 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:11.004 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 1232, 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.012027+0000", 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:11.005 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1232, 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.596405+0000" 2024-03-30T13:11:11.006 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1232, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.596405+0000" 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 110, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 38, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:11.008 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:11.009 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.010 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:11.011 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.012 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:11.013 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:11.014 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:11.014 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:11.014 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:11.014 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:11.014 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:11.014 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:11.014 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.014 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:11.014 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:11.014 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:11.014 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:11.014 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:11.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/2260622140 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1a78067ff0 msgr2=0x7f1a7806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9ab1e640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1a78067ff0 0x7f1a7806a4b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1a880af000 tx=0x7f1a880a7000 comp rx=0 tx=0).stop 2024-03-30T13:11:11.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/2260622140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a94160140 msgr2=0x7f1a9406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9ab1e640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a94160140 0x7f1a9406cff0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c760 tx=0x7f1a8c00cc20 comp rx=0 tx=0).stop 2024-03-30T13:11:11.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/2260622140 shutdown_connections 2024-03-30T13:11:11.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9ab1e640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1a78067ff0 0x7f1a7806a4b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9ab1e640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a94160140 0x7f1a9406cff0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9ab1e640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a9415c7f0 0x7f1a94147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9ab1e640 1 --2- 172.21.15.83:0/2260622140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a9409aa50 0x7f1a9415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/2260622140 >> 172.21.15.83:0/2260622140 conn(0x7f1a940b3e70 msgr2=0x7f1a941594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/2260622140 shutdown_connections 2024-03-30T13:11:11.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:10.988+0000 7f1a9ab1e640 1 -- 172.21.15.83:0/2260622140 wait complete. 2024-03-30T13:11:11.017 DEBUG:tasks.cephfs.test_uninlining:getting inode info #8 of 23:1099511628402 2024-03-30T13:11:11.017 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628402 2024-03-30T13:11:11.017 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628402 2024-03-30T13:11:11.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.124+0000 7f6935211640 1 Processor -- start 2024-03-30T13:11:11.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.124+0000 7f6935211640 1 -- start start 2024-03-30T13:11:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.124+0000 7f6935211640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f693015b530 0x7f69300b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.124+0000 7f6935211640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f69300cf6e0 0x7f69300cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.124+0000 7f6935211640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69300b3c90 con 0x7f69300b4990 2024-03-30T13:11:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.124+0000 7f6935211640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f69300d0820 con 0x7f69300cf6e0 2024-03-30T13:11:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.124+0000 7f6935211640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f69300b3fc0 con 0x7f693015b530 2024-03-30T13:11:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692f59e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f69300cf6e0 0x7f69300cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692f59e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f69300cf6e0 0x7f69300cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37498/0 (socket says 172.21.15.83:37498) 2024-03-30T13:11:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692f59e640 1 -- 172.21.15.83:0/2499821726 learned_addr learned my addr 172.21.15.83:0/2499821726 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692ed9d640 1 --2- 172.21.15.83:0/2499821726 >> v2:172.21.15.153:3300/0 conn(0x7f693015b530 0x7f69300b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692f59e640 1 -- 172.21.15.83:0/2499821726 >> v2:172.21.15.153:3300/0 conn(0x7f693015b530 msgr2=0x7f69300b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692f59e640 1 --2- 172.21.15.83:0/2499821726 >> v2:172.21.15.153:3300/0 conn(0x7f693015b530 0x7f69300b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692f59e640 1 -- 172.21.15.83:0/2499821726 >> v1:172.21.15.153:6789/0 conn(0x7f69300b4990 legacy=0x7f69300ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692f59e640 1 -- 172.21.15.83:0/2499821726 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69300d0260 con 0x7f69300cf6e0 2024-03-30T13:11:11.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692ed9d640 1 --2- 172.21.15.83:0/2499821726 >> v2:172.21.15.153:3300/0 conn(0x7f693015b530 0x7f69300b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692f59e640 1 --2- 172.21.15.83:0/2499821726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69300cf6e0 0x7f69300cfb10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f69300d09a0 tx=0x7f692001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e68ed20bbae3873 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692dd9b640 1 -- 172.21.15.83:0/2499821726 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69200a5670 con 0x7f69300cf6e0 2024-03-30T13:11:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692dd9b640 1 -- 172.21.15.83:0/2499821726 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69200a5810 con 0x7f69300cf6e0 2024-03-30T13:11:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f692dd9b640 1 -- 172.21.15.83:0/2499821726 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69200a5be0 con 0x7f69300cf6e0 2024-03-30T13:11:11.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f6935211640 1 -- 172.21.15.83:0/2499821726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69300cf6e0 msgr2=0x7f69300cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f6935211640 1 --2- 172.21.15.83:0/2499821726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69300cf6e0 0x7f69300cfb10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f69300d09a0 tx=0x7f692001c920 comp rx=0 tx=0).stop 2024-03-30T13:11:11.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f6935211640 1 -- 172.21.15.83:0/2499821726 shutdown_connections 2024-03-30T13:11:11.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f6935211640 1 --2- 172.21.15.83:0/2499821726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69300cf6e0 0x7f69300cfb10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f6935211640 1 --2- 172.21.15.83:0/2499821726 >> v2:172.21.15.153:3300/0 conn(0x7f693015b530 0x7f69300b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f6935211640 1 -- 172.21.15.83:0/2499821726 >> 172.21.15.83:0/2499821726 conn(0x7f6930072f00 msgr2=0x7f693006b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f6935211640 1 -- 172.21.15.83:0/2499821726 shutdown_connections 2024-03-30T13:11:11.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.128+0000 7f6935211640 1 -- 172.21.15.83:0/2499821726 wait complete. 2024-03-30T13:11:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f6935211640 1 Processor -- start 2024-03-30T13:11:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f6935211640 1 -- start start 2024-03-30T13:11:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f6935211640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69300b4990 0x7f69301fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f6935211640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69300cf6e0 0x7f69301515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f6935211640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693015b530 0x7f69300ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f6935211640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f69300cd4f0 con 0x7f69300b4990 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f6935211640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69300cd370 con 0x7f693015b530 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f6935211640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f69301684c0 con 0x7f69300cf6e0 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f692ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69300b4990 0x7f69301fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f692ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69300b4990 0x7f69301fbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37508/0 (socket says 172.21.15.83:37508) 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f692ed9d640 1 -- 172.21.15.83:0/3416074795 learned_addr learned my addr 172.21.15.83:0/3416074795 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f692e59c640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69300cf6e0 0x7f69301515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f692f59e640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693015b530 0x7f69300ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f692ed9d640 1 -- 172.21.15.83:0/3416074795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69300cf6e0 msgr2=0x7f69301515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f692ed9d640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69300cf6e0 0x7f69301515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f692ed9d640 1 -- 172.21.15.83:0/3416074795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693015b530 msgr2=0x7f69300ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f692ed9d640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693015b530 0x7f69300ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f692ed9d640 1 -- 172.21.15.83:0/3416074795 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69300c5a60 con 0x7f69300b4990 2024-03-30T13:11:11.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f692f59e640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693015b530 0x7f69300ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f692ed9d640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69300b4990 0x7f69301fbf20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f692800c7f0 tx=0x7f692800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f69277fe640 1 -- 172.21.15.83:0/3416074795 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928015070 con 0x7f69300b4990 2024-03-30T13:11:11.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f69277fe640 1 -- 172.21.15.83:0/3416074795 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6928007820 con 0x7f69300b4990 2024-03-30T13:11:11.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f69277fe640 1 -- 172.21.15.83:0/3416074795 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928007c10 con 0x7f69300b4990 2024-03-30T13:11:11.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f6935211640 1 -- 172.21.15.83:0/3416074795 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69300c5d40 con 0x7f69300b4990 2024-03-30T13:11:11.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f6935211640 1 -- 172.21.15.83:0/3416074795 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69300c6300 con 0x7f69300b4990 2024-03-30T13:11:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.132+0000 7f69277fe640 1 -- 172.21.15.83:0/3416074795 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6928018070 con 0x7f69300b4990 2024-03-30T13:11:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f69277fe640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6910067fc0 0x7f691006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692e59c640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6910067fc0 0x7f691006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f69277fe640 1 -- 172.21.15.83:0/3416074795 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6928086640 con 0x7f69300b4990 2024-03-30T13:11:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 Processor -- start 2024-03-30T13:11:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692e59c640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6910067fc0 0x7f691006a480 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6930158ac0 tx=0x7f6918009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 -- start start 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 0x55d3df9ed150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9ed690 0x55d3df9a32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9a3830 0x55d3df9a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55d3df7f1aa0 con 0x55d3df9ed690 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d3df778af0 con 0x55d3df9a3830 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55d3df7eda50 con 0x55d3df9ecd70 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692e59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9ed690 0x55d3df9a32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692e59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9ed690 0x55d3df9a32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37524/0 (socket says 172.21.15.83:37524) 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692e59c640 1 -- 172.21.15.83:0/2713946051 learned_addr learned my addr 172.21.15.83:0/2713946051 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692f59e640 1 --2- 172.21.15.83:0/2713946051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9a3830 0x55d3df9a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692e59c640 1 -- 172.21.15.83:0/2713946051 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 msgr2=0x55d3df9ed150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692ed9d640 1 --2- 172.21.15.83:0/2713946051 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 0x55d3df9ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692e59c640 1 --2- 172.21.15.83:0/2713946051 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 0x55d3df9ed150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692e59c640 1 -- 172.21.15.83:0/2713946051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9a3830 msgr2=0x55d3df9a3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692e59c640 1 --2- 172.21.15.83:0/2713946051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9a3830 0x55d3df9a3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692e59c640 1 -- 172.21.15.83:0/2713946051 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3df776d00 con 0x55d3df9ed690 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692f59e640 1 --2- 172.21.15.83:0/2713946051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9a3830 0x55d3df9a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f692e59c640 1 --2- 172.21.15.83:0/2713946051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9ed690 0x55d3df9a32f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6918004500 tx=0x7f6918011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7bdbb2b33b2d1f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6924ff9640 1 -- 172.21.15.83:0/2713946051 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918007020 con 0x55d3df9ed690 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6924ff9640 1 -- 172.21.15.83:0/2713946051 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69180071c0 con 0x55d3df9ed690 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6924ff9640 1 -- 172.21.15.83:0/2713946051 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918007570 con 0x55d3df9ed690 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 -- 172.21.15.83:0/2713946051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9ed690 msgr2=0x55d3df9a32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 --2- 172.21.15.83:0/2713946051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9ed690 0x55d3df9a32f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6918004500 tx=0x7f6918011000 comp rx=0 tx=0).stop 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 -- 172.21.15.83:0/2713946051 shutdown_connections 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 --2- 172.21.15.83:0/2713946051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9a3830 0x55d3df9a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 --2- 172.21.15.83:0/2713946051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9ed690 0x55d3df9a32f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 --2- 172.21.15.83:0/2713946051 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 0x55d3df9ed150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 -- 172.21.15.83:0/2713946051 >> 172.21.15.83:0/2713946051 conn(0x55d3df99f7e0 msgr2=0x55d3df9a1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 -- 172.21.15.83:0/2713946051 shutdown_connections 2024-03-30T13:11:11.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 -- 172.21.15.83:0/2713946051 wait complete. 2024-03-30T13:11:11.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 -- start start 2024-03-30T13:11:11.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.136+0000 7f6938393000 1 Processor -- start 2024-03-30T13:11:11.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9a8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 0x55d3df9d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ed690 0x55d3df9d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55d3df7b9270 con 0x55d3df9a3830 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d3df7af6a0 con 0x55d3df9ed690 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55d3df789880 con 0x55d3df9ecd70 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 10 client.0 _ll_register_callbacks cb 0x55d3df98e490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9a8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9a8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37528/0 (socket says 172.21.15.83:37528) 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692ed9d640 1 -- 172.21.15.83:0/4287570993 learned_addr learned my addr 172.21.15.83:0/4287570993 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692f59e640 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ed690 0x55d3df9d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692e59c640 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 0x55d3df9d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692ed9d640 1 -- 172.21.15.83:0/4287570993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 msgr2=0x55d3df9d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692ed9d640 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 0x55d3df9d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692ed9d640 1 -- 172.21.15.83:0/4287570993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ed690 msgr2=0x55d3df9d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692ed9d640 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ed690 0x55d3df9d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692ed9d640 1 -- 172.21.15.83:0/4287570993 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3df7b6730 con 0x55d3df9a3830 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692ed9d640 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9a8c10 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f692805edb0 tx=0x7f6928056120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd6ee77302a848b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f690dffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f690dffb640 1 -- 172.21.15.83:0/4287570993 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692801f040 con 0x55d3df9a3830 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 -- 172.21.15.83:0/4287570993 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69180071c0 con 0x55d3df9a3830 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f690dffb640 1 -- 172.21.15.83:0/4287570993 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6928055b50 con 0x55d3df9a3830 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f690dffb640 1 -- 172.21.15.83:0/4287570993 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f692805aab0 con 0x55d3df9a3830 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 10 client.6108 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 -- 172.21.15.83:0/4287570993 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55d3df7a9ca0 con 0x55d3df9a3830 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f690dffb640 1 -- 172.21.15.83:0/4287570993 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69180071c0 con 0x55d3df9a3830 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f690dffb640 1 -- 172.21.15.83:0/4287570993 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f6928052450 con 0x55d3df9a3830 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 10 client.6108 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 10 client.6108 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 20 client.6108 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d3df9f45d0 0x55d3df9f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 4 client.6108 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:11.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 -- 172.21.15.83:0/4287570993 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3df78cc90 con 0x55d3df9f45d0 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692e59c640 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d3df9f45d0 0x55d3df9f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f690dffb640 10 client.6108 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f692e59c640 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d3df9f45d0 0x55d3df9f49b0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaab37c5730aebd8 server_cookie=f2aab9188214d5a2 in_seq=0 out_seq=0 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f690dffb640 1 -- 172.21.15.83:0/4287570993 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55d3df78cc90 con 0x55d3df9f45d0 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f690dffb640 10 client.6108 handle_command_reply: tid=0 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 client.6108 shutdown 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 -- 172.21.15.83:0/4287570993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 msgr2=0x55d3df9a8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9a8c10 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f692805edb0 tx=0x7f6928056120 comp rx=0 tx=0).stop 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 -- 172.21.15.83:0/4287570993 shutdown_connections 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ed690 0x55d3df9d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 0x55d3df9d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d3df9f45d0 0x55d3df9f49b0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 --2- 172.21.15.83:0/4287570993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9a8c10 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f690dffb640 0 client.6108 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 -- 172.21.15.83:0/4287570993 >> 172.21.15.83:0/4287570993 conn(0x55d3df99f7e0 msgr2=0x55d3df9a2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 -- 172.21.15.83:0/4287570993 shutdown_connections 2024-03-30T13:11:11.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 1 -- 172.21.15.83:0/4287570993 wait complete. 2024-03-30T13:11:11.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.140+0000 7f6938393000 20 client.6108 trim_cache size 0 max 16384 2024-03-30T13:11:11.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 Processor -- start 2024-03-30T13:11:11.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 -- start start 2024-03-30T13:11:11.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ecd70 0x55d3df9a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ed690 0x55d3df9a2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6930203b90 con 0x55d3df9a3830 2024-03-30T13:11:11.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69300c7130 con 0x55d3df9ecd70 2024-03-30T13:11:11.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f693006bf70 con 0x55d3df9ed690 2024-03-30T13:11:11.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f692ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f692ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9d2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37542/0 (socket says 172.21.15.83:37542) 2024-03-30T13:11:11.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f692ed9d640 1 -- 172.21.15.83:0/3770883126 learned_addr learned my addr 172.21.15.83:0/3770883126 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f692ed9d640 1 -- 172.21.15.83:0/3770883126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ed690 msgr2=0x55d3df9a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f692f59e640 1 --2- 172.21.15.83:0/3770883126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ed690 0x55d3df9a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f692ed9d640 1 --2- 172.21.15.83:0/3770883126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ed690 0x55d3df9a2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f692ed9d640 1 -- 172.21.15.83:0/3770883126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ecd70 msgr2=0x55d3df9a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f692ed9d640 1 --2- 172.21.15.83:0/3770883126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ecd70 0x55d3df9a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f692ed9d640 1 -- 172.21.15.83:0/3770883126 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3df778d00 con 0x55d3df9a3830 2024-03-30T13:11:11.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f692ed9d640 1 --2- 172.21.15.83:0/3770883126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9d2180 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6928006aa0 tx=0x7f692801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82c5c3ef00ab7e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f690ffff640 1 -- 172.21.15.83:0/3770883126 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692801f050 con 0x55d3df9a3830 2024-03-30T13:11:11.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f690ffff640 1 -- 172.21.15.83:0/3770883126 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6928055b50 con 0x55d3df9a3830 2024-03-30T13:11:11.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f690ffff640 1 -- 172.21.15.83:0/3770883126 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69280555c0 con 0x55d3df9a3830 2024-03-30T13:11:11.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 -- 172.21.15.83:0/3770883126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 msgr2=0x55d3df9d2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 --2- 172.21.15.83:0/3770883126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9d2180 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6928006aa0 tx=0x7f692801c000 comp rx=0 tx=0).stop 2024-03-30T13:11:11.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 -- 172.21.15.83:0/3770883126 shutdown_connections 2024-03-30T13:11:11.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 --2- 172.21.15.83:0/3770883126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ed690 0x55d3df9a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 --2- 172.21.15.83:0/3770883126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ecd70 0x55d3df9a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 --2- 172.21.15.83:0/3770883126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9d2180 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 -- 172.21.15.83:0/3770883126 >> 172.21.15.83:0/3770883126 conn(0x55d3df99f7e0 msgr2=0x55d3dfa03f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 -- 172.21.15.83:0/3770883126 shutdown_connections 2024-03-30T13:11:11.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.156+0000 7f6938393000 1 -- 172.21.15.83:0/3770883126 wait complete. 2024-03-30T13:11:11.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 -- start start 2024-03-30T13:11:11.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 Processor -- start 2024-03-30T13:11:11.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 0x55d3df9f1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ed690 0x55d3df9f1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55d3df789880 con 0x55d3df9a3830 2024-03-30T13:11:11.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69300c6ae0 con 0x55d3df9ed690 2024-03-30T13:11:11.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55d3df7b9270 con 0x55d3df9ecd70 2024-03-30T13:11:11.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 10 client.0 _ll_register_callbacks cb 0x7f69280069d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:11.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9f0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37556/0 (socket says 172.21.15.83:37556) 2024-03-30T13:11:11.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692ed9d640 1 -- 172.21.15.83:0/149004312 learned_addr learned my addr 172.21.15.83:0/149004312 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692f59e640 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ed690 0x55d3df9f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692e59c640 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 0x55d3df9f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692ed9d640 1 -- 172.21.15.83:0/149004312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 msgr2=0x55d3df9f1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692ed9d640 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 0x55d3df9f1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692ed9d640 1 -- 172.21.15.83:0/149004312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ed690 msgr2=0x55d3df9f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692ed9d640 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ed690 0x55d3df9f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692ed9d640 1 -- 172.21.15.83:0/149004312 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3df872f70 con 0x55d3df9a3830 2024-03-30T13:11:11.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692f59e640 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ed690 0x55d3df9f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692ed9d640 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9f0ad0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6928056690 tx=0x7f692801c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7222118d6cd638b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f690dffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:11.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f690dffb640 1 -- 172.21.15.83:0/149004312 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692801f070 con 0x55d3df9a3830 2024-03-30T13:11:11.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f690dffb640 1 -- 172.21.15.83:0/149004312 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f69280557c0 con 0x55d3df9a3830 2024-03-30T13:11:11.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 -- 172.21.15.83:0/149004312 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6928055b50 con 0x55d3df9a3830 2024-03-30T13:11:11.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f690dffb640 1 -- 172.21.15.83:0/149004312 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f69280529a0 con 0x55d3df9a3830 2024-03-30T13:11:11.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 10 client.6114 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:11.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 -- 172.21.15.83:0/149004312 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55d3df798760 con 0x55d3df9a3830 2024-03-30T13:11:11.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f690dffb640 1 -- 172.21.15.83:0/149004312 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6928055b50 con 0x55d3df9a3830 2024-03-30T13:11:11.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f690dffb640 1 -- 172.21.15.83:0/149004312 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f69280860c0 con 0x55d3df9a3830 2024-03-30T13:11:11.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 10 client.6114 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:11.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 10 client.6114 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:11.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 20 client.6114 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:11.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d3df9f1a90 0x55d3df9f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 4 client.6114 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628402}] 2024-03-30T13:11:11.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 -- 172.21.15.83:0/149004312 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628402}) -- 0x55d3df7fefe0 con 0x55d3df9f1a90 2024-03-30T13:11:11.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692e59c640 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d3df9f1a90 0x55d3df9f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f692e59c640 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d3df9f1a90 0x55d3df9f1ea0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=269d7ce5c07035bf server_cookie=b2e5550610cf6a6d in_seq=0 out_seq=0 2024-03-30T13:11:11.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f690dffb640 10 client.6114 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f690dffb640 1 -- 172.21.15.83:0/149004312 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3804 (crc 0 0 0) 0x55d3df7fefe0 con 0x55d3df9f1a90 2024-03-30T13:11:11.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f690dffb640 10 client.6114 handle_command_reply: tid=0 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 client.6114 shutdown 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 -- 172.21.15.83:0/149004312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 msgr2=0x55d3df9f0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9f0ad0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6928056690 tx=0x7f692801c070 comp rx=0 tx=0).stop 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 -- 172.21.15.83:0/149004312 shutdown_connections 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3df9ed690 0x55d3df9f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d3df9ecd70 0x55d3df9f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d3df9f1a90 0x55d3df9f1ea0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 --2- 172.21.15.83:0/149004312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3df9a3830 0x55d3df9f0ad0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f690dffb640 0 client.6114 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 -- 172.21.15.83:0/149004312 >> 172.21.15.83:0/149004312 conn(0x55d3df99f7e0 msgr2=0x55d3dfa04620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 -- 172.21.15.83:0/149004312 shutdown_connections 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 1 -- 172.21.15.83:0/149004312 wait complete. 2024-03-30T13:11:11.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.160+0000 7f6938393000 20 client.6114 trim_cache size 0 max 16384 2024-03-30T13:11:11.180 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:11.180 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/xattr_security.c", 2024-03-30T13:11:11.180 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628402, 2024-03-30T13:11:11.180 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:11.180 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.601873+0000", 2024-03-30T13:11:11.180 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.008673+0000", 2024-03-30T13:11:11.180 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:11.180 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:11.181 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:11.182 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:11.182 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.182 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:11.182 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 1473, 2024-03-30T13:11:11.182 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:11.182 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:11.182 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:11.182 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:11.182 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:11.182 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.008673+0000", 2024-03-30T13:11:11.182 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:11.182 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:11.183 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.184 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1473, 2024-03-30T13:11:11.184 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:11.184 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:11.184 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:11.184 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.601873+0000" 2024-03-30T13:11:11.184 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.184 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:11.184 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.184 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1473, 2024-03-30T13:11:11.184 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:11.184 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:11.184 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:11.185 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.601873+0000" 2024-03-30T13:11:11.185 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.185 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 118, 2024-03-30T13:11:11.185 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:11.185 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:11.185 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 34, 2024-03-30T13:11:11.185 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:11.185 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:11.185 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:11.186 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:11.186 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:11.186 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:11.186 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:11.186 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.186 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:11.186 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:11.186 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:11.186 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:11.186 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:11.186 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:11.187 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.187 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:11.187 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:11.187 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:11.187 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:11.187 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:11.187 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:11.187 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.187 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:11.187 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:11.188 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:11.188 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:11.188 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.188 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:11.188 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.188 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:11.188 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:11.188 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:11.188 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:11.188 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:11.188 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:11.188 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:11.189 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:11.189 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:11.189 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:11.189 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:11.189 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:11.189 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:11.189 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.189 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:11.189 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:11.189 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.189 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.190 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:11.190 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.190 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.190 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.190 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.190 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.190 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.190 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:11.190 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:11.190 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:11.191 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:11.191 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:11.191 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:11.191 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:11.191 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.191 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.191 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:11.191 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.191 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.191 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.191 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.191 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.192 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.192 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:11.192 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:11.192 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:11.192 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.192 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.192 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:11.192 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.193 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.193 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.193 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.193 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.193 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.193 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:11.193 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:11.193 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:11.193 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:11.193 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:11.193 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.193 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:11.194 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:11.194 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:11.194 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:11.194 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:11.194 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:11.194 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:11.194 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:11.194 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.194 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:11.194 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:11.194 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:11.194 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:11.195 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.164+0000 7f6935211640 1 -- 172.21.15.83:0/3416074795 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6910067fc0 msgr2=0x7f691006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.164+0000 7f6935211640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6910067fc0 0x7f691006a480 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6930158ac0 tx=0x7f6918009040 comp rx=0 tx=0).stop 2024-03-30T13:11:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.164+0000 7f6935211640 1 -- 172.21.15.83:0/3416074795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69300b4990 msgr2=0x7f69301fbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.164+0000 7f6935211640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69300b4990 0x7f69301fbf20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f692800c7f0 tx=0x7f692800ccb0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.164+0000 7f6935211640 1 -- 172.21.15.83:0/3416074795 shutdown_connections 2024-03-30T13:11:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.164+0000 7f6935211640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6910067fc0 0x7f691006a480 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.164+0000 7f6935211640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693015b530 0x7f69300ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.164+0000 7f6935211640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69300cf6e0 0x7f69301515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.164+0000 7f6935211640 1 --2- 172.21.15.83:0/3416074795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69300b4990 0x7f69301fbf20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.164+0000 7f6935211640 1 -- 172.21.15.83:0/3416074795 >> 172.21.15.83:0/3416074795 conn(0x7f6930072f00 msgr2=0x7f6930153600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.164+0000 7f6935211640 1 -- 172.21.15.83:0/3416074795 shutdown_connections 2024-03-30T13:11:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.164+0000 7f6935211640 1 -- 172.21.15.83:0/3416074795 wait complete. 2024-03-30T13:11:11.200 DEBUG:tasks.cephfs.test_uninlining:getting inode info #9 of 23:1099511628387 2024-03-30T13:11:11.200 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628387 2024-03-30T13:11:11.200 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628387 2024-03-30T13:11:11.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81ac9b7640 1 Processor -- start 2024-03-30T13:11:11.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81ac9b7640 1 -- start start 2024-03-30T13:11:11.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81ac9b7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f81a8145c40 0x7f81a809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81ac9b7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81a8160c30 0x7f81a80b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81ac9b7640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81a80b0690 con 0x7f81a8160090 2024-03-30T13:11:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81ac9b7640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f81a80ae3a0 con 0x7f81a8145c40 2024-03-30T13:11:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81ac9b7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f81a80b3520 con 0x7f81a8160c30 2024-03-30T13:11:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81a659c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f81a8145c40 0x7f81a809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81a5d9b640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f81a8160090 0x7f81a8160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57442/0 (socket says 172.21.15.83:57442) 2024-03-30T13:11:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81a5d9b640 1 -- 172.21.15.83:0/2960729782 learned_addr learned my addr 172.21.15.83:0/2960729782 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81a6d9d640 1 --2- 172.21.15.83:0/2960729782 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81a8160c30 0x7f81a80b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81a659c640 1 -- 172.21.15.83:0/2960729782 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81a8160c30 msgr2=0x7f81a80b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81a659c640 1 --2- 172.21.15.83:0/2960729782 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81a8160c30 0x7f81a80b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81a659c640 1 -- 172.21.15.83:0/2960729782 >> v1:172.21.15.83:6789/0 conn(0x7f81a8160090 legacy=0x7f81a8160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.304+0000 7f81a659c640 1 -- 172.21.15.83:0/2960729782 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a80b3800 con 0x7f81a8145c40 2024-03-30T13:11:11.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81a659c640 1 --2- 172.21.15.83:0/2960729782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81a8145c40 0x7f81a809aa50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f81980097c0 tx=0x7f819801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af02fb371d76424 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81a559a640 1 -- 172.21.15.83:0/2960729782 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980b1070 con 0x7f81a8145c40 2024-03-30T13:11:11.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81a559a640 1 -- 172.21.15.83:0/2960729782 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81980ac410 con 0x7f81a8145c40 2024-03-30T13:11:11.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81a559a640 1 -- 172.21.15.83:0/2960729782 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980ac7e0 con 0x7f81a8145c40 2024-03-30T13:11:11.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 -- 172.21.15.83:0/2960729782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81a8145c40 msgr2=0x7f81a809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 --2- 172.21.15.83:0/2960729782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81a8145c40 0x7f81a809aa50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f81980097c0 tx=0x7f819801c4a0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 -- 172.21.15.83:0/2960729782 shutdown_connections 2024-03-30T13:11:11.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 --2- 172.21.15.83:0/2960729782 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81a8160c30 0x7f81a80b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 --2- 172.21.15.83:0/2960729782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81a8145c40 0x7f81a809aa50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 -- 172.21.15.83:0/2960729782 >> 172.21.15.83:0/2960729782 conn(0x7f81a8072d30 msgr2=0x7f81a80b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 -- 172.21.15.83:0/2960729782 shutdown_connections 2024-03-30T13:11:11.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 -- 172.21.15.83:0/2960729782 wait complete. 2024-03-30T13:11:11.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 Processor -- start 2024-03-30T13:11:11.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 -- start start 2024-03-30T13:11:11.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81a8145c40 0x7f81a815c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81a8160090 0x7f81a809d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a8160c30 0x7f81a80d1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f81a80b1ad0 con 0x7f81a8145c40 2024-03-30T13:11:11.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f81a80b1950 con 0x7f81a8160c30 2024-03-30T13:11:11.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81ac9b7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f81a80b1c50 con 0x7f81a8160090 2024-03-30T13:11:11.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81a659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81a8145c40 0x7f81a815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81a659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81a8145c40 0x7f81a815c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37566/0 (socket says 172.21.15.83:37566) 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.308+0000 7f81a659c640 1 -- 172.21.15.83:0/3802882876 learned_addr learned my addr 172.21.15.83:0/3802882876 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81a659c640 1 -- 172.21.15.83:0/3802882876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81a8160090 msgr2=0x7f81a809d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81a5d9b640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81a8160090 0x7f81a809d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81a659c640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81a8160090 0x7f81a809d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81a6d9d640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a8160c30 0x7f81a80d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81a659c640 1 -- 172.21.15.83:0/3802882876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a8160c30 msgr2=0x7f81a80d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81a659c640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a8160c30 0x7f81a80d1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81a659c640 1 -- 172.21.15.83:0/3802882876 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a809e460 con 0x7f81a8145c40 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81a659c640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81a8145c40 0x7f81a815c110 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f81980af040 tx=0x7f8198019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f8196ffd640 1 -- 172.21.15.83:0/3802882876 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980b1040 con 0x7f81a8145c40 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f8196ffd640 1 -- 172.21.15.83:0/3802882876 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81980bc070 con 0x7f81a8145c40 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f8196ffd640 1 -- 172.21.15.83:0/3802882876 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980b5630 con 0x7f81a8145c40 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81ac9b7640 1 -- 172.21.15.83:0/3802882876 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a809e740 con 0x7f81a8145c40 2024-03-30T13:11:11.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81ac9b7640 1 -- 172.21.15.83:0/3802882876 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a809ed00 con 0x7f81a8145c40 2024-03-30T13:11:11.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f8196ffd640 1 -- 172.21.15.83:0/3802882876 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f81980b57d0 con 0x7f81a8145c40 2024-03-30T13:11:11.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f8196ffd640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8188067fc0 0x7f818806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f8196ffd640 1 -- 172.21.15.83:0/3802882876 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8198120060 con 0x7f81a8145c40 2024-03-30T13:11:11.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81a5d9b640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8188067fc0 0x7f818806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81a5d9b640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8188067fc0 0x7f818806a480 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f81a80d1d00 tx=0x7f819c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81afb39000 1 Processor -- start 2024-03-30T13:11:11.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.312+0000 7f81afb39000 1 -- start start 2024-03-30T13:11:11.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 0x55e89a23a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a1f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 0x55e89a1f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e89a03eaa0 con 0x55e89a23a690 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e899fc5af0 con 0x55e89a239d70 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55e89a03aa50 con 0x55e89a1f0830 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a5d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a1f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a5d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a1f02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37576/0 (socket says 172.21.15.83:37576) 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a5d9b640 1 -- 172.21.15.83:0/447123058 learned_addr learned my addr 172.21.15.83:0/447123058 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a5d9b640 1 -- 172.21.15.83:0/447123058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 msgr2=0x55e89a1f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a5d9b640 1 --2- 172.21.15.83:0/447123058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 0x55e89a1f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a5d9b640 1 -- 172.21.15.83:0/447123058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 msgr2=0x55e89a23a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a5d9b640 1 --2- 172.21.15.83:0/447123058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 0x55e89a23a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a5d9b640 1 -- 172.21.15.83:0/447123058 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e899fc3d00 con 0x55e89a23a690 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a5d9b640 1 --2- 172.21.15.83:0/447123058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a1f02f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f819c005be0 tx=0x7f819c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685c53ad6983ac0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f8187fff640 1 -- 172.21.15.83:0/447123058 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c00d8a0 con 0x55e89a23a690 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f8187fff640 1 -- 172.21.15.83:0/447123058 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f819c00da40 con 0x55e89a23a690 2024-03-30T13:11:11.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f8187fff640 1 -- 172.21.15.83:0/447123058 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c00ddf0 con 0x55e89a23a690 2024-03-30T13:11:11.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 -- 172.21.15.83:0/447123058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 msgr2=0x55e89a1f02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 --2- 172.21.15.83:0/447123058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a1f02f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f819c005be0 tx=0x7f819c010000 comp rx=0 tx=0).stop 2024-03-30T13:11:11.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 -- 172.21.15.83:0/447123058 shutdown_connections 2024-03-30T13:11:11.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 --2- 172.21.15.83:0/447123058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 0x55e89a1f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 --2- 172.21.15.83:0/447123058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a1f02f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 --2- 172.21.15.83:0/447123058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 0x55e89a23a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 -- 172.21.15.83:0/447123058 >> 172.21.15.83:0/447123058 conn(0x55e89a1ec7e0 msgr2=0x55e89a1eebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 -- 172.21.15.83:0/447123058 shutdown_connections 2024-03-30T13:11:11.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 -- 172.21.15.83:0/447123058 wait complete. 2024-03-30T13:11:11.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 -- start start 2024-03-30T13:11:11.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 Processor -- start 2024-03-30T13:11:11.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 0x55e89a1f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 0x55e89a21eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a21f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e89a006270 con 0x55e89a23a690 2024-03-30T13:11:11.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e899ffc6a0 con 0x55e89a239d70 2024-03-30T13:11:11.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55e899fd6880 con 0x55e89a1f0830 2024-03-30T13:11:11.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81afb39000 10 client.0 _ll_register_callbacks cb 0x55e89a1db490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:11.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a21f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a21f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37590/0 (socket says 172.21.15.83:37590) 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a6d9d640 1 -- 172.21.15.83:0/3082115379 learned_addr learned my addr 172.21.15.83:0/3082115379 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a5d9b640 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 0x55e89a21eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a659c640 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 0x55e89a1f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a6d9d640 1 -- 172.21.15.83:0/3082115379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 msgr2=0x55e89a1f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a6d9d640 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 0x55e89a1f5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a6d9d640 1 -- 172.21.15.83:0/3082115379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 msgr2=0x55e89a21eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a6d9d640 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 0x55e89a21eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a6d9d640 1 -- 172.21.15.83:0/3082115379 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e89a003730 con 0x55e89a23a690 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.316+0000 7f81a5d9b640 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 0x55e89a21eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81a6d9d640 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a21f2e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f81a00079d0 tx=0x7f81a0007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa64c3b7f154049 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81857fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81857fa640 1 -- 172.21.15.83:0/3082115379 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0018020 con 0x55e89a23a690 2024-03-30T13:11:11.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81857fa640 1 -- 172.21.15.83:0/3082115379 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f81a000fc00 con 0x55e89a23a690 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 -- 172.21.15.83:0/3082115379 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f819c00da40 con 0x55e89a23a690 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81857fa640 1 -- 172.21.15.83:0/3082115379 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f81a0022050 con 0x55e89a23a690 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 10 client.6129 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 -- 172.21.15.83:0/3082115379 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55e899ff6ca0 con 0x55e89a23a690 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81857fa640 1 -- 172.21.15.83:0/3082115379 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f819c00da40 con 0x55e89a23a690 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81857fa640 1 -- 172.21.15.83:0/3082115379 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f81a0025020 con 0x55e89a23a690 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 10 client.6129 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 10 client.6129 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 20 client.6129 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e89a2415d0 0x55e89a2419e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 4 client.6129 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 -- 172.21.15.83:0/3082115379 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e899fd9c90 con 0x55e89a2415d0 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81a659c640 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e89a2415d0 0x55e89a2419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81857fa640 10 client.6129 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81a659c640 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e89a2415d0 0x55e89a2419e0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d67ac6f4d36af9c server_cookie=cada82aef40cb427 in_seq=0 out_seq=0 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81857fa640 1 -- 172.21.15.83:0/3082115379 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55e899fd9c90 con 0x55e89a2415d0 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81857fa640 10 client.6129 handle_command_reply: tid=0 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 client.6129 shutdown 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 -- 172.21.15.83:0/3082115379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 msgr2=0x55e89a21f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a21f2e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f81a00079d0 tx=0x7f81a0007e90 comp rx=0 tx=0).stop 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 -- 172.21.15.83:0/3082115379 shutdown_connections 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e89a2415d0 0x55e89a2419e0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a21f2e0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 0x55e89a21eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81857fa640 0 client.6129 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 --2- 172.21.15.83:0/3082115379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 0x55e89a1f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 -- 172.21.15.83:0/3082115379 >> 172.21.15.83:0/3082115379 conn(0x55e89a1ec7e0 msgr2=0x55e89a1ef460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 -- 172.21.15.83:0/3082115379 shutdown_connections 2024-03-30T13:11:11.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 1 -- 172.21.15.83:0/3082115379 wait complete. 2024-03-30T13:11:11.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.320+0000 7f81afb39000 20 client.6129 trim_cache size 0 max 16384 2024-03-30T13:11:11.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 Processor -- start 2024-03-30T13:11:11.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- start start 2024-03-30T13:11:11.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a1f0830 0x55e89a21f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a239d70 0x55e89a1eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a23a690 0x55e89a1ef110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f81a8203880 con 0x55e89a1f0830 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f81a82028e0 con 0x55e89a23a690 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f81a8201c70 con 0x55e89a239d70 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a1f0830 0x55e89a21f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a1f0830 0x55e89a21f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37604/0 (socket says 172.21.15.83:37604) 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a659c640 1 -- 172.21.15.83:0/2965903836 learned_addr learned my addr 172.21.15.83:0/2965903836 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a659c640 1 -- 172.21.15.83:0/2965903836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a239d70 msgr2=0x55e89a1eebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a5d9b640 1 --2- 172.21.15.83:0/2965903836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a239d70 0x55e89a1eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a659c640 1 --2- 172.21.15.83:0/2965903836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a239d70 0x55e89a1eebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a659c640 1 -- 172.21.15.83:0/2965903836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a23a690 msgr2=0x55e89a1ef110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a659c640 1 --2- 172.21.15.83:0/2965903836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a23a690 0x55e89a1ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a659c640 1 -- 172.21.15.83:0/2965903836 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e899fc5d00 con 0x55e89a1f0830 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a5d9b640 1 --2- 172.21.15.83:0/2965903836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a239d70 0x55e89a1eebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a659c640 1 --2- 172.21.15.83:0/2965903836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a1f0830 0x55e89a21f180 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f81980f00a0 tx=0x7f8198006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff931fac29d4c99 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81877fe640 1 -- 172.21.15.83:0/2965903836 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980f0110 con 0x55e89a1f0830 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81877fe640 1 -- 172.21.15.83:0/2965903836 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81980f44c0 con 0x55e89a1f0830 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81877fe640 1 -- 172.21.15.83:0/2965903836 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980f8cf0 con 0x55e89a1f0830 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- 172.21.15.83:0/2965903836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a1f0830 msgr2=0x55e89a21f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 --2- 172.21.15.83:0/2965903836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a1f0830 0x55e89a21f180 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f81980f00a0 tx=0x7f8198006ee0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- 172.21.15.83:0/2965903836 shutdown_connections 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 --2- 172.21.15.83:0/2965903836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a23a690 0x55e89a1ef110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 --2- 172.21.15.83:0/2965903836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a239d70 0x55e89a1eebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 --2- 172.21.15.83:0/2965903836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a1f0830 0x55e89a21f180 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- 172.21.15.83:0/2965903836 >> 172.21.15.83:0/2965903836 conn(0x55e89a1ec7e0 msgr2=0x55e89a250f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- 172.21.15.83:0/2965903836 shutdown_connections 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- 172.21.15.83:0/2965903836 wait complete. 2024-03-30T13:11:11.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- start start 2024-03-30T13:11:11.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 Processor -- start 2024-03-30T13:11:11.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 0x55e89a2ac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 0x55e89a2ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a23dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e89a006270 con 0x55e89a23a690 2024-03-30T13:11:11.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f81a8202290 con 0x55e89a239d70 2024-03-30T13:11:11.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55e89a0fab00 con 0x55e89a1f0830 2024-03-30T13:11:11.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81afb39000 10 client.0 _ll_register_callbacks cb 0x7f81a0009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:11.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a23dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a23dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37620/0 (socket says 172.21.15.83:37620) 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a6d9d640 1 -- 172.21.15.83:0/2719111919 learned_addr learned my addr 172.21.15.83:0/2719111919 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a6d9d640 1 -- 172.21.15.83:0/2719111919 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 msgr2=0x55e89a2ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a6d9d640 1 --2- 172.21.15.83:0/2719111919 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 0x55e89a2ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a6d9d640 1 -- 172.21.15.83:0/2719111919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 msgr2=0x55e89a2ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a6d9d640 1 --2- 172.21.15.83:0/2719111919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 0x55e89a2ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.336+0000 7f81a6d9d640 1 -- 172.21.15.83:0/2719111919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e89a0bff70 con 0x55e89a23a690 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81a6d9d640 1 --2- 172.21.15.83:0/2719111919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a23dad0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f81a0002240 tx=0x7f81a0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b001e436d856dea1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81857fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81857fa640 1 -- 172.21.15.83:0/2719111919 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a002c020 con 0x55e89a23a690 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81857fa640 1 -- 172.21.15.83:0/2719111919 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f81a0003db0 con 0x55e89a23a690 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 -- 172.21.15.83:0/2719111919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81980f44c0 con 0x55e89a23a690 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81857fa640 1 -- 172.21.15.83:0/2719111919 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f81a0018040 con 0x55e89a23a690 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 10 client.6135 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:11.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 -- 172.21.15.83:0/2719111919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55e899fe5760 con 0x55e89a23a690 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81857fa640 1 -- 172.21.15.83:0/2719111919 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81980f44c0 con 0x55e89a23a690 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81857fa640 1 -- 172.21.15.83:0/2719111919 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f81a0025050 con 0x55e89a23a690 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 10 client.6135 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 10 client.6135 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 20 client.6135 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 --2- 172.21.15.83:0/2719111919 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e89a23e950 0x55e89a23ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 4 client.6135 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628387}] 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 -- 172.21.15.83:0/2719111919 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628387}) -- 0x55e89a04bfe0 con 0x55e89a23e950 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81a659c640 1 --2- 172.21.15.83:0/2719111919 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e89a23e950 0x55e89a23ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81857fa640 10 client.6135 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81a659c640 1 --2- 172.21.15.83:0/2719111919 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e89a23e950 0x55e89a23ed60 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17d5e704d90cb08c server_cookie=4afcb2edfc9cd650 in_seq=0 out_seq=0 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81857fa640 1 -- 172.21.15.83:0/2719111919 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3792 (crc 0 0 0) 0x55e89a04bfe0 con 0x55e89a23e950 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81857fa640 10 client.6135 handle_command_reply: tid=0 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 client.6135 shutdown 2024-03-30T13:11:11.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 -- 172.21.15.83:0/2719111919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 msgr2=0x55e89a23dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 --2- 172.21.15.83:0/2719111919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a23dad0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f81a0002240 tx=0x7f81a0004ac0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 -- 172.21.15.83:0/2719111919 shutdown_connections 2024-03-30T13:11:11.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 --2- 172.21.15.83:0/2719111919 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e89a23e950 0x55e89a23ed60 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 --2- 172.21.15.83:0/2719111919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e89a23a690 0x55e89a23dad0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81857fa640 0 client.6135 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 --2- 172.21.15.83:0/2719111919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e89a239d70 0x55e89a2ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 --2- 172.21.15.83:0/2719111919 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e89a1f0830 0x55e89a2ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 -- 172.21.15.83:0/2719111919 >> 172.21.15.83:0/2719111919 conn(0x55e89a1ec7e0 msgr2=0x55e89a251620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 -- 172.21.15.83:0/2719111919 shutdown_connections 2024-03-30T13:11:11.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 1 -- 172.21.15.83:0/2719111919 wait complete. 2024-03-30T13:11:11.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81afb39000 20 client.6135 trim_cache size 0 max 16384 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/Makefile", 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628387, 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.627237+0000", 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:35.955354+0000", 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:11.354 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 378, 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:11.355 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:35.955354+0000", 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:11.356 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 378, 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.627237+0000" 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 378, 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:11.357 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:11.358 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.627237+0000" 2024-03-30T13:11:11.358 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.358 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 122, 2024-03-30T13:11:11.358 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:11.358 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:11.358 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 4, 2024-03-30T13:11:11.358 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:11.358 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:11.358 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:11.358 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:11.359 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.360 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:11.361 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:11.362 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.363 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.364 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:11.365 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:11.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81ac9b7640 1 -- 172.21.15.83:0/3802882876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8188067fc0 msgr2=0x7f818806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81ac9b7640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8188067fc0 0x7f818806a480 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f81a80d1d00 tx=0x7f819c009040 comp rx=0 tx=0).stop 2024-03-30T13:11:11.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81ac9b7640 1 -- 172.21.15.83:0/3802882876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81a8145c40 msgr2=0x7f81a815c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81ac9b7640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81a8145c40 0x7f81a815c110 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f81980af040 tx=0x7f8198019240 comp rx=0 tx=0).stop 2024-03-30T13:11:11.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81ac9b7640 1 -- 172.21.15.83:0/3802882876 shutdown_connections 2024-03-30T13:11:11.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81ac9b7640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8188067fc0 0x7f818806a480 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81ac9b7640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a8160c30 0x7f81a80d1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81ac9b7640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81a8160090 0x7f81a809d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81ac9b7640 1 --2- 172.21.15.83:0/3802882876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81a8145c40 0x7f81a815c110 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81ac9b7640 1 -- 172.21.15.83:0/3802882876 >> 172.21.15.83:0/3802882876 conn(0x7f81a8072d30 msgr2=0x7f81a806eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81ac9b7640 1 -- 172.21.15.83:0/3802882876 shutdown_connections 2024-03-30T13:11:11.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.340+0000 7f81ac9b7640 1 -- 172.21.15.83:0/3802882876 wait complete. 2024-03-30T13:11:11.370 DEBUG:tasks.cephfs.test_uninlining:getting inode info #10 of 23:1099511628399 2024-03-30T13:11:11.370 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628399 2024-03-30T13:11:11.370 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628399 2024-03-30T13:11:11.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2c1a8e640 1 Processor -- start 2024-03-30T13:11:11.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2c1a8e640 1 -- start start 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2c1a8e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc2bc15d490 0x7fc2bc0b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2c1a8e640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2bc0d1270 con 0x7fc2bc145ed0 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2c1a8e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2bc0d1550 con 0x7fc2bc06bd70 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2c1a8e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc2bc0d2030 con 0x7fc2bc15d490 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bb7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc2bc145ed0 0x7fc2bc06b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57446/0 (socket says 172.21.15.83:57446) 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bb7fe640 1 -- 172.21.15.83:0/4294847955 learned_addr learned my addr 172.21.15.83:0/4294847955 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bbfff640 1 --2- 172.21.15.83:0/4294847955 >> v2:172.21.15.153:3300/0 conn(0x7fc2bc15d490 0x7fc2bc0b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519738624 0 0) 0x7fc2bc0d1270 con 0x7fc2bc145ed0 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2a4003530 con 0x7fc2bc145ed0 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3861400804 0 0) 0x7fc2a4003530 con 0x7fc2bc145ed0 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 >> v2:172.21.15.153:3300/0 conn(0x7fc2bc15d490 msgr2=0x7fc2bc0b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 --2- 172.21.15.83:0/4294847955 >> v2:172.21.15.153:3300/0 conn(0x7fc2bc15d490 0x7fc2bc0b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 >> v1:172.21.15.153:6789/0 conn(0x7fc2bc06bd70 legacy=0x7fc2bc15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2bc0d1830 con 0x7fc2bc145ed0 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fc2b0001680 con 0x7fc2bc145ed0 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bbfff640 1 --2- 172.21.15.83:0/4294847955 >> v2:172.21.15.153:3300/0 conn(0x7fc2bc15d490 0x7fc2bc0b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 >> v1:172.21.15.83:6789/0 conn(0x7fc2bc145ed0 legacy=0x7fc2bc06b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 --2- 172.21.15.83:0/4294847955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2a40039c0 0x7fc2a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 --2- 172.21.15.83:0/4294847955 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2a4004810 0x7fc2a4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 --2- 172.21.15.83:0/4294847955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2a40052f0 0x7fc2a400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc0d2030 con 0x7fc2a40039c0 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a400c1c0 con 0x7fc2a40052f0 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc2a400c3c0 con 0x7fc2a4004810 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/4294847955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2a40039c0 0x7fc2a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bbfff640 1 --2- 172.21.15.83:0/4294847955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2a40052f0 0x7fc2a400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2baffd640 1 --2- 172.21.15.83:0/4294847955 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2a4004810 0x7fc2a4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bb7fe640 1 -- 172.21.15.83:0/4294847955 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2a4004810 msgr2=0x7fc2a4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/4294847955 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2a4004810 0x7fc2a4004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bb7fe640 1 -- 172.21.15.83:0/4294847955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2a40052f0 msgr2=0x7fc2a400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/4294847955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2a40052f0 0x7fc2a400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bb7fe640 1 -- 172.21.15.83:0/4294847955 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a4003530 con 0x7fc2a40039c0 2024-03-30T13:11:11.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bbfff640 1 --2- 172.21.15.83:0/4294847955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2a40052f0 0x7fc2a400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.472+0000 7fc2bbfff640 1 -- 172.21.15.83:0/4294847955 reap_dead start 2024-03-30T13:11:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/4294847955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2a40039c0 0x7fc2a4003de0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000c190 tx=0x7fc2b001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8824fe54499f12 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0007d00 con 0x7fc2a40039c0 2024-03-30T13:11:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b00a9020 con 0x7fc2a40039c0 2024-03-30T13:11:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2ba7fc640 1 -- 172.21.15.83:0/4294847955 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0005ae0 con 0x7fc2a40039c0 2024-03-30T13:11:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/4294847955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2a40039c0 msgr2=0x7fc2a4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 --2- 172.21.15.83:0/4294847955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2a40039c0 0x7fc2a4003de0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000c190 tx=0x7fc2b001cc40 comp rx=0 tx=0).stop 2024-03-30T13:11:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/4294847955 shutdown_connections 2024-03-30T13:11:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 --2- 172.21.15.83:0/4294847955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2a40039c0 0x7fc2a4003de0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/4294847955 >> 172.21.15.83:0/4294847955 conn(0x7fc2bc09aa50 msgr2=0x7fc2bc0b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/4294847955 shutdown_connections 2024-03-30T13:11:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/4294847955 wait complete. 2024-03-30T13:11:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 Processor -- start 2024-03-30T13:11:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 -- start start 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2a40039c0 0x7fc2bc0b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2bc13ad90 0x7fc2bc141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2bc06f780 0x7fc2bc06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc160a20 con 0x7fc2bc06f780 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc0b7250 con 0x7fc2a40039c0 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2c1a8e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc2bc160ba0 con 0x7fc2bc13ad90 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.476+0000 7fc2bbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2bc06f780 0x7fc2bc06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2bbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2bc06f780 0x7fc2bc06fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37630/0 (socket says 172.21.15.83:37630) 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2bbfff640 1 -- 172.21.15.83:0/3852657137 learned_addr learned my addr 172.21.15.83:0/3852657137 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2baffd640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2bc13ad90 0x7fc2bc141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2a40039c0 0x7fc2bc0b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2bbfff640 1 -- 172.21.15.83:0/3852657137 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2bc13ad90 msgr2=0x7fc2bc141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2bbfff640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2bc13ad90 0x7fc2bc141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2bbfff640 1 -- 172.21.15.83:0/3852657137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2a40039c0 msgr2=0x7fc2bc0b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2bbfff640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2a40039c0 0x7fc2bc0b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2bbfff640 1 -- 172.21.15.83:0/3852657137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2bc0b47c0 con 0x7fc2bc06f780 2024-03-30T13:11:11.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2a40039c0 0x7fc2bc0b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2bbfff640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2bc06f780 0x7fc2bc06fc00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0ae720 tx=0x7fc2b4004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2a3fff640 1 -- 172.21.15.83:0/3852657137 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4019070 con 0x7fc2bc06f780 2024-03-30T13:11:11.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2a3fff640 1 -- 172.21.15.83:0/3852657137 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b4007cd0 con 0x7fc2bc06f780 2024-03-30T13:11:11.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/3852657137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2bc0b4aa0 con 0x7fc2bc06f780 2024-03-30T13:11:11.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2a3fff640 1 -- 172.21.15.83:0/3852657137 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4014640 con 0x7fc2bc06f780 2024-03-30T13:11:11.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/3852657137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2bc0b5060 con 0x7fc2bc06f780 2024-03-30T13:11:11.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2a3fff640 1 -- 172.21.15.83:0/3852657137 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc2b401c070 con 0x7fc2bc06f780 2024-03-30T13:11:11.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2a3fff640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc2a8067fc0 0x7fc2a806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2c4c10000 1 Processor -- start 2024-03-30T13:11:11.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2a3fff640 1 -- 172.21.15.83:0/3852657137 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc2b4086000 con 0x7fc2bc06f780 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc2a8067fc0 0x7fc2a806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2c4c10000 1 -- start start 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.480+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc2a8067fc0 0x7fc2a806a480 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00aa000 tx=0x7fc2bc0d1440 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b584150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 0x56522b53a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b53a830 0x56522b53ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56522b388aa0 con 0x56522b583d70 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56522b30faf0 con 0x56522b53a830 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56522b384a50 con 0x56522b584690 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b584150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b584150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37636/0 (socket says 172.21.15.83:37636) 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bb7fe640 1 -- 172.21.15.83:0/4270321183 learned_addr learned my addr 172.21.15.83:0/4270321183 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2baffd640 1 --2- 172.21.15.83:0/4270321183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 0x56522b53a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bbfff640 1 --2- 172.21.15.83:0/4270321183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b53a830 0x56522b53ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bb7fe640 1 -- 172.21.15.83:0/4270321183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 msgr2=0x56522b53a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/4270321183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 0x56522b53a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bb7fe640 1 -- 172.21.15.83:0/4270321183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b53a830 msgr2=0x56522b53ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/4270321183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b53a830 0x56522b53ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bb7fe640 1 -- 172.21.15.83:0/4270321183 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56522b30dd00 con 0x56522b583d70 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/4270321183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b584150 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc2b001d120 tx=0x7fc2bc0d1720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d822f6ec61971a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2a17fa640 1 -- 172.21.15.83:0/4270321183 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00be070 con 0x56522b583d70 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2a17fa640 1 -- 172.21.15.83:0/4270321183 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b00072d0 con 0x56522b583d70 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2a17fa640 1 -- 172.21.15.83:0/4270321183 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0007680 con 0x56522b583d70 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- 172.21.15.83:0/4270321183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 msgr2=0x56522b584150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/4270321183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b584150 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc2b001d120 tx=0x7fc2bc0d1720 comp rx=0 tx=0).stop 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- 172.21.15.83:0/4270321183 shutdown_connections 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/4270321183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b53a830 0x56522b53ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/4270321183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 0x56522b53a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/4270321183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b584150 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- 172.21.15.83:0/4270321183 >> 172.21.15.83:0/4270321183 conn(0x56522b5367e0 msgr2=0x56522b538bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- 172.21.15.83:0/4270321183 shutdown_connections 2024-03-30T13:11:11.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- 172.21.15.83:0/4270321183 wait complete. 2024-03-30T13:11:11.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- start start 2024-03-30T13:11:11.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 Processor -- start 2024-03-30T13:11:11.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b53a830 0x56522b53fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b568da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b584690 0x56522b5692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56522b350270 con 0x56522b583d70 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56522b3466a0 con 0x56522b584690 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56522b320880 con 0x56522b53a830 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 10 client.0 _ll_register_callbacks cb 0x56522b525490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2baffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b568da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2baffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b568da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37650/0 (socket says 172.21.15.83:37650) 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2baffd640 1 -- 172.21.15.83:0/718481800 learned_addr learned my addr 172.21.15.83:0/718481800 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bbfff640 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b584690 0x56522b5692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b53a830 0x56522b53fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2baffd640 1 -- 172.21.15.83:0/718481800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b53a830 msgr2=0x56522b53fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2baffd640 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b53a830 0x56522b53fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2baffd640 1 -- 172.21.15.83:0/718481800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b584690 msgr2=0x56522b5692e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2baffd640 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b584690 0x56522b5692e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2baffd640 1 -- 172.21.15.83:0/718481800 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56522b34d730 con 0x56522b583d70 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2bbfff640 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b584690 0x56522b5692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2baffd640 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b568da0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac005630 tx=0x7fc2ac001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30f61d801878b7b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc29a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc29a7fc640 1 -- 172.21.15.83:0/718481800 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac01b060 con 0x56522b583d70 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc29a7fc640 1 -- 172.21.15.83:0/718481800 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc2ac016ae0 con 0x56522b583d70 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 1 -- 172.21.15.83:0/718481800 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b00072d0 con 0x56522b583d70 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc29a7fc640 1 -- 172.21.15.83:0/718481800 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc2ac016ce0 con 0x56522b583d70 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.484+0000 7fc2c4c10000 10 client.6147 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 -- 172.21.15.83:0/718481800 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56522b340ca0 con 0x56522b583d70 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc29a7fc640 1 -- 172.21.15.83:0/718481800 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b00072d0 con 0x56522b583d70 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc29a7fc640 1 -- 172.21.15.83:0/718481800 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fc2ac0143d0 con 0x56522b583d70 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 10 client.6147 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:11.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 10 client.6147 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 20 client.6147 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56522b58b5d0 0x56522b58b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 4 client.6147 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 -- 172.21.15.83:0/718481800 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56522b323c90 con 0x56522b58b5d0 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56522b58b5d0 0x56522b58b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56522b58b5d0 0x56522b58b9e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dab58cda9f923923 server_cookie=e01fcd268f2fb8a9 in_seq=0 out_seq=0 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc29a7fc640 10 client.6147 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc29a7fc640 1 -- 172.21.15.83:0/718481800 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x7fc2b00cfad0 con 0x56522b58b5d0 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc29a7fc640 10 client.6147 handle_command_reply: tid=0 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 client.6147 shutdown 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 -- 172.21.15.83:0/718481800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 msgr2=0x56522b568da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b568da0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac005630 tx=0x7fc2ac001670 comp rx=0 tx=0).stop 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 -- 172.21.15.83:0/718481800 shutdown_connections 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b584690 0x56522b5692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56522b58b5d0 0x56522b58b9e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b568da0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc29a7fc640 0 client.6147 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/718481800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b53a830 0x56522b53fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 -- 172.21.15.83:0/718481800 >> 172.21.15.83:0/718481800 conn(0x56522b5367e0 msgr2=0x56522b539460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 -- 172.21.15.83:0/718481800 shutdown_connections 2024-03-30T13:11:11.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 1 -- 172.21.15.83:0/718481800 wait complete. 2024-03-30T13:11:11.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.488+0000 7fc2c4c10000 20 client.6147 trim_cache size 0 max 16384 2024-03-30T13:11:11.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.500+0000 7fc2c4c10000 1 Processor -- start 2024-03-30T13:11:11.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.500+0000 7fc2c4c10000 1 -- start start 2024-03-30T13:11:11.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b53a830 0x56522b538bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b583d70 0x56522b539110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 0x56522b539650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc204930 con 0x56522b53a830 2024-03-30T13:11:11.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc203a00 con 0x56522b583d70 2024-03-30T13:11:11.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc2bc144a10 con 0x56522b584690 2024-03-30T13:11:11.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2bb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b53a830 0x56522b538bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2bb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b53a830 0x56522b538bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37658/0 (socket says 172.21.15.83:37658) 2024-03-30T13:11:11.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2bb7fe640 1 -- 172.21.15.83:0/1532125348 learned_addr learned my addr 172.21.15.83:0/1532125348 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2bb7fe640 1 -- 172.21.15.83:0/1532125348 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 msgr2=0x56522b539650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2bbfff640 1 --2- 172.21.15.83:0/1532125348 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 0x56522b539650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/1532125348 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 0x56522b539650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2bb7fe640 1 -- 172.21.15.83:0/1532125348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b583d70 msgr2=0x56522b539110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2baffd640 1 --2- 172.21.15.83:0/1532125348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b583d70 0x56522b539110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/1532125348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b583d70 0x56522b539110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2bb7fe640 1 -- 172.21.15.83:0/1532125348 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56522b30fd00 con 0x56522b53a830 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2baffd640 1 --2- 172.21.15.83:0/1532125348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b583d70 0x56522b539110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/1532125348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b53a830 0x56522b538bd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0001210 tx=0x7fc2b00b0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f03c253c394cf1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2a0ff9640 1 -- 172.21.15.83:0/1532125348 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00c8050 con 0x56522b53a830 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2a0ff9640 1 -- 172.21.15.83:0/1532125348 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b00ca040 con 0x56522b53a830 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2a0ff9640 1 -- 172.21.15.83:0/1532125348 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00be040 con 0x56522b53a830 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- 172.21.15.83:0/1532125348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b53a830 msgr2=0x56522b538bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/1532125348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b53a830 0x56522b538bd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0001210 tx=0x7fc2b00b0040 comp rx=0 tx=0).stop 2024-03-30T13:11:11.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- 172.21.15.83:0/1532125348 shutdown_connections 2024-03-30T13:11:11.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/1532125348 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 0x56522b539650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/1532125348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b583d70 0x56522b539110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/1532125348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b53a830 0x56522b538bd0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- 172.21.15.83:0/1532125348 >> 172.21.15.83:0/1532125348 conn(0x56522b5367e0 msgr2=0x56522b59af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- 172.21.15.83:0/1532125348 shutdown_connections 2024-03-30T13:11:11.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- 172.21.15.83:0/1532125348 wait complete. 2024-03-30T13:11:11.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- start start 2024-03-30T13:11:11.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 Processor -- start 2024-03-30T13:11:11.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b53a830 0x56522b5f6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b5f6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 0x56522b5f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56522b350270 con 0x56522b583d70 2024-03-30T13:11:11.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc145060 con 0x56522b53a830 2024-03-30T13:11:11.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x56522b444b00 con 0x56522b584690 2024-03-30T13:11:11.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 10 client.0 _ll_register_callbacks cb 0x7fc2ac007cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2baffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b5f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2baffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b5f6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37662/0 (socket says 172.21.15.83:37662) 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2baffd640 1 -- 172.21.15.83:0/3570544159 learned_addr learned my addr 172.21.15.83:0/3570544159 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2bbfff640 1 --2- 172.21.15.83:0/3570544159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 0x56522b5f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2baffd640 1 -- 172.21.15.83:0/3570544159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 msgr2=0x56522b5f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2baffd640 1 --2- 172.21.15.83:0/3570544159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 0x56522b5f27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2baffd640 1 -- 172.21.15.83:0/3570544159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b53a830 msgr2=0x56522b5f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2baffd640 1 --2- 172.21.15.83:0/3570544159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b53a830 0x56522b5f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2baffd640 1 -- 172.21.15.83:0/3570544159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56522b409f70 con 0x56522b583d70 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2baffd640 1 --2- 172.21.15.83:0/3570544159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b5f6780 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac014cf0 tx=0x7fc2ac001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74439a42b37c9fdf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc29a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc29a7fc640 1 -- 172.21.15.83:0/3570544159 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac014920 con 0x56522b583d70 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc29a7fc640 1 -- 172.21.15.83:0/3570544159 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc2ac0067e0 con 0x56522b583d70 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- 172.21.15.83:0/3570544159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b00ca040 con 0x56522b583d70 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc29a7fc640 1 -- 172.21.15.83:0/3570544159 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc2ac036050 con 0x56522b583d70 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 10 client.6153 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc2c4c10000 1 -- 172.21.15.83:0/3570544159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56522b32f760 con 0x56522b583d70 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.504+0000 7fc29a7fc640 1 -- 172.21.15.83:0/3570544159 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b00ca040 con 0x56522b583d70 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc29a7fc640 1 -- 172.21.15.83:0/3570544159 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fc2ac039020 con 0x56522b583d70 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 10 client.6153 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 10 client.6153 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 20 client.6153 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/3570544159 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56522b5f3400 0x56522b5f3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 4 client.6153 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628399}] 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 -- 172.21.15.83:0/3570544159 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628399}) -- 0x56522b395fe0 con 0x56522b5f3400 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/3570544159 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56522b5f3400 0x56522b5f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc29a7fc640 10 client.6153 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2bb7fe640 1 --2- 172.21.15.83:0/3570544159 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56522b5f3400 0x56522b5f3810 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3690c0dc58895082 server_cookie=6c9bf049310a87c0 in_seq=0 out_seq=0 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc29a7fc640 1 -- 172.21.15.83:0/3570544159 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3794 (crc 0 0 0) 0x56522b395fe0 con 0x56522b5f3400 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc29a7fc640 10 client.6153 handle_command_reply: tid=0 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 client.6153 shutdown 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 -- 172.21.15.83:0/3570544159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 msgr2=0x56522b5f6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/3570544159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b5f6780 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac014cf0 tx=0x7fc2ac001130 comp rx=0 tx=0).stop 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 -- 172.21.15.83:0/3570544159 shutdown_connections 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/3570544159 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x56522b584690 0x56522b5f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/3570544159 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x56522b5f3400 0x56522b5f3810 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/3570544159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56522b583d70 0x56522b5f6780 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 --2- 172.21.15.83:0/3570544159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56522b53a830 0x56522b5f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc29a7fc640 0 client.6153 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 -- 172.21.15.83:0/3570544159 >> 172.21.15.83:0/3570544159 conn(0x56522b5367e0 msgr2=0x56522b59b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 -- 172.21.15.83:0/3570544159 shutdown_connections 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 1 -- 172.21.15.83:0/3570544159 wait complete. 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c4c10000 20 client.6153 trim_cache size 0 max 16384 2024-03-30T13:11:11.522 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:11.522 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/symlink.c", 2024-03-30T13:11:11.522 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628399, 2024-03-30T13:11:11.522 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:11.522 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.629115+0000", 2024-03-30T13:11:11.522 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.002222+0000", 2024-03-30T13:11:11.522 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:11.522 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:11.522 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:11.522 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:11.522 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 916, 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.002222+0000", 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 916, 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.629115+0000" 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 916, 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:11.526 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:11.526 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:11.526 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.629115+0000" 2024-03-30T13:11:11.526 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.526 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 124, 2024-03-30T13:11:11.526 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:11.526 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:11.526 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 28, 2024-03-30T13:11:11.526 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:11.526 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:11.527 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:11.528 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.529 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:11.530 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.531 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:11.532 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:11.533 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:11.533 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:11.533 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:11.533 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.533 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:11.533 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:11.533 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:11.533 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:11.533 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:11.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/3852657137 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc2a8067fc0 msgr2=0x7fc2a806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c1a8e640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc2a8067fc0 0x7fc2a806a480 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00aa000 tx=0x7fc2bc0d1440 comp rx=0 tx=0).stop 2024-03-30T13:11:11.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/3852657137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2bc06f780 msgr2=0x7fc2bc06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c1a8e640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2bc06f780 0x7fc2bc06fc00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0ae720 tx=0x7fc2b4004840 comp rx=0 tx=0).stop 2024-03-30T13:11:11.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/3852657137 shutdown_connections 2024-03-30T13:11:11.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c1a8e640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc2a8067fc0 0x7fc2a806a480 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c1a8e640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2bc06f780 0x7fc2bc06fc00 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c1a8e640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2bc13ad90 0x7fc2bc141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c1a8e640 1 --2- 172.21.15.83:0/3852657137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2a40039c0 0x7fc2bc0b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/3852657137 >> 172.21.15.83:0/3852657137 conn(0x7fc2bc09aa50 msgr2=0x7fc2bc074870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/3852657137 shutdown_connections 2024-03-30T13:11:11.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.508+0000 7fc2c1a8e640 1 -- 172.21.15.83:0/3852657137 wait complete. 2024-03-30T13:11:11.535 DEBUG:tasks.cephfs.test_uninlining:getting inode info #11 of 23:1099511628389 2024-03-30T13:11:11.536 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628389 2024-03-30T13:11:11.536 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628389 2024-03-30T13:11:11.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d29bba640 1 Processor -- start 2024-03-30T13:11:11.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d29bba640 1 -- start start 2024-03-30T13:11:11.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d29bba640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0d24160140 0x7f0d241605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d29bba640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0d240b1b60 0x7f0d240b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d29bba640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d240aff40 con 0x7f0d2415c7f0 2024-03-30T13:11:11.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d29bba640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f0d240b0fe0 con 0x7f0d24160140 2024-03-30T13:11:11.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d29bba640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0d24160ae0 con 0x7f0d240b1b60 2024-03-30T13:11:11.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d1bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0d24160140 0x7f0d241605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d1bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0d24160140 0x7f0d241605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37664/0 (socket says 172.21.15.83:37664) 2024-03-30T13:11:11.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d1bfff640 1 -- 172.21.15.83:0/3699166948 learned_addr learned my addr 172.21.15.83:0/3699166948 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d23fff640 1 --2- 172.21.15.83:0/3699166948 >> v2:172.21.15.153:3300/0 conn(0x7f0d240b1b60 0x7f0d240b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d1bfff640 1 -- 172.21.15.83:0/3699166948 >> v2:172.21.15.153:3300/0 conn(0x7f0d240b1b60 msgr2=0x7f0d240b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/3699166948 >> v2:172.21.15.153:3300/0 conn(0x7f0d240b1b60 0x7f0d240b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d1bfff640 1 -- 172.21.15.83:0/3699166948 >> v1:172.21.15.153:6789/0 conn(0x7f0d2415c7f0 legacy=0x7f0d240d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.632+0000 7f0d1bfff640 1 -- 172.21.15.83:0/3699166948 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d240b0220 con 0x7f0d24160140 2024-03-30T13:11:11.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/3699166948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d24160140 0x7f0d241605a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0d24073090 tx=0x7f0d1401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb853730dfc3db4c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d22ffd640 1 -- 172.21.15.83:0/3699166948 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140ab5f0 con 0x7f0d24160140 2024-03-30T13:11:11.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d22ffd640 1 -- 172.21.15.83:0/3699166948 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d140b0070 con 0x7f0d24160140 2024-03-30T13:11:11.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d22ffd640 1 -- 172.21.15.83:0/3699166948 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140ab9b0 con 0x7f0d24160140 2024-03-30T13:11:11.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 -- 172.21.15.83:0/3699166948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d24160140 msgr2=0x7f0d241605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 --2- 172.21.15.83:0/3699166948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d24160140 0x7f0d241605a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0d24073090 tx=0x7f0d1401c4e0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 -- 172.21.15.83:0/3699166948 shutdown_connections 2024-03-30T13:11:11.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 --2- 172.21.15.83:0/3699166948 >> v2:172.21.15.153:3300/0 conn(0x7f0d240b1b60 0x7f0d240b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 --2- 172.21.15.83:0/3699166948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d24160140 0x7f0d241605a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 -- 172.21.15.83:0/3699166948 >> 172.21.15.83:0/3699166948 conn(0x7f0d240b3e70 msgr2=0x7f0d240b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 -- 172.21.15.83:0/3699166948 shutdown_connections 2024-03-30T13:11:11.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 -- 172.21.15.83:0/3699166948 wait complete. 2024-03-30T13:11:11.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 Processor -- start 2024-03-30T13:11:11.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 -- start start 2024-03-30T13:11:11.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d240b1b60 0x7f0d2415e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d2415c7f0 0x7f0d24070230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d24160140 0x7f0d24151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0d240afb60 con 0x7f0d2415c7f0 2024-03-30T13:11:11.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0d240b0b50 con 0x7f0d240b1b60 2024-03-30T13:11:11.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0d240afce0 con 0x7f0d24160140 2024-03-30T13:11:11.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d1bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d2415c7f0 0x7f0d24070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d1bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d2415c7f0 0x7f0d24070230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37672/0 (socket says 172.21.15.83:37672) 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d1bfff640 1 -- 172.21.15.83:0/3332712405 learned_addr learned my addr 172.21.15.83:0/3332712405 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d1bfff640 1 -- 172.21.15.83:0/3332712405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d24160140 msgr2=0x7f0d24151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d23fff640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d24160140 0x7f0d24151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d237fe640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d240b1b60 0x7f0d2415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d24160140 0x7f0d24151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d1bfff640 1 -- 172.21.15.83:0/3332712405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d240b1b60 msgr2=0x7f0d2415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d240b1b60 0x7f0d2415e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d1bfff640 1 -- 172.21.15.83:0/3332712405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2415eb90 con 0x7f0d2415c7f0 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d2415c7f0 0x7f0d24070230 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0d1401ab90 tx=0x7f0d14019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d20ff9640 1 -- 172.21.15.83:0/3332712405 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140bf610 con 0x7f0d2415c7f0 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d20ff9640 1 -- 172.21.15.83:0/3332712405 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d240b2d00 con 0x7f0d2415c7f0 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d29bba640 1 -- 172.21.15.83:0/3332712405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2415ee70 con 0x7f0d2415c7f0 2024-03-30T13:11:11.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.636+0000 7f0d20ff9640 1 -- 172.21.15.83:0/3332712405 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140bfa10 con 0x7f0d2415c7f0 2024-03-30T13:11:11.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.640+0000 7f0d29bba640 1 -- 172.21.15.83:0/3332712405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d2415f430 con 0x7f0d2415c7f0 2024-03-30T13:11:11.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.640+0000 7f0d20ff9640 1 -- 172.21.15.83:0/3332712405 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f0d140bd020 con 0x7f0d2415c7f0 2024-03-30T13:11:11.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.640+0000 7f0d20ff9640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0d08067fc0 0x7f0d0806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.640+0000 7f0d237fe640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0d08067fc0 0x7f0d0806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.640+0000 7f0d20ff9640 1 -- 172.21.15.83:0/3332712405 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0d14120750 con 0x7f0d2415c7f0 2024-03-30T13:11:11.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.640+0000 7f0d237fe640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0d08067fc0 0x7f0d0806a480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00a750 tx=0x7f0d0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.640+0000 7f0d2cd3c000 1 Processor -- start 2024-03-30T13:11:11.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.640+0000 7f0d2cd3c000 1 -- start start 2024-03-30T13:11:11.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461bd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bd690 0x55e2461732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 0x55e246173c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e245fc1aa0 con 0x55e2461bcd70 2024-03-30T13:11:11.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e245f48af0 con 0x55e246173830 2024-03-30T13:11:11.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55e245fbda50 con 0x55e2461bd690 2024-03-30T13:11:11.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d237fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461bd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d237fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461bd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37684/0 (socket says 172.21.15.83:37684) 2024-03-30T13:11:11.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d237fe640 1 -- 172.21.15.83:0/1770031678 learned_addr learned my addr 172.21.15.83:0/1770031678 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/1770031678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bd690 0x55e2461732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d237fe640 1 -- 172.21.15.83:0/1770031678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bd690 msgr2=0x55e2461732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d23fff640 1 --2- 172.21.15.83:0/1770031678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 0x55e246173c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d237fe640 1 --2- 172.21.15.83:0/1770031678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bd690 0x55e2461732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d237fe640 1 -- 172.21.15.83:0/1770031678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 msgr2=0x55e246173c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d237fe640 1 --2- 172.21.15.83:0/1770031678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 0x55e246173c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d237fe640 1 -- 172.21.15.83:0/1770031678 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e245f46d00 con 0x55e2461bcd70 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d237fe640 1 --2- 172.21.15.83:0/1770031678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461bd150 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00c940 tx=0x7f0d0c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5badb880e5a2bced server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d197fa640 1 -- 172.21.15.83:0/1770031678 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c019040 con 0x55e2461bcd70 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d197fa640 1 -- 172.21.15.83:0/1770031678 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c022070 con 0x55e2461bcd70 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d197fa640 1 -- 172.21.15.83:0/1770031678 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c013dc0 con 0x55e2461bcd70 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/1770031678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 msgr2=0x55e2461bd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/1770031678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461bd150 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00c940 tx=0x7f0d0c00f000 comp rx=0 tx=0).stop 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/1770031678 shutdown_connections 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/1770031678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 0x55e246173c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/1770031678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bd690 0x55e2461732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/1770031678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461bd150 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/1770031678 >> 172.21.15.83:0/1770031678 conn(0x55e24616f7e0 msgr2=0x55e246171bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/1770031678 shutdown_connections 2024-03-30T13:11:11.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/1770031678 wait complete. 2024-03-30T13:11:11.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 -- start start 2024-03-30T13:11:11.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.644+0000 7f0d2cd3c000 1 Processor -- start 2024-03-30T13:11:11.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 0x55e246178c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bd690 0x55e2461a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e245f89270 con 0x55e2461bcd70 2024-03-30T13:11:11.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e245f7f6a0 con 0x55e246173830 2024-03-30T13:11:11.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55e245f59880 con 0x55e2461bd690 2024-03-30T13:11:11.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d1bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d1bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37700/0 (socket says 172.21.15.83:37700) 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d1bfff640 1 -- 172.21.15.83:0/2231121188 learned_addr learned my addr 172.21.15.83:0/2231121188 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 10 client.0 _ll_register_callbacks cb 0x55e24615e490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d23fff640 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bd690 0x55e2461a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d237fe640 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 0x55e246178c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d1bfff640 1 -- 172.21.15.83:0/2231121188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bd690 msgr2=0x55e2461a22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bd690 0x55e2461a22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d1bfff640 1 -- 172.21.15.83:0/2231121188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 msgr2=0x55e246178c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 0x55e246178c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d1bfff640 1 -- 172.21.15.83:0/2231121188 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e245f86730 con 0x55e2461bcd70 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461a1da0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0d1411eca0 tx=0x7f0d140f0370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab97519d8883ed3a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d127fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d127fc640 1 -- 172.21.15.83:0/2231121188 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140f5e60 con 0x55e2461bcd70 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d127fc640 1 -- 172.21.15.83:0/2231121188 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0d140bfbb0 con 0x55e2461bcd70 2024-03-30T13:11:11.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/2231121188 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d0c022070 con 0x55e2461bcd70 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d127fc640 1 -- 172.21.15.83:0/2231121188 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f0d140f9500 con 0x55e2461bcd70 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 10 client.6165 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/2231121188 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55e245f79ca0 con 0x55e2461bcd70 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d127fc640 1 -- 172.21.15.83:0/2231121188 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c022070 con 0x55e2461bcd70 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d127fc640 1 -- 172.21.15.83:0/2231121188 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f0d140c7030 con 0x55e2461bcd70 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 10 client.6165 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 10 client.6165 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 20 client.6165 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e2461c45d0 0x55e2461c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 4 client.6165 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/2231121188 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e245f5cc90 con 0x55e2461c45d0 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d237fe640 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e2461c45d0 0x55e2461c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d237fe640 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e2461c45d0 0x55e2461c49b0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b924439313128c97 server_cookie=664685e3a6e7cf6a in_seq=0 out_seq=0 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d127fc640 10 client.6165 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d127fc640 1 -- 172.21.15.83:0/2231121188 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55e245f5cc90 con 0x55e2461c45d0 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d127fc640 10 client.6165 handle_command_reply: tid=0 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 client.6165 shutdown 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/2231121188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 msgr2=0x55e2461a1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461a1da0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0d1411eca0 tx=0x7f0d140f0370 comp rx=0 tx=0).stop 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/2231121188 shutdown_connections 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bd690 0x55e2461a22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e2461c45d0 0x55e2461c49b0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461a1da0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/2231121188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 0x55e246178c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d127fc640 0 client.6165 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.648+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/2231121188 >> 172.21.15.83:0/2231121188 conn(0x55e24616f7e0 msgr2=0x55e246172460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.652+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/2231121188 shutdown_connections 2024-03-30T13:11:11.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.652+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/2231121188 wait complete. 2024-03-30T13:11:11.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.652+0000 7f0d2cd3c000 20 client.6165 trim_cache size 0 max 16384 2024-03-30T13:11:11.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 Processor -- start 2024-03-30T13:11:11.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 -- start start 2024-03-30T13:11:11.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e246173830 0x55e2461a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e2461bd690 0x55e2461a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24201940 con 0x55e2461bcd70 2024-03-30T13:11:11.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0d242009c0 con 0x55e2461bd690 2024-03-30T13:11:11.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0d24154430 con 0x55e246173830 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d1bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d1bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461a1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37716/0 (socket says 172.21.15.83:37716) 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d1bfff640 1 -- 172.21.15.83:0/1000541869 learned_addr learned my addr 172.21.15.83:0/1000541869 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d23fff640 1 --2- 172.21.15.83:0/1000541869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e2461bd690 0x55e2461a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d1bfff640 1 -- 172.21.15.83:0/1000541869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e246173830 msgr2=0x55e2461a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/1000541869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e246173830 0x55e2461a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d1bfff640 1 -- 172.21.15.83:0/1000541869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e2461bd690 msgr2=0x55e2461a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/1000541869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e2461bd690 0x55e2461a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d1bfff640 1 -- 172.21.15.83:0/1000541869 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e245f48d00 con 0x55e2461bcd70 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/1000541869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461a1290 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0d140ecd80 tx=0x7f0d140c1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf5e0af110edbb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d18ff9640 1 -- 172.21.15.83:0/1000541869 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140f5e60 con 0x55e2461bcd70 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d18ff9640 1 -- 172.21.15.83:0/1000541869 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d140b0040 con 0x55e2461bcd70 2024-03-30T13:11:11.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d18ff9640 1 -- 172.21.15.83:0/1000541869 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140fe080 con 0x55e2461bcd70 2024-03-30T13:11:11.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/1000541869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 msgr2=0x55e2461a1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/1000541869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461a1290 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0d140ecd80 tx=0x7f0d140c1000 comp rx=0 tx=0).stop 2024-03-30T13:11:11.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/1000541869 shutdown_connections 2024-03-30T13:11:11.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/1000541869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e2461bd690 0x55e2461a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/1000541869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bcd70 0x55e2461a1290 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/1000541869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e246173830 0x55e2461a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.664+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/1000541869 >> 172.21.15.83:0/1000541869 conn(0x55e24616f7e0 msgr2=0x55e2461d3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/1000541869 shutdown_connections 2024-03-30T13:11:11.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/1000541869 wait complete. 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- start start 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 Processor -- start 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 0x55e246172fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bcd70 0x55e24622e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bd690 0x55e24622eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24200370 con 0x55e2461bd690 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e245f89270 con 0x55e246173830 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55e245f59880 con 0x55e2461bcd70 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 10 client.0 _ll_register_callbacks cb 0x7f0d140094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d23fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bd690 0x55e24622eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d23fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bd690 0x55e24622eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37732/0 (socket says 172.21.15.83:37732) 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d23fff640 1 -- 172.21.15.83:0/3258460952 learned_addr learned my addr 172.21.15.83:0/3258460952 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d1bfff640 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bcd70 0x55e24622e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d237fe640 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 0x55e246172fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d23fff640 1 -- 172.21.15.83:0/3258460952 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bcd70 msgr2=0x55e24622e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d23fff640 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bcd70 0x55e24622e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d23fff640 1 -- 172.21.15.83:0/3258460952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 msgr2=0x55e246172fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d23fff640 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 0x55e246172fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d23fff640 1 -- 172.21.15.83:0/3258460952 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e246042f70 con 0x55e2461bd690 2024-03-30T13:11:11.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d23fff640 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bd690 0x55e24622eb40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c011a80 tx=0x7f0d1c011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8a646311625b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d127fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:11.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d127fc640 1 -- 172.21.15.83:0/3258460952 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c01f060 con 0x55e2461bd690 2024-03-30T13:11:11.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d127fc640 1 -- 172.21.15.83:0/3258460952 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0d1c00fc70 con 0x55e2461bd690 2024-03-30T13:11:11.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/3258460952 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d140b0040 con 0x55e2461bd690 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d127fc640 1 -- 172.21.15.83:0/3258460952 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f0d1c025050 con 0x55e2461bd690 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 10 client.6171 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/3258460952 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55e245f68760 con 0x55e2461bd690 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d127fc640 1 -- 172.21.15.83:0/3258460952 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d140b0040 con 0x55e2461bd690 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d127fc640 1 -- 172.21.15.83:0/3258460952 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f0d1c028020 con 0x55e2461bd690 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 10 client.6171 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 10 client.6171 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 20 client.6171 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e24622fa00 0x55e24623b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 4 client.6171 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628389}] 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/3258460952 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628389}) -- 0x55e245fcefe0 con 0x55e24622fa00 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d237fe640 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e24622fa00 0x55e24623b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d237fe640 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e24622fa00 0x55e24623b6e0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fc9d8c27a47a5d server_cookie=986faf4db6fffe74 in_seq=0 out_seq=0 2024-03-30T13:11:11.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d127fc640 10 client.6171 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d127fc640 1 -- 172.21.15.83:0/3258460952 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3792 (crc 0 0 0) 0x55e245fcefe0 con 0x55e24622fa00 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d127fc640 10 client.6171 handle_command_reply: tid=0 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 client.6171 shutdown 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/3258460952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bd690 msgr2=0x55e24622eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bd690 0x55e24622eb40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c011a80 tx=0x7f0d1c011f40 comp rx=0 tx=0).stop 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/3258460952 shutdown_connections 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55e24622fa00 0x55e24623b6e0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e2461bd690 0x55e24622eb40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55e2461bcd70 0x55e24622e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d127fc640 0 client.6171 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 --2- 172.21.15.83:0/3258460952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e246173830 0x55e246172fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/3258460952 >> 172.21.15.83:0/3258460952 conn(0x55e24616f7e0 msgr2=0x55e2461d3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/3258460952 shutdown_connections 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 1 -- 172.21.15.83:0/3258460952 wait complete. 2024-03-30T13:11:11.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.668+0000 7f0d2cd3c000 20 client.6171 trim_cache size 0 max 16384 2024-03-30T13:11:11.684 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:11.684 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/acl.h", 2024-03-30T13:11:11.684 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628389, 2024-03-30T13:11:11.684 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:11.684 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.631817+0000", 2024-03-30T13:11:11.684 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:35.961332+0000", 2024-03-30T13:11:11.684 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:11.684 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:11.684 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:11.684 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:11.685 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:11.685 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:11.685 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:11.685 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:11.685 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:11.685 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.685 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:11.685 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:11.685 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:11.685 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:11.685 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:11.685 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 1502, 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:35.961332+0000", 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:11.686 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1502, 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.631817+0000" 2024-03-30T13:11:11.687 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1502, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.631817+0000" 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 126, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 8, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:11.688 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:11.689 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:11.690 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:11.691 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:11.691 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:11.691 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:11.691 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:11.691 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:11.691 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:11.691 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.691 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:11.691 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:11.692 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.693 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:11.694 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:11.695 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:11.695 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:11.695 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:11.695 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:11.695 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.695 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:11.695 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:11.695 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:11.695 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:11.695 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:11.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.672+0000 7f0d29bba640 1 -- 172.21.15.83:0/3332712405 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0d08067fc0 msgr2=0x7f0d0806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.672+0000 7f0d29bba640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0d08067fc0 0x7f0d0806a480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00a750 tx=0x7f0d0c008040 comp rx=0 tx=0).stop 2024-03-30T13:11:11.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.672+0000 7f0d29bba640 1 -- 172.21.15.83:0/3332712405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d2415c7f0 msgr2=0x7f0d24070230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.672+0000 7f0d29bba640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d2415c7f0 0x7f0d24070230 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0d1401ab90 tx=0x7f0d14019280 comp rx=0 tx=0).stop 2024-03-30T13:11:11.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.672+0000 7f0d29bba640 1 -- 172.21.15.83:0/3332712405 shutdown_connections 2024-03-30T13:11:11.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.672+0000 7f0d29bba640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f0d08067fc0 0x7f0d0806a480 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.672+0000 7f0d29bba640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0d24160140 0x7f0d24151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.672+0000 7f0d29bba640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d2415c7f0 0x7f0d24070230 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.672+0000 7f0d29bba640 1 --2- 172.21.15.83:0/3332712405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d240b1b60 0x7f0d2415e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.672+0000 7f0d29bba640 1 -- 172.21.15.83:0/3332712405 >> 172.21.15.83:0/3332712405 conn(0x7f0d240b3e70 msgr2=0x7f0d240b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.672+0000 7f0d29bba640 1 -- 172.21.15.83:0/3332712405 shutdown_connections 2024-03-30T13:11:11.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.672+0000 7f0d29bba640 1 -- 172.21.15.83:0/3332712405 wait complete. 2024-03-30T13:11:11.698 DEBUG:tasks.cephfs.test_uninlining:getting inode info #12 of 23:1099511628403 2024-03-30T13:11:11.698 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628403 2024-03-30T13:11:11.698 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628403 2024-03-30T13:11:11.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.796+0000 7f2fa1d6c640 1 Processor -- start 2024-03-30T13:11:11.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2fa1d6c640 1 -- start start 2024-03-30T13:11:11.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2fa1d6c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2f9c145ed0 0x7f2f9c15d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2fa1d6c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2f9c0b6d10 0x7f2f9c06b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2fa1d6c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c06bba0 0x7f2f9c160000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2fa1d6c640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f2f9c0d2030 con 0x7f2f9c145ed0 2024-03-30T13:11:11.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2fa1d6c640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2f9c06c010 con 0x7f2f9c0b6d10 2024-03-30T13:11:11.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2fa1d6c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9c0d1020 con 0x7f2f9c06bba0 2024-03-30T13:11:11.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9b7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2f9c145ed0 0x7f2f9c15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9b7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2f9c145ed0 0x7f2f9c15d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37738/0 (socket says 172.21.15.83:37738) 2024-03-30T13:11:11.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9b7fe640 1 -- 172.21.15.83:0/2904340730 learned_addr learned my addr 172.21.15.83:0/2904340730 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9affd640 1 --2- 172.21.15.83:0/2904340730 >> v2:172.21.15.153:3300/0 conn(0x7f2f9c0b6d10 0x7f2f9c06b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/2904340730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c06bba0 0x7f2f9c160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9b7fe640 1 -- 172.21.15.83:0/2904340730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c06bba0 msgr2=0x7f2f9c160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/2904340730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c06bba0 0x7f2f9c160000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9b7fe640 1 -- 172.21.15.83:0/2904340730 >> v2:172.21.15.153:3300/0 conn(0x7f2f9c0b6d10 msgr2=0x7f2f9c06b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/2904340730 >> v2:172.21.15.153:3300/0 conn(0x7f2f9c0b6d10 0x7f2f9c06b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9b7fe640 1 -- 172.21.15.83:0/2904340730 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c0b71c0 con 0x7f2f9c145ed0 2024-03-30T13:11:11.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9affd640 1 --2- 172.21.15.83:0/2904340730 >> v2:172.21.15.153:3300/0 conn(0x7f2f9c0b6d10 0x7f2f9c06b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/2904340730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c06bba0 0x7f2f9c160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/2904340730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f9c145ed0 0x7f2f9c15d490 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c071290 tx=0x7f2f9001c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209e278b5bf433ef server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9a7fc640 1 -- 172.21.15.83:0/2904340730 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900b0070 con 0x7f2f9c145ed0 2024-03-30T13:11:11.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9a7fc640 1 -- 172.21.15.83:0/2904340730 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f900ab600 con 0x7f2f9c145ed0 2024-03-30T13:11:11.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.800+0000 7f2f9a7fc640 1 -- 172.21.15.83:0/2904340730 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900ab9d0 con 0x7f2f9c145ed0 2024-03-30T13:11:11.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/2904340730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f9c145ed0 msgr2=0x7f2f9c15d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 --2- 172.21.15.83:0/2904340730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f9c145ed0 0x7f2f9c15d490 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c071290 tx=0x7f2f9001c1a0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/2904340730 shutdown_connections 2024-03-30T13:11:11.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 --2- 172.21.15.83:0/2904340730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c06bba0 0x7f2f9c160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 --2- 172.21.15.83:0/2904340730 >> v2:172.21.15.153:3300/0 conn(0x7f2f9c0b6d10 0x7f2f9c06b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 --2- 172.21.15.83:0/2904340730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f9c145ed0 0x7f2f9c15d490 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/2904340730 >> 172.21.15.83:0/2904340730 conn(0x7f2f9c09aa50 msgr2=0x7f2f9c0b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/2904340730 shutdown_connections 2024-03-30T13:11:11.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/2904340730 wait complete. 2024-03-30T13:11:11.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 Processor -- start 2024-03-30T13:11:11.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 -- start start 2024-03-30T13:11:11.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f9c06bba0 0x7f2f9c0cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f9c0b6d10 0x7f2f9c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c145ed0 0x7f2f9c0b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c15dbd0 con 0x7f2f9c0b6d10 2024-03-30T13:11:11.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c0d1b10 con 0x7f2f9c06bba0 2024-03-30T13:11:11.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9c15dd50 con 0x7f2f9c145ed0 2024-03-30T13:11:11.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f9c0b6d10 0x7f2f9c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f9c0b6d10 0x7f2f9c154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37740/0 (socket says 172.21.15.83:37740) 2024-03-30T13:11:11.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9affd640 1 -- 172.21.15.83:0/3697383109 learned_addr learned my addr 172.21.15.83:0/3697383109 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f9c06bba0 0x7f2f9c0cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c145ed0 0x7f2f9c0b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9affd640 1 -- 172.21.15.83:0/3697383109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c145ed0 msgr2=0x7f2f9c0b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9affd640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c145ed0 0x7f2f9c0b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9affd640 1 -- 172.21.15.83:0/3697383109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f9c06bba0 msgr2=0x7f2f9c0cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9affd640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f9c06bba0 0x7f2f9c0cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9affd640 1 -- 172.21.15.83:0/3697383109 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c1552e0 con 0x7f2f9c0b6d10 2024-03-30T13:11:11.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c145ed0 0x7f2f9c0b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f9c06bba0 0x7f2f9c0cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:11.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f9affd640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f9c0b6d10 0x7f2f9c154da0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00c7f0 tx=0x7f2f8c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f83fff640 1 -- 172.21.15.83:0/3697383109 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c007a30 con 0x7f2f9c0b6d10 2024-03-30T13:11:11.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f83fff640 1 -- 172.21.15.83:0/3697383109 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f8c007bd0 con 0x7f2f9c0b6d10 2024-03-30T13:11:11.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/3697383109 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9c155580 con 0x7f2f9c0b6d10 2024-03-30T13:11:11.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2f83fff640 1 -- 172.21.15.83:0/3697383109 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0113f0 con 0x7f2f9c0b6d10 2024-03-30T13:11:11.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.804+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/3697383109 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9c155b40 con 0x7f2f9c0b6d10 2024-03-30T13:11:11.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f83fff640 1 -- 172.21.15.83:0/3697383109 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2f8c011590 con 0x7f2f9c0b6d10 2024-03-30T13:11:11.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f83fff640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2f88067fc0 0x7f2f8806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f83fff640 1 -- 172.21.15.83:0/3697383109 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2f8c086690 con 0x7f2f9c0b6d10 2024-03-30T13:11:11.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2f88067fc0 0x7f2f8806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2f88067fc0 0x7f2f8806a480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2f900ad000 tx=0x7f2f900a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2fa4eee000 1 Processor -- start 2024-03-30T13:11:11.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2fa4eee000 1 -- start start 2024-03-30T13:11:11.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2fa4eee000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 0x55b9d7c333a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2fa4eee000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c338e0 0x55b9d7be9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2fa4eee000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 0x55b9d7bea020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2fa4eee000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b9d7a33aa0 con 0x55b9d7be9c40 2024-03-30T13:11:11.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2fa4eee000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b9d79baaf0 con 0x55b9d7c32fc0 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2fa4eee000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b9d7a2fa50 con 0x55b9d7c338e0 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 0x55b9d7bea020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 0x55b9d7bea020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37746/0 (socket says 172.21.15.83:37746) 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9bfff640 1 -- 172.21.15.83:0/3737771347 learned_addr learned my addr 172.21.15.83:0/3737771347 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9affd640 1 --2- 172.21.15.83:0/3737771347 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c338e0 0x55b9d7be9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/3737771347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 0x55b9d7c333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9bfff640 1 -- 172.21.15.83:0/3737771347 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c338e0 msgr2=0x55b9d7be9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/3737771347 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c338e0 0x55b9d7be9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9bfff640 1 -- 172.21.15.83:0/3737771347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 msgr2=0x55b9d7c333a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/3737771347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 0x55b9d7c333a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9bfff640 1 -- 172.21.15.83:0/3737771347 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9d79b8d00 con 0x55b9d7be9c40 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9affd640 1 --2- 172.21.15.83:0/3737771347 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c338e0 0x55b9d7be9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/3737771347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 0x55b9d7c333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/3737771347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 0x55b9d7bea020 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400d460 tx=0x7f2f9400d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a45081a4b1bfee3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f817fa640 1 -- 172.21.15.83:0/3737771347 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9401a070 con 0x55b9d7be9c40 2024-03-30T13:11:11.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f817fa640 1 -- 172.21.15.83:0/3737771347 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9400b740 con 0x55b9d7be9c40 2024-03-30T13:11:11.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.808+0000 7f2f817fa640 1 -- 172.21.15.83:0/3737771347 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400baf0 con 0x55b9d7be9c40 2024-03-30T13:11:11.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 -- 172.21.15.83:0/3737771347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 msgr2=0x55b9d7bea020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/3737771347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 0x55b9d7bea020 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400d460 tx=0x7f2f9400d920 comp rx=0 tx=0).stop 2024-03-30T13:11:11.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 -- 172.21.15.83:0/3737771347 shutdown_connections 2024-03-30T13:11:11.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/3737771347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 0x55b9d7bea020 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/3737771347 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c338e0 0x55b9d7be9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/3737771347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 0x55b9d7c333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 -- 172.21.15.83:0/3737771347 >> 172.21.15.83:0/3737771347 conn(0x55b9d7be17e0 msgr2=0x55b9d7be3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 -- 172.21.15.83:0/3737771347 shutdown_connections 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 -- 172.21.15.83:0/3737771347 wait complete. 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 -- start start 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 Processor -- start 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7be9c40 0x55b9d7c32890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 0x55b9d7bef910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 0x55b9d7befe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b9d79fb270 con 0x55b9d7c338e0 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b9d79f16a0 con 0x55b9d7c32fc0 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b9d79cb880 con 0x55b9d7be9c40 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 10 client.0 _ll_register_callbacks cb 0x55b9d7bd0490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 0x55b9d7befe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 0x55b9d7befe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37750/0 (socket says 172.21.15.83:37750) 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9bfff640 1 -- 172.21.15.83:0/504336868 learned_addr learned my addr 172.21.15.83:0/504336868 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9affd640 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 0x55b9d7bef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7be9c40 0x55b9d7c32890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9bfff640 1 -- 172.21.15.83:0/504336868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7be9c40 msgr2=0x55b9d7c32890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7be9c40 0x55b9d7c32890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9bfff640 1 -- 172.21.15.83:0/504336868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 msgr2=0x55b9d7bef910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 0x55b9d7bef910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9bfff640 1 -- 172.21.15.83:0/504336868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9d79f8730 con 0x55b9d7c338e0 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 0x55b9d7befe50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2f94018040 tx=0x7f2f94004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6708628212d6b182 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f7a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f7a7fc640 1 -- 172.21.15.83:0/504336868 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94025020 con 0x55b9d7c338e0 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f7a7fc640 1 -- 172.21.15.83:0/504336868 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2f94020670 con 0x55b9d7c338e0 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 -- 172.21.15.83:0/504336868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f9400b740 con 0x55b9d7c338e0 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f7a7fc640 1 -- 172.21.15.83:0/504336868 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2f9402f050 con 0x55b9d7c338e0 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 10 client.6183 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 -- 172.21.15.83:0/504336868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b9d79ebca0 con 0x55b9d7c338e0 2024-03-30T13:11:11.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f7a7fc640 1 -- 172.21.15.83:0/504336868 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9400b740 con 0x55b9d7c338e0 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f7a7fc640 1 -- 172.21.15.83:0/504336868 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f2f94032020 con 0x55b9d7c338e0 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 10 client.6183 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 10 client.6183 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 20 client.6183 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9d7bf0b90 0x55b9d7c45280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 4 client.6183 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 -- 172.21.15.83:0/504336868 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9d79cec90 con 0x55b9d7bf0b90 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9d7bf0b90 0x55b9d7c45280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9d7bf0b90 0x55b9d7c45280 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=865b0178e811ad56 server_cookie=16e75f18048b1e15 in_seq=0 out_seq=0 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f7a7fc640 10 client.6183 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f7a7fc640 1 -- 172.21.15.83:0/504336868 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b9d79cec90 con 0x55b9d7bf0b90 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2f7a7fc640 10 client.6183 handle_command_reply: tid=0 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.812+0000 7f2fa4eee000 1 client.6183 shutdown 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.816+0000 7f2fa4eee000 1 -- 172.21.15.83:0/504336868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 msgr2=0x55b9d7befe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.816+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 0x55b9d7befe50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2f94018040 tx=0x7f2f94004ac0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.816+0000 7f2fa4eee000 1 -- 172.21.15.83:0/504336868 shutdown_connections 2024-03-30T13:11:11.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.816+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9d7bf0b90 0x55b9d7c45280 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.816+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 0x55b9d7befe50 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.816+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 0x55b9d7bef910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.816+0000 7f2f7a7fc640 0 client.6183 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.816+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/504336868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7be9c40 0x55b9d7c32890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.816+0000 7f2fa4eee000 1 -- 172.21.15.83:0/504336868 >> 172.21.15.83:0/504336868 conn(0x55b9d7be17e0 msgr2=0x55b9d7bea8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.816+0000 7f2fa4eee000 1 -- 172.21.15.83:0/504336868 shutdown_connections 2024-03-30T13:11:11.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.816+0000 7f2fa4eee000 1 -- 172.21.15.83:0/504336868 wait complete. 2024-03-30T13:11:11.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.816+0000 7f2fa4eee000 20 client.6183 trim_cache size 0 max 16384 2024-03-30T13:11:11.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 Processor -- start 2024-03-30T13:11:11.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 -- start start 2024-03-30T13:11:11.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 0x55b9d7c484c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 0x55b9d7c12080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c338e0 0x55b9d7c125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c0b6000 con 0x55b9d7be9c40 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c09d960 con 0x55b9d7c32fc0 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9c09be00 con 0x55b9d7c338e0 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2f9b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 0x55b9d7c484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2f9b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 0x55b9d7c484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37756/0 (socket says 172.21.15.83:37756) 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2f9b7fe640 1 -- 172.21.15.83:0/180218378 learned_addr learned my addr 172.21.15.83:0/180218378 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2f9b7fe640 1 -- 172.21.15.83:0/180218378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c338e0 msgr2=0x55b9d7c125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/180218378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c338e0 0x55b9d7c125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2f9b7fe640 1 -- 172.21.15.83:0/180218378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 msgr2=0x55b9d7c12080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/180218378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 0x55b9d7c12080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2f9b7fe640 1 -- 172.21.15.83:0/180218378 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9d79bad00 con 0x55b9d7be9c40 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/180218378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 0x55b9d7c484c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2f9001c1e0 tx=0x7f2f90004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab34878b5ecb145 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2f80ff9640 1 -- 172.21.15.83:0/180218378 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900b0040 con 0x55b9d7be9c40 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2f80ff9640 1 -- 172.21.15.83:0/180218378 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f900c63b0 con 0x55b9d7be9c40 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2f80ff9640 1 -- 172.21.15.83:0/180218378 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900c6760 con 0x55b9d7be9c40 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 -- 172.21.15.83:0/180218378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 msgr2=0x55b9d7c484c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/180218378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 0x55b9d7c484c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2f9001c1e0 tx=0x7f2f90004740 comp rx=0 tx=0).stop 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 -- 172.21.15.83:0/180218378 shutdown_connections 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/180218378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c338e0 0x55b9d7c125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/180218378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7c32fc0 0x55b9d7c12080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/180218378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7be9c40 0x55b9d7c484c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 -- 172.21.15.83:0/180218378 >> 172.21.15.83:0/180218378 conn(0x55b9d7be17e0 msgr2=0x55b9d7c12d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 -- 172.21.15.83:0/180218378 shutdown_connections 2024-03-30T13:11:11.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.828+0000 7f2fa4eee000 1 -- 172.21.15.83:0/180218378 wait complete. 2024-03-30T13:11:11.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 -- start start 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 Processor -- start 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7be9c40 0x55b9d7c11f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c32fc0 0x55b9d7c462d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 0x55b9d7c46810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b9d7a32db0 con 0x55b9d7c338e0 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c09d310 con 0x55b9d7be9c40 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b9d7aefb00 con 0x55b9d7c32fc0 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 10 client.0 _ll_register_callbacks cb 0x7f2f94018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 0x55b9d7c46810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 0x55b9d7c46810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37762/0 (socket says 172.21.15.83:37762) 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9bfff640 1 -- 172.21.15.83:0/135174742 learned_addr learned my addr 172.21.15.83:0/135174742 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9affd640 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c32fc0 0x55b9d7c462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7be9c40 0x55b9d7c11f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9bfff640 1 -- 172.21.15.83:0/135174742 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c32fc0 msgr2=0x55b9d7c462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c32fc0 0x55b9d7c462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9bfff640 1 -- 172.21.15.83:0/135174742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7be9c40 msgr2=0x55b9d7c11f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7be9c40 0x55b9d7c11f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9bfff640 1 -- 172.21.15.83:0/135174742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9d7ab4f70 con 0x55b9d7c338e0 2024-03-30T13:11:11.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9bfff640 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 0x55b9d7c46810 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2f940085d0 tx=0x7f2f94004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461c268eabdf5f34 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f7a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:11.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f7a7fc640 1 -- 172.21.15.83:0/135174742 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94025070 con 0x55b9d7c338e0 2024-03-30T13:11:11.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f7a7fc640 1 -- 172.21.15.83:0/135174742 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2f9400be00 con 0x55b9d7c338e0 2024-03-30T13:11:11.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 -- 172.21.15.83:0/135174742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f900c63b0 con 0x55b9d7c338e0 2024-03-30T13:11:11.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f7a7fc640 1 -- 172.21.15.83:0/135174742 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2f9401a040 con 0x55b9d7c338e0 2024-03-30T13:11:11.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 10 client.6189 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:11.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 -- 172.21.15.83:0/135174742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b9d79da760 con 0x55b9d7c338e0 2024-03-30T13:11:11.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f7a7fc640 1 -- 172.21.15.83:0/135174742 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f900c63b0 con 0x55b9d7c338e0 2024-03-30T13:11:11.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f7a7fc640 1 -- 172.21.15.83:0/135174742 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f2f9403b050 con 0x55b9d7c338e0 2024-03-30T13:11:11.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 10 client.6189 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:11.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 10 client.6189 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:11.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 20 client.6189 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:11.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9d7c46d50 0x55b9d7ca4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 4 client.6189 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628403}] 2024-03-30T13:11:11.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 -- 172.21.15.83:0/135174742 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628403}) -- 0x55b9d7a40fe0 con 0x55b9d7c46d50 2024-03-30T13:11:11.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9d7c46d50 0x55b9d7ca4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f7a7fc640 10 client.6189 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f9b7fe640 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9d7c46d50 0x55b9d7ca4b50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36892674f253b80f server_cookie=19d5f6cdf5251db3 in_seq=0 out_seq=0 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f7a7fc640 1 -- 172.21.15.83:0/135174742 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3803 (crc 0 0 0) 0x55b9d7a40fe0 con 0x55b9d7c46d50 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f7a7fc640 10 client.6189 handle_command_reply: tid=0 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 client.6189 shutdown 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 -- 172.21.15.83:0/135174742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 msgr2=0x55b9d7c46810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 0x55b9d7c46810 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2f940085d0 tx=0x7f2f94004a50 comp rx=0 tx=0).stop 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 -- 172.21.15.83:0/135174742 shutdown_connections 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9d7c46d50 0x55b9d7ca4b50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9d7c338e0 0x55b9d7c46810 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2f7a7fc640 0 client.6189 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9d7c32fc0 0x55b9d7c462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 --2- 172.21.15.83:0/135174742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9d7be9c40 0x55b9d7c11f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 -- 172.21.15.83:0/135174742 >> 172.21.15.83:0/135174742 conn(0x55b9d7be17e0 msgr2=0x55b9d7c135e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 -- 172.21.15.83:0/135174742 shutdown_connections 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 1 -- 172.21.15.83:0/135174742 wait complete. 2024-03-30T13:11:11.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa4eee000 20 client.6189 trim_cache size 0 max 16384 2024-03-30T13:11:11.848 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:11.848 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/xattr_trusted.c", 2024-03-30T13:11:11.848 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628403, 2024-03-30T13:11:11.848 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:11.848 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.635826+0000", 2024-03-30T13:11:11.848 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.010414+0000", 2024-03-30T13:11:11.848 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:11.848 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:11.848 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:11.848 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:11.848 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 1094, 2024-03-30T13:11:11.849 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.010414+0000", 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.850 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1094, 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.635826+0000" 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:11.851 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 1094, 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.635826+0000" 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 128, 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 36, 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:11.853 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:11.854 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:11.855 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:11.855 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:11.855 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:11.855 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:11.855 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:11.855 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:11.855 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:11.855 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:11.855 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.855 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:11.855 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:11.856 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.856 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.856 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:11.856 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.856 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.856 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.856 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.856 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.856 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.856 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:11.856 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:11.858 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:11.859 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:11.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/3697383109 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2f88067fc0 msgr2=0x7f2f8806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa1d6c640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2f88067fc0 0x7f2f8806a480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2f900ad000 tx=0x7f2f900a6000 comp rx=0 tx=0).stop 2024-03-30T13:11:11.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.832+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/3697383109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f9c0b6d10 msgr2=0x7f2f9c154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.836+0000 7f2fa1d6c640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f9c0b6d10 0x7f2f9c154da0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00c7f0 tx=0x7f2f8c00ccb0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.836+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/3697383109 shutdown_connections 2024-03-30T13:11:11.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.836+0000 7f2fa1d6c640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2f88067fc0 0x7f2f8806a480 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.836+0000 7f2fa1d6c640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c145ed0 0x7f2f9c0b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.836+0000 7f2fa1d6c640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f9c0b6d10 0x7f2f9c154da0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.836+0000 7f2fa1d6c640 1 --2- 172.21.15.83:0/3697383109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f9c06bba0 0x7f2f9c0cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.836+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/3697383109 >> 172.21.15.83:0/3697383109 conn(0x7f2f9c09aa50 msgr2=0x7f2f9c0cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.836+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/3697383109 shutdown_connections 2024-03-30T13:11:11.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.836+0000 7f2fa1d6c640 1 -- 172.21.15.83:0/3697383109 wait complete. 2024-03-30T13:11:11.862 DEBUG:tasks.cephfs.test_uninlining:getting inode info #13 of 23:1099511628401 2024-03-30T13:11:11.862 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628401 2024-03-30T13:11:11.862 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628401 2024-03-30T13:11:11.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76ed0b640 1 Processor -- start 2024-03-30T13:11:11.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76ed0b640 1 -- start start 2024-03-30T13:11:11.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76ed0b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff76815b430 0x7ff7680b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76ed0b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff76815b810 0x7ff768140180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76ed0b640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7680cf280 con 0x7ff76815bca0 2024-03-30T13:11:11.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76ed0b640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff7680cfbb0 con 0x7ff76815b430 2024-03-30T13:11:11.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76ed0b640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff7680cf560 con 0x7ff76815b810 2024-03-30T13:11:11.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76caa7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff76815b430 0x7ff7680b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76caa7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff76815b430 0x7ff7680b65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37764/0 (socket says 172.21.15.83:37764) 2024-03-30T13:11:11.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76d2a8640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff76815bca0 0x7ff76815e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57450/0 (socket says 172.21.15.83:57450) 2024-03-30T13:11:11.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76caa7640 1 -- 172.21.15.83:0/2711950679 learned_addr learned my addr 172.21.15.83:0/2711950679 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff767fff640 1 --2- 172.21.15.83:0/2711950679 >> v2:172.21.15.153:3300/0 conn(0x7ff76815b810 0x7ff768140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76caa7640 1 -- 172.21.15.83:0/2711950679 >> v2:172.21.15.153:3300/0 conn(0x7ff76815b810 msgr2=0x7ff768140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76caa7640 1 --2- 172.21.15.83:0/2711950679 >> v2:172.21.15.153:3300/0 conn(0x7ff76815b810 0x7ff768140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76caa7640 1 -- 172.21.15.83:0/2711950679 >> v1:172.21.15.83:6789/0 conn(0x7ff76815bca0 legacy=0x7ff76815e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76caa7640 1 -- 172.21.15.83:0/2711950679 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7680cf840 con 0x7ff76815b430 2024-03-30T13:11:11.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff7677fe640 1 -- 172.21.15.83:0/2711950679 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2659339333 0 0) 0x7ff7680cf280 con 0x7ff76815bca0 2024-03-30T13:11:11.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff767fff640 1 --2- 172.21.15.83:0/2711950679 >> v2:172.21.15.153:3300/0 conn(0x7ff76815b810 0x7ff768140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.964+0000 7ff76caa7640 1 --2- 172.21.15.83:0/2711950679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815b430 0x7ff7680b65b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff768158bd0 tx=0x7ff75c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111d7765869dc70c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff7677fe640 1 -- 172.21.15.83:0/2711950679 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0ab430 con 0x7ff76815b430 2024-03-30T13:11:11.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff7677fe640 1 -- 172.21.15.83:0/2711950679 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75c0b0070 con 0x7ff76815b430 2024-03-30T13:11:11.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff7677fe640 1 -- 172.21.15.83:0/2711950679 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0ab7f0 con 0x7ff76815b430 2024-03-30T13:11:11.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 -- 172.21.15.83:0/2711950679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815b430 msgr2=0x7ff7680b65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 --2- 172.21.15.83:0/2711950679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815b430 0x7ff7680b65b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff768158bd0 tx=0x7ff75c01c4e0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 -- 172.21.15.83:0/2711950679 shutdown_connections 2024-03-30T13:11:11.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 --2- 172.21.15.83:0/2711950679 >> v2:172.21.15.153:3300/0 conn(0x7ff76815b810 0x7ff768140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 --2- 172.21.15.83:0/2711950679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815b430 0x7ff7680b65b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 -- 172.21.15.83:0/2711950679 >> 172.21.15.83:0/2711950679 conn(0x7ff768072f00 msgr2=0x7ff76806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 -- 172.21.15.83:0/2711950679 shutdown_connections 2024-03-30T13:11:11.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 -- 172.21.15.83:0/2711950679 wait complete. 2024-03-30T13:11:11.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 Processor -- start 2024-03-30T13:11:11.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 -- start start 2024-03-30T13:11:11.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff76815b430 0x7ff7680c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76815b810 0x7ff76813bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815bca0 0x7ff7680c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff768067370 con 0x7ff76815bca0 2024-03-30T13:11:11.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff7680d0250 con 0x7ff76815b810 2024-03-30T13:11:11.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76ed0b640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff7680674f0 con 0x7ff76815b430 2024-03-30T13:11:11.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76d2a8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815bca0 0x7ff7680c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76d2a8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815bca0 0x7ff7680c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37772/0 (socket says 172.21.15.83:37772) 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76d2a8640 1 -- 172.21.15.83:0/3302811712 learned_addr learned my addr 172.21.15.83:0/3302811712 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76caa7640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff76815b430 0x7ff7680c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76d2a8640 1 -- 172.21.15.83:0/3302811712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff76815b430 msgr2=0x7ff7680c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff767fff640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76815b810 0x7ff76813bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76d2a8640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff76815b430 0x7ff7680c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76d2a8640 1 -- 172.21.15.83:0/3302811712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76815b810 msgr2=0x7ff76813bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76d2a8640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76815b810 0x7ff76813bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.968+0000 7ff76d2a8640 1 -- 172.21.15.83:0/3302811712 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7680c6d30 con 0x7ff76815bca0 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff76d2a8640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815bca0 0x7ff7680c7570 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ff76000c7d0 tx=0x7ff76000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff7657fa640 1 -- 172.21.15.83:0/3302811712 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760018070 con 0x7ff76815bca0 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff7657fa640 1 -- 172.21.15.83:0/3302811712 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76000a640 con 0x7ff76815bca0 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff76ed0b640 1 -- 172.21.15.83:0/3302811712 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7680c6a50 con 0x7ff76815bca0 2024-03-30T13:11:11.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff7657fa640 1 -- 172.21.15.83:0/3302811712 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76000aa70 con 0x7ff76815bca0 2024-03-30T13:11:11.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff76ed0b640 1 -- 172.21.15.83:0/3302811712 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76813c5e0 con 0x7ff76815bca0 2024-03-30T13:11:11.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff7657fa640 1 -- 172.21.15.83:0/3302811712 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff76001b070 con 0x7ff76815bca0 2024-03-30T13:11:11.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff7657fa640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff74c067ff0 0x7ff74c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff76caa7640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff74c067ff0 0x7ff74c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff7657fa640 1 -- 172.21.15.83:0/3302811712 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff760085aa0 con 0x7ff76815bca0 2024-03-30T13:11:11.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff771e8d000 1 Processor -- start 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff771e8d000 1 -- start start 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff76caa7640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff74c067ff0 0x7ff74c06a4b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0af000 tx=0x7ff75c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff771e8d000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fccd70 0x565478fcd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff771e8d000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fcd690 0x565478f832f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff771e8d000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478f83830 0x565478f83c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff771e8d000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x565478dd1aa0 con 0x565478fcd690 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff771e8d000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565478d58af0 con 0x565478fccd70 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff771e8d000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x565478dcda50 con 0x565478f83830 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff767fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fcd690 0x565478f832f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff767fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fcd690 0x565478f832f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37782/0 (socket says 172.21.15.83:37782) 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.972+0000 7ff767fff640 1 -- 172.21.15.83:0/2419883063 learned_addr learned my addr 172.21.15.83:0/2419883063 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76caa7640 1 --2- 172.21.15.83:0/2419883063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fccd70 0x565478fcd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76d2a8640 1 --2- 172.21.15.83:0/2419883063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478f83830 0x565478f83c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff767fff640 1 -- 172.21.15.83:0/2419883063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478f83830 msgr2=0x565478f83c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff767fff640 1 --2- 172.21.15.83:0/2419883063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478f83830 0x565478f83c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff767fff640 1 -- 172.21.15.83:0/2419883063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fccd70 msgr2=0x565478fcd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff767fff640 1 --2- 172.21.15.83:0/2419883063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fccd70 0x565478fcd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff767fff640 1 -- 172.21.15.83:0/2419883063 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565478d56d00 con 0x565478fcd690 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76d2a8640 1 --2- 172.21.15.83:0/2419883063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478f83830 0x565478f83c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff767fff640 1 --2- 172.21.15.83:0/2419883063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fcd690 0x565478f832f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff75400b900 tx=0x7ff75400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbd3b1023eff72f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff7527fc640 1 -- 172.21.15.83:0/2419883063 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754016070 con 0x565478fcd690 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff7527fc640 1 -- 172.21.15.83:0/2419883063 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75400dc70 con 0x565478fcd690 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff7527fc640 1 -- 172.21.15.83:0/2419883063 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754012680 con 0x565478fcd690 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 -- 172.21.15.83:0/2419883063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fcd690 msgr2=0x565478f832f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 --2- 172.21.15.83:0/2419883063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fcd690 0x565478f832f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff75400b900 tx=0x7ff75400bdc0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 -- 172.21.15.83:0/2419883063 shutdown_connections 2024-03-30T13:11:11.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 --2- 172.21.15.83:0/2419883063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478f83830 0x565478f83c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 --2- 172.21.15.83:0/2419883063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fcd690 0x565478f832f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 --2- 172.21.15.83:0/2419883063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fccd70 0x565478fcd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 -- 172.21.15.83:0/2419883063 >> 172.21.15.83:0/2419883063 conn(0x565478f7f7e0 msgr2=0x565478f81bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 -- 172.21.15.83:0/2419883063 shutdown_connections 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 -- 172.21.15.83:0/2419883063 wait complete. 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 -- start start 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 Processor -- start 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 0x565478f88c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fccd70 0x565478fb1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478fcd690 0x565478fb22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x565478d99270 con 0x565478f83830 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565478d8f6a0 con 0x565478fccd70 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x565478d69880 con 0x565478fcd690 2024-03-30T13:11:11.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 10 client.0 _ll_register_callbacks cb 0x565478f6e490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76caa7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 0x565478f88c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76caa7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 0x565478f88c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37788/0 (socket says 172.21.15.83:37788) 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76caa7640 1 -- 172.21.15.83:0/436329237 learned_addr learned my addr 172.21.15.83:0/436329237 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76d2a8640 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478fcd690 0x565478fb22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff767fff640 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fccd70 0x565478fb1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76caa7640 1 -- 172.21.15.83:0/436329237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478fcd690 msgr2=0x565478fb22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76caa7640 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478fcd690 0x565478fb22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76caa7640 1 -- 172.21.15.83:0/436329237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fccd70 msgr2=0x565478fb1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76caa7640 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fccd70 0x565478fb1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76caa7640 1 -- 172.21.15.83:0/436329237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565478d96730 con 0x565478f83830 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff767fff640 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fccd70 0x565478fb1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff76caa7640 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 0x565478f88c10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0ad040 tx=0x7ff75c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1311d502a3282f6f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:11.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff7477fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff7477fe640 1 -- 172.21.15.83:0/436329237 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0b4d00 con 0x565478f83830 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff7477fe640 1 -- 172.21.15.83:0/436329237 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff75c0c1470 con 0x565478f83830 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 -- 172.21.15.83:0/436329237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff75400dc70 con 0x565478f83830 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff7477fe640 1 -- 172.21.15.83:0/436329237 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff75c0ce050 con 0x565478f83830 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 10 client.6204 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 -- 172.21.15.83:0/436329237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x565478d89ca0 con 0x565478f83830 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff7477fe640 1 -- 172.21.15.83:0/436329237 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75400dc70 con 0x565478f83830 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff7477fe640 1 -- 172.21.15.83:0/436329237 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7ff75c0d1020 con 0x565478f83830 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 10 client.6204 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 10 client.6204 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 20 client.6204 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x565478fd45d0 0x565478fd49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 4 client.6204 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:11.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.976+0000 7ff771e8d000 1 -- 172.21.15.83:0/436329237 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565478d6cc90 con 0x565478fd45d0 2024-03-30T13:11:11.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff767fff640 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x565478fd45d0 0x565478fd49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:11.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff7477fe640 10 client.6204 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff767fff640 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x565478fd45d0 0x565478fd49e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3342b42873798516 server_cookie=1953feeecdbc59b8 in_seq=0 out_seq=0 2024-03-30T13:11:11.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff7477fe640 1 -- 172.21.15.83:0/436329237 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x565478d6cc90 con 0x565478fd45d0 2024-03-30T13:11:11.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff7477fe640 10 client.6204 handle_command_reply: tid=0 2024-03-30T13:11:11.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff771e8d000 1 client.6204 shutdown 2024-03-30T13:11:11.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff771e8d000 1 -- 172.21.15.83:0/436329237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 msgr2=0x565478f88c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:11.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff771e8d000 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 0x565478f88c10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0ad040 tx=0x7ff75c0046d0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff771e8d000 1 -- 172.21.15.83:0/436329237 shutdown_connections 2024-03-30T13:11:11.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff771e8d000 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478fcd690 0x565478fb22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff771e8d000 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fccd70 0x565478fb1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff771e8d000 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x565478fd45d0 0x565478fd49e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff771e8d000 1 --2- 172.21.15.83:0/436329237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 0x565478f88c10 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:11.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff771e8d000 1 -- 172.21.15.83:0/436329237 >> 172.21.15.83:0/436329237 conn(0x565478f7f7e0 msgr2=0x565478f82460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:11.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff7477fe640 0 client.6204 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:11.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff771e8d000 1 -- 172.21.15.83:0/436329237 shutdown_connections 2024-03-30T13:11:11.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff771e8d000 1 -- 172.21.15.83:0/436329237 wait complete. 2024-03-30T13:11:11.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.980+0000 7ff771e8d000 20 client.6204 trim_cache size 0 max 16384 2024-03-30T13:11:12.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.992+0000 7ff771e8d000 1 Processor -- start 2024-03-30T13:11:12.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.992+0000 7ff771e8d000 1 -- start start 2024-03-30T13:11:12.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478f83830 0x565478fd2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fccd70 0x565478fb0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fcd690 0x565478fb1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff768203ad0 con 0x565478fccd70 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff768202b00 con 0x565478fcd690 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff7681fb2c0 con 0x565478f83830 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff767fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fccd70 0x565478fb0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff767fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fccd70 0x565478fb0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37798/0 (socket says 172.21.15.83:37798) 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff767fff640 1 -- 172.21.15.83:0/4189510158 learned_addr learned my addr 172.21.15.83:0/4189510158 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76caa7640 1 --2- 172.21.15.83:0/4189510158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478f83830 0x565478fd2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76d2a8640 1 --2- 172.21.15.83:0/4189510158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fcd690 0x565478fb1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff767fff640 1 -- 172.21.15.83:0/4189510158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478f83830 msgr2=0x565478fd2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff767fff640 1 --2- 172.21.15.83:0/4189510158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478f83830 0x565478fd2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff767fff640 1 -- 172.21.15.83:0/4189510158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fcd690 msgr2=0x565478fb1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff767fff640 1 --2- 172.21.15.83:0/4189510158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fcd690 0x565478fb1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff767fff640 1 -- 172.21.15.83:0/4189510158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565478d58d00 con 0x565478fccd70 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff767fff640 1 --2- 172.21.15.83:0/4189510158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fccd70 0x565478fb0d50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x565478e91c80 tx=0x7ff754012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ba6d8fe1f60e45 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff751ffb640 1 -- 172.21.15.83:0/4189510158 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75402d070 con 0x565478fccd70 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff751ffb640 1 -- 172.21.15.83:0/4189510158 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75400b040 con 0x565478fccd70 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff751ffb640 1 -- 172.21.15.83:0/4189510158 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754016040 con 0x565478fccd70 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- 172.21.15.83:0/4189510158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fccd70 msgr2=0x565478fb0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 --2- 172.21.15.83:0/4189510158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fccd70 0x565478fb0d50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x565478e91c80 tx=0x7ff754012000 comp rx=0 tx=0).stop 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- 172.21.15.83:0/4189510158 shutdown_connections 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 --2- 172.21.15.83:0/4189510158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fcd690 0x565478fb1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 --2- 172.21.15.83:0/4189510158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478fccd70 0x565478fb0d50 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 --2- 172.21.15.83:0/4189510158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478f83830 0x565478fd2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- 172.21.15.83:0/4189510158 >> 172.21.15.83:0/4189510158 conn(0x565478f7f7e0 msgr2=0x565478fb02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- 172.21.15.83:0/4189510158 shutdown_connections 2024-03-30T13:11:12.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- 172.21.15.83:0/4189510158 wait complete. 2024-03-30T13:11:12.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- start start 2024-03-30T13:11:12.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 Processor -- start 2024-03-30T13:11:12.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 0x56547903e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478fccd70 0x56547903ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fcd690 0x565478fcfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x565478e8db00 con 0x565478f83830 2024-03-30T13:11:12.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff7680c8550 con 0x565478fcd690 2024-03-30T13:11:12.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x565478fb09c0 con 0x565478fccd70 2024-03-30T13:11:12.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 10 client.0 _ll_register_callbacks cb 0x7ff75c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:12.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76caa7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 0x56547903e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76caa7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 0x56547903e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37812/0 (socket says 172.21.15.83:37812) 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76caa7640 1 -- 172.21.15.83:0/555145840 learned_addr learned my addr 172.21.15.83:0/555145840 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff767fff640 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478fccd70 0x56547903ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76d2a8640 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fcd690 0x565478fcfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76caa7640 1 -- 172.21.15.83:0/555145840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478fccd70 msgr2=0x56547903ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76caa7640 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478fccd70 0x56547903ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76caa7640 1 -- 172.21.15.83:0/555145840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fcd690 msgr2=0x565478fcfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76caa7640 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fcd690 0x565478fcfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76caa7640 1 -- 172.21.15.83:0/555145840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565478e52f70 con 0x565478f83830 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff767fff640 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478fccd70 0x56547903ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76d2a8640 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fcd690 0x565478fcfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff76caa7640 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 0x56547903e730 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff75c01ca50 tx=0x7ff75c01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b91e45dc0088b84 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff7477fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:12.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff7477fe640 1 -- 172.21.15.83:0/555145840 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0d6070 con 0x565478f83830 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff7477fe640 1 -- 172.21.15.83:0/555145840 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff75c004040 con 0x565478f83830 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- 172.21.15.83:0/555145840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff75400b040 con 0x565478f83830 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff7477fe640 1 -- 172.21.15.83:0/555145840 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff75c0e1050 con 0x565478f83830 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 10 client.6210 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:11.996+0000 7ff771e8d000 1 -- 172.21.15.83:0/555145840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x565478d78760 con 0x565478f83830 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff7477fe640 1 -- 172.21.15.83:0/555145840 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75400b040 con 0x565478f83830 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff7477fe640 1 -- 172.21.15.83:0/555145840 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7ff75c0e4020 con 0x565478f83830 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 10 client.6210 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 10 client.6210 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 20 client.6210 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x565478fd03b0 0x565478fd0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 4 client.6210 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628401}] 2024-03-30T13:11:12.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 -- 172.21.15.83:0/555145840 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628401}) -- 0x565478ddefe0 con 0x565478fd03b0 2024-03-30T13:11:12.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff767fff640 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x565478fd03b0 0x565478fd0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff767fff640 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x565478fd03b0 0x565478fd0790 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0bf79f1b2c32a82 server_cookie=9f3aa00086d5322a in_seq=0 out_seq=0 2024-03-30T13:11:12.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff7477fe640 10 client.6210 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff7477fe640 1 -- 172.21.15.83:0/555145840 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3795 (crc 0 0 0) 0x565478ddefe0 con 0x565478fd03b0 2024-03-30T13:11:12.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff7477fe640 10 client.6210 handle_command_reply: tid=0 2024-03-30T13:11:12.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 client.6210 shutdown 2024-03-30T13:11:12.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 -- 172.21.15.83:0/555145840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 msgr2=0x56547903e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 0x56547903e730 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff75c01ca50 tx=0x7ff75c01ad20 comp rx=0 tx=0).stop 2024-03-30T13:11:12.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 -- 172.21.15.83:0/555145840 shutdown_connections 2024-03-30T13:11:12.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565478fcd690 0x565478fcfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x565478fccd70 0x56547903ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x565478fd03b0 0x565478fd0790 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 --2- 172.21.15.83:0/555145840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x565478f83830 0x56547903e730 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 -- 172.21.15.83:0/555145840 >> 172.21.15.83:0/555145840 conn(0x565478f7f7e0 msgr2=0x565478fe3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff7477fe640 0 client.6210 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 -- 172.21.15.83:0/555145840 shutdown_connections 2024-03-30T13:11:12.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 1 -- 172.21.15.83:0/555145840 wait complete. 2024-03-30T13:11:12.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff771e8d000 20 client.6210 trim_cache size 0 max 16384 2024-03-30T13:11:12.014 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/ext2/xattr.h", 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628401, 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.638068+0000", 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.006679+0000", 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:12.015 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 3340, 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:12.016 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.006679+0000", 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:12.017 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 3340, 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.638068+0000" 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 3340, 2024-03-30T13:11:12.018 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.638068+0000" 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 130, 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 32, 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:12.019 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:12.020 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:12.021 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:12.022 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.023 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.024 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:12.025 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:12.026 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:12.026 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:12.026 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:12.026 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:12.026 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:12.026 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.026 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:12.026 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:12.026 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:12.026 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:12.026 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:12.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff76ed0b640 1 -- 172.21.15.83:0/3302811712 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff74c067ff0 msgr2=0x7ff74c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff76ed0b640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff74c067ff0 0x7ff74c06a4b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0af000 tx=0x7ff75c008040 comp rx=0 tx=0).stop 2024-03-30T13:11:12.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff76ed0b640 1 -- 172.21.15.83:0/3302811712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815bca0 msgr2=0x7ff7680c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff76ed0b640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815bca0 0x7ff7680c7570 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ff76000c7d0 tx=0x7ff76000cc90 comp rx=0 tx=0).stop 2024-03-30T13:11:12.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff76ed0b640 1 -- 172.21.15.83:0/3302811712 shutdown_connections 2024-03-30T13:11:12.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff76ed0b640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff74c067ff0 0x7ff74c06a4b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff76ed0b640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815bca0 0x7ff7680c7570 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff76ed0b640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76815b810 0x7ff76813bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff76ed0b640 1 --2- 172.21.15.83:0/3302811712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff76815b430 0x7ff7680c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff76ed0b640 1 -- 172.21.15.83:0/3302811712 >> 172.21.15.83:0/3302811712 conn(0x7ff768072f00 msgr2=0x7ff7680b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff76ed0b640 1 -- 172.21.15.83:0/3302811712 shutdown_connections 2024-03-30T13:11:12.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.000+0000 7ff76ed0b640 1 -- 172.21.15.83:0/3302811712 wait complete. 2024-03-30T13:11:12.029 DEBUG:tasks.cephfs.test_uninlining:getting inode info #14 of 23:1099511628406 2024-03-30T13:11:12.029 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628406 2024-03-30T13:11:12.029 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628406 2024-03-30T13:11:12.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f232c587640 1 Processor -- start 2024-03-30T13:11:12.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f232c587640 1 -- start start 2024-03-30T13:11:12.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f232c587640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f23240b1fe0 0x7f23240aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f232c587640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23240b4070 0x7f23240b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f232c587640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23240b37a0 con 0x7f232415b570 2024-03-30T13:11:12.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f232c587640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f23240b5a30 con 0x7f23240b1fe0 2024-03-30T13:11:12.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f232c587640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f23240b0af0 con 0x7f23240b4070 2024-03-30T13:11:12.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f2329b22640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f23240b1fe0 0x7f23240aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f2329b22640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f23240b1fe0 0x7f23240aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37820/0 (socket says 172.21.15.83:37820) 2024-03-30T13:11:12.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f2329b22640 1 -- 172.21.15.83:0/3392685944 learned_addr learned my addr 172.21.15.83:0/3392685944 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f232ab24640 1 --2- 172.21.15.83:0/3392685944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23240b4070 0x7f23240b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f2329b22640 1 -- 172.21.15.83:0/3392685944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23240b4070 msgr2=0x7f23240b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f2329b22640 1 --2- 172.21.15.83:0/3392685944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23240b4070 0x7f23240b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f2329b22640 1 -- 172.21.15.83:0/3392685944 >> v1:172.21.15.153:6789/0 conn(0x7f232415b570 legacy=0x7f23240ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.136+0000 7f2329b22640 1 -- 172.21.15.83:0/3392685944 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232415b950 con 0x7f23240b1fe0 2024-03-30T13:11:12.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f2329b22640 1 --2- 172.21.15.83:0/3392685944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23240b1fe0 0x7f23240aee40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2314009870 tx=0x7f231401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a5ae644222ded7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f2329321640 1 -- 172.21.15.83:0/3392685944 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140a95f0 con 0x7f23240b1fe0 2024-03-30T13:11:12.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f2329321640 1 -- 172.21.15.83:0/3392685944 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23140a9790 con 0x7f23240b1fe0 2024-03-30T13:11:12.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f2329321640 1 -- 172.21.15.83:0/3392685944 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140a9b60 con 0x7f23240b1fe0 2024-03-30T13:11:12.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f232c587640 1 -- 172.21.15.83:0/3392685944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23240b1fe0 msgr2=0x7f23240aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f232c587640 1 --2- 172.21.15.83:0/3392685944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23240b1fe0 0x7f23240aee40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2314009870 tx=0x7f231401c530 comp rx=0 tx=0).stop 2024-03-30T13:11:12.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f232c587640 1 -- 172.21.15.83:0/3392685944 shutdown_connections 2024-03-30T13:11:12.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f232c587640 1 --2- 172.21.15.83:0/3392685944 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f23240b4070 0x7f23240b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f232c587640 1 --2- 172.21.15.83:0/3392685944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23240b1fe0 0x7f23240aee40 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f232c587640 1 -- 172.21.15.83:0/3392685944 >> 172.21.15.83:0/3392685944 conn(0x7f2324072d30 msgr2=0x7f23240b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f232c587640 1 -- 172.21.15.83:0/3392685944 shutdown_connections 2024-03-30T13:11:12.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f232c587640 1 -- 172.21.15.83:0/3392685944 wait complete. 2024-03-30T13:11:12.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f232c587640 1 Processor -- start 2024-03-30T13:11:12.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.140+0000 7f232c587640 1 -- start start 2024-03-30T13:11:12.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232c587640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23240b1fe0 0x7f2324148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232c587640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23240b4070 0x7f232415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232c587640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f232415b570 0x7f2324152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232c587640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f23240b5230 con 0x7f23240b1fe0 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232c587640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23240afd30 con 0x7f23240b4070 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232c587640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f23240b53b0 con 0x7f232415b570 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232a323640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23240b1fe0 0x7f2324148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232a323640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23240b1fe0 0x7f2324148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37836/0 (socket says 172.21.15.83:37836) 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232a323640 1 -- 172.21.15.83:0/1097411205 learned_addr learned my addr 172.21.15.83:0/1097411205 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232ab24640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f232415b570 0x7f2324152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f2329b22640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23240b4070 0x7f232415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232a323640 1 -- 172.21.15.83:0/1097411205 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f232415b570 msgr2=0x7f2324152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232a323640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f232415b570 0x7f2324152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232a323640 1 -- 172.21.15.83:0/1097411205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23240b4070 msgr2=0x7f232415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232a323640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23240b4070 0x7f232415bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232a323640 1 -- 172.21.15.83:0/1097411205 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232415d150 con 0x7f23240b1fe0 2024-03-30T13:11:12.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232a323640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23240b1fe0 0x7f2324148de0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f232000c370 tx=0x7f232000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f231affd640 1 -- 172.21.15.83:0/1097411205 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23200052d0 con 0x7f23240b1fe0 2024-03-30T13:11:12.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f231affd640 1 -- 172.21.15.83:0/1097411205 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2320005470 con 0x7f23240b1fe0 2024-03-30T13:11:12.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232c587640 1 -- 172.21.15.83:0/1097411205 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232415c5d0 con 0x7f23240b1fe0 2024-03-30T13:11:12.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f231affd640 1 -- 172.21.15.83:0/1097411205 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320007260 con 0x7f23240b1fe0 2024-03-30T13:11:12.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232c587640 1 -- 172.21.15.83:0/1097411205 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f232415cb90 con 0x7f23240b1fe0 2024-03-30T13:11:12.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f231affd640 1 -- 172.21.15.83:0/1097411205 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2320007400 con 0x7f23240b1fe0 2024-03-30T13:11:12.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f231affd640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2308067fc0 0x7f230806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f231affd640 1 -- 172.21.15.83:0/1097411205 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2320085a60 con 0x7f23240b1fe0 2024-03-30T13:11:12.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f2329b22640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2308067fc0 0x7f230806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232f709000 1 Processor -- start 2024-03-30T13:11:12.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.144+0000 7f232f709000 1 -- start start 2024-03-30T13:11:12.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f2329b22640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2308067fc0 0x7f230806a480 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f23140ae000 tx=0x7f23140b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cad70 0x55c6ad2cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 0x55c6ad2812f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad281c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c6ad0cfaa0 con 0x55c6ad281830 2024-03-30T13:11:12.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c6ad056af0 con 0x55c6ad2cad70 2024-03-30T13:11:12.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55c6ad0cba50 con 0x55c6ad2cb690 2024-03-30T13:11:12.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232ab24640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad281c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232ab24640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad281c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37852/0 (socket says 172.21.15.83:37852) 2024-03-30T13:11:12.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232ab24640 1 -- 172.21.15.83:0/2257854684 learned_addr learned my addr 172.21.15.83:0/2257854684 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f2329b22640 1 --2- 172.21.15.83:0/2257854684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 0x55c6ad2812f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232a323640 1 --2- 172.21.15.83:0/2257854684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cad70 0x55c6ad2cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232ab24640 1 -- 172.21.15.83:0/2257854684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 msgr2=0x55c6ad2812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232ab24640 1 --2- 172.21.15.83:0/2257854684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 0x55c6ad2812f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232ab24640 1 -- 172.21.15.83:0/2257854684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cad70 msgr2=0x55c6ad2cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232ab24640 1 --2- 172.21.15.83:0/2257854684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cad70 0x55c6ad2cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232ab24640 1 -- 172.21.15.83:0/2257854684 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6ad054d00 con 0x55c6ad281830 2024-03-30T13:11:12.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232a323640 1 --2- 172.21.15.83:0/2257854684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cad70 0x55c6ad2cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232ab24640 1 --2- 172.21.15.83:0/2257854684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad281c10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f231c009f40 tx=0x7f231c0077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77776555a15fce00 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f2307fff640 1 -- 172.21.15.83:0/2257854684 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c013780 con 0x55c6ad281830 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f2307fff640 1 -- 172.21.15.83:0/2257854684 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f231c019070 con 0x55c6ad281830 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f2307fff640 1 -- 172.21.15.83:0/2257854684 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c013b60 con 0x55c6ad281830 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 -- 172.21.15.83:0/2257854684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 msgr2=0x55c6ad281c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 --2- 172.21.15.83:0/2257854684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad281c10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f231c009f40 tx=0x7f231c0077c0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 -- 172.21.15.83:0/2257854684 shutdown_connections 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 --2- 172.21.15.83:0/2257854684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad281c10 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 --2- 172.21.15.83:0/2257854684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 0x55c6ad2812f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 --2- 172.21.15.83:0/2257854684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cad70 0x55c6ad2cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 -- 172.21.15.83:0/2257854684 >> 172.21.15.83:0/2257854684 conn(0x55c6ad27d7e0 msgr2=0x55c6ad27fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 -- 172.21.15.83:0/2257854684 shutdown_connections 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 -- 172.21.15.83:0/2257854684 wait complete. 2024-03-30T13:11:12.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 -- start start 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 Processor -- start 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad286c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cad70 0x55c6ad2afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cb690 0x55c6ad2b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c6ad097270 con 0x55c6ad281830 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c6ad08d6a0 con 0x55c6ad2cb690 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55c6ad067880 con 0x55c6ad2cad70 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232f709000 10 client.0 _ll_register_callbacks cb 0x55c6ad26c490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232a323640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad286c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232a323640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad286c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37866/0 (socket says 172.21.15.83:37866) 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232a323640 1 -- 172.21.15.83:0/3520380904 learned_addr learned my addr 172.21.15.83:0/3520380904 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232ab24640 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cb690 0x55c6ad2b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f2329b22640 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cad70 0x55c6ad2afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232a323640 1 -- 172.21.15.83:0/3520380904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cad70 msgr2=0x55c6ad2afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232a323640 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cad70 0x55c6ad2afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232a323640 1 -- 172.21.15.83:0/3520380904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cb690 msgr2=0x55c6ad2b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232a323640 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cb690 0x55c6ad2b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232a323640 1 -- 172.21.15.83:0/3520380904 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6ad094730 con 0x55c6ad281830 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232ab24640 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cb690 0x55c6ad2b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.148+0000 7f232a323640 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad286c50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f232000a040 tx=0x7f23200562c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3616018765258272 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f23057fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f23057fa640 1 -- 172.21.15.83:0/3520380904 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320054ed0 con 0x55c6ad281830 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 -- 172.21.15.83:0/3520380904 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f231c019070 con 0x55c6ad281830 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f23057fa640 1 -- 172.21.15.83:0/3520380904 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2320055070 con 0x55c6ad281830 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f23057fa640 1 -- 172.21.15.83:0/3520380904 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f23200517d0 con 0x55c6ad281830 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 10 client.6222 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:12.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 -- 172.21.15.83:0/3520380904 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c6ad087ca0 con 0x55c6ad281830 2024-03-30T13:11:12.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f23057fa640 1 -- 172.21.15.83:0/3520380904 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f231c019070 con 0x55c6ad281830 2024-03-30T13:11:12.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f23057fa640 1 -- 172.21.15.83:0/3520380904 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f2320051970 con 0x55c6ad281830 2024-03-30T13:11:12.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 10 client.6222 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:12.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 10 client.6222 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:12.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 20 client.6222 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:12.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c6ad2d25d0 0x55c6ad2d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 4 client.6222 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:12.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 -- 172.21.15.83:0/3520380904 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6ad06ac90 con 0x55c6ad2d25d0 2024-03-30T13:11:12.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f2329b22640 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c6ad2d25d0 0x55c6ad2d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f2329b22640 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c6ad2d25d0 0x55c6ad2d29b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1321d2c756a35972 server_cookie=67bc9ea701b703ed in_seq=0 out_seq=0 2024-03-30T13:11:12.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f23057fa640 10 client.6222 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f23057fa640 1 -- 172.21.15.83:0/3520380904 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55c6ad06ac90 con 0x55c6ad2d25d0 2024-03-30T13:11:12.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f23057fa640 10 client.6222 handle_command_reply: tid=0 2024-03-30T13:11:12.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 client.6222 shutdown 2024-03-30T13:11:12.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 -- 172.21.15.83:0/3520380904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 msgr2=0x55c6ad286c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad286c50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f232000a040 tx=0x7f23200562c0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 -- 172.21.15.83:0/3520380904 shutdown_connections 2024-03-30T13:11:12.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cb690 0x55c6ad2b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cad70 0x55c6ad2afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c6ad2d25d0 0x55c6ad2d29b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 --2- 172.21.15.83:0/3520380904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad286c50 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f23057fa640 0 client.6222 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 -- 172.21.15.83:0/3520380904 >> 172.21.15.83:0/3520380904 conn(0x55c6ad27d7e0 msgr2=0x55c6ad280460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 -- 172.21.15.83:0/3520380904 shutdown_connections 2024-03-30T13:11:12.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 1 -- 172.21.15.83:0/3520380904 wait complete. 2024-03-30T13:11:12.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.152+0000 7f232f709000 20 client.6222 trim_cache size 0 max 16384 2024-03-30T13:11:12.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.164+0000 7f232f709000 1 Processor -- start 2024-03-30T13:11:12.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.164+0000 7f232f709000 1 -- start start 2024-03-30T13:11:12.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad281830 0x55c6ad2afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad2cad70 0x55c6ad2b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 0x55c6ad27fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2324203900 con 0x55c6ad2cad70 2024-03-30T13:11:12.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23242028e0 con 0x55c6ad281830 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2324201cf0 con 0x55c6ad2cb690 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f2329b22640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad2cad70 0x55c6ad2b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f2329b22640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad2cad70 0x55c6ad2b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37872/0 (socket says 172.21.15.83:37872) 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f2329b22640 1 -- 172.21.15.83:0/367906383 learned_addr learned my addr 172.21.15.83:0/367906383 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f2329b22640 1 -- 172.21.15.83:0/367906383 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 msgr2=0x55c6ad27fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f2329b22640 1 --2- 172.21.15.83:0/367906383 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 0x55c6ad27fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f2329b22640 1 -- 172.21.15.83:0/367906383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad281830 msgr2=0x55c6ad2afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f2329b22640 1 --2- 172.21.15.83:0/367906383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad281830 0x55c6ad2afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f2329b22640 1 -- 172.21.15.83:0/367906383 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6ad056d00 con 0x55c6ad2cad70 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f2329b22640 1 --2- 172.21.15.83:0/367906383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad2cad70 0x55c6ad2b02a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2314008010 tx=0x7f2314004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4cb689e9958c414 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f23077fe640 1 -- 172.21.15.83:0/367906383 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140b1df0 con 0x55c6ad2cad70 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f23077fe640 1 -- 172.21.15.83:0/367906383 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23140c7430 con 0x55c6ad2cad70 2024-03-30T13:11:12.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f23077fe640 1 -- 172.21.15.83:0/367906383 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140c75e0 con 0x55c6ad2cad70 2024-03-30T13:11:12.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- 172.21.15.83:0/367906383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad2cad70 msgr2=0x55c6ad2b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 --2- 172.21.15.83:0/367906383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad2cad70 0x55c6ad2b02a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2314008010 tx=0x7f2314004740 comp rx=0 tx=0).stop 2024-03-30T13:11:12.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- 172.21.15.83:0/367906383 shutdown_connections 2024-03-30T13:11:12.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 --2- 172.21.15.83:0/367906383 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 0x55c6ad27fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 --2- 172.21.15.83:0/367906383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad2cad70 0x55c6ad2b02a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 --2- 172.21.15.83:0/367906383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad281830 0x55c6ad2afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- 172.21.15.83:0/367906383 >> 172.21.15.83:0/367906383 conn(0x55c6ad27d7e0 msgr2=0x55c6ad2e1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- 172.21.15.83:0/367906383 shutdown_connections 2024-03-30T13:11:12.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- 172.21.15.83:0/367906383 wait complete. 2024-03-30T13:11:12.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- start start 2024-03-30T13:11:12.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 Processor -- start 2024-03-30T13:11:12.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad33cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cad70 0x55c6ad33d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 0x55c6ad2cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c6ad08d6a0 con 0x55c6ad281830 2024-03-30T13:11:12.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2324202270 con 0x55c6ad2cad70 2024-03-30T13:11:12.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55c6ad097270 con 0x55c6ad2cb690 2024-03-30T13:11:12.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 10 client.0 _ll_register_callbacks cb 0x7f2320055850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:12.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232a323640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad33cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232a323640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad33cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37886/0 (socket says 172.21.15.83:37886) 2024-03-30T13:11:12.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232a323640 1 -- 172.21.15.83:0/3335286178 learned_addr learned my addr 172.21.15.83:0/3335286178 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232a323640 1 -- 172.21.15.83:0/3335286178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 msgr2=0x55c6ad2cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232a323640 1 --2- 172.21.15.83:0/3335286178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 0x55c6ad2cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232a323640 1 -- 172.21.15.83:0/3335286178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cad70 msgr2=0x55c6ad33d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232a323640 1 --2- 172.21.15.83:0/3335286178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cad70 0x55c6ad33d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232a323640 1 -- 172.21.15.83:0/3335286178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6ad150f70 con 0x55c6ad281830 2024-03-30T13:11:12.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232a323640 1 --2- 172.21.15.83:0/3335286178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad33cf30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2320053fb0 tx=0x7f2320000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb5628c11dd77cd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f23057fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:12.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f23057fa640 1 -- 172.21.15.83:0/3335286178 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320051d20 con 0x55c6ad281830 2024-03-30T13:11:12.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f23057fa640 1 -- 172.21.15.83:0/3335286178 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2320054b40 con 0x55c6ad281830 2024-03-30T13:11:12.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f232f709000 1 -- 172.21.15.83:0/3335286178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23140c7430 con 0x55c6ad281830 2024-03-30T13:11:12.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.168+0000 7f23057fa640 1 -- 172.21.15.83:0/3335286178 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f23200555c0 con 0x55c6ad281830 2024-03-30T13:11:12.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 10 client.6228 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:12.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 -- 172.21.15.83:0/3335286178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c6ad076760 con 0x55c6ad281830 2024-03-30T13:11:12.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f23057fa640 1 -- 172.21.15.83:0/3335286178 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23140c7430 con 0x55c6ad281830 2024-03-30T13:11:12.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f23057fa640 1 -- 172.21.15.83:0/3335286178 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f232005afc0 con 0x55c6ad281830 2024-03-30T13:11:12.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 10 client.6228 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:12.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 10 client.6228 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:12.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 20 client.6228 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:12.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 --2- 172.21.15.83:0/3335286178 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c6ad2cf010 0x55c6ad2cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 4 client.6228 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628406}] 2024-03-30T13:11:12.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 -- 172.21.15.83:0/3335286178 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628406}) -- 0x55c6ad0dcfe0 con 0x55c6ad2cf010 2024-03-30T13:11:12.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f2329b22640 1 --2- 172.21.15.83:0/3335286178 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c6ad2cf010 0x55c6ad2cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f2329b22640 1 --2- 172.21.15.83:0/3335286178 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c6ad2cf010 0x55c6ad2cf420 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dc23a0afddad58b server_cookie=f3093265f5768eea in_seq=0 out_seq=0 2024-03-30T13:11:12.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f23057fa640 10 client.6228 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f23057fa640 1 -- 172.21.15.83:0/3335286178 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3795 (crc 0 0 0) 0x55c6ad0dcfe0 con 0x55c6ad2cf010 2024-03-30T13:11:12.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f23057fa640 10 client.6228 handle_command_reply: tid=0 2024-03-30T13:11:12.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 client.6228 shutdown 2024-03-30T13:11:12.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 -- 172.21.15.83:0/3335286178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 msgr2=0x55c6ad33cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 --2- 172.21.15.83:0/3335286178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad33cf30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2320053fb0 tx=0x7f2320000bd0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 -- 172.21.15.83:0/3335286178 shutdown_connections 2024-03-30T13:11:12.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 --2- 172.21.15.83:0/3335286178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c6ad2cb690 0x55c6ad2cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 --2- 172.21.15.83:0/3335286178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6ad2cad70 0x55c6ad33d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 --2- 172.21.15.83:0/3335286178 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55c6ad2cf010 0x55c6ad2cf420 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 --2- 172.21.15.83:0/3335286178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c6ad281830 0x55c6ad33cf30 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f23057fa640 0 client.6228 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 -- 172.21.15.83:0/3335286178 >> 172.21.15.83:0/3335286178 conn(0x55c6ad27d7e0 msgr2=0x55c6ad2e2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 -- 172.21.15.83:0/3335286178 shutdown_connections 2024-03-30T13:11:12.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 1 -- 172.21.15.83:0/3335286178 wait complete. 2024-03-30T13:11:12.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232f709000 20 client.6228 trim_cache size 0 max 16384 2024-03-30T13:11:12.188 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:12.188 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/Kconfig", 2024-03-30T13:11:12.188 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628406, 2024-03-30T13:11:12.188 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:12.188 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.640963+0000", 2024-03-30T13:11:12.188 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.122621+0000", 2024-03-30T13:11:12.188 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:12.188 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:12.189 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:12.189 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:12.189 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:12.189 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:12.189 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:12.189 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:12.189 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:12.189 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.189 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:12.190 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:12.190 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:12.190 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:12.190 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:12.190 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:12.190 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.190 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:12.190 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 228, 2024-03-30T13:11:12.190 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:12.190 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:12.190 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:12.190 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:12.191 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:12.191 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.122621+0000", 2024-03-30T13:11:12.191 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:12.191 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:12.191 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:12.191 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:12.192 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:12.192 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:12.192 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:12.192 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:12.192 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.192 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:12.192 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:12.192 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:12.192 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:12.193 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.193 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:12.193 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.193 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 228, 2024-03-30T13:11:12.193 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:12.193 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:12.193 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:12.193 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.640963+0000" 2024-03-30T13:11:12.193 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.193 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:12.193 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 228, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.640963+0000" 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 124, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 2, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:12.194 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:12.195 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:12.195 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:12.195 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.195 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:12.195 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:12.195 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:12.195 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:12.195 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:12.195 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:12.195 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.195 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.196 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.197 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:12.198 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:12.199 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.200 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:12.201 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:12.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232c587640 1 -- 172.21.15.83:0/1097411205 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2308067fc0 msgr2=0x7f230806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232c587640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2308067fc0 0x7f230806a480 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f23140ae000 tx=0x7f23140b3040 comp rx=0 tx=0).stop 2024-03-30T13:11:12.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232c587640 1 -- 172.21.15.83:0/1097411205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23240b1fe0 msgr2=0x7f2324148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232c587640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23240b1fe0 0x7f2324148de0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f232000c370 tx=0x7f232000c830 comp rx=0 tx=0).stop 2024-03-30T13:11:12.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232c587640 1 -- 172.21.15.83:0/1097411205 shutdown_connections 2024-03-30T13:11:12.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232c587640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2308067fc0 0x7f230806a480 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232c587640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f232415b570 0x7f2324152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232c587640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23240b4070 0x7f232415bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232c587640 1 --2- 172.21.15.83:0/1097411205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23240b1fe0 0x7f2324148de0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232c587640 1 -- 172.21.15.83:0/1097411205 >> 172.21.15.83:0/1097411205 conn(0x7f2324072d30 msgr2=0x7f232415a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232c587640 1 -- 172.21.15.83:0/1097411205 shutdown_connections 2024-03-30T13:11:12.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.172+0000 7f232c587640 1 -- 172.21.15.83:0/1097411205 wait complete. 2024-03-30T13:11:12.204 DEBUG:tasks.cephfs.test_uninlining:getting inode info #15 of 23:1099511628419 2024-03-30T13:11:12.204 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628419 2024-03-30T13:11:12.205 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628419 2024-03-30T13:11:12.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.304+0000 7f4d5946a640 1 Processor -- start 2024-03-30T13:11:12.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.304+0000 7f4d5946a640 1 -- start start 2024-03-30T13:11:12.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d5946a640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d5415c7f0 0x7f4d540d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d5946a640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4d54160140 0x7f4d541605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d5946a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d5409aa50 0x7f4d5409aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d5946a640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f4d540b0fe0 con 0x7f4d54160140 2024-03-30T13:11:12.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d5946a640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4d54160ae0 con 0x7f4d5415c7f0 2024-03-30T13:11:12.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d5946a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4d540b3ca0 con 0x7f4d5409aa50 2024-03-30T13:11:12.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d527fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4d54160140 0x7f4d541605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d527fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4d54160140 0x7f4d541605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37894/0 (socket says 172.21.15.83:37894) 2024-03-30T13:11:12.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d527fc640 1 -- 172.21.15.83:0/838943588 learned_addr learned my addr 172.21.15.83:0/838943588 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d52ffd640 1 --2- 172.21.15.83:0/838943588 >> v2:172.21.15.153:3300/0 conn(0x7f4d5415c7f0 0x7f4d540d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d537fe640 1 --2- 172.21.15.83:0/838943588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d5409aa50 0x7f4d5409aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d527fc640 1 -- 172.21.15.83:0/838943588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d5409aa50 msgr2=0x7f4d5409aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d527fc640 1 --2- 172.21.15.83:0/838943588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d5409aa50 0x7f4d5409aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d527fc640 1 -- 172.21.15.83:0/838943588 >> v2:172.21.15.153:3300/0 conn(0x7f4d5415c7f0 msgr2=0x7f4d540d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d527fc640 1 --2- 172.21.15.83:0/838943588 >> v2:172.21.15.153:3300/0 conn(0x7f4d5415c7f0 0x7f4d540d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.308+0000 7f4d527fc640 1 -- 172.21.15.83:0/838943588 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d540aff40 con 0x7f4d54160140 2024-03-30T13:11:12.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d527fc640 1 --2- 172.21.15.83:0/838943588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d54160140 0x7f4d541605a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f4d54072dc0 tx=0x7f4d4801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6392d91a6d8cbde5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d51ffb640 1 -- 172.21.15.83:0/838943588 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480b1070 con 0x7f4d54160140 2024-03-30T13:11:12.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d51ffb640 1 -- 172.21.15.83:0/838943588 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d480ac630 con 0x7f4d54160140 2024-03-30T13:11:12.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d51ffb640 1 -- 172.21.15.83:0/838943588 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480a8050 con 0x7f4d54160140 2024-03-30T13:11:12.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 -- 172.21.15.83:0/838943588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d54160140 msgr2=0x7f4d541605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 --2- 172.21.15.83:0/838943588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d54160140 0x7f4d541605a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f4d54072dc0 tx=0x7f4d4801c520 comp rx=0 tx=0).stop 2024-03-30T13:11:12.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 -- 172.21.15.83:0/838943588 shutdown_connections 2024-03-30T13:11:12.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 --2- 172.21.15.83:0/838943588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d5409aa50 0x7f4d5409aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 --2- 172.21.15.83:0/838943588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d54160140 0x7f4d541605a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 --2- 172.21.15.83:0/838943588 >> v2:172.21.15.153:3300/0 conn(0x7f4d5415c7f0 0x7f4d540d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 -- 172.21.15.83:0/838943588 >> 172.21.15.83:0/838943588 conn(0x7f4d540b3e70 msgr2=0x7f4d540b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 -- 172.21.15.83:0/838943588 shutdown_connections 2024-03-30T13:11:12.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 -- 172.21.15.83:0/838943588 wait complete. 2024-03-30T13:11:12.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 Processor -- start 2024-03-30T13:11:12.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 -- start start 2024-03-30T13:11:12.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d5409aa50 0x7f4d54145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d5415c7f0 0x7f4d541f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d54160140 0x7f4d5415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4d54160f00 con 0x7f4d5415c7f0 2024-03-30T13:11:12.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4d540b07e0 con 0x7f4d54160140 2024-03-30T13:11:12.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.312+0000 7f4d5946a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4d540d1ee0 con 0x7f4d5409aa50 2024-03-30T13:11:12.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d527fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d5415c7f0 0x7f4d541f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d527fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d5415c7f0 0x7f4d541f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37904/0 (socket says 172.21.15.83:37904) 2024-03-30T13:11:12.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d527fc640 1 -- 172.21.15.83:0/721920869 learned_addr learned my addr 172.21.15.83:0/721920869 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d52ffd640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d5409aa50 0x7f4d54145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d537fe640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d54160140 0x7f4d5415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d527fc640 1 -- 172.21.15.83:0/721920869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d5409aa50 msgr2=0x7f4d54145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d527fc640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d5409aa50 0x7f4d54145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d527fc640 1 -- 172.21.15.83:0/721920869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d54160140 msgr2=0x7f4d5415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d527fc640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d54160140 0x7f4d5415dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d527fc640 1 -- 172.21.15.83:0/721920869 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d541f9bf0 con 0x7f4d5415c7f0 2024-03-30T13:11:12.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d527fc640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d5415c7f0 0x7f4d541f9150 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4d480af040 tx=0x7f4d480192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d3b7fe640 1 -- 172.21.15.83:0/721920869 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480b1040 con 0x7f4d5415c7f0 2024-03-30T13:11:12.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d3b7fe640 1 -- 172.21.15.83:0/721920869 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d480bc070 con 0x7f4d5415c7f0 2024-03-30T13:11:12.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d5946a640 1 -- 172.21.15.83:0/721920869 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d541f9ed0 con 0x7f4d5415c7f0 2024-03-30T13:11:12.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d3b7fe640 1 -- 172.21.15.83:0/721920869 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480a8040 con 0x7f4d5415c7f0 2024-03-30T13:11:12.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d5946a640 1 -- 172.21.15.83:0/721920869 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d5409e550 con 0x7f4d5415c7f0 2024-03-30T13:11:12.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d3b7fe640 1 -- 172.21.15.83:0/721920869 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f4d480b7690 con 0x7f4d5415c7f0 2024-03-30T13:11:12.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d3b7fe640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4d40067fc0 0x7f4d4006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d52ffd640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4d40067fc0 0x7f4d4006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d3b7fe640 1 -- 172.21.15.83:0/721920869 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4d48120770 con 0x7f4d5415c7f0 2024-03-30T13:11:12.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d5c5ec000 1 Processor -- start 2024-03-30T13:11:12.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d5c5ec000 1 -- start start 2024-03-30T13:11:12.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.316+0000 7f4d52ffd640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4d40067fc0 0x7f4d4006a480 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4d440079c0 tx=0x7f4d44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7ad70 0x561d5ab7b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7b690 0x561d5ab312f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab31830 0x561d5ab31c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561d5a97faa0 con 0x561d5ab7b690 2024-03-30T13:11:12.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561d5a906af0 con 0x561d5ab7ad70 2024-03-30T13:11:12.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x561d5a97ba50 con 0x561d5ab31830 2024-03-30T13:11:12.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d527fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7b690 0x561d5ab312f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d527fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7b690 0x561d5ab312f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37906/0 (socket says 172.21.15.83:37906) 2024-03-30T13:11:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d527fc640 1 -- 172.21.15.83:0/3265742107 learned_addr learned my addr 172.21.15.83:0/3265742107 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d52ffd640 1 --2- 172.21.15.83:0/3265742107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7ad70 0x561d5ab7b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d527fc640 1 -- 172.21.15.83:0/3265742107 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab31830 msgr2=0x561d5ab31c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d527fc640 1 --2- 172.21.15.83:0/3265742107 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab31830 0x561d5ab31c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d527fc640 1 -- 172.21.15.83:0/3265742107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7ad70 msgr2=0x561d5ab7b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d527fc640 1 --2- 172.21.15.83:0/3265742107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7ad70 0x561d5ab7b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d527fc640 1 -- 172.21.15.83:0/3265742107 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5a904d00 con 0x561d5ab7b690 2024-03-30T13:11:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d527fc640 1 --2- 172.21.15.83:0/3265742107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7b690 0x561d5ab312f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4d480ecc80 tx=0x7f4d480f0720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fc65601ad62452 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d38ff9640 1 -- 172.21.15.83:0/3265742107 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480f0820 con 0x561d5ab7b690 2024-03-30T13:11:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d38ff9640 1 -- 172.21.15.83:0/3265742107 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d480f4bd0 con 0x561d5ab7b690 2024-03-30T13:11:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d38ff9640 1 -- 172.21.15.83:0/3265742107 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480f9400 con 0x561d5ab7b690 2024-03-30T13:11:12.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/3265742107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7b690 msgr2=0x561d5ab312f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/3265742107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7b690 0x561d5ab312f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4d480ecc80 tx=0x7f4d480f0720 comp rx=0 tx=0).stop 2024-03-30T13:11:12.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/3265742107 shutdown_connections 2024-03-30T13:11:12.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/3265742107 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab31830 0x561d5ab31c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/3265742107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7b690 0x561d5ab312f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/3265742107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7ad70 0x561d5ab7b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/3265742107 >> 172.21.15.83:0/3265742107 conn(0x561d5ab2d7e0 msgr2=0x561d5ab2fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/3265742107 shutdown_connections 2024-03-30T13:11:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/3265742107 wait complete. 2024-03-30T13:11:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 -- start start 2024-03-30T13:11:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 Processor -- start 2024-03-30T13:11:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab31830 0x561d5ab36c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab7ad70 0x561d5ab5fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7b690 0x561d5ab602e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561d5a947270 con 0x561d5ab31830 2024-03-30T13:11:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561d5a93d6a0 con 0x561d5ab7b690 2024-03-30T13:11:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x561d5a917880 con 0x561d5ab7ad70 2024-03-30T13:11:12.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d5c5ec000 10 client.0 _ll_register_callbacks cb 0x561d5ab1c490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:12.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d52ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab31830 0x561d5ab36c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d52ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab31830 0x561d5ab36c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37912/0 (socket says 172.21.15.83:37912) 2024-03-30T13:11:12.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d52ffd640 1 -- 172.21.15.83:0/4124841720 learned_addr learned my addr 172.21.15.83:0/4124841720 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d537fe640 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7b690 0x561d5ab602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d52ffd640 1 -- 172.21.15.83:0/4124841720 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab7ad70 msgr2=0x561d5ab5fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d527fc640 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab7ad70 0x561d5ab5fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d52ffd640 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab7ad70 0x561d5ab5fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d52ffd640 1 -- 172.21.15.83:0/4124841720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7b690 msgr2=0x561d5ab602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d52ffd640 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7b690 0x561d5ab602e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d52ffd640 1 -- 172.21.15.83:0/4124841720 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d5a944730 con 0x561d5ab31830 2024-03-30T13:11:12.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d537fe640 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7b690 0x561d5ab602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:12.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d52ffd640 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab31830 0x561d5ab36c40 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4d44011010 tx=0x7f4d44004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8953f18aa6e009f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:12.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.320+0000 7f4d31ffb640 1 -- 172.21.15.83:0/4124841720 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44026020 con 0x561d5ab31830 2024-03-30T13:11:12.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/4124841720 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d480f4bd0 con 0x561d5ab31830 2024-03-30T13:11:12.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d31ffb640 1 -- 172.21.15.83:0/4124841720 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4d440149b0 con 0x561d5ab31830 2024-03-30T13:11:12.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d31ffb640 1 -- 172.21.15.83:0/4124841720 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f4d44030050 con 0x561d5ab31830 2024-03-30T13:11:12.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 10 client.6240 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:12.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/4124841720 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x561d5a937ca0 con 0x561d5ab31830 2024-03-30T13:11:12.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d31ffb640 1 -- 172.21.15.83:0/4124841720 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d480f4bd0 con 0x561d5ab31830 2024-03-30T13:11:12.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d31ffb640 1 -- 172.21.15.83:0/4124841720 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f4d44033020 con 0x561d5ab31830 2024-03-30T13:11:12.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 10 client.6240 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:12.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 10 client.6240 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:12.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 20 client.6240 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:12.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d5ab825d0 0x561d5ab829b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 4 client.6240 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:12.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/4124841720 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d5a91ac90 con 0x561d5ab825d0 2024-03-30T13:11:12.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d527fc640 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d5ab825d0 0x561d5ab829b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d527fc640 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d5ab825d0 0x561d5ab829b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=712b219748a9f89f server_cookie=83281c43f0110816 in_seq=0 out_seq=0 2024-03-30T13:11:12.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d31ffb640 10 client.6240 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d31ffb640 1 -- 172.21.15.83:0/4124841720 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x561d5a91ac90 con 0x561d5ab825d0 2024-03-30T13:11:12.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d31ffb640 10 client.6240 handle_command_reply: tid=0 2024-03-30T13:11:12.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 client.6240 shutdown 2024-03-30T13:11:12.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/4124841720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab31830 msgr2=0x561d5ab36c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab31830 0x561d5ab36c40 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4d44011010 tx=0x7f4d44004740 comp rx=0 tx=0).stop 2024-03-30T13:11:12.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/4124841720 shutdown_connections 2024-03-30T13:11:12.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7b690 0x561d5ab602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab7ad70 0x561d5ab5fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d5ab825d0 0x561d5ab829b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/4124841720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab31830 0x561d5ab36c40 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d31ffb640 0 client.6240 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/4124841720 >> 172.21.15.83:0/4124841720 conn(0x561d5ab2d7e0 msgr2=0x561d5ab30460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/4124841720 shutdown_connections 2024-03-30T13:11:12.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/4124841720 wait complete. 2024-03-30T13:11:12.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.324+0000 7f4d5c5ec000 20 client.6240 trim_cache size 0 max 16384 2024-03-30T13:11:12.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 Processor -- start 2024-03-30T13:11:12.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 -- start start 2024-03-30T13:11:12.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab31830 0x561d5ab60180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 0x561d5ab2fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab7b690 0x561d5ab30110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4d54201e50 con 0x561d5ab7ad70 2024-03-30T13:11:12.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4d54200ee0 con 0x561d5ab31830 2024-03-30T13:11:12.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4d542002d0 con 0x561d5ab7b690 2024-03-30T13:11:12.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d527fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 0x561d5ab2fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d527fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 0x561d5ab2fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37926/0 (socket says 172.21.15.83:37926) 2024-03-30T13:11:12.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d527fc640 1 -- 172.21.15.83:0/3767609479 learned_addr learned my addr 172.21.15.83:0/3767609479 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d527fc640 1 -- 172.21.15.83:0/3767609479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab7b690 msgr2=0x561d5ab30110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d527fc640 1 --2- 172.21.15.83:0/3767609479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab7b690 0x561d5ab30110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d527fc640 1 -- 172.21.15.83:0/3767609479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab31830 msgr2=0x561d5ab60180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d527fc640 1 --2- 172.21.15.83:0/3767609479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab31830 0x561d5ab60180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d527fc640 1 -- 172.21.15.83:0/3767609479 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5a906d00 con 0x561d5ab7ad70 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d527fc640 1 --2- 172.21.15.83:0/3767609479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 0x561d5ab2fbd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4d480f0520 tx=0x7f4d480f2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb2e318e9edde8e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d33fff640 1 -- 172.21.15.83:0/3767609479 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480f4bd0 con 0x561d5ab7ad70 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d33fff640 1 -- 172.21.15.83:0/3767609479 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4811c070 con 0x561d5ab7ad70 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d33fff640 1 -- 172.21.15.83:0/3767609479 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480eeb20 con 0x561d5ab7ad70 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/3767609479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 msgr2=0x561d5ab2fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/3767609479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 0x561d5ab2fbd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4d480f0520 tx=0x7f4d480f2000 comp rx=0 tx=0).stop 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/3767609479 shutdown_connections 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/3767609479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab7b690 0x561d5ab30110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/3767609479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 0x561d5ab2fbd0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/3767609479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab31830 0x561d5ab60180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/3767609479 >> 172.21.15.83:0/3767609479 conn(0x561d5ab2d7e0 msgr2=0x561d5ab91f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/3767609479 shutdown_connections 2024-03-30T13:11:12.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/3767609479 wait complete. 2024-03-30T13:11:12.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 -- start start 2024-03-30T13:11:12.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.352+0000 7f4d5c5ec000 1 Processor -- start 2024-03-30T13:11:12.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab31830 0x561d5abe8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 0x561d5ab7ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7b690 0x561d5ab7f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561d5a93d6a0 con 0x561d5ab7ad70 2024-03-30T13:11:12.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4d54200890 con 0x561d5ab7b690 2024-03-30T13:11:12.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x561d5a97edb0 con 0x561d5ab31830 2024-03-30T13:11:12.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 10 client.0 _ll_register_callbacks cb 0x7f4d440076d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:12.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d527fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 0x561d5ab7ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d527fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 0x561d5ab7ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37942/0 (socket says 172.21.15.83:37942) 2024-03-30T13:11:12.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d527fc640 1 -- 172.21.15.83:0/2662909144 learned_addr learned my addr 172.21.15.83:0/2662909144 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d527fc640 1 -- 172.21.15.83:0/2662909144 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab31830 msgr2=0x561d5abe8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d527fc640 1 --2- 172.21.15.83:0/2662909144 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab31830 0x561d5abe8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d527fc640 1 -- 172.21.15.83:0/2662909144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7b690 msgr2=0x561d5ab7f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d527fc640 1 --2- 172.21.15.83:0/2662909144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7b690 0x561d5ab7f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d527fc640 1 -- 172.21.15.83:0/2662909144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d5aa00f70 con 0x561d5ab7ad70 2024-03-30T13:11:12.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d527fc640 1 --2- 172.21.15.83:0/2662909144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 0x561d5ab7ead0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4d4801cdc0 tx=0x7f4d48000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6492549273951941 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:12.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d31ffb640 1 -- 172.21.15.83:0/2662909144 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48114060 con 0x561d5ab7ad70 2024-03-30T13:11:12.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d31ffb640 1 -- 172.21.15.83:0/2662909144 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4d480eeb20 con 0x561d5ab7ad70 2024-03-30T13:11:12.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/2662909144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d4811c070 con 0x561d5ab7ad70 2024-03-30T13:11:12.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d31ffb640 1 -- 172.21.15.83:0/2662909144 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f4d480f4bd0 con 0x561d5ab7ad70 2024-03-30T13:11:12.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 10 client.6246 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:12.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/2662909144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x561d5a926760 con 0x561d5ab7ad70 2024-03-30T13:11:12.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d31ffb640 1 -- 172.21.15.83:0/2662909144 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4811c070 con 0x561d5ab7ad70 2024-03-30T13:11:12.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d31ffb640 1 -- 172.21.15.83:0/2662909144 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f4d48118120 con 0x561d5ab7ad70 2024-03-30T13:11:12.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 10 client.6246 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:12.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 10 client.6246 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:12.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 20 client.6246 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:12.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/2662909144 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d5ab7f550 0x561d5ab7f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 4 client.6246 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628419}] 2024-03-30T13:11:12.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/2662909144 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628419}) -- 0x561d5a98cfe0 con 0x561d5ab7f550 2024-03-30T13:11:12.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d52ffd640 1 --2- 172.21.15.83:0/2662909144 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d5ab7f550 0x561d5ab7f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d52ffd640 1 --2- 172.21.15.83:0/2662909144 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d5ab7f550 0x561d5ab7f960 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2b92df74c106918 server_cookie=e715d122f6571c4a in_seq=0 out_seq=0 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d31ffb640 10 client.6246 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d31ffb640 1 -- 172.21.15.83:0/2662909144 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3808 (crc 0 0 0) 0x561d5a98cfe0 con 0x561d5ab7f550 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d31ffb640 10 client.6246 handle_command_reply: tid=0 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 client.6246 shutdown 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/2662909144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 msgr2=0x561d5ab7ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/2662909144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 0x561d5ab7ead0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4d4801cdc0 tx=0x7f4d48000bd0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/2662909144 shutdown_connections 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/2662909144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d5ab7b690 0x561d5ab7f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/2662909144 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d5ab7f550 0x561d5ab7f960 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/2662909144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d5ab7ad70 0x561d5ab7ead0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 --2- 172.21.15.83:0/2662909144 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d5ab31830 0x561d5abe8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d31ffb640 0 client.6246 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/2662909144 >> 172.21.15.83:0/2662909144 conn(0x561d5ab2d7e0 msgr2=0x561d5ab92620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/2662909144 shutdown_connections 2024-03-30T13:11:12.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 1 -- 172.21.15.83:0/2662909144 wait complete. 2024-03-30T13:11:12.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5c5ec000 20 client.6246 trim_cache size 0 max 16384 2024-03-30T13:11:12.372 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:12.372 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-debug.h", 2024-03-30T13:11:12.372 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628419, 2024-03-30T13:11:12.373 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:12.373 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.642757+0000", 2024-03-30T13:11:12.373 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.176679+0000", 2024-03-30T13:11:12.373 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:12.373 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:12.373 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:12.373 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:12.373 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:12.373 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:12.373 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:12.373 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:12.374 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:12.374 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.374 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:12.374 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:12.374 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:12.374 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:12.374 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:12.374 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:12.374 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.374 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:12.374 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 2579, 2024-03-30T13:11:12.375 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:12.375 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:12.375 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:12.375 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:12.375 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:12.375 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.176679+0000", 2024-03-30T13:11:12.375 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:12.375 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 4, 2024-03-30T13:11:12.375 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:12.375 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:12.375 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 2579, 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:12.376 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.642757+0000" 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 2579, 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.642757+0000" 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 126, 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:12.377 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 28, 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:12.378 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.379 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.380 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:12.381 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:12.382 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:12.383 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:12.384 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:12.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5946a640 1 -- 172.21.15.83:0/721920869 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4d40067fc0 msgr2=0x7f4d4006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5946a640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4d40067fc0 0x7f4d4006a480 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4d440079c0 tx=0x7f4d44008040 comp rx=0 tx=0).stop 2024-03-30T13:11:12.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5946a640 1 -- 172.21.15.83:0/721920869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d5415c7f0 msgr2=0x7f4d541f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5946a640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d5415c7f0 0x7f4d541f9150 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4d480af040 tx=0x7f4d480192c0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5946a640 1 -- 172.21.15.83:0/721920869 shutdown_connections 2024-03-30T13:11:12.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5946a640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4d40067fc0 0x7f4d4006a480 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5946a640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d54160140 0x7f4d5415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5946a640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d5415c7f0 0x7f4d541f9150 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5946a640 1 --2- 172.21.15.83:0/721920869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d5409aa50 0x7f4d54145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5946a640 1 -- 172.21.15.83:0/721920869 >> 172.21.15.83:0/721920869 conn(0x7f4d540b3e70 msgr2=0x7f4d5415b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5946a640 1 -- 172.21.15.83:0/721920869 shutdown_connections 2024-03-30T13:11:12.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.356+0000 7f4d5946a640 1 -- 172.21.15.83:0/721920869 wait complete. 2024-03-30T13:11:12.387 DEBUG:tasks.cephfs.test_uninlining:getting inode info #16 of 23:1099511628426 2024-03-30T13:11:12.387 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628426 2024-03-30T13:11:12.387 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628426 2024-03-30T13:11:12.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.488+0000 7f38aa246640 1 Processor -- start 2024-03-30T13:11:12.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.488+0000 7f38aa246640 1 -- start start 2024-03-30T13:11:12.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f38aa246640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38a4145c40 0x7f38a409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f38aa246640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f38a4160090 0x7f38a41604f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f38aa246640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38a4160ea0 con 0x7f38a4160a30 2024-03-30T13:11:12.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f38aa246640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f38a40ae3a0 con 0x7f38a4160090 2024-03-30T13:11:12.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f38aa246640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38a40b0690 con 0x7f38a4145c40 2024-03-30T13:11:12.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f389bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f38a4160090 0x7f38a41604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f389bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f38a4160090 0x7f38a41604f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37956/0 (socket says 172.21.15.83:37956) 2024-03-30T13:11:12.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f389bfff640 1 -- 172.21.15.83:0/4184519463 learned_addr learned my addr 172.21.15.83:0/4184519463 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f38a37fe640 1 --2- 172.21.15.83:0/4184519463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38a4145c40 0x7f38a409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f389bfff640 1 -- 172.21.15.83:0/4184519463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38a4145c40 msgr2=0x7f38a409aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f389bfff640 1 --2- 172.21.15.83:0/4184519463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38a4145c40 0x7f38a409aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f389bfff640 1 -- 172.21.15.83:0/4184519463 >> v1:172.21.15.153:6789/0 conn(0x7f38a4160a30 legacy=0x7f38a406b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.492+0000 7f389bfff640 1 -- 172.21.15.83:0/4184519463 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a40b3520 con 0x7f38a4160090 2024-03-30T13:11:12.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f389bfff640 1 --2- 172.21.15.83:0/4184519463 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38a4160090 0x7f38a41604f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f388c009870 tx=0x7f388c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba89310c1fea120 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38a2ffd640 1 -- 172.21.15.83:0/4184519463 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c0a7070 con 0x7f38a4160090 2024-03-30T13:11:12.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38a2ffd640 1 -- 172.21.15.83:0/4184519463 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388c0b0070 con 0x7f38a4160090 2024-03-30T13:11:12.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38a2ffd640 1 -- 172.21.15.83:0/4184519463 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a406c580 con 0x7f38a4160090 2024-03-30T13:11:12.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38aa246640 1 -- 172.21.15.83:0/4184519463 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38a4160090 msgr2=0x7f38a41604f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38aa246640 1 --2- 172.21.15.83:0/4184519463 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38a4160090 0x7f38a41604f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f388c009870 tx=0x7f388c01c560 comp rx=0 tx=0).stop 2024-03-30T13:11:12.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38aa246640 1 -- 172.21.15.83:0/4184519463 shutdown_connections 2024-03-30T13:11:12.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38aa246640 1 --2- 172.21.15.83:0/4184519463 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38a4160090 0x7f38a41604f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38aa246640 1 --2- 172.21.15.83:0/4184519463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38a4145c40 0x7f38a409aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38aa246640 1 -- 172.21.15.83:0/4184519463 >> 172.21.15.83:0/4184519463 conn(0x7f38a4072d30 msgr2=0x7f38a40b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38aa246640 1 -- 172.21.15.83:0/4184519463 shutdown_connections 2024-03-30T13:11:12.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38aa246640 1 -- 172.21.15.83:0/4184519463 wait complete. 2024-03-30T13:11:12.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38aa246640 1 Processor -- start 2024-03-30T13:11:12.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.496+0000 7f38aa246640 1 -- start start 2024-03-30T13:11:12.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38aa246640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38a4145c40 0x7f38a415bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38aa246640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a4160090 0x7f38a409e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38aa246640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38a4160a30 0x7f38a413d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38aa246640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f38a41693d0 con 0x7f38a4160a30 2024-03-30T13:11:12.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38aa246640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38a4146020 con 0x7f38a4160090 2024-03-30T13:11:12.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38aa246640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38a4169550 con 0x7f38a4145c40 2024-03-30T13:11:12.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38a4160a30 0x7f38a413d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38a4160a30 0x7f38a413d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37970/0 (socket says 172.21.15.83:37970) 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a3fff640 1 -- 172.21.15.83:0/1679901654 learned_addr learned my addr 172.21.15.83:0/1679901654 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a37fe640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38a4145c40 0x7f38a415bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f389bfff640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a4160090 0x7f38a409e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a3fff640 1 -- 172.21.15.83:0/1679901654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38a4145c40 msgr2=0x7f38a415bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a3fff640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38a4145c40 0x7f38a415bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a3fff640 1 -- 172.21.15.83:0/1679901654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a4160090 msgr2=0x7f38a409e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a3fff640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a4160090 0x7f38a409e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a3fff640 1 -- 172.21.15.83:0/1679901654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a40d05a0 con 0x7f38a4160a30 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a3fff640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38a4160a30 0x7f38a413d6e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f389c00c730 tx=0x7f389c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a0ff9640 1 -- 172.21.15.83:0/1679901654 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c003b80 con 0x7f38a4160a30 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a0ff9640 1 -- 172.21.15.83:0/1679901654 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389c003d20 con 0x7f38a4160a30 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38aa246640 1 -- 172.21.15.83:0/1679901654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a415b030 con 0x7f38a4160a30 2024-03-30T13:11:12.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a0ff9640 1 -- 172.21.15.83:0/1679901654 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c00aa30 con 0x7f38a4160a30 2024-03-30T13:11:12.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38aa246640 1 -- 172.21.15.83:0/1679901654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a415b5f0 con 0x7f38a4160a30 2024-03-30T13:11:12.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a0ff9640 1 -- 172.21.15.83:0/1679901654 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f389c00abd0 con 0x7f38a4160a30 2024-03-30T13:11:12.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a0ff9640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3884067ff0 0x7f388406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a0ff9640 1 -- 172.21.15.83:0/1679901654 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f389c086420 con 0x7f38a4160a30 2024-03-30T13:11:12.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a37fe640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3884067ff0 0x7f388406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.500+0000 7f38a37fe640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3884067ff0 0x7f388406a4b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f389400b9d0 tx=0x7f3894008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 Processor -- start 2024-03-30T13:11:12.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- start start 2024-03-30T13:11:12.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720ad70 0x55b39720b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 0x55b3971c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b3971c1830 0x55b3971c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b39700faa0 con 0x55b39720ad70 2024-03-30T13:11:12.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b396f96af0 con 0x55b39720b690 2024-03-30T13:11:12.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b39700ba50 con 0x55b3971c1830 2024-03-30T13:11:12.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38a37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720ad70 0x55b39720b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38a37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720ad70 0x55b39720b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37976/0 (socket says 172.21.15.83:37976) 2024-03-30T13:11:12.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38a37fe640 1 -- 172.21.15.83:0/2077083549 learned_addr learned my addr 172.21.15.83:0/2077083549 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38a3fff640 1 --2- 172.21.15.83:0/2077083549 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b3971c1830 0x55b3971c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f389bfff640 1 --2- 172.21.15.83:0/2077083549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 0x55b3971c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38a37fe640 1 -- 172.21.15.83:0/2077083549 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b3971c1830 msgr2=0x55b3971c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38a37fe640 1 --2- 172.21.15.83:0/2077083549 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b3971c1830 0x55b3971c1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38a37fe640 1 -- 172.21.15.83:0/2077083549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 msgr2=0x55b3971c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38a37fe640 1 --2- 172.21.15.83:0/2077083549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 0x55b3971c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38a37fe640 1 -- 172.21.15.83:0/2077083549 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b396f94d00 con 0x55b39720ad70 2024-03-30T13:11:12.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38a37fe640 1 --2- 172.21.15.83:0/2077083549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720ad70 0x55b39720b150 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f389400fa60 tx=0x7f3894012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3834e29dcf4118a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38997fa640 1 -- 172.21.15.83:0/2077083549 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389401b050 con 0x55b39720ad70 2024-03-30T13:11:12.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38997fa640 1 -- 172.21.15.83:0/2077083549 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894025070 con 0x55b39720ad70 2024-03-30T13:11:12.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38997fa640 1 -- 172.21.15.83:0/2077083549 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894014de0 con 0x55b39720ad70 2024-03-30T13:11:12.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2077083549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720ad70 msgr2=0x55b39720b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/2077083549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720ad70 0x55b39720b150 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f389400fa60 tx=0x7f3894012000 comp rx=0 tx=0).stop 2024-03-30T13:11:12.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2077083549 shutdown_connections 2024-03-30T13:11:12.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/2077083549 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b3971c1830 0x55b3971c1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/2077083549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 0x55b3971c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/2077083549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720ad70 0x55b39720b150 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2077083549 >> 172.21.15.83:0/2077083549 conn(0x55b3971bd7e0 msgr2=0x55b3971bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2077083549 shutdown_connections 2024-03-30T13:11:12.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2077083549 wait complete. 2024-03-30T13:11:12.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- start start 2024-03-30T13:11:12.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 Processor -- start 2024-03-30T13:11:12.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 0x55b3971eef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 0x55b3971ef470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 0x55b3971ef9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b396fd7270 con 0x55b3971c1830 2024-03-30T13:11:12.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b396fcd6a0 con 0x55b39720b690 2024-03-30T13:11:12.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b396fa7880 con 0x55b39720ad70 2024-03-30T13:11:12.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38ad3c8000 10 client.0 _ll_register_callbacks cb 0x55b3971ac490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:12.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38a37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 0x55b3971eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.504+0000 7f38a37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 0x55b3971eef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37980/0 (socket says 172.21.15.83:37980) 2024-03-30T13:11:12.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38a37fe640 1 -- 172.21.15.83:0/3772994435 learned_addr learned my addr 172.21.15.83:0/3772994435 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f389bfff640 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 0x55b3971ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38a3fff640 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 0x55b3971ef9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38a37fe640 1 -- 172.21.15.83:0/3772994435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 msgr2=0x55b3971ef470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38a37fe640 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 0x55b3971ef470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38a37fe640 1 -- 172.21.15.83:0/3772994435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 msgr2=0x55b3971ef9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38a37fe640 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 0x55b3971ef9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38a37fe640 1 -- 172.21.15.83:0/3772994435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b396fd4730 con 0x55b3971c1830 2024-03-30T13:11:12.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38a37fe640 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 0x55b3971eef30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f389400fa00 tx=0x7f3894004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725506540ed28dcd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38827fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:12.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38827fc640 1 -- 172.21.15.83:0/3772994435 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894020b00 con 0x55b3971c1830 2024-03-30T13:11:12.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38827fc640 1 -- 172.21.15.83:0/3772994435 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3894020ca0 con 0x55b3971c1830 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 -- 172.21.15.83:0/3772994435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3894025070 con 0x55b3971c1830 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38827fc640 1 -- 172.21.15.83:0/3772994435 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f389403c050 con 0x55b3971c1830 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 10 client.6258 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 -- 172.21.15.83:0/3772994435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b396fc7ca0 con 0x55b3971c1830 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38827fc640 1 -- 172.21.15.83:0/3772994435 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894025070 con 0x55b3971c1830 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38827fc640 1 -- 172.21.15.83:0/3772994435 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f389403f020 con 0x55b3971c1830 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 10 client.6258 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 10 client.6258 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 20 client.6258 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b39721a010 0x55b39721c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 4 client.6258 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 -- 172.21.15.83:0/3772994435 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b396faac90 con 0x55b39721a010 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f389bfff640 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b39721a010 0x55b39721c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f389bfff640 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b39721a010 0x55b39721c400 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dfbbde3bcf152c9 server_cookie=f77602cdeb900984 in_seq=0 out_seq=0 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38827fc640 10 client.6258 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38827fc640 1 -- 172.21.15.83:0/3772994435 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b396faac90 con 0x55b39721a010 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38827fc640 10 client.6258 handle_command_reply: tid=0 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 client.6258 shutdown 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 -- 172.21.15.83:0/3772994435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 msgr2=0x55b3971eef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 0x55b3971eef30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f389400fa00 tx=0x7f3894004740 comp rx=0 tx=0).stop 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 -- 172.21.15.83:0/3772994435 shutdown_connections 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 0x55b3971ef9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 0x55b3971ef470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b39721a010 0x55b39721c400 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/3772994435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 0x55b3971eef30 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 -- 172.21.15.83:0/3772994435 >> 172.21.15.83:0/3772994435 conn(0x55b3971bd7e0 msgr2=0x55b3971c0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38827fc640 0 client.6258 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 -- 172.21.15.83:0/3772994435 shutdown_connections 2024-03-30T13:11:12.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 1 -- 172.21.15.83:0/3772994435 wait complete. 2024-03-30T13:11:12.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.508+0000 7f38ad3c8000 20 client.6258 trim_cache size 0 max 16384 2024-03-30T13:11:12.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.520+0000 7f38ad3c8000 1 Processor -- start 2024-03-30T13:11:12.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.520+0000 7f38ad3c8000 1 -- start start 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3971c1830 0x55b3971c1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 0x55b3971c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720b690 0x55b3971c7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f38a4201ad0 con 0x55b39720b690 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38a41447d0 con 0x55b3971c1830 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38a40d0050 con 0x55b39720ad70 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720b690 0x55b3971c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720b690 0x55b3971c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37988/0 (socket says 172.21.15.83:37988) 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a3fff640 1 -- 172.21.15.83:0/830182417 learned_addr learned my addr 172.21.15.83:0/830182417 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a3fff640 1 -- 172.21.15.83:0/830182417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 msgr2=0x55b3971c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f389bfff640 1 --2- 172.21.15.83:0/830182417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 0x55b3971c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a37fe640 1 --2- 172.21.15.83:0/830182417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3971c1830 0x55b3971c1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a3fff640 1 --2- 172.21.15.83:0/830182417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 0x55b3971c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a3fff640 1 -- 172.21.15.83:0/830182417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3971c1830 msgr2=0x55b3971c1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a3fff640 1 --2- 172.21.15.83:0/830182417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3971c1830 0x55b3971c1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a3fff640 1 -- 172.21.15.83:0/830182417 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b39720b4c0 con 0x55b39720b690 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a3fff640 1 --2- 172.21.15.83:0/830182417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720b690 0x55b3971c7030 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f389c0528a0 tx=0x7f389c086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53601bfd481c2be6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f3898ff9640 1 -- 172.21.15.83:0/830182417 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c056440 con 0x55b39720b690 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f3898ff9640 1 -- 172.21.15.83:0/830182417 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389c05a7f0 con 0x55b39720b690 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f3898ff9640 1 -- 172.21.15.83:0/830182417 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c05f0b0 con 0x55b39720b690 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 -- 172.21.15.83:0/830182417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720b690 msgr2=0x55b3971c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/830182417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720b690 0x55b3971c7030 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f389c0528a0 tx=0x7f389c086040 comp rx=0 tx=0).stop 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 -- 172.21.15.83:0/830182417 shutdown_connections 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/830182417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b39720b690 0x55b3971c7030 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/830182417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 0x55b3971c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/830182417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3971c1830 0x55b3971c1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 -- 172.21.15.83:0/830182417 >> 172.21.15.83:0/830182417 conn(0x55b3971bd7e0 msgr2=0x55b3971c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 -- 172.21.15.83:0/830182417 shutdown_connections 2024-03-30T13:11:12.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 -- 172.21.15.83:0/830182417 wait complete. 2024-03-30T13:11:12.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 -- start start 2024-03-30T13:11:12.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 Processor -- start 2024-03-30T13:11:12.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 0x55b39721ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 0x55b397280920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 0x55b397280e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b3970cbb00 con 0x55b3971c1830 2024-03-30T13:11:12.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38a4144180 con 0x55b39720b690 2024-03-30T13:11:12.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b39700faa0 con 0x55b39720ad70 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38ad3c8000 10 client.0 _ll_register_callbacks cb 0x7f389400f930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 0x55b39721ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 0x55b39721ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37994/0 (socket says 172.21.15.83:37994) 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a37fe640 1 -- 172.21.15.83:0/2361076498 learned_addr learned my addr 172.21.15.83:0/2361076498 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a3fff640 1 --2- 172.21.15.83:0/2361076498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 0x55b397280e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a37fe640 1 -- 172.21.15.83:0/2361076498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 msgr2=0x55b397280920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a37fe640 1 --2- 172.21.15.83:0/2361076498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 0x55b397280920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a37fe640 1 -- 172.21.15.83:0/2361076498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 msgr2=0x55b397280e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a37fe640 1 --2- 172.21.15.83:0/2361076498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 0x55b397280e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a37fe640 1 -- 172.21.15.83:0/2361076498 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b396f96d00 con 0x55b3971c1830 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38a37fe640 1 --2- 172.21.15.83:0/2361076498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 0x55b39721ec40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f389400fa60 tx=0x7f3894015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee2555d5f1c38eb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38827fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.524+0000 7f38827fc640 1 -- 172.21.15.83:0/2361076498 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389401b050 con 0x55b3971c1830 2024-03-30T13:11:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38827fc640 1 -- 172.21.15.83:0/2361076498 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3894020d10 con 0x55b3971c1830 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2361076498 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f389c05a7f0 con 0x55b3971c1830 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38827fc640 1 -- 172.21.15.83:0/2361076498 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f3894034580 con 0x55b3971c1830 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 10 client.6264 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2361076498 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b397090f70 con 0x55b3971c1830 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38827fc640 1 -- 172.21.15.83:0/2361076498 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389c05a7f0 con 0x55b3971c1830 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38827fc640 1 -- 172.21.15.83:0/2361076498 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f389403f040 con 0x55b3971c1830 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 10 client.6264 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 10 client.6264 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 20 client.6264 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/2361076498 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b39727d340 0x55b39727d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 4 client.6264 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628426}] 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2361076498 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628426}) -- 0x55b39701cfe0 con 0x55b39727d340 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f389bfff640 1 --2- 172.21.15.83:0/2361076498 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b39727d340 0x55b39727d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38827fc640 10 client.6264 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f389bfff640 1 --2- 172.21.15.83:0/2361076498 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b39727d340 0x55b39727d720 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4620bd1d863e118f server_cookie=dd1a9a4306a453a7 in_seq=0 out_seq=0 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38827fc640 1 -- 172.21.15.83:0/2361076498 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3802 (crc 0 0 0) 0x55b39701cfe0 con 0x55b39727d340 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38827fc640 10 client.6264 handle_command_reply: tid=0 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 client.6264 shutdown 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2361076498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 msgr2=0x55b39721ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/2361076498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 0x55b39721ec40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f389400fa60 tx=0x7f3894015000 comp rx=0 tx=0).stop 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2361076498 shutdown_connections 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/2361076498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b39720b690 0x55b397280e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/2361076498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b39720ad70 0x55b397280920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/2361076498 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b39727d340 0x55b39727d720 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 --2- 172.21.15.83:0/2361076498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3971c1830 0x55b39721ec40 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2361076498 >> 172.21.15.83:0/2361076498 conn(0x55b3971bd7e0 msgr2=0x55b3971c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38827fc640 0 client.6264 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2361076498 shutdown_connections 2024-03-30T13:11:12.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 1 -- 172.21.15.83:0/2361076498 wait complete. 2024-03-30T13:11:12.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38ad3c8000 20 client.6264 trim_cache size 0 max 16384 2024-03-30T13:11:12.542 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:12.542 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-sysfs.h", 2024-03-30T13:11:12.542 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628426, 2024-03-30T13:11:12.542 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:12.542 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.643178+0000", 2024-03-30T13:11:12.542 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.197060+0000", 2024-03-30T13:11:12.542 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:12.543 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 77, 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.197060+0000", 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:12.544 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 77, 2024-03-30T13:11:12.545 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.643178+0000" 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 77, 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.643178+0000" 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 130, 2024-03-30T13:11:12.546 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 42, 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:12.547 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.548 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:12.549 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.550 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:12.550 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:12.550 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.550 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.550 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:12.550 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.550 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.550 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.550 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.550 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.550 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.553 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:12.554 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:12.554 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:12.554 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:12.554 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:12.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38aa246640 1 -- 172.21.15.83:0/1679901654 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3884067ff0 msgr2=0x7f388406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38aa246640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3884067ff0 0x7f388406a4b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f389400b9d0 tx=0x7f3894008040 comp rx=0 tx=0).stop 2024-03-30T13:11:12.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38aa246640 1 -- 172.21.15.83:0/1679901654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38a4160a30 msgr2=0x7f38a413d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38aa246640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38a4160a30 0x7f38a413d6e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f389c00c730 tx=0x7f389c00cbf0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38aa246640 1 -- 172.21.15.83:0/1679901654 shutdown_connections 2024-03-30T13:11:12.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38aa246640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3884067ff0 0x7f388406a4b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38aa246640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38a4160a30 0x7f38a413d6e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38aa246640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a4160090 0x7f38a409e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38aa246640 1 --2- 172.21.15.83:0/1679901654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38a4145c40 0x7f38a415bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38aa246640 1 -- 172.21.15.83:0/1679901654 >> 172.21.15.83:0/1679901654 conn(0x7f38a4072d30 msgr2=0x7f38a4070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38aa246640 1 -- 172.21.15.83:0/1679901654 shutdown_connections 2024-03-30T13:11:12.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.528+0000 7f38aa246640 1 -- 172.21.15.83:0/1679901654 wait complete. 2024-03-30T13:11:12.557 DEBUG:tasks.cephfs.test_uninlining:getting inode info #17 of 23:1099511628409 2024-03-30T13:11:12.557 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628409 2024-03-30T13:11:12.557 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628409 2024-03-30T13:11:12.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c219f4640 1 Processor -- start 2024-03-30T13:11:12.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c219f4640 1 -- start start 2024-03-30T13:11:12.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c219f4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6c1c15e5d0 0x7f6c1c0afe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c219f4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6c1c0b4fd0 0x7f6c1c06f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c219f4640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1c15e9b0 con 0x7f6c1c0b5430 2024-03-30T13:11:12.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c219f4640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1c0b0390 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c219f4640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1c0b05c0 con 0x7f6c1c0b4fd0 2024-03-30T13:11:12.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c1affd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6c1c15e5d0 0x7f6c1c0afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c1b7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f6c1c0b5430 0x7f6c1c162140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57460/0 (socket says 172.21.15.83:57460) 2024-03-30T13:11:12.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/3174726519 learned_addr learned my addr 172.21.15.83:0/3174726519 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:12.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c1a7fc640 1 --2- 172.21.15.83:0/3174726519 >> v2:172.21.15.153:3300/0 conn(0x7f6c1c0b4fd0 0x7f6c1c06f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c1affd640 1 -- 172.21.15.83:0/3174726519 >> v2:172.21.15.153:3300/0 conn(0x7f6c1c0b4fd0 msgr2=0x7f6c1c06f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c1affd640 1 --2- 172.21.15.83:0/3174726519 >> v2:172.21.15.153:3300/0 conn(0x7f6c1c0b4fd0 0x7f6c1c06f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c1affd640 1 -- 172.21.15.83:0/3174726519 >> v1:172.21.15.83:6789/0 conn(0x7f6c1c0b5430 legacy=0x7f6c1c162140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c1affd640 1 -- 172.21.15.83:0/3174726519 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c06e2e0 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c19ffb640 1 -- 172.21.15.83:0/3174726519 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2872719770 0 0) 0x7f6c1c15e9b0 con 0x7f6c1c0b5430 2024-03-30T13:11:12.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.656+0000 7f6c1affd640 1 --2- 172.21.15.83:0/3174726519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c1c15e5d0 0x7f6c1c0afe50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c06d0a0 tx=0x7f6c1001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c806221ef5d1c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c19ffb640 1 -- 172.21.15.83:0/3174726519 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c100b0070 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c19ffb640 1 -- 172.21.15.83:0/3174726519 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c100ab600 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c19ffb640 1 -- 172.21.15.83:0/3174726519 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c100ab9d0 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 -- 172.21.15.83:0/3174726519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c1c15e5d0 msgr2=0x7f6c1c0afe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 --2- 172.21.15.83:0/3174726519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c1c15e5d0 0x7f6c1c0afe50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c06d0a0 tx=0x7f6c1001c460 comp rx=0 tx=0).stop 2024-03-30T13:11:12.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 -- 172.21.15.83:0/3174726519 shutdown_connections 2024-03-30T13:11:12.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 --2- 172.21.15.83:0/3174726519 >> v2:172.21.15.153:3300/0 conn(0x7f6c1c0b4fd0 0x7f6c1c06f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 --2- 172.21.15.83:0/3174726519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c1c15e5d0 0x7f6c1c0afe50 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 -- 172.21.15.83:0/3174726519 >> 172.21.15.83:0/3174726519 conn(0x7f6c1c072ec0 msgr2=0x7f6c1c06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 -- 172.21.15.83:0/3174726519 shutdown_connections 2024-03-30T13:11:12.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 -- 172.21.15.83:0/3174726519 wait complete. 2024-03-30T13:11:12.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 Processor -- start 2024-03-30T13:11:12.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 -- start start 2024-03-30T13:11:12.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c1c0b4fd0 0x7f6c1c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c1c0b5430 0x7f6c1c14a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c1c15e5d0 0x7f6c1c156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c16b660 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c16b4e0 con 0x7f6c1c0b4fd0 2024-03-30T13:11:12.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1c16b7e0 con 0x7f6c1c0b5430 2024-03-30T13:11:12.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c1b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c1c15e5d0 0x7f6c1c156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c1b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c1c15e5d0 0x7f6c1c156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38008/0 (socket says 172.21.15.83:38008) 2024-03-30T13:11:12.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/7076637 learned_addr learned my addr 172.21.15.83:0/7076637 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c1a7fc640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c1c0b5430 0x7f6c1c14a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c1affd640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c1c0b4fd0 0x7f6c1c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/7076637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c1c0b5430 msgr2=0x7f6c1c14a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c1b7fe640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c1c0b5430 0x7f6c1c14a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/7076637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c1c0b4fd0 msgr2=0x7f6c1c0cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c1b7fe640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c1c0b4fd0 0x7f6c1c0cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/7076637 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c0ccee0 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c1b7fe640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c1c15e5d0 0x7f6c1c156290 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c730 tx=0x7f6c1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c03fff640 1 -- 172.21.15.83:0/7076637 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14018070 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c03fff640 1 -- 172.21.15.83:0/7076637 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c1400ce40 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c03fff640 1 -- 172.21.15.83:0/7076637 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1400a860 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 -- 172.21.15.83:0/7076637 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1c0ce1f0 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.660+0000 7f6c219f4640 1 -- 172.21.15.83:0/7076637 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1c0cdf10 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c03fff640 1 -- 172.21.15.83:0/7076637 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6c1401b070 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c03fff640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c08067fc0 0x7f6c0806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c03fff640 1 -- 172.21.15.83:0/7076637 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c14085af0 con 0x7f6c1c15e5d0 2024-03-30T13:11:12.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1affd640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c08067fc0 0x7f6c0806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1affd640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c08067fc0 0x7f6c0806a480 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6c100ad000 tx=0x7f6c100a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c24b76000 1 Processor -- start 2024-03-30T13:11:12.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c24b76000 1 -- start start 2024-03-30T13:11:12.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c24b76000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b3e3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c24b76000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b3e3690 0x564c4b3992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c24b76000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 0x564c4b399c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c24b76000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564c4b1e7aa0 con 0x564c4b399830 2024-03-30T13:11:12.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c24b76000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564c4b16eaf0 con 0x564c4b3e2d70 2024-03-30T13:11:12.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c24b76000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564c4b1e3a50 con 0x564c4b3e3690 2024-03-30T13:11:12.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 0x564c4b399c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 0x564c4b399c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38014/0 (socket says 172.21.15.83:38014) 2024-03-30T13:11:12.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/1035328914 learned_addr learned my addr 172.21.15.83:0/1035328914 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1a7fc640 1 --2- 172.21.15.83:0/1035328914 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b3e3690 0x564c4b3992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1affd640 1 --2- 172.21.15.83:0/1035328914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b3e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/1035328914 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b3e3690 msgr2=0x564c4b3992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1b7fe640 1 --2- 172.21.15.83:0/1035328914 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b3e3690 0x564c4b3992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/1035328914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 msgr2=0x564c4b3e3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1b7fe640 1 --2- 172.21.15.83:0/1035328914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b3e3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/1035328914 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c4b16cd00 con 0x564c4b399830 2024-03-30T13:11:12.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1affd640 1 --2- 172.21.15.83:0/1035328914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b3e3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:12.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c1b7fe640 1 --2- 172.21.15.83:0/1035328914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 0x564c4b399c10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6c1405e1b0 tx=0x7f6c14055b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e955df34659c23 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c017fa640 1 -- 172.21.15.83:0/1035328914 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14053e00 con 0x564c4b399830 2024-03-30T13:11:12.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c017fa640 1 -- 172.21.15.83:0/1035328914 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c14052170 con 0x564c4b399830 2024-03-30T13:11:12.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.664+0000 7f6c017fa640 1 -- 172.21.15.83:0/1035328914 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14055150 con 0x564c4b399830 2024-03-30T13:11:12.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 -- 172.21.15.83:0/1035328914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 msgr2=0x564c4b399c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 --2- 172.21.15.83:0/1035328914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 0x564c4b399c10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6c1405e1b0 tx=0x7f6c14055b00 comp rx=0 tx=0).stop 2024-03-30T13:11:12.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 -- 172.21.15.83:0/1035328914 shutdown_connections 2024-03-30T13:11:12.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 --2- 172.21.15.83:0/1035328914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 0x564c4b399c10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 --2- 172.21.15.83:0/1035328914 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b3e3690 0x564c4b3992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 --2- 172.21.15.83:0/1035328914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b3e3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 -- 172.21.15.83:0/1035328914 >> 172.21.15.83:0/1035328914 conn(0x564c4b3957e0 msgr2=0x564c4b397bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 -- 172.21.15.83:0/1035328914 shutdown_connections 2024-03-30T13:11:12.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 -- 172.21.15.83:0/1035328914 wait complete. 2024-03-30T13:11:12.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 -- start start 2024-03-30T13:11:12.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 Processor -- start 2024-03-30T13:11:12.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b399830 0x564c4b39ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e2d70 0x564c4b3c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e3690 0x564c4b3c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564c4b1af270 con 0x564c4b3e2d70 2024-03-30T13:11:12.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564c4b1a56a0 con 0x564c4b3e3690 2024-03-30T13:11:12.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564c4b17f880 con 0x564c4b399830 2024-03-30T13:11:12.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 10 client.0 _ll_register_callbacks cb 0x564c4b384490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e2d70 0x564c4b3c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e2d70 0x564c4b3c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38016/0 (socket says 172.21.15.83:38016) 2024-03-30T13:11:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1a7fc640 1 -- 172.21.15.83:0/4048433012 learned_addr learned my addr 172.21.15.83:0/4048433012 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1affd640 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b399830 0x564c4b39ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1a7fc640 1 -- 172.21.15.83:0/4048433012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b399830 msgr2=0x564c4b39ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1a7fc640 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b399830 0x564c4b39ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1b7fe640 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e3690 0x564c4b3c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1a7fc640 1 -- 172.21.15.83:0/4048433012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e3690 msgr2=0x564c4b3c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1a7fc640 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e3690 0x564c4b3c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1a7fc640 1 -- 172.21.15.83:0/4048433012 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c4b1ac730 con 0x564c4b3e2d70 2024-03-30T13:11:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1a7fc640 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e2d70 0x564c4b3c7da0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00bef0 tx=0x7f6c0c011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78d12ba1f5f50d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6bfa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6bfa7fc640 1 -- 172.21.15.83:0/4048433012 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c011e60 con 0x564c4b3e2d70 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 -- 172.21.15.83:0/4048433012 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c14052170 con 0x564c4b3e2d70 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6bfa7fc640 1 -- 172.21.15.83:0/4048433012 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c0c004030 con 0x564c4b3e2d70 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6bfa7fc640 1 -- 172.21.15.83:0/4048433012 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f6c0c023050 con 0x564c4b3e2d70 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 10 client.6279 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 -- 172.21.15.83:0/4048433012 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564c4b19fca0 con 0x564c4b3e2d70 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6bfa7fc640 1 -- 172.21.15.83:0/4048433012 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c14052170 con 0x564c4b3e2d70 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6bfa7fc640 1 -- 172.21.15.83:0/4048433012 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f6c0c026020 con 0x564c4b3e2d70 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 10 client.6279 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 10 client.6279 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 20 client.6279 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564c4b3ea5d0 0x564c4b3ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 4 client.6279 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c24b76000 1 -- 172.21.15.83:0/4048433012 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c4b182c90 con 0x564c4b3ea5d0 2024-03-30T13:11:12.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1affd640 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564c4b3ea5d0 0x564c4b3ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6c1affd640 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564c4b3ea5d0 0x564c4b3ea9e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bca59a77c5ecdd62 server_cookie=3bbe6158b0d96f4f in_seq=0 out_seq=0 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.668+0000 7f6bfa7fc640 10 client.6279 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6bfa7fc640 1 -- 172.21.15.83:0/4048433012 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x564c4b182c90 con 0x564c4b3ea5d0 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6bfa7fc640 10 client.6279 handle_command_reply: tid=0 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6c24b76000 1 client.6279 shutdown 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6c24b76000 1 -- 172.21.15.83:0/4048433012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e2d70 msgr2=0x564c4b3c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6c24b76000 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e2d70 0x564c4b3c7da0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00bef0 tx=0x7f6c0c011630 comp rx=0 tx=0).stop 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6c24b76000 1 -- 172.21.15.83:0/4048433012 shutdown_connections 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6c24b76000 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e3690 0x564c4b3c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6c24b76000 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564c4b3ea5d0 0x564c4b3ea9e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6c24b76000 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e2d70 0x564c4b3c7da0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6bfa7fc640 0 client.6279 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6c24b76000 1 --2- 172.21.15.83:0/4048433012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b399830 0x564c4b39ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6c24b76000 1 -- 172.21.15.83:0/4048433012 >> 172.21.15.83:0/4048433012 conn(0x564c4b3957e0 msgr2=0x564c4b398460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6c24b76000 1 -- 172.21.15.83:0/4048433012 shutdown_connections 2024-03-30T13:11:12.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6c24b76000 1 -- 172.21.15.83:0/4048433012 wait complete. 2024-03-30T13:11:12.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.672+0000 7f6c24b76000 20 client.6279 trim_cache size 0 max 16384 2024-03-30T13:11:12.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c24b76000 1 Processor -- start 2024-03-30T13:11:12.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c24b76000 1 -- start start 2024-03-30T13:11:12.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c24b76000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b399830 0x564c4b3c8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c24b76000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b397bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c24b76000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e3690 0x564c4b398110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c24b76000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c203e50 con 0x564c4b3e3690 2024-03-30T13:11:12.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c24b76000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c202e50 con 0x564c4b3e2d70 2024-03-30T13:11:12.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c24b76000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1c2022d0 con 0x564c4b399830 2024-03-30T13:11:12.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c1b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e3690 0x564c4b398110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c1b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e3690 0x564c4b398110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38020/0 (socket says 172.21.15.83:38020) 2024-03-30T13:11:12.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/2947262925 learned_addr learned my addr 172.21.15.83:0/2947262925 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c1a7fc640 1 --2- 172.21.15.83:0/2947262925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b397bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c1affd640 1 --2- 172.21.15.83:0/2947262925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b399830 0x564c4b3c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.684+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/2947262925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b399830 msgr2=0x564c4b3c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1b7fe640 1 --2- 172.21.15.83:0/2947262925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b399830 0x564c4b3c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/2947262925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 msgr2=0x564c4b397bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1b7fe640 1 --2- 172.21.15.83:0/2947262925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b397bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1b7fe640 1 -- 172.21.15.83:0/2947262925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c4b16ed00 con 0x564c4b3e3690 2024-03-30T13:11:12.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1a7fc640 1 --2- 172.21.15.83:0/2947262925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b397bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:12.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1b7fe640 1 --2- 172.21.15.83:0/2947262925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e3690 0x564c4b398110 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6c140563b0 tx=0x7f6c14013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1afb654a71aa4f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c00ff9640 1 -- 172.21.15.83:0/2947262925 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14070070 con 0x564c4b3e3690 2024-03-30T13:11:12.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c00ff9640 1 -- 172.21.15.83:0/2947262925 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c14053e00 con 0x564c4b3e3690 2024-03-30T13:11:12.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c00ff9640 1 -- 172.21.15.83:0/2947262925 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14052170 con 0x564c4b3e3690 2024-03-30T13:11:12.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 -- 172.21.15.83:0/2947262925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e3690 msgr2=0x564c4b398110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 --2- 172.21.15.83:0/2947262925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e3690 0x564c4b398110 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6c140563b0 tx=0x7f6c14013000 comp rx=0 tx=0).stop 2024-03-30T13:11:12.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 -- 172.21.15.83:0/2947262925 shutdown_connections 2024-03-30T13:11:12.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 --2- 172.21.15.83:0/2947262925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b3e3690 0x564c4b398110 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 --2- 172.21.15.83:0/2947262925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b397bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 --2- 172.21.15.83:0/2947262925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b399830 0x564c4b3c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 -- 172.21.15.83:0/2947262925 >> 172.21.15.83:0/2947262925 conn(0x564c4b3957e0 msgr2=0x564c4b3f9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 -- 172.21.15.83:0/2947262925 shutdown_connections 2024-03-30T13:11:12.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 -- 172.21.15.83:0/2947262925 wait complete. 2024-03-30T13:11:12.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 -- start start 2024-03-30T13:11:12.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 Processor -- start 2024-03-30T13:11:12.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 0x564c4b455100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b455640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b3e3690 0x564c4b3e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564c4b1e6db0 con 0x564c4b399830 2024-03-30T13:11:12.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c202800 con 0x564c4b3e2d70 2024-03-30T13:11:12.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x564c4b17f880 con 0x564c4b3e3690 2024-03-30T13:11:12.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 10 client.0 _ll_register_callbacks cb 0x7f6c0c00b220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:12.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 0x564c4b455100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 0x564c4b455100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38028/0 (socket says 172.21.15.83:38028) 2024-03-30T13:11:12.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1affd640 1 -- 172.21.15.83:0/987040486 learned_addr learned my addr 172.21.15.83:0/987040486 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1a7fc640 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b455640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1b7fe640 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b3e3690 0x564c4b3e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1affd640 1 -- 172.21.15.83:0/987040486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b3e3690 msgr2=0x564c4b3e6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1affd640 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b3e3690 0x564c4b3e6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1affd640 1 -- 172.21.15.83:0/987040486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 msgr2=0x564c4b455640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1affd640 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b455640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1affd640 1 -- 172.21.15.83:0/987040486 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c4b268f70 con 0x564c4b399830 2024-03-30T13:11:12.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1affd640 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 0x564c4b455100 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6c10019070 tx=0x7f6c100046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f249cdbfcdbb641 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6bfa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:12.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6bfa7fc640 1 -- 172.21.15.83:0/987040486 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c100b0040 con 0x564c4b399830 2024-03-30T13:11:12.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6bfa7fc640 1 -- 172.21.15.83:0/987040486 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c100c7350 con 0x564c4b399830 2024-03-30T13:11:12.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 -- 172.21.15.83:0/987040486 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c14053e00 con 0x564c4b399830 2024-03-30T13:11:12.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6bfa7fc640 1 -- 172.21.15.83:0/987040486 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f6c100d7050 con 0x564c4b399830 2024-03-30T13:11:12.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 10 client.6285 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:12.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 -- 172.21.15.83:0/987040486 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564c4b18e760 con 0x564c4b399830 2024-03-30T13:11:12.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6bfa7fc640 1 -- 172.21.15.83:0/987040486 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c14053e00 con 0x564c4b399830 2024-03-30T13:11:12.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6bfa7fc640 1 -- 172.21.15.83:0/987040486 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f6c100da020 con 0x564c4b399830 2024-03-30T13:11:12.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 10 client.6285 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:12.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 10 client.6285 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:12.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 20 client.6285 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:12.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564c4b3ea5d0 0x564c4b3e78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 4 client.6285 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628409}] 2024-03-30T13:11:12.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c24b76000 1 -- 172.21.15.83:0/987040486 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628409}) -- 0x564c4b1f4fe0 con 0x564c4b3ea5d0 2024-03-30T13:11:12.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.688+0000 7f6c1a7fc640 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564c4b3ea5d0 0x564c4b3e78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c1a7fc640 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564c4b3ea5d0 0x564c4b3e78c0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7398c70c9806adee server_cookie=d2438123529be6ee in_seq=0 out_seq=0 2024-03-30T13:11:12.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6bfa7fc640 10 client.6285 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6bfa7fc640 1 -- 172.21.15.83:0/987040486 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3799 (crc 0 0 0) 0x564c4b1f4fe0 con 0x564c4b3ea5d0 2024-03-30T13:11:12.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6bfa7fc640 10 client.6285 handle_command_reply: tid=0 2024-03-30T13:11:12.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c24b76000 1 client.6285 shutdown 2024-03-30T13:11:12.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c24b76000 1 -- 172.21.15.83:0/987040486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 msgr2=0x564c4b455100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c24b76000 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 0x564c4b455100 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6c10019070 tx=0x7f6c100046d0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c24b76000 1 -- 172.21.15.83:0/987040486 shutdown_connections 2024-03-30T13:11:12.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c24b76000 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x564c4b3e3690 0x564c4b3e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c24b76000 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c4b3e2d70 0x564c4b455640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c24b76000 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x564c4b3ea5d0 0x564c4b3e78c0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c24b76000 1 --2- 172.21.15.83:0/987040486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c4b399830 0x564c4b455100 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c24b76000 1 -- 172.21.15.83:0/987040486 >> 172.21.15.83:0/987040486 conn(0x564c4b3957e0 msgr2=0x564c4b3fa620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6bfa7fc640 0 client.6285 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c24b76000 1 -- 172.21.15.83:0/987040486 shutdown_connections 2024-03-30T13:11:12.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c24b76000 1 -- 172.21.15.83:0/987040486 wait complete. 2024-03-30T13:11:12.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c24b76000 20 client.6285 trim_cache size 0 max 16384 2024-03-30T13:11:12.714 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:12.715 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/dcache.c", 2024-03-30T13:11:12.715 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628409, 2024-03-30T13:11:12.715 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:12.715 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.644692+0000", 2024-03-30T13:11:12.715 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.133820+0000", 2024-03-30T13:11:12.715 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:12.715 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:12.715 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:12.715 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:12.716 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 3670, 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.133820+0000", 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 4, 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.717 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 3670, 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.644692+0000" 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:12.718 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.719 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 3670, 2024-03-30T13:11:12.719 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:12.719 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:12.719 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:12.719 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.644692+0000" 2024-03-30T13:11:12.719 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.719 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 128, 2024-03-30T13:11:12.719 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:12.719 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:12.719 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 8, 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:12.720 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:12.721 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.721 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:12.721 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:12.721 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:12.721 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:12.721 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:12.721 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:12.721 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.721 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:12.721 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:12.721 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:12.721 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:12.722 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.722 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:12.722 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.722 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:12.722 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:12.722 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:12.722 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:12.722 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:12.723 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.724 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.724 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.724 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.724 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.724 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.724 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:12.724 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:12.725 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:12.725 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:12.725 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:12.725 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:12.725 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:12.725 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.725 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.726 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:12.726 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.726 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.726 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.726 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.726 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.726 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.726 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:12.726 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:12.727 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:12.728 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.728 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:12.728 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:12.728 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:12.728 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:12.728 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:12.728 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:12.729 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:12.729 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:12.729 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.729 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:12.729 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:12.730 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:12.730 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:12.730 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:12.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c219f4640 1 -- 172.21.15.83:0/7076637 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c08067fc0 msgr2=0x7f6c0806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c219f4640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c08067fc0 0x7f6c0806a480 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6c100ad000 tx=0x7f6c100a6000 comp rx=0 tx=0).stop 2024-03-30T13:11:12.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c219f4640 1 -- 172.21.15.83:0/7076637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c1c15e5d0 msgr2=0x7f6c1c156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c219f4640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c1c15e5d0 0x7f6c1c156290 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c730 tx=0x7f6c1400cbf0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c219f4640 1 -- 172.21.15.83:0/7076637 shutdown_connections 2024-03-30T13:11:12.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c219f4640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6c08067fc0 0x7f6c0806a480 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c219f4640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c1c15e5d0 0x7f6c1c156290 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c219f4640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c1c0b5430 0x7f6c1c14a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c219f4640 1 --2- 172.21.15.83:0/7076637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c1c0b4fd0 0x7f6c1c0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c219f4640 1 -- 172.21.15.83:0/7076637 >> 172.21.15.83:0/7076637 conn(0x7f6c1c072ec0 msgr2=0x7f6c1c0ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c219f4640 1 -- 172.21.15.83:0/7076637 shutdown_connections 2024-03-30T13:11:12.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.692+0000 7f6c219f4640 1 -- 172.21.15.83:0/7076637 wait complete. 2024-03-30T13:11:12.735 DEBUG:tasks.cephfs.test_uninlining:getting inode info #18 of 23:1099511628417 2024-03-30T13:11:12.735 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628417 2024-03-30T13:11:12.736 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628417 2024-03-30T13:11:12.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f01721ab640 1 Processor -- start 2024-03-30T13:11:12.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f01721ab640 1 -- start start 2024-03-30T13:11:12.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f01721ab640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f016c06f290 0x7f016c06f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f01721ab640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f016c13e820 con 0x7f016c0ccfa0 2024-03-30T13:11:12.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f01721ab640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f016c0cfb10 con 0x7f016c13e440 2024-03-30T13:11:12.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f01721ab640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f016c06fc30 con 0x7f016c06f290 2024-03-30T13:11:12.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016bfff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f016c0ccfa0 0x7f016c0cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57466/0 (socket says 172.21.15.83:57466) 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016bfff640 1 -- 172.21.15.83:0/3907899948 learned_addr learned my addr 172.21.15.83:0/3907899948 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016affd640 1 --2- 172.21.15.83:0/3907899948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f016c06f290 0x7f016c06f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3742074555 0 0) 0x7f016c13e820 con 0x7f016c0ccfa0 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0158005740 con 0x7f016c0ccfa0 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1974280874 0 0) 0x7f0158005740 con 0x7f016c0ccfa0 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f016c06f290 msgr2=0x7f016c06f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 --2- 172.21.15.83:0/3907899948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f016c06f290 0x7f016c06f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 >> v1:172.21.15.153:6789/0 conn(0x7f016c13e440 legacy=0x7f016c15c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016c0cfdf0 con 0x7f016c0ccfa0 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f015c001a00 con 0x7f016c0ccfa0 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 >> v1:172.21.15.83:6789/0 conn(0x7f016c0ccfa0 legacy=0x7f016c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 --2- 172.21.15.83:0/3907899948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0158005c00 0x7f0158006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 --2- 172.21.15.83:0/3907899948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f016c06f290 0x7f0158006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 --2- 172.21.15.83:0/3907899948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0158006f60 0x7f01580073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f015800dc90 con 0x7f0158005c00 2024-03-30T13:11:12.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f015800de40 con 0x7f0158006f60 2024-03-30T13:11:12.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f015800e040 con 0x7f016c06f290 2024-03-30T13:11:12.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016b7fe640 1 --2- 172.21.15.83:0/3907899948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0158005c00 0x7f0158006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016b7fe640 1 -- 172.21.15.83:0/3907899948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f016c06f290 msgr2=0x7f0158006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016b7fe640 1 --2- 172.21.15.83:0/3907899948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f016c06f290 0x7f0158006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016bfff640 1 --2- 172.21.15.83:0/3907899948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0158006f60 0x7f01580073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016b7fe640 1 -- 172.21.15.83:0/3907899948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0158006f60 msgr2=0x7f01580073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016b7fe640 1 --2- 172.21.15.83:0/3907899948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0158006f60 0x7f01580073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.848+0000 7f016b7fe640 1 -- 172.21.15.83:0/3907899948 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0158005740 con 0x7f0158005c00 2024-03-30T13:11:12.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.852+0000 7f016b7fe640 1 --2- 172.21.15.83:0/3907899948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0158005c00 0x7f0158006020 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0164001750 tx=0x7f016401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab16b2d8124b477 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.852+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01640013a0 con 0x7f0158005c00 2024-03-30T13:11:12.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.852+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01640052f0 con 0x7f0158005c00 2024-03-30T13:11:12.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.852+0000 7f016a7fc640 1 -- 172.21.15.83:0/3907899948 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164003840 con 0x7f0158005c00 2024-03-30T13:11:12.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.852+0000 7f01721ab640 1 -- 172.21.15.83:0/3907899948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0158005c00 msgr2=0x7f0158006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.852+0000 7f01721ab640 1 --2- 172.21.15.83:0/3907899948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0158005c00 0x7f0158006020 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0164001750 tx=0x7f016401c3b0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.852+0000 7f016bfff640 1 -- 172.21.15.83:0/3907899948 reap_dead start 2024-03-30T13:11:12.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.852+0000 7f01721ab640 1 -- 172.21.15.83:0/3907899948 shutdown_connections 2024-03-30T13:11:12.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.852+0000 7f01721ab640 1 -- 172.21.15.83:0/3907899948 >> 172.21.15.83:0/3907899948 conn(0x7f016c072f00 msgr2=0x7f016c06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.852+0000 7f01721ab640 1 -- 172.21.15.83:0/3907899948 shutdown_connections 2024-03-30T13:11:12.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.852+0000 7f01721ab640 1 -- 172.21.15.83:0/3907899948 wait complete. 2024-03-30T13:11:12.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f01721ab640 1 Processor -- start 2024-03-30T13:11:12.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f01721ab640 1 -- start start 2024-03-30T13:11:12.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f01721ab640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0158005c00 0x7f016c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f01721ab640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f016c153160 0x7f016c1f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f01721ab640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f016c13a5f0 0x7f016c13aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f01721ab640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f016c140ef0 con 0x7f016c153160 2024-03-30T13:11:12.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f01721ab640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f016c140d70 con 0x7f016c13a5f0 2024-03-30T13:11:12.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f01721ab640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f016c0cf720 con 0x7f0158005c00 2024-03-30T13:11:12.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f016c153160 0x7f016c1f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f016c153160 0x7f016c1f79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38058/0 (socket says 172.21.15.83:38058) 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016affd640 1 -- 172.21.15.83:0/4252906181 learned_addr learned my addr 172.21.15.83:0/4252906181 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016b7fe640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0158005c00 0x7f016c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016bfff640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f016c13a5f0 0x7f016c13aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016affd640 1 -- 172.21.15.83:0/4252906181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0158005c00 msgr2=0x7f016c153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016affd640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0158005c00 0x7f016c153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016affd640 1 -- 172.21.15.83:0/4252906181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f016c13a5f0 msgr2=0x7f016c13aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016affd640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f016c13a5f0 0x7f016c13aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016affd640 1 -- 172.21.15.83:0/4252906181 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016c1f7f20 con 0x7f016c153160 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016b7fe640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0158005c00 0x7f016c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016bfff640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f016c13a5f0 0x7f016c13aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016affd640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f016c153160 0x7f016c1f79e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f015400e820 tx=0x7f015400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f0163fff640 1 -- 172.21.15.83:0/4252906181 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154017070 con 0x7f016c153160 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f0163fff640 1 -- 172.21.15.83:0/4252906181 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015400c940 con 0x7f016c153160 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f0163fff640 1 -- 172.21.15.83:0/4252906181 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015400cd30 con 0x7f016c153160 2024-03-30T13:11:12.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f01721ab640 1 -- 172.21.15.83:0/4252906181 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f016c1390f0 con 0x7f016c153160 2024-03-30T13:11:12.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f01721ab640 1 -- 172.21.15.83:0/4252906181 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f016c1396b0 con 0x7f016c153160 2024-03-30T13:11:12.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f0163fff640 1 -- 172.21.15.83:0/4252906181 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f015401a070 con 0x7f016c153160 2024-03-30T13:11:12.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f0163fff640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f014c067fc0 0x7f014c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f0163fff640 1 -- 172.21.15.83:0/4252906181 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0154086330 con 0x7f016c153160 2024-03-30T13:11:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.856+0000 7f016b7fe640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f014c067fc0 0x7f014c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016b7fe640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f014c067fc0 0x7f014c06a480 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0158007a00 tx=0x7f01640011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f017532d000 1 Processor -- start 2024-03-30T13:11:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f017532d000 1 -- start start 2024-03-30T13:11:12.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f017532d000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d9966d70 0x5580d9967150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f017532d000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 0x5580d991d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f017532d000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d991d830 0x5580d991dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f017532d000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5580d976baa0 con 0x5580d9967690 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f017532d000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5580d96f2af0 con 0x5580d9966d70 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f017532d000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5580d9767a50 con 0x5580d991d830 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 0x5580d991d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 0x5580d991d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38068/0 (socket says 172.21.15.83:38068) 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016affd640 1 -- 172.21.15.83:0/1400992572 learned_addr learned my addr 172.21.15.83:0/1400992572 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016b7fe640 1 --2- 172.21.15.83:0/1400992572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d9966d70 0x5580d9967150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016bfff640 1 --2- 172.21.15.83:0/1400992572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d991d830 0x5580d991dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016affd640 1 -- 172.21.15.83:0/1400992572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d991d830 msgr2=0x5580d991dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016affd640 1 --2- 172.21.15.83:0/1400992572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d991d830 0x5580d991dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016affd640 1 -- 172.21.15.83:0/1400992572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d9966d70 msgr2=0x5580d9967150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016affd640 1 --2- 172.21.15.83:0/1400992572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d9966d70 0x5580d9967150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016affd640 1 -- 172.21.15.83:0/1400992572 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d96f0d00 con 0x5580d9967690 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016b7fe640 1 --2- 172.21.15.83:0/1400992572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d9966d70 0x5580d9967150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f016affd640 1 --2- 172.21.15.83:0/1400992572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 0x5580d991d2f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f015405ea90 tx=0x7f0154055e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9cde97473fed48b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f01617fa640 1 -- 172.21.15.83:0/1400992572 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154021040 con 0x5580d9967690 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f01617fa640 1 -- 172.21.15.83:0/1400992572 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015405efc0 con 0x5580d9967690 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.860+0000 7f01617fa640 1 -- 172.21.15.83:0/1400992572 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154086070 con 0x5580d9967690 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 -- 172.21.15.83:0/1400992572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 msgr2=0x5580d991d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 --2- 172.21.15.83:0/1400992572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 0x5580d991d2f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f015405ea90 tx=0x7f0154055e40 comp rx=0 tx=0).stop 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 -- 172.21.15.83:0/1400992572 shutdown_connections 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 --2- 172.21.15.83:0/1400992572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d991d830 0x5580d991dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 --2- 172.21.15.83:0/1400992572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 0x5580d991d2f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 --2- 172.21.15.83:0/1400992572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d9966d70 0x5580d9967150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 -- 172.21.15.83:0/1400992572 >> 172.21.15.83:0/1400992572 conn(0x5580d99197e0 msgr2=0x5580d991bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 -- 172.21.15.83:0/1400992572 shutdown_connections 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 -- 172.21.15.83:0/1400992572 wait complete. 2024-03-30T13:11:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 -- start start 2024-03-30T13:11:12.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 Processor -- start 2024-03-30T13:11:12.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d991d830 0x5580d9922c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9966d70 0x5580d994bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 0x5580d994c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5580d9733270 con 0x5580d9967690 2024-03-30T13:11:12.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5580d97296a0 con 0x5580d991d830 2024-03-30T13:11:12.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5580d9703880 con 0x5580d9966d70 2024-03-30T13:11:12.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 10 client.0 _ll_register_callbacks cb 0x5580d9908490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 0x5580d994c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 0x5580d994c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38082/0 (socket says 172.21.15.83:38082) 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016bfff640 1 -- 172.21.15.83:0/531926646 learned_addr learned my addr 172.21.15.83:0/531926646 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016b7fe640 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d991d830 0x5580d9922c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016affd640 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9966d70 0x5580d994bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016bfff640 1 -- 172.21.15.83:0/531926646 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9966d70 msgr2=0x5580d994bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016bfff640 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9966d70 0x5580d994bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016bfff640 1 -- 172.21.15.83:0/531926646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d991d830 msgr2=0x5580d9922c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016bfff640 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d991d830 0x5580d9922c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016bfff640 1 -- 172.21.15.83:0/531926646 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580d9730730 con 0x5580d9967690 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016bfff640 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 0x5580d994c2e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f016c073420 tx=0x7f015c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac113a8c8dfe96b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f014a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f014a7fc640 1 -- 172.21.15.83:0/531926646 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c00fe80 con 0x5580d9967690 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f014a7fc640 1 -- 172.21.15.83:0/531926646 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f015c004d80 con 0x5580d9967690 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 -- 172.21.15.83:0/531926646 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f015405efc0 con 0x5580d9967690 2024-03-30T13:11:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f014a7fc640 1 -- 172.21.15.83:0/531926646 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f015c00d760 con 0x5580d9967690 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 10 client.6297 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 -- 172.21.15.83:0/531926646 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5580d9723ca0 con 0x5580d9967690 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f014a7fc640 1 -- 172.21.15.83:0/531926646 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015405efc0 con 0x5580d9967690 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f014a7fc640 1 -- 172.21.15.83:0/531926646 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f015c00d900 con 0x5580d9967690 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 10 client.6297 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 10 client.6297 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 20 client.6297 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580d996e5d0 0x5580d996e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 4 client.6297 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f017532d000 1 -- 172.21.15.83:0/531926646 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580d9706c90 con 0x5580d996e5d0 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016b7fe640 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580d996e5d0 0x5580d996e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f014a7fc640 10 client.6297 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.864+0000 7f016b7fe640 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580d996e5d0 0x5580d996e9b0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44e73b893e4f9de0 server_cookie=78d38aa22d18fea8 in_seq=0 out_seq=0 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f014a7fc640 1 -- 172.21.15.83:0/531926646 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5580d9706c90 con 0x5580d996e5d0 2024-03-30T13:11:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f014a7fc640 10 client.6297 handle_command_reply: tid=0 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f017532d000 1 client.6297 shutdown 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f017532d000 1 -- 172.21.15.83:0/531926646 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 msgr2=0x5580d994c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f017532d000 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 0x5580d994c2e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f016c073420 tx=0x7f015c00fc30 comp rx=0 tx=0).stop 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f017532d000 1 -- 172.21.15.83:0/531926646 shutdown_connections 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f017532d000 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580d996e5d0 0x5580d996e9b0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f017532d000 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9967690 0x5580d994c2e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f017532d000 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9966d70 0x5580d994bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f017532d000 1 --2- 172.21.15.83:0/531926646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d991d830 0x5580d9922c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f017532d000 1 -- 172.21.15.83:0/531926646 >> 172.21.15.83:0/531926646 conn(0x5580d99197e0 msgr2=0x5580d991c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f014a7fc640 0 client.6297 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f017532d000 1 -- 172.21.15.83:0/531926646 shutdown_connections 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f017532d000 1 -- 172.21.15.83:0/531926646 wait complete. 2024-03-30T13:11:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.868+0000 7f017532d000 20 client.6297 trim_cache size 0 max 16384 2024-03-30T13:11:12.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.884+0000 7f017532d000 1 Processor -- start 2024-03-30T13:11:12.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.884+0000 7f017532d000 1 -- start start 2024-03-30T13:11:12.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d991d830 0x5580d994c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9966d70 0x5580d991bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9967690 0x5580d991c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f016c1fff60 con 0x5580d9966d70 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f016c0b45d0 con 0x5580d991d830 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f016c0b3930 con 0x5580d9967690 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9966d70 0x5580d991bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9966d70 0x5580d991bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38088/0 (socket says 172.21.15.83:38088) 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016affd640 1 -- 172.21.15.83:0/384185183 learned_addr learned my addr 172.21.15.83:0/384185183 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016b7fe640 1 --2- 172.21.15.83:0/384185183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d991d830 0x5580d994c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016affd640 1 -- 172.21.15.83:0/384185183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9967690 msgr2=0x5580d991c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016affd640 1 --2- 172.21.15.83:0/384185183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9967690 0x5580d991c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016affd640 1 -- 172.21.15.83:0/384185183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d991d830 msgr2=0x5580d994c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016affd640 1 --2- 172.21.15.83:0/384185183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d991d830 0x5580d994c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016affd640 1 -- 172.21.15.83:0/384185183 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d96f2d00 con 0x5580d9966d70 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016affd640 1 --2- 172.21.15.83:0/384185183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9966d70 0x5580d991bbd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0154084850 tx=0x7f015401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe93928a1aa912ce server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f0160ff9640 1 -- 172.21.15.83:0/384185183 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154073070 con 0x5580d9966d70 2024-03-30T13:11:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f0160ff9640 1 -- 172.21.15.83:0/384185183 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0154086070 con 0x5580d9966d70 2024-03-30T13:11:12.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f0160ff9640 1 -- 172.21.15.83:0/384185183 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154021040 con 0x5580d9966d70 2024-03-30T13:11:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 -- 172.21.15.83:0/384185183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9966d70 msgr2=0x5580d991bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 --2- 172.21.15.83:0/384185183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9966d70 0x5580d991bbd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0154084850 tx=0x7f015401e000 comp rx=0 tx=0).stop 2024-03-30T13:11:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 -- 172.21.15.83:0/384185183 shutdown_connections 2024-03-30T13:11:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 --2- 172.21.15.83:0/384185183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9967690 0x5580d991c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 --2- 172.21.15.83:0/384185183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d9966d70 0x5580d991bbd0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 --2- 172.21.15.83:0/384185183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d991d830 0x5580d994c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 -- 172.21.15.83:0/384185183 >> 172.21.15.83:0/384185183 conn(0x5580d99197e0 msgr2=0x5580d997df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 -- 172.21.15.83:0/384185183 shutdown_connections 2024-03-30T13:11:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 -- 172.21.15.83:0/384185183 wait complete. 2024-03-30T13:11:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 -- start start 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 Processor -- start 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d991d830 0x5580d99d8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d9966d70 0x5580d996aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9967690 0x5580d996b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5580d9733270 con 0x5580d991d830 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f016c0b3f80 con 0x5580d9966d70 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5580d9827b00 con 0x5580d9967690 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f017532d000 10 client.0 _ll_register_callbacks cb 0x7f015c001820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d991d830 0x5580d99d8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d991d830 0x5580d99d8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38102/0 (socket says 172.21.15.83:38102) 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016b7fe640 1 -- 172.21.15.83:0/2454267495 learned_addr learned my addr 172.21.15.83:0/2454267495 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016affd640 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d9966d70 0x5580d996aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016bfff640 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9967690 0x5580d996b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016b7fe640 1 -- 172.21.15.83:0/2454267495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9967690 msgr2=0x5580d996b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016b7fe640 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9967690 0x5580d996b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016b7fe640 1 -- 172.21.15.83:0/2454267495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d9966d70 msgr2=0x5580d996aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016b7fe640 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d9966d70 0x5580d996aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.888+0000 7f016b7fe640 1 -- 172.21.15.83:0/2454267495 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580d97ecf70 con 0x5580d991d830 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f016b7fe640 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d991d830 0x5580d99d8310 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f016401c1e0 tx=0x7f016401abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a29dfa39da45af server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f014a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f014a7fc640 1 -- 172.21.15.83:0/2454267495 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01640cd030 con 0x5580d991d830 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f014a7fc640 1 -- 172.21.15.83:0/2454267495 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f01640b1040 con 0x5580d991d830 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 -- 172.21.15.83:0/2454267495 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0154086070 con 0x5580d991d830 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f014a7fc640 1 -- 172.21.15.83:0/2454267495 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f01640d9050 con 0x5580d991d830 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 10 client.6303 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 -- 172.21.15.83:0/2454267495 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5580d9712760 con 0x5580d991d830 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f014a7fc640 1 -- 172.21.15.83:0/2454267495 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0154086070 con 0x5580d991d830 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f014a7fc640 1 -- 172.21.15.83:0/2454267495 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f01640dc020 con 0x5580d991d830 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 10 client.6303 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 10 client.6303 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 20 client.6303 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580d996b550 0x5580d996b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 4 client.6303 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628417}] 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 -- 172.21.15.83:0/2454267495 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628417}) -- 0x5580d9778fe0 con 0x5580d996b550 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f016affd640 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580d996b550 0x5580d996b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f016affd640 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580d996b550 0x5580d996b960 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99e6a47082d3836d server_cookie=e3b66b6babb6cb49 in_seq=0 out_seq=0 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f014a7fc640 10 client.6303 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f014a7fc640 1 -- 172.21.15.83:0/2454267495 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3806 (crc 0 0 0) 0x5580d9778fe0 con 0x5580d996b550 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f014a7fc640 10 client.6303 handle_command_reply: tid=0 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 client.6303 shutdown 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 -- 172.21.15.83:0/2454267495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d991d830 msgr2=0x5580d99d8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d991d830 0x5580d99d8310 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f016401c1e0 tx=0x7f016401abf0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 -- 172.21.15.83:0/2454267495 shutdown_connections 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5580d9967690 0x5580d996b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5580d9966d70 0x5580d996aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x5580d996b550 0x5580d996b960 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 --2- 172.21.15.83:0/2454267495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5580d991d830 0x5580d99d8310 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 -- 172.21.15.83:0/2454267495 >> 172.21.15.83:0/2454267495 conn(0x5580d99197e0 msgr2=0x5580d997e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f014a7fc640 0 client.6303 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:12.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 -- 172.21.15.83:0/2454267495 shutdown_connections 2024-03-30T13:11:12.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 1 -- 172.21.15.83:0/2454267495 wait complete. 2024-03-30T13:11:12.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f017532d000 20 client.6303 trim_cache size 0 max 16384 2024-03-30T13:11:12.905 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:12.905 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-bufmap.h", 2024-03-30T13:11:12.905 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628417, 2024-03-30T13:11:12.905 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.646274+0000", 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.173011+0000", 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:12.906 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 925, 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.173011+0000", 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:12.907 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 925, 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:12.908 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.646274+0000" 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 925, 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.646274+0000" 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 132, 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 24, 2024-03-30T13:11:12.909 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.910 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:12.911 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.912 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.913 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:12.914 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:12.915 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:12.916 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f01721ab640 1 -- 172.21.15.83:0/4252906181 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f014c067fc0 msgr2=0x7f014c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f01721ab640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f014c067fc0 0x7f014c06a480 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0158007a00 tx=0x7f01640011a0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f01721ab640 1 -- 172.21.15.83:0/4252906181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f016c153160 msgr2=0x7f016c1f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f01721ab640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f016c153160 0x7f016c1f79e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f015400e820 tx=0x7f015400ece0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f01721ab640 1 -- 172.21.15.83:0/4252906181 shutdown_connections 2024-03-30T13:11:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f01721ab640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f014c067fc0 0x7f014c06a480 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f01721ab640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f016c13a5f0 0x7f016c13aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f01721ab640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f016c153160 0x7f016c1f79e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f01721ab640 1 --2- 172.21.15.83:0/4252906181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0158005c00 0x7f016c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f01721ab640 1 -- 172.21.15.83:0/4252906181 >> 172.21.15.83:0/4252906181 conn(0x7f016c072f00 msgr2=0x7f016c0cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f01721ab640 1 -- 172.21.15.83:0/4252906181 shutdown_connections 2024-03-30T13:11:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:12.892+0000 7f01721ab640 1 -- 172.21.15.83:0/4252906181 wait complete. 2024-03-30T13:11:12.919 DEBUG:tasks.cephfs.test_uninlining:getting inode info #19 of 23:1099511628421 2024-03-30T13:11:12.919 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628421 2024-03-30T13:11:12.919 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628421 2024-03-30T13:11:13.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.068+0000 7fc7aea9a640 1 Processor -- start 2024-03-30T13:11:13.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7aea9a640 1 -- start start 2024-03-30T13:11:13.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7aea9a640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc7a815b050 0x7fc7a8073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7aea9a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc7a806f860 0x7fc7a815b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7aea9a640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a80b31e0 con 0x7fc7a80b3ca0 2024-03-30T13:11:13.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7aea9a640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a8073ab0 con 0x7fc7a815b050 2024-03-30T13:11:13.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7aea9a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a80ad4f0 con 0x7fc7a806f860 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a7fff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc7a80b3ca0 0x7fc7a806f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57482/0 (socket says 172.21.15.83:57482) 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a7fff640 1 -- 172.21.15.83:0/6355945 learned_addr learned my addr 172.21.15.83:0/6355945 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7ac836640 1 --2- 172.21.15.83:0/6355945 >> v2:172.21.15.153:3300/0 conn(0x7fc7a815b050 0x7fc7a8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7ad037640 1 --2- 172.21.15.83:0/6355945 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc7a806f860 0x7fc7a815b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 313646137 0 0) 0x7fc7a80b31e0 con 0x7fc7a80b3ca0 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc790003530 con 0x7fc7a80b3ca0 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1801877059 0 0) 0x7fc790003530 con 0x7fc7a80b3ca0 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc7a806f860 msgr2=0x7fc7a815b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 --2- 172.21.15.83:0/6355945 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc7a806f860 0x7fc7a815b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 >> v2:172.21.15.153:3300/0 conn(0x7fc7a815b050 msgr2=0x7fc7a8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 --2- 172.21.15.83:0/6355945 >> v2:172.21.15.153:3300/0 conn(0x7fc7a815b050 0x7fc7a8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a80ad7d0 con 0x7fc7a80b3ca0 2024-03-30T13:11:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fc79c001680 con 0x7fc7a80b3ca0 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 >> v1:172.21.15.83:6789/0 conn(0x7fc7a80b3ca0 legacy=0x7fc7a806f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 --2- 172.21.15.83:0/6355945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7900039c0 0x7fc790003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 --2- 172.21.15.83:0/6355945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc790004810 0x7fc790004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 --2- 172.21.15.83:0/6355945 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc7a806f860 0x7fc7900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a8073ab0 con 0x7fc790004810 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a80ad4f0 con 0x7fc7900039c0 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc79000b9d0 con 0x7fc7a806f860 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/6355945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc790004810 0x7fc790004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a7fff640 1 -- 172.21.15.83:0/6355945 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc7a806f860 msgr2=0x7fc7900051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/6355945 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc7a806f860 0x7fc7900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a7fff640 1 -- 172.21.15.83:0/6355945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7900039c0 msgr2=0x7fc790003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/6355945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7900039c0 0x7fc790003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.072+0000 7fc7a7fff640 1 -- 172.21.15.83:0/6355945 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc790003530 con 0x7fc790004810 2024-03-30T13:11:13.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/6355945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc790004810 0x7fc790004c90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c210 tx=0x7fc79c01f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e943955d82fbc6ef server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c007d60 con 0x7fc790004810 2024-03-30T13:11:13.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c005ae0 con 0x7fc790004810 2024-03-30T13:11:13.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7a77fe640 1 -- 172.21.15.83:0/6355945 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c007070 con 0x7fc790004810 2024-03-30T13:11:13.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7aea9a640 1 -- 172.21.15.83:0/6355945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc790004810 msgr2=0x7fc790004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7aea9a640 1 --2- 172.21.15.83:0/6355945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc790004810 0x7fc790004c90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c210 tx=0x7fc79c01f3f0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7ad037640 1 -- 172.21.15.83:0/6355945 reap_dead start 2024-03-30T13:11:13.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7aea9a640 1 -- 172.21.15.83:0/6355945 shutdown_connections 2024-03-30T13:11:13.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7aea9a640 1 -- 172.21.15.83:0/6355945 >> 172.21.15.83:0/6355945 conn(0x7fc7a806b660 msgr2=0x7fc7a806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7aea9a640 1 -- 172.21.15.83:0/6355945 shutdown_connections 2024-03-30T13:11:13.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7aea9a640 1 -- 172.21.15.83:0/6355945 wait complete. 2024-03-30T13:11:13.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7aea9a640 1 Processor -- start 2024-03-30T13:11:13.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.076+0000 7fc7aea9a640 1 -- start start 2024-03-30T13:11:13.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7aea9a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc790004810 0x7fc7a81513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7aea9a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7a814e920 0x7fc7a814fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7aea9a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc7a81f3d60 0x7fc7a815ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7aea9a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a80ad1c0 con 0x7fc790004810 2024-03-30T13:11:13.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7aea9a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a80b3780 con 0x7fc7a814e920 2024-03-30T13:11:13.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7aea9a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a80b4110 con 0x7fc7a81f3d60 2024-03-30T13:11:13.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7ac836640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc790004810 0x7fc7a81513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7ac836640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc790004810 0x7fc7a81513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38112/0 (socket says 172.21.15.83:38112) 2024-03-30T13:11:13.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7ac836640 1 -- 172.21.15.83:0/714724657 learned_addr learned my addr 172.21.15.83:0/714724657 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7ac836640 1 -- 172.21.15.83:0/714724657 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc7a81f3d60 msgr2=0x7fc7a815ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7ac836640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc7a81f3d60 0x7fc7a815ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7ac836640 1 -- 172.21.15.83:0/714724657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7a814e920 msgr2=0x7fc7a814fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7a814e920 0x7fc7a814fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7ac836640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7a814e920 0x7fc7a814fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7ac836640 1 -- 172.21.15.83:0/714724657 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a814ede0 con 0x7fc790004810 2024-03-30T13:11:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7ac836640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc790004810 0x7fc7a81513b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc79800e7c0 tx=0x7fc79800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7a57fa640 1 -- 172.21.15.83:0/714724657 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798017070 con 0x7fc790004810 2024-03-30T13:11:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7a57fa640 1 -- 172.21.15.83:0/714724657 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79800c8c0 con 0x7fc790004810 2024-03-30T13:11:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7aea9a640 1 -- 172.21.15.83:0/714724657 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a814f0c0 con 0x7fc790004810 2024-03-30T13:11:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7a57fa640 1 -- 172.21.15.83:0/714724657 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79800ccb0 con 0x7fc790004810 2024-03-30T13:11:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7aea9a640 1 -- 172.21.15.83:0/714724657 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a814f680 con 0x7fc790004810 2024-03-30T13:11:13.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7a57fa640 1 -- 172.21.15.83:0/714724657 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc79801a070 con 0x7fc790004810 2024-03-30T13:11:13.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7a57fa640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc794067ff0 0x7fc79406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc794067ff0 0x7fc79406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.080+0000 7fc7a57fa640 1 -- 172.21.15.83:0/714724657 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc798086720 con 0x7fc790004810 2024-03-30T13:11:13.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc794067ff0 0x7fc79406a4b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0ae000 tx=0x7fc79c000ff0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 Processor -- start 2024-03-30T13:11:13.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- start start 2024-03-30T13:11:13.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b21c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b1d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b1d2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561d4b020aa0 con 0x561d4b21c690 2024-03-30T13:11:13.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561d4afa7af0 con 0x561d4b1d2830 2024-03-30T13:11:13.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x561d4b01ca50 con 0x561d4b21bd70 2024-03-30T13:11:13.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7a7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b1d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7a7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b1d22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38114/0 (socket says 172.21.15.83:38114) 2024-03-30T13:11:13.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7a7fff640 1 -- 172.21.15.83:0/2412592203 learned_addr learned my addr 172.21.15.83:0/2412592203 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7ac836640 1 --2- 172.21.15.83:0/2412592203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b21c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7ad037640 1 --2- 172.21.15.83:0/2412592203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b1d2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7a7fff640 1 -- 172.21.15.83:0/2412592203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 msgr2=0x561d4b21c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/2412592203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b21c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7a7fff640 1 -- 172.21.15.83:0/2412592203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 msgr2=0x561d4b1d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/2412592203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b1d2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7a7fff640 1 -- 172.21.15.83:0/2412592203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d4afa5d00 con 0x561d4b21c690 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7ad037640 1 --2- 172.21.15.83:0/2412592203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b1d2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/2412592203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b1d22f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c300 tx=0x7fc7a80ad9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916849dfe5f55b72 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc78e7fc640 1 -- 172.21.15.83:0/2412592203 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c007220 con 0x561d4b21c690 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc78e7fc640 1 -- 172.21.15.83:0/2412592203 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c0c4070 con 0x561d4b21c690 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc78e7fc640 1 -- 172.21.15.83:0/2412592203 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0075c0 con 0x561d4b21c690 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/2412592203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 msgr2=0x561d4b1d22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/2412592203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b1d22f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c300 tx=0x7fc7a80ad9a0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/2412592203 shutdown_connections 2024-03-30T13:11:13.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/2412592203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b1d2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/2412592203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b1d22f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/2412592203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b21c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/2412592203 >> 172.21.15.83:0/2412592203 conn(0x561d4b1ce7e0 msgr2=0x561d4b1d0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/2412592203 shutdown_connections 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/2412592203 wait complete. 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- start start 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 Processor -- start 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b1d7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b200da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b2012e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561d4afe8270 con 0x561d4b21c690 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561d4afde6a0 con 0x561d4b1d2830 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x561d4afb8880 con 0x561d4b21bd70 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.084+0000 7fc7b1c1c000 10 client.0 _ll_register_callbacks cb 0x561d4b1bd490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7ad037640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b2012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7ad037640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b2012e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38118/0 (socket says 172.21.15.83:38118) 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7ad037640 1 -- 172.21.15.83:0/3401190517 learned_addr learned my addr 172.21.15.83:0/3401190517 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7ac836640 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b1d7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b200da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7ad037640 1 -- 172.21.15.83:0/3401190517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 msgr2=0x561d4b200da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7ad037640 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b200da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7ad037640 1 -- 172.21.15.83:0/3401190517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 msgr2=0x561d4b1d7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7ad037640 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b1d7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7ad037640 1 -- 172.21.15.83:0/3401190517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d4afe5730 con 0x561d4b21c690 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7ad037640 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b2012e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc7a806d7b0 tx=0x7fc7a0007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c8e130e14e8ac8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7877fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7877fe640 1 -- 172.21.15.83:0/3401190517 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a001c060 con 0x561d4b21c690 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7877fe640 1 -- 172.21.15.83:0/3401190517 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc7a000f990 con 0x561d4b21c690 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/3401190517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc79c0c4070 con 0x561d4b21c690 2024-03-30T13:11:13.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7877fe640 1 -- 172.21.15.83:0/3401190517 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc7a0022050 con 0x561d4b21c690 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 10 client.6315 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/3401190517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x561d4afd8ca0 con 0x561d4b21c690 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7877fe640 1 -- 172.21.15.83:0/3401190517 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c0c4070 con 0x561d4b21c690 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7877fe640 1 -- 172.21.15.83:0/3401190517 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fc7a000fb90 con 0x561d4b21c690 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 10 client.6315 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 10 client.6315 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 20 client.6315 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d4b2235d0 0x561d4b2239b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 4 client.6315 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/3401190517 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d4afbbc90 con 0x561d4b2235d0 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7ac836640 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d4b2235d0 0x561d4b2239b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7877fe640 10 client.6315 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7ac836640 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d4b2235d0 0x561d4b2239b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a739f7748064dde6 server_cookie=efa791a485fb0f03 in_seq=0 out_seq=0 2024-03-30T13:11:13.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7877fe640 1 -- 172.21.15.83:0/3401190517 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x561d4afbbc90 con 0x561d4b2235d0 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7877fe640 10 client.6315 handle_command_reply: tid=0 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 client.6315 shutdown 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/3401190517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 msgr2=0x561d4b2012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b2012e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc7a806d7b0 tx=0x7fc7a0007d80 comp rx=0 tx=0).stop 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/3401190517 shutdown_connections 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d4b2235d0 0x561d4b2239b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b2012e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7877fe640 0 client.6315 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b200da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/3401190517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b1d7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/3401190517 >> 172.21.15.83:0/3401190517 conn(0x561d4b1ce7e0 msgr2=0x561d4b1d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/3401190517 shutdown_connections 2024-03-30T13:11:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/3401190517 wait complete. 2024-03-30T13:11:13.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.088+0000 7fc7b1c1c000 20 client.6315 trim_cache size 0 max 16384 2024-03-30T13:11:13.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 Processor -- start 2024-03-30T13:11:13.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- start start 2024-03-30T13:11:13.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b1d2830 0x561d4b24bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b24c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b21c690 0x561d4b24c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a81ff100 con 0x561d4b1d2830 2024-03-30T13:11:13.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a806e7e0 con 0x561d4b21c690 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a815bf30 con 0x561d4b21bd70 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ac836640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b1d2830 0x561d4b24bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ac836640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b1d2830 0x561d4b24bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38124/0 (socket says 172.21.15.83:38124) 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ac836640 1 -- 172.21.15.83:0/120808552 learned_addr learned my addr 172.21.15.83:0/120808552 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ac836640 1 -- 172.21.15.83:0/120808552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 msgr2=0x561d4b24c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ac836640 1 --2- 172.21.15.83:0/120808552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b24c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ac836640 1 -- 172.21.15.83:0/120808552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b21c690 msgr2=0x561d4b24c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ac836640 1 --2- 172.21.15.83:0/120808552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b21c690 0x561d4b24c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ac836640 1 -- 172.21.15.83:0/120808552 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d4afa7d00 con 0x561d4b1d2830 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ac836640 1 --2- 172.21.15.83:0/120808552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b1d2830 0x561d4b24bcb0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc798056750 tx=0x7fc79805d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617695cf5af1e70d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc78dffb640 1 -- 172.21.15.83:0/120808552 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798083070 con 0x561d4b1d2830 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc78dffb640 1 -- 172.21.15.83:0/120808552 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc798084cc0 con 0x561d4b1d2830 2024-03-30T13:11:13.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc78dffb640 1 -- 172.21.15.83:0/120808552 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798021040 con 0x561d4b1d2830 2024-03-30T13:11:13.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/120808552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b1d2830 msgr2=0x561d4b24bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/120808552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b1d2830 0x561d4b24bcb0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc798056750 tx=0x7fc79805d040 comp rx=0 tx=0).stop 2024-03-30T13:11:13.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/120808552 shutdown_connections 2024-03-30T13:11:13.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/120808552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b21c690 0x561d4b24c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/120808552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b24c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/120808552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b1d2830 0x561d4b24bcb0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/120808552 >> 172.21.15.83:0/120808552 conn(0x561d4b1ce7e0 msgr2=0x561d4b232f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/120808552 shutdown_connections 2024-03-30T13:11:13.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/120808552 wait complete. 2024-03-30T13:11:13.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- start start 2024-03-30T13:11:13.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 Processor -- start 2024-03-30T13:11:13.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b28ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b28efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b28f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561d4afe8270 con 0x561d4b21c690 2024-03-30T13:11:13.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a806e190 con 0x561d4b1d2830 2024-03-30T13:11:13.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x561d4afea450 con 0x561d4b21bd70 2024-03-30T13:11:13.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7b1c1c000 10 client.0 _ll_register_callbacks cb 0x7fc7a0009270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:13.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ad037640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b28f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ad037640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b28f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38128/0 (socket says 172.21.15.83:38128) 2024-03-30T13:11:13.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ad037640 1 -- 172.21.15.83:0/380388119 learned_addr learned my addr 172.21.15.83:0/380388119 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b28efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ac836640 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b28ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ad037640 1 -- 172.21.15.83:0/380388119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 msgr2=0x561d4b28efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ad037640 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b28efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ad037640 1 -- 172.21.15.83:0/380388119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 msgr2=0x561d4b28ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ad037640 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b28ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ad037640 1 -- 172.21.15.83:0/380388119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d4b0a1f70 con 0x561d4b21c690 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ac836640 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b28ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7a7fff640 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b28efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7ad037640 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b28f4f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0017440 tx=0x7fc7a0004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac37d10858257d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.104+0000 7fc7877fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7877fe640 1 -- 172.21.15.83:0/380388119 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0003ba0 con 0x561d4b21c690 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7877fe640 1 -- 172.21.15.83:0/380388119 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc7a0003d40 con 0x561d4b21c690 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/380388119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc798084cc0 con 0x561d4b21c690 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7877fe640 1 -- 172.21.15.83:0/380388119 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc7a0033050 con 0x561d4b21c690 2024-03-30T13:11:13.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 10 client.6321 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/380388119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x561d4afc7760 con 0x561d4b21c690 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7877fe640 1 -- 172.21.15.83:0/380388119 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc798084cc0 con 0x561d4b21c690 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7877fe640 1 -- 172.21.15.83:0/380388119 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fc7a0036020 con 0x561d4b21c690 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 10 client.6321 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 10 client.6321 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 20 client.6321 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d4b28fa30 0x561d4b28fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 4 client.6321 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628421}] 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/380388119 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628421}) -- 0x561d4b02dfe0 con 0x561d4b28fa30 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7ac836640 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d4b28fa30 0x561d4b28fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7877fe640 10 client.6321 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7ac836640 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d4b28fa30 0x561d4b28fe10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c950c184846ca06 server_cookie=50844389f4cc7d14 in_seq=0 out_seq=0 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7877fe640 1 -- 172.21.15.83:0/380388119 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3807 (crc 0 0 0) 0x561d4b02dfe0 con 0x561d4b28fa30 2024-03-30T13:11:13.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7877fe640 10 client.6321 handle_command_reply: tid=0 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 client.6321 shutdown 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/380388119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 msgr2=0x561d4b28f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b28f4f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0017440 tx=0x7fc7a0004a50 comp rx=0 tx=0).stop 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/380388119 shutdown_connections 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x561d4b28fa30 0x561d4b28fe10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561d4b21c690 0x561d4b28f4f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x561d4b21bd70 0x561d4b28efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7877fe640 0 client.6321 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 --2- 172.21.15.83:0/380388119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561d4b1d2830 0x561d4b28ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/380388119 >> 172.21.15.83:0/380388119 conn(0x561d4b1ce7e0 msgr2=0x561d4b233620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/380388119 shutdown_connections 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 1 -- 172.21.15.83:0/380388119 wait complete. 2024-03-30T13:11:13.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7b1c1c000 20 client.6321 trim_cache size 0 max 16384 2024-03-30T13:11:13.122 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:13.122 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-debugfs.h", 2024-03-30T13:11:13.122 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628421, 2024-03-30T13:11:13.122 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:13.122 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.741505+0000", 2024-03-30T13:11:13.122 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.180674+0000", 2024-03-30T13:11:13.122 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:13.122 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:13.122 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:13.122 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:13.122 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:13.123 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 311, 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.180674+0000", 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:13.124 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 311, 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.741505+0000" 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.125 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 311, 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.741505+0000" 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 226, 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 32, 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:13.126 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:13.127 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:13.128 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.129 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:13.130 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:13.131 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:13.132 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:13.133 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:13.133 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:13.133 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:13.133 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:13.133 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.133 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:13.133 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:13.133 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:13.133 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:13.133 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:13.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7aea9a640 1 -- 172.21.15.83:0/714724657 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc794067ff0 msgr2=0x7fc79406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7aea9a640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc794067ff0 0x7fc79406a4b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0ae000 tx=0x7fc79c000ff0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7aea9a640 1 -- 172.21.15.83:0/714724657 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc790004810 msgr2=0x7fc7a81513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7aea9a640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc790004810 0x7fc7a81513b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc79800e7c0 tx=0x7fc79800ec80 comp rx=0 tx=0).stop 2024-03-30T13:11:13.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7aea9a640 1 -- 172.21.15.83:0/714724657 shutdown_connections 2024-03-30T13:11:13.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7aea9a640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc794067ff0 0x7fc79406a4b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7aea9a640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc7a81f3d60 0x7fc7a815ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7aea9a640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7a814e920 0x7fc7a814fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7aea9a640 1 --2- 172.21.15.83:0/714724657 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc790004810 0x7fc7a81513b0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7aea9a640 1 -- 172.21.15.83:0/714724657 >> 172.21.15.83:0/714724657 conn(0x7fc7a806b660 msgr2=0x7fc7a81597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7aea9a640 1 -- 172.21.15.83:0/714724657 shutdown_connections 2024-03-30T13:11:13.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.108+0000 7fc7aea9a640 1 -- 172.21.15.83:0/714724657 wait complete. 2024-03-30T13:11:13.136 DEBUG:tasks.cephfs.test_uninlining:getting inode info #20 of 23:1099511628422 2024-03-30T13:11:13.136 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628422 2024-03-30T13:11:13.136 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628422 2024-03-30T13:11:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda45e90640 1 Processor -- start 2024-03-30T13:11:13.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda45e90640 1 -- start start 2024-03-30T13:11:13.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda45e90640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fda40161d30 0x7fda4015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda45e90640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda4006bd70 0x7fda40147620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda45e90640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda40146580 con 0x7fda400b2430 2024-03-30T13:11:13.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda45e90640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fda40146860 con 0x7fda40161d30 2024-03-30T13:11:13.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda45e90640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fda40146b40 con 0x7fda4006bd70 2024-03-30T13:11:13.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda3f7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fda40161d30 0x7fda4015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda3f7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fda40161d30 0x7fda4015ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38130/0 (socket says 172.21.15.83:38130) 2024-03-30T13:11:13.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda3f7fe640 1 -- 172.21.15.83:0/155541141 learned_addr learned my addr 172.21.15.83:0/155541141 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda3f7fe640 1 -- 172.21.15.83:0/155541141 >> v2:172.21.15.153:3300/0 conn(0x7fda4006bd70 msgr2=0x7fda40147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/155541141 >> v2:172.21.15.153:3300/0 conn(0x7fda4006bd70 0x7fda40147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda3f7fe640 1 -- 172.21.15.83:0/155541141 >> v1:172.21.15.153:6789/0 conn(0x7fda400b2430 legacy=0x7fda4006b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.232+0000 7fda3f7fe640 1 -- 172.21.15.83:0/155541141 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda40146e20 con 0x7fda40161d30 2024-03-30T13:11:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/155541141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda40161d30 0x7fda4015ec80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fda400b6590 tx=0x7fda3001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c351028be9bb77a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda3effd640 1 -- 172.21.15.83:0/155541141 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda300b0070 con 0x7fda40161d30 2024-03-30T13:11:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda3effd640 1 -- 172.21.15.83:0/155541141 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda300ab600 con 0x7fda40161d30 2024-03-30T13:11:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda3effd640 1 -- 172.21.15.83:0/155541141 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda300ab9d0 con 0x7fda40161d30 2024-03-30T13:11:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 -- 172.21.15.83:0/155541141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda40161d30 msgr2=0x7fda4015ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 --2- 172.21.15.83:0/155541141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda40161d30 0x7fda4015ec80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fda400b6590 tx=0x7fda3001c420 comp rx=0 tx=0).stop 2024-03-30T13:11:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 -- 172.21.15.83:0/155541141 shutdown_connections 2024-03-30T13:11:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 --2- 172.21.15.83:0/155541141 >> v2:172.21.15.153:3300/0 conn(0x7fda4006bd70 0x7fda40147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 --2- 172.21.15.83:0/155541141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda40161d30 0x7fda4015ec80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 -- 172.21.15.83:0/155541141 >> 172.21.15.83:0/155541141 conn(0x7fda4009aa50 msgr2=0x7fda400b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 -- 172.21.15.83:0/155541141 shutdown_connections 2024-03-30T13:11:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 -- 172.21.15.83:0/155541141 wait complete. 2024-03-30T13:11:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 Processor -- start 2024-03-30T13:11:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 -- start start 2024-03-30T13:11:13.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda4006bd70 0x7fda400b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda400b2430 0x7fda40159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda40161d30 0x7fda400ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fda4016b600 con 0x7fda400b2430 2024-03-30T13:11:13.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda4016b480 con 0x7fda40161d30 2024-03-30T13:11:13.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda45e90640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fda4016b780 con 0x7fda4006bd70 2024-03-30T13:11:13.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda36ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda400b2430 0x7fda40159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda36ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda400b2430 0x7fda40159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38132/0 (socket says 172.21.15.83:38132) 2024-03-30T13:11:13.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.236+0000 7fda36ffd640 1 -- 172.21.15.83:0/3014712444 learned_addr learned my addr 172.21.15.83:0/3014712444 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda4006bd70 0x7fda400b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda3ffff640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda40161d30 0x7fda400ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda36ffd640 1 -- 172.21.15.83:0/3014712444 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda4006bd70 msgr2=0x7fda400b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda36ffd640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda4006bd70 0x7fda400b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda36ffd640 1 -- 172.21.15.83:0/3014712444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda40161d30 msgr2=0x7fda400ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda36ffd640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda40161d30 0x7fda400ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda36ffd640 1 -- 172.21.15.83:0/3014712444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4013d9f0 con 0x7fda400b2430 2024-03-30T13:11:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda36ffd640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda400b2430 0x7fda40159c50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fda2800c490 tx=0x7fda28001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda3cff9640 1 -- 172.21.15.83:0/3014712444 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda28017070 con 0x7fda400b2430 2024-03-30T13:11:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda3cff9640 1 -- 172.21.15.83:0/3014712444 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda28003600 con 0x7fda400b2430 2024-03-30T13:11:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda45e90640 1 -- 172.21.15.83:0/3014712444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda40158e90 con 0x7fda400b2430 2024-03-30T13:11:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda3cff9640 1 -- 172.21.15.83:0/3014712444 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda28003a30 con 0x7fda400b2430 2024-03-30T13:11:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda45e90640 1 -- 172.21.15.83:0/3014712444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda40159450 con 0x7fda400b2430 2024-03-30T13:11:13.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda3cff9640 1 -- 172.21.15.83:0/3014712444 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fda2801a070 con 0x7fda400b2430 2024-03-30T13:11:13.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda3cff9640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fda20067fc0 0x7fda2006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fda20067fc0 0x7fda2006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda3cff9640 1 -- 172.21.15.83:0/3014712444 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fda28085980 con 0x7fda400b2430 2024-03-30T13:11:13.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.240+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fda20067fc0 0x7fda2006a480 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fda300ad000 tx=0x7fda300a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 Processor -- start 2024-03-30T13:11:13.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 -- start start 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f18d70 0x55b9a9f19150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 0x55b9a9ecf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9ecf830 0x55b9a9ecfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b9a9d1daa0 con 0x55b9a9f19690 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b9a9ca4af0 con 0x55b9a9f18d70 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b9a9d19a50 con 0x55b9a9ecf830 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda36ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 0x55b9a9ecf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda36ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 0x55b9a9ecf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38144/0 (socket says 172.21.15.83:38144) 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda36ffd640 1 -- 172.21.15.83:0/36515560 learned_addr learned my addr 172.21.15.83:0/36515560 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda36ffd640 1 -- 172.21.15.83:0/36515560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9ecf830 msgr2=0x55b9a9ecfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda3ffff640 1 --2- 172.21.15.83:0/36515560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9ecf830 0x55b9a9ecfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda36ffd640 1 --2- 172.21.15.83:0/36515560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9ecf830 0x55b9a9ecfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda36ffd640 1 -- 172.21.15.83:0/36515560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f18d70 msgr2=0x55b9a9f19150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/36515560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f18d70 0x55b9a9f19150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda36ffd640 1 --2- 172.21.15.83:0/36515560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f18d70 0x55b9a9f19150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda36ffd640 1 -- 172.21.15.83:0/36515560 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9a9ca2d00 con 0x55b9a9f19690 2024-03-30T13:11:13.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda36ffd640 1 --2- 172.21.15.83:0/36515560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 0x55b9a9ecf2f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fda28083ed0 tx=0x7fda280561f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca40fadc372a778b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda357fa640 1 -- 172.21.15.83:0/36515560 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2805e610 con 0x55b9a9f19690 2024-03-30T13:11:13.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda357fa640 1 -- 172.21.15.83:0/36515560 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda28053d30 con 0x55b9a9f19690 2024-03-30T13:11:13.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda357fa640 1 -- 172.21.15.83:0/36515560 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2805c0c0 con 0x55b9a9f19690 2024-03-30T13:11:13.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 -- 172.21.15.83:0/36515560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 msgr2=0x55b9a9ecf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 --2- 172.21.15.83:0/36515560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 0x55b9a9ecf2f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fda28083ed0 tx=0x7fda280561f0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 -- 172.21.15.83:0/36515560 shutdown_connections 2024-03-30T13:11:13.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 --2- 172.21.15.83:0/36515560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9ecf830 0x55b9a9ecfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 --2- 172.21.15.83:0/36515560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 0x55b9a9ecf2f0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 --2- 172.21.15.83:0/36515560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f18d70 0x55b9a9f19150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 -- 172.21.15.83:0/36515560 >> 172.21.15.83:0/36515560 conn(0x55b9a9ecb7e0 msgr2=0x55b9a9ecdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 -- 172.21.15.83:0/36515560 shutdown_connections 2024-03-30T13:11:13.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.244+0000 7fda49012000 1 -- 172.21.15.83:0/36515560 wait complete. 2024-03-30T13:11:13.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 1 -- start start 2024-03-30T13:11:13.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 1 Processor -- start 2024-03-30T13:11:13.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9ecf830 0x55b9a9ed4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9f18d70 0x55b9a9efdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 0x55b9a9efe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b9a9ce5270 con 0x55b9a9f19690 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b9a9cdb6a0 con 0x55b9a9ecf830 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b9a9cb5880 con 0x55b9a9f18d70 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 10 client.0 _ll_register_callbacks cb 0x55b9a9eba490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 0x55b9a9efe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 0x55b9a9efe2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38154/0 (socket says 172.21.15.83:38154) 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3ffff640 1 -- 172.21.15.83:0/2357473683 learned_addr learned my addr 172.21.15.83:0/2357473683 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9ecf830 0x55b9a9ed4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda36ffd640 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9f18d70 0x55b9a9efdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3ffff640 1 -- 172.21.15.83:0/2357473683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9f18d70 msgr2=0x55b9a9efdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3ffff640 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9f18d70 0x55b9a9efdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3ffff640 1 -- 172.21.15.83:0/2357473683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9ecf830 msgr2=0x55b9a9ed4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3ffff640 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9ecf830 0x55b9a9ed4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3ffff640 1 -- 172.21.15.83:0/2357473683 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9a9ce2730 con 0x55b9a9f19690 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9ecf830 0x55b9a9ed4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3ffff640 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 0x55b9a9efe2e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fda38009a90 tx=0x7fda38009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d32e8f73df3e12 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda1e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda1e7fc640 1 -- 172.21.15.83:0/2357473683 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda380143f0 con 0x55b9a9f19690 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda1e7fc640 1 -- 172.21.15.83:0/2357473683 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fda38014590 con 0x55b9a9f19690 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 1 -- 172.21.15.83:0/2357473683 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda28053d30 con 0x55b9a9f19690 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda1e7fc640 1 -- 172.21.15.83:0/2357473683 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fda38021050 con 0x55b9a9f19690 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 10 client.6333 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 1 -- 172.21.15.83:0/2357473683 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b9a9cd5ca0 con 0x55b9a9f19690 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda1e7fc640 1 -- 172.21.15.83:0/2357473683 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda28053d30 con 0x55b9a9f19690 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda1e7fc640 1 -- 172.21.15.83:0/2357473683 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fda38024020 con 0x55b9a9f19690 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 10 client.6333 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:13.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 10 client.6333 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 20 client.6333 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9a9f205d0 0x55b9a9f209b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 4 client.6333 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda49012000 1 -- 172.21.15.83:0/2357473683 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9a9cb8c90 con 0x55b9a9f205d0 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9a9f205d0 0x55b9a9f209b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9a9f205d0 0x55b9a9f209b0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1644c9fb233e2c0c server_cookie=236a0e2701e6b3e6 in_seq=0 out_seq=0 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.248+0000 7fda1e7fc640 10 client.6333 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda1e7fc640 1 -- 172.21.15.83:0/2357473683 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b9a9cb8c90 con 0x55b9a9f205d0 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda1e7fc640 10 client.6333 handle_command_reply: tid=0 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda49012000 1 client.6333 shutdown 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda49012000 1 -- 172.21.15.83:0/2357473683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 msgr2=0x55b9a9efe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda49012000 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 0x55b9a9efe2e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fda38009a90 tx=0x7fda38009f50 comp rx=0 tx=0).stop 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda49012000 1 -- 172.21.15.83:0/2357473683 shutdown_connections 2024-03-30T13:11:13.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda49012000 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9a9f205d0 0x55b9a9f209b0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda49012000 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f19690 0x55b9a9efe2e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda1e7fc640 0 client.6333 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda49012000 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9f18d70 0x55b9a9efdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda49012000 1 --2- 172.21.15.83:0/2357473683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9ecf830 0x55b9a9ed4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda49012000 1 -- 172.21.15.83:0/2357473683 >> 172.21.15.83:0/2357473683 conn(0x55b9a9ecb7e0 msgr2=0x55b9a9ece460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda49012000 1 -- 172.21.15.83:0/2357473683 shutdown_connections 2024-03-30T13:11:13.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda49012000 1 -- 172.21.15.83:0/2357473683 wait complete. 2024-03-30T13:11:13.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.252+0000 7fda49012000 20 client.6333 trim_cache size 0 max 16384 2024-03-30T13:11:13.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda49012000 1 Processor -- start 2024-03-30T13:11:13.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda49012000 1 -- start start 2024-03-30T13:11:13.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda49012000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9ecf830 0x55b9a9efcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda49012000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f18d70 0x55b9a9efd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda49012000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9f19690 0x55b9a9efda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda49012000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fda40203fe0 con 0x55b9a9ecf830 2024-03-30T13:11:13.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda49012000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda40203020 con 0x55b9a9f18d70 2024-03-30T13:11:13.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda49012000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fda40202410 con 0x55b9a9f19690 2024-03-30T13:11:13.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda3f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9ecf830 0x55b9a9efcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda3f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9ecf830 0x55b9a9efcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38158/0 (socket says 172.21.15.83:38158) 2024-03-30T13:11:13.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda3f7fe640 1 -- 172.21.15.83:0/1021014220 learned_addr learned my addr 172.21.15.83:0/1021014220 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda3f7fe640 1 -- 172.21.15.83:0/1021014220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9f19690 msgr2=0x55b9a9efda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/1021014220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9f19690 0x55b9a9efda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda36ffd640 1 --2- 172.21.15.83:0/1021014220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f18d70 0x55b9a9efd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda3f7fe640 1 -- 172.21.15.83:0/1021014220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f18d70 msgr2=0x55b9a9efd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/1021014220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f18d70 0x55b9a9efd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda3f7fe640 1 -- 172.21.15.83:0/1021014220 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9a9ca4d00 con 0x55b9a9ecf830 2024-03-30T13:11:13.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/1021014220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9ecf830 0x55b9a9efcd50 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fda3001c460 tx=0x7fda30004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d71cf8b001ae181 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda34ff9640 1 -- 172.21.15.83:0/1021014220 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda300b0040 con 0x55b9a9ecf830 2024-03-30T13:11:13.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda34ff9640 1 -- 172.21.15.83:0/1021014220 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda300c4250 con 0x55b9a9ecf830 2024-03-30T13:11:13.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.264+0000 7fda34ff9640 1 -- 172.21.15.83:0/1021014220 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda300c4600 con 0x55b9a9ecf830 2024-03-30T13:11:13.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 -- 172.21.15.83:0/1021014220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9ecf830 msgr2=0x55b9a9efcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 --2- 172.21.15.83:0/1021014220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9ecf830 0x55b9a9efcd50 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fda3001c460 tx=0x7fda30004740 comp rx=0 tx=0).stop 2024-03-30T13:11:13.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 -- 172.21.15.83:0/1021014220 shutdown_connections 2024-03-30T13:11:13.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 --2- 172.21.15.83:0/1021014220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9f19690 0x55b9a9efda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 --2- 172.21.15.83:0/1021014220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f18d70 0x55b9a9efd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 --2- 172.21.15.83:0/1021014220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9ecf830 0x55b9a9efcd50 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 -- 172.21.15.83:0/1021014220 >> 172.21.15.83:0/1021014220 conn(0x55b9a9ecb7e0 msgr2=0x55b9a9f2f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 -- 172.21.15.83:0/1021014220 shutdown_connections 2024-03-30T13:11:13.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 -- 172.21.15.83:0/1021014220 wait complete. 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 -- start start 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 Processor -- start 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9ecf830 0x55b9a9ecefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f18d70 0x55b9a9f86300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f19690 0x55b9a9f86840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b9a9ce5270 con 0x55b9a9f18d70 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda40202a00 con 0x55b9a9f19690 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b9a9dd9b00 con 0x55b9a9ecf830 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 10 client.0 _ll_register_callbacks cb 0x7fda3800a720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda36ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f18d70 0x55b9a9f86300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda36ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f18d70 0x55b9a9f86300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38166/0 (socket says 172.21.15.83:38166) 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda36ffd640 1 -- 172.21.15.83:0/2437777494 learned_addr learned my addr 172.21.15.83:0/2437777494 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda3ffff640 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f19690 0x55b9a9f86840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9ecf830 0x55b9a9ecefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda36ffd640 1 -- 172.21.15.83:0/2437777494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9ecf830 msgr2=0x55b9a9ecefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda36ffd640 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9ecf830 0x55b9a9ecefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda36ffd640 1 -- 172.21.15.83:0/2437777494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f19690 msgr2=0x55b9a9f86840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda36ffd640 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f19690 0x55b9a9f86840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda36ffd640 1 -- 172.21.15.83:0/2437777494 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9a9d9ef70 con 0x55b9a9f18d70 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9ecf830 0x55b9a9ecefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda3ffff640 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f19690 0x55b9a9f86840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda36ffd640 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f18d70 0x55b9a9f86300 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fda2805e0e0 tx=0x7fda28014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f6a563c7f00a1d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda1e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda1e7fc640 1 -- 172.21.15.83:0/2437777494 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2805e610 con 0x55b9a9f18d70 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda1e7fc640 1 -- 172.21.15.83:0/2437777494 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fda2805c0c0 con 0x55b9a9f18d70 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 -- 172.21.15.83:0/2437777494 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda300c4250 con 0x55b9a9f18d70 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda1e7fc640 1 -- 172.21.15.83:0/2437777494 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fda2805c2e0 con 0x55b9a9f18d70 2024-03-30T13:11:13.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 10 client.6339 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda49012000 1 -- 172.21.15.83:0/2437777494 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b9a9cc4760 con 0x55b9a9f18d70 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.268+0000 7fda1e7fc640 1 -- 172.21.15.83:0/2437777494 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda300c4250 con 0x55b9a9f18d70 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda1e7fc640 1 -- 172.21.15.83:0/2437777494 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fda2805e180 con 0x55b9a9f18d70 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 10 client.6339 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 10 client.6339 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 20 client.6339 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9a9f205d0 0x55b9a9f1cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 4 client.6339 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628422}] 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 -- 172.21.15.83:0/2437777494 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628422}) -- 0x55b9a9d2afe0 con 0x55b9a9f205d0 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9a9f205d0 0x55b9a9f1cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda3f7fe640 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9a9f205d0 0x55b9a9f1cf50 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d86c84fe97701b8d server_cookie=f47fe12d1d34eaf0 in_seq=0 out_seq=0 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda1e7fc640 10 client.6339 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda1e7fc640 1 -- 172.21.15.83:0/2437777494 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3812 (crc 0 0 0) 0x55b9a9d2afe0 con 0x55b9a9f205d0 2024-03-30T13:11:13.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda1e7fc640 10 client.6339 handle_command_reply: tid=0 2024-03-30T13:11:13.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 client.6339 shutdown 2024-03-30T13:11:13.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 -- 172.21.15.83:0/2437777494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f18d70 msgr2=0x55b9a9f86300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f18d70 0x55b9a9f86300 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fda2805e0e0 tx=0x7fda28014070 comp rx=0 tx=0).stop 2024-03-30T13:11:13.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 -- 172.21.15.83:0/2437777494 shutdown_connections 2024-03-30T13:11:13.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9a9f19690 0x55b9a9f86840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b9a9f205d0 0x55b9a9f1cf50 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9a9f18d70 0x55b9a9f86300 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 --2- 172.21.15.83:0/2437777494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b9a9ecf830 0x55b9a9ecefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 -- 172.21.15.83:0/2437777494 >> 172.21.15.83:0/2437777494 conn(0x55b9a9ecb7e0 msgr2=0x55b9a9f2ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda1e7fc640 0 client.6339 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 -- 172.21.15.83:0/2437777494 shutdown_connections 2024-03-30T13:11:13.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 1 -- 172.21.15.83:0/2437777494 wait complete. 2024-03-30T13:11:13.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda49012000 20 client.6339 trim_cache size 0 max 16384 2024-03-30T13:11:13.285 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:13.285 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-dev-proto.h", 2024-03-30T13:11:13.285 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628422, 2024-03-30T13:11:13.285 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:13.285 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.745136+0000", 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.182438+0000", 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:13.286 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 2111, 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.182438+0000", 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:13.287 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 4, 2024-03-30T13:11:13.288 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:13.288 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:13.288 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:13.288 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:13.288 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:13.288 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:13.288 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.288 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:13.288 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:13.288 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:13.288 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 2111, 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.745136+0000" 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 2111, 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:13.289 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.745136+0000" 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 228, 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 34, 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:13.290 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:13.291 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:13.292 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:13.293 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:13.293 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:13.293 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:13.293 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:13.293 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:13.293 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:13.293 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:13.293 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.293 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:13.293 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:13.294 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.294 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.294 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:13.294 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.294 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.294 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.294 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.294 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.294 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.294 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.295 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.296 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.297 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:13.298 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:13.298 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:13.298 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:13.298 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda45e90640 1 -- 172.21.15.83:0/3014712444 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fda20067fc0 msgr2=0x7fda2006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda45e90640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fda20067fc0 0x7fda2006a480 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fda300ad000 tx=0x7fda300a6000 comp rx=0 tx=0).stop 2024-03-30T13:11:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda45e90640 1 -- 172.21.15.83:0/3014712444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda400b2430 msgr2=0x7fda40159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda45e90640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda400b2430 0x7fda40159c50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fda2800c490 tx=0x7fda28001e80 comp rx=0 tx=0).stop 2024-03-30T13:11:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda45e90640 1 -- 172.21.15.83:0/3014712444 shutdown_connections 2024-03-30T13:11:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda45e90640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fda20067fc0 0x7fda2006a480 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda45e90640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda40161d30 0x7fda400ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda45e90640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda400b2430 0x7fda40159c50 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda45e90640 1 --2- 172.21.15.83:0/3014712444 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda4006bd70 0x7fda400b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda45e90640 1 -- 172.21.15.83:0/3014712444 >> 172.21.15.83:0/3014712444 conn(0x7fda4009aa50 msgr2=0x7fda40160a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda45e90640 1 -- 172.21.15.83:0/3014712444 shutdown_connections 2024-03-30T13:11:13.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.272+0000 7fda45e90640 1 -- 172.21.15.83:0/3014712444 wait complete. 2024-03-30T13:11:13.300 DEBUG:tasks.cephfs.test_uninlining:getting inode info #21 of 23:1099511628407 2024-03-30T13:11:13.301 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628407 2024-03-30T13:11:13.301 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628407 2024-03-30T13:11:13.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.396+0000 7f33375ca640 1 Processor -- start 2024-03-30T13:11:13.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.396+0000 7f33375ca640 1 -- start start 2024-03-30T13:11:13.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f33375ca640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33300b1fe0 0x7f33300aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f33375ca640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33300b37a0 con 0x7f33300b4070 2024-03-30T13:11:13.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f33375ca640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33300b0af0 con 0x7f333015b570 2024-03-30T13:11:13.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f33375ca640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f333015b950 con 0x7f33300b1fe0 2024-03-30T13:11:13.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3335b67640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f33300b4070 0x7f33300b4500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57496/0 (socket says 172.21.15.83:57496) 2024-03-30T13:11:13.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3335b67640 1 -- 172.21.15.83:0/798315551 learned_addr learned my addr 172.21.15.83:0/798315551 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:13.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3334b65640 1 --2- 172.21.15.83:0/798315551 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33300b1fe0 0x7f33300aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266267 0 0) 0x7f33300b37a0 con 0x7f33300b4070 2024-03-30T13:11:13.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f331c003530 con 0x7f33300b4070 2024-03-30T13:11:13.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1247017826 0 0) 0x7f331c003530 con 0x7f33300b4070 2024-03-30T13:11:13.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33300b1fe0 msgr2=0x7f33300aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 --2- 172.21.15.83:0/798315551 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33300b1fe0 0x7f33300aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 >> v1:172.21.15.153:6789/0 conn(0x7f333015b570 legacy=0x7f33300ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33300af490 con 0x7f33300b4070 2024-03-30T13:11:13.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f3328001a00 con 0x7f33300b4070 2024-03-30T13:11:13.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 >> v1:172.21.15.83:6789/0 conn(0x7f33300b4070 legacy=0x7f33300b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 --2- 172.21.15.83:0/798315551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f331c0039f0 0x7f331c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 --2- 172.21.15.83:0/798315551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f331c004810 0x7f331c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 --2- 172.21.15.83:0/798315551 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33300b1fe0 0x7f331c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f333015b950 con 0x7f331c0039f0 2024-03-30T13:11:13.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f331c00ba80 con 0x7f331c004810 2024-03-30T13:11:13.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f331c00bc80 con 0x7f33300b1fe0 2024-03-30T13:11:13.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3335366640 1 --2- 172.21.15.83:0/798315551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f331c0039f0 0x7f331c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3335366640 1 -- 172.21.15.83:0/798315551 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33300b1fe0 msgr2=0x7f331c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3335366640 1 --2- 172.21.15.83:0/798315551 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33300b1fe0 0x7f331c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3335366640 1 -- 172.21.15.83:0/798315551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f331c004810 msgr2=0x7f331c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3335366640 1 --2- 172.21.15.83:0/798315551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f331c004810 0x7f331c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3335366640 1 -- 172.21.15.83:0/798315551 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c003530 con 0x7f331c0039f0 2024-03-30T13:11:13.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3335366640 1 --2- 172.21.15.83:0/798315551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f331c0039f0 0x7f331c003e10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3320001750 tx=0x7f332001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780457ddea39c386 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200013a0 con 0x7f331c0039f0 2024-03-30T13:11:13.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33200a4e50 con 0x7f331c0039f0 2024-03-30T13:11:13.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.400+0000 7f3327fff640 1 -- 172.21.15.83:0/798315551 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320003600 con 0x7f331c0039f0 2024-03-30T13:11:13.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 -- 172.21.15.83:0/798315551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f331c0039f0 msgr2=0x7f331c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 --2- 172.21.15.83:0/798315551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f331c0039f0 0x7f331c003e10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3320001750 tx=0x7f332001c390 comp rx=0 tx=0).stop 2024-03-30T13:11:13.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3335b67640 1 -- 172.21.15.83:0/798315551 reap_dead start 2024-03-30T13:11:13.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 -- 172.21.15.83:0/798315551 shutdown_connections 2024-03-30T13:11:13.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 -- 172.21.15.83:0/798315551 >> 172.21.15.83:0/798315551 conn(0x7f3330072d30 msgr2=0x7f33300b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 -- 172.21.15.83:0/798315551 shutdown_connections 2024-03-30T13:11:13.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 -- 172.21.15.83:0/798315551 wait complete. 2024-03-30T13:11:13.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 Processor -- start 2024-03-30T13:11:13.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 -- start start 2024-03-30T13:11:13.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f331c0039f0 0x7f33301505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f333015f7d0 0x7f3330161860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3330157420 0x7f33301578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f33300b55a0 con 0x7f331c0039f0 2024-03-30T13:11:13.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f33300b5420 con 0x7f3330157420 2024-03-30T13:11:13.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f33300b5720 con 0x7f333015f7d0 2024-03-30T13:11:13.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3335366640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f331c0039f0 0x7f33301505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3335366640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f331c0039f0 0x7f33301505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38172/0 (socket says 172.21.15.83:38172) 2024-03-30T13:11:13.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3335366640 1 -- 172.21.15.83:0/3469152112 learned_addr learned my addr 172.21.15.83:0/3469152112 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3335366640 1 -- 172.21.15.83:0/3469152112 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f333015f7d0 msgr2=0x7f3330161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3335366640 1 --2- 172.21.15.83:0/3469152112 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f333015f7d0 0x7f3330161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3335366640 1 -- 172.21.15.83:0/3469152112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3330157420 msgr2=0x7f33301578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3335366640 1 --2- 172.21.15.83:0/3469152112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3330157420 0x7f33301578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3335366640 1 -- 172.21.15.83:0/3469152112 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333015fd40 con 0x7f331c0039f0 2024-03-30T13:11:13.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3335366640 1 --2- 172.21.15.83:0/3469152112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f331c0039f0 0x7f33301505e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3320005040 tx=0x7f331c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3325ffb640 1 -- 172.21.15.83:0/3469152112 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320007040 con 0x7f331c0039f0 2024-03-30T13:11:13.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3325ffb640 1 -- 172.21.15.83:0/3469152112 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33200bb070 con 0x7f331c0039f0 2024-03-30T13:11:13.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 -- 172.21.15.83:0/3469152112 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3330160020 con 0x7f331c0039f0 2024-03-30T13:11:13.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f3325ffb640 1 -- 172.21.15.83:0/3469152112 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200073e0 con 0x7f331c0039f0 2024-03-30T13:11:13.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.404+0000 7f33375ca640 1 -- 172.21.15.83:0/3469152112 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3330159250 con 0x7f331c0039f0 2024-03-30T13:11:13.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3325ffb640 1 -- 172.21.15.83:0/3469152112 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f33200b4040 con 0x7f331c0039f0 2024-03-30T13:11:13.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3325ffb640 1 --2- 172.21.15.83:0/3469152112 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3314067fc0 0x7f331406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3334b65640 1 --2- 172.21.15.83:0/3469152112 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3314067fc0 0x7f331406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3325ffb640 1 -- 172.21.15.83:0/3469152112 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f33201203c0 con 0x7f331c0039f0 2024-03-30T13:11:13.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3334b65640 1 --2- 172.21.15.83:0/3469152112 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3314067fc0 0x7f331406a480 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f332c006e90 tx=0x7f332c006de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f333a74c000 1 Processor -- start 2024-03-30T13:11:13.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f333a74c000 1 -- start start 2024-03-30T13:11:13.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f333a74c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec4008150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f333a74c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec4008690 0x55fec3fbe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f333a74c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 0x55fec3fbec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f333a74c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fec3e0caa0 con 0x55fec4007d70 2024-03-30T13:11:13.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f333a74c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fec3d93af0 con 0x55fec3fbe830 2024-03-30T13:11:13.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f333a74c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55fec3e08a50 con 0x55fec4008690 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3335366640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec4008150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3335366640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec4008150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38182/0 (socket says 172.21.15.83:38182) 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3335366640 1 -- 172.21.15.83:0/4206218659 learned_addr learned my addr 172.21.15.83:0/4206218659 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3335366640 1 -- 172.21.15.83:0/4206218659 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec4008690 msgr2=0x55fec3fbe2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3335366640 1 --2- 172.21.15.83:0/4206218659 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec4008690 0x55fec3fbe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3335366640 1 -- 172.21.15.83:0/4206218659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 msgr2=0x55fec3fbec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3335366640 1 --2- 172.21.15.83:0/4206218659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 0x55fec3fbec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3335366640 1 -- 172.21.15.83:0/4206218659 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fec3d91d00 con 0x55fec4007d70 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f3335366640 1 --2- 172.21.15.83:0/4206218659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec4008150 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f33200f0040 tx=0x7f33200efd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be5a6d914c4ec3c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f331affd640 1 -- 172.21.15.83:0/4206218659 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200f8fb0 con 0x55fec4007d70 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f331affd640 1 -- 172.21.15.83:0/4206218659 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33200ee640 con 0x55fec4007d70 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.408+0000 7f331affd640 1 -- 172.21.15.83:0/4206218659 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33201200c0 con 0x55fec4007d70 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/4206218659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 msgr2=0x55fec4008150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- 172.21.15.83:0/4206218659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec4008150 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f33200f0040 tx=0x7f33200efd60 comp rx=0 tx=0).stop 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/4206218659 shutdown_connections 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- 172.21.15.83:0/4206218659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 0x55fec3fbec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- 172.21.15.83:0/4206218659 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec4008690 0x55fec3fbe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- 172.21.15.83:0/4206218659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec4008150 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/4206218659 >> 172.21.15.83:0/4206218659 conn(0x55fec3fba7e0 msgr2=0x55fec3fbcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/4206218659 shutdown_connections 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/4206218659 wait complete. 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- start start 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 Processor -- start 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 0x55fec3fc3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec3fecda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec4008690 0x55fec3fed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fec3dd4270 con 0x55fec4007d70 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fec3dca6a0 con 0x55fec3fbe830 2024-03-30T13:11:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55fec3da4880 con 0x55fec4008690 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 10 client.0 _ll_register_callbacks cb 0x55fec3fa9490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f3334b65640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec3fecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f3334b65640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec3fecda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38196/0 (socket says 172.21.15.83:38196) 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f3334b65640 1 -- 172.21.15.83:0/2810298762 learned_addr learned my addr 172.21.15.83:0/2810298762 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f3334b65640 1 -- 172.21.15.83:0/2810298762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec4008690 msgr2=0x55fec3fed2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f3334b65640 1 --2- 172.21.15.83:0/2810298762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec4008690 0x55fec3fed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f3334b65640 1 -- 172.21.15.83:0/2810298762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 msgr2=0x55fec3fc3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f3334b65640 1 --2- 172.21.15.83:0/2810298762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 0x55fec3fc3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f3334b65640 1 -- 172.21.15.83:0/2810298762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fec3dd1730 con 0x55fec4007d70 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f3334b65640 1 --2- 172.21.15.83:0/2810298762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec3fecda0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f332c015760 tx=0x7f332c015b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7b4059eb928036 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f330ffff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f330ffff640 1 -- 172.21.15.83:0/2810298762 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c006be0 con 0x55fec4007d70 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f330ffff640 1 -- 172.21.15.83:0/2810298762 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f332c0138d0 con 0x55fec4007d70 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/2810298762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33200ee640 con 0x55fec4007d70 2024-03-30T13:11:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f330ffff640 1 -- 172.21.15.83:0/2810298762 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f332c02c050 con 0x55fec4007d70 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 10 client.6351 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/2810298762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55fec3dc4ca0 con 0x55fec4007d70 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f330ffff640 1 -- 172.21.15.83:0/2810298762 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33200ee640 con 0x55fec4007d70 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f330ffff640 1 -- 172.21.15.83:0/2810298762 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f332c02f020 con 0x55fec4007d70 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 10 client.6351 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 10 client.6351 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 20 client.6351 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- 172.21.15.83:0/2810298762 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55fec400f5d0 0x55fec400f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 4 client.6351 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/2810298762 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fec3da7c90 con 0x55fec400f5d0 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f3335366640 1 --2- 172.21.15.83:0/2810298762 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55fec400f5d0 0x55fec400f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f330ffff640 10 client.6351 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f3335366640 1 --2- 172.21.15.83:0/2810298762 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55fec400f5d0 0x55fec400f9b0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1e85a1333453ac server_cookie=cf8c13adac92de08 in_seq=0 out_seq=0 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f330ffff640 1 -- 172.21.15.83:0/2810298762 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55fec3da7c90 con 0x55fec400f5d0 2024-03-30T13:11:13.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f330ffff640 10 client.6351 handle_command_reply: tid=0 2024-03-30T13:11:13.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 client.6351 shutdown 2024-03-30T13:11:13.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/2810298762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 msgr2=0x55fec3fecda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- 172.21.15.83:0/2810298762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec3fecda0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f332c015760 tx=0x7f332c015b60 comp rx=0 tx=0).stop 2024-03-30T13:11:13.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/2810298762 shutdown_connections 2024-03-30T13:11:13.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- 172.21.15.83:0/2810298762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec4008690 0x55fec3fed2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- 172.21.15.83:0/2810298762 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55fec400f5d0 0x55fec400f9b0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- 172.21.15.83:0/2810298762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec3fecda0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 --2- 172.21.15.83:0/2810298762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 0x55fec3fc3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f330ffff640 0 client.6351 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/2810298762 >> 172.21.15.83:0/2810298762 conn(0x55fec3fba7e0 msgr2=0x55fec3fbd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/2810298762 shutdown_connections 2024-03-30T13:11:13.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.412+0000 7f333a74c000 1 -- 172.21.15.83:0/2810298762 wait complete. 2024-03-30T13:11:13.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.416+0000 7f333a74c000 20 client.6351 trim_cache size 0 max 16384 2024-03-30T13:11:13.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 Processor -- start 2024-03-30T13:11:13.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 -- start start 2024-03-30T13:11:13.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 0x55fec3febd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec3fec290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec4008690 0x55fec3feca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3330204520 con 0x55fec4007d70 2024-03-30T13:11:13.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3330203540 con 0x55fec3fbe830 2024-03-30T13:11:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f333015a430 con 0x55fec4008690 2024-03-30T13:11:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f3334b65640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec3fec290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f3334b65640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec3fec290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38198/0 (socket says 172.21.15.83:38198) 2024-03-30T13:11:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f3334b65640 1 -- 172.21.15.83:0/4277102527 learned_addr learned my addr 172.21.15.83:0/4277102527 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f3334b65640 1 -- 172.21.15.83:0/4277102527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec4008690 msgr2=0x55fec3feca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f3335366640 1 --2- 172.21.15.83:0/4277102527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 0x55fec3febd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f3334b65640 1 --2- 172.21.15.83:0/4277102527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec4008690 0x55fec3feca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f3334b65640 1 -- 172.21.15.83:0/4277102527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 msgr2=0x55fec3febd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f3334b65640 1 --2- 172.21.15.83:0/4277102527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 0x55fec3febd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f3334b65640 1 -- 172.21.15.83:0/4277102527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fec3d93d00 con 0x55fec4007d70 2024-03-30T13:11:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f3334b65640 1 --2- 172.21.15.83:0/4277102527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec3fec290 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f332c00ea90 tx=0x7f332c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794942220c06487b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f331a7fc640 1 -- 172.21.15.83:0/4277102527 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c036070 con 0x55fec4007d70 2024-03-30T13:11:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f331a7fc640 1 -- 172.21.15.83:0/4277102527 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c024070 con 0x55fec4007d70 2024-03-30T13:11:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f331a7fc640 1 -- 172.21.15.83:0/4277102527 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c004020 con 0x55fec4007d70 2024-03-30T13:11:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 -- 172.21.15.83:0/4277102527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 msgr2=0x55fec3fec290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 --2- 172.21.15.83:0/4277102527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec3fec290 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f332c00ea90 tx=0x7f332c01c000 comp rx=0 tx=0).stop 2024-03-30T13:11:13.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 -- 172.21.15.83:0/4277102527 shutdown_connections 2024-03-30T13:11:13.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 --2- 172.21.15.83:0/4277102527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec4008690 0x55fec3feca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 --2- 172.21.15.83:0/4277102527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4007d70 0x55fec3fec290 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 --2- 172.21.15.83:0/4277102527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec3fbe830 0x55fec3febd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 -- 172.21.15.83:0/4277102527 >> 172.21.15.83:0/4277102527 conn(0x55fec3fba7e0 msgr2=0x55fec401e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 -- 172.21.15.83:0/4277102527 shutdown_connections 2024-03-30T13:11:13.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 -- 172.21.15.83:0/4277102527 wait complete. 2024-03-30T13:11:13.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.428+0000 7f333a74c000 1 -- start start 2024-03-30T13:11:13.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 Processor -- start 2024-03-30T13:11:13.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec3fbe830 0x55fec3fbdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec4007d70 0x55fec400bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4008690 0x55fec400c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fec3e0bdb0 con 0x55fec4008690 2024-03-30T13:11:13.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f333015aa80 con 0x55fec4007d70 2024-03-30T13:11:13.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55fec3da4880 con 0x55fec3fbe830 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 10 client.0 _ll_register_callbacks cb 0x7f332c0095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3335b67640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4008690 0x55fec400c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3335b67640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4008690 0x55fec400c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38200/0 (socket says 172.21.15.83:38200) 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3335b67640 1 -- 172.21.15.83:0/2045702631 learned_addr learned my addr 172.21.15.83:0/2045702631 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3335366640 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec3fbe830 0x55fec3fbdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3335b67640 1 -- 172.21.15.83:0/2045702631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec3fbe830 msgr2=0x55fec3fbdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3335b67640 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec3fbe830 0x55fec3fbdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3335b67640 1 -- 172.21.15.83:0/2045702631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec4007d70 msgr2=0x55fec400bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3334b65640 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec4007d70 0x55fec400bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3335b67640 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec4007d70 0x55fec400bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3335b67640 1 -- 172.21.15.83:0/2045702631 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fec3e8df70 con 0x55fec4008690 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3335b67640 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4008690 0x55fec400c010 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3330071db0 tx=0x7f332800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f903f021ff08a164 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f330ffff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:13.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f330ffff640 1 -- 172.21.15.83:0/2045702631 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328013450 con 0x55fec4008690 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f330ffff640 1 -- 172.21.15.83:0/2045702631 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f33280135f0 con 0x55fec4008690 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 -- 172.21.15.83:0/2045702631 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f332c024070 con 0x55fec4008690 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f330ffff640 1 -- 172.21.15.83:0/2045702631 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f332801b050 con 0x55fec4008690 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 10 client.6357 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 -- 172.21.15.83:0/2045702631 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55fec3db3760 con 0x55fec4008690 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f330ffff640 1 -- 172.21.15.83:0/2045702631 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c024070 con 0x55fec4008690 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f330ffff640 1 -- 172.21.15.83:0/2045702631 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f332801e020 con 0x55fec4008690 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 10 client.6357 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 10 client.6357 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 20 client.6357 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55fec4079630 0x55fec4079a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 4 client.6357 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628407}] 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 -- 172.21.15.83:0/2045702631 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628407}) -- 0x55fec3e19fe0 con 0x55fec4079630 2024-03-30T13:11:13.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3335366640 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55fec4079630 0x55fec4079a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f330ffff640 10 client.6357 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f3335366640 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55fec4079630 0x55fec4079a40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ac56ed1c4c7dbd1 server_cookie=ac65019885063d9b in_seq=0 out_seq=0 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f330ffff640 1 -- 172.21.15.83:0/2045702631 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3796 (crc 0 0 0) 0x55fec3e19fe0 con 0x55fec4079630 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f330ffff640 10 client.6357 handle_command_reply: tid=0 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 client.6357 shutdown 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 -- 172.21.15.83:0/2045702631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4008690 msgr2=0x55fec400c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4008690 0x55fec400c010 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3330071db0 tx=0x7f332800c810 comp rx=0 tx=0).stop 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 -- 172.21.15.83:0/2045702631 shutdown_connections 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55fec4079630 0x55fec4079a40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fec4008690 0x55fec400c010 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fec4007d70 0x55fec400bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f330ffff640 0 client.6357 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 --2- 172.21.15.83:0/2045702631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55fec3fbe830 0x55fec3fbdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 -- 172.21.15.83:0/2045702631 >> 172.21.15.83:0/2045702631 conn(0x55fec3fba7e0 msgr2=0x55fec401ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 -- 172.21.15.83:0/2045702631 shutdown_connections 2024-03-30T13:11:13.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 1 -- 172.21.15.83:0/2045702631 wait complete. 2024-03-30T13:11:13.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f333a74c000 20 client.6357 trim_cache size 0 max 16384 2024-03-30T13:11:13.454 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:13.454 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/Makefile", 2024-03-30T13:11:13.454 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628407, 2024-03-30T13:11:13.454 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:13.454 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.745749+0000", 2024-03-30T13:11:13.455 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.126837+0000", 2024-03-30T13:11:13.455 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:13.455 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:13.455 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:13.455 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:13.455 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:13.455 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:13.455 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:13.456 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:13.456 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:13.456 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.456 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:13.456 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:13.456 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:13.456 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:13.456 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:13.456 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:13.456 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.456 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:13.456 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 356, 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.126837+0000", 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.457 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 356, 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.745749+0000" 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:13.458 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.459 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 356, 2024-03-30T13:11:13.459 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:13.459 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:13.459 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:13.459 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.745749+0000" 2024-03-30T13:11:13.459 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.459 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 230, 2024-03-30T13:11:13.459 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:13.459 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:13.459 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 4, 2024-03-30T13:11:13.459 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:13.459 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:13.460 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:13.460 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:13.460 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:13.460 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:13.460 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:13.460 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.460 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:13.460 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:13.460 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:13.460 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:13.460 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:13.461 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:13.461 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.461 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:13.461 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:13.461 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:13.461 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:13.461 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:13.461 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:13.462 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.462 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:13.462 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:13.462 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:13.462 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:13.462 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.462 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:13.462 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.462 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:13.463 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:13.463 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:13.463 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:13.463 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:13.463 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:13.463 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:13.463 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:13.464 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:13.464 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:13.464 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:13.464 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:13.464 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:13.464 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.464 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:13.464 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:13.465 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.465 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.465 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:13.465 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.465 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.465 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.465 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.465 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.466 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.466 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:13.466 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:13.466 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:13.466 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:13.466 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:13.466 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:13.466 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:13.466 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.466 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.466 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.467 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:13.468 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:13.469 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:13.469 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.469 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:13.469 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:13.469 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:13.469 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:13.469 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:13.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f33375ca640 1 -- 172.21.15.83:0/3469152112 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3314067fc0 msgr2=0x7f331406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f33375ca640 1 --2- 172.21.15.83:0/3469152112 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3314067fc0 0x7f331406a480 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f332c006e90 tx=0x7f332c006de0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f33375ca640 1 -- 172.21.15.83:0/3469152112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f331c0039f0 msgr2=0x7f33301505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f33375ca640 1 --2- 172.21.15.83:0/3469152112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f331c0039f0 0x7f33301505e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3320005040 tx=0x7f331c005840 comp rx=0 tx=0).stop 2024-03-30T13:11:13.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f33375ca640 1 -- 172.21.15.83:0/3469152112 shutdown_connections 2024-03-30T13:11:13.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f33375ca640 1 --2- 172.21.15.83:0/3469152112 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3314067fc0 0x7f331406a480 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f33375ca640 1 --2- 172.21.15.83:0/3469152112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3330157420 0x7f33301578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f33375ca640 1 --2- 172.21.15.83:0/3469152112 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f333015f7d0 0x7f3330161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f33375ca640 1 --2- 172.21.15.83:0/3469152112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f331c0039f0 0x7f33301505e0 secure :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3320005040 tx=0x7f331c005840 comp rx=0 tx=0).stop 2024-03-30T13:11:13.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.432+0000 7f33375ca640 1 -- 172.21.15.83:0/3469152112 >> 172.21.15.83:0/3469152112 conn(0x7f3330072d30 msgr2=0x7f333015bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.436+0000 7f33375ca640 1 -- 172.21.15.83:0/3469152112 shutdown_connections 2024-03-30T13:11:13.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.436+0000 7f33375ca640 1 -- 172.21.15.83:0/3469152112 wait complete. 2024-03-30T13:11:13.472 DEBUG:tasks.cephfs.test_uninlining:getting inode info #22 of 23:1099511628430 2024-03-30T13:11:13.472 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628430 2024-03-30T13:11:13.472 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628430 2024-03-30T13:11:13.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f3231435640 1 Processor -- start 2024-03-30T13:11:13.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f3231435640 1 -- start start 2024-03-30T13:11:13.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f3231435640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f322c15b550 0x7f322c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f3231435640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f322c0d15a0 0x7f322c0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f3231435640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f322c0af2e0 con 0x7f322c15b170 2024-03-30T13:11:13.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f3231435640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f322c0b09b0 con 0x7f322c15b550 2024-03-30T13:11:13.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f3231435640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f322c0b40e0 con 0x7f322c0d15a0 2024-03-30T13:11:13.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f322a7fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f322c15b550 0x7f322c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f322a7fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f322c15b550 0x7f322c0afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38208/0 (socket says 172.21.15.83:38208) 2024-03-30T13:11:13.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f322a7fc640 1 -- 172.21.15.83:0/1652764017 learned_addr learned my addr 172.21.15.83:0/1652764017 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f322b7fe640 1 --2- 172.21.15.83:0/1652764017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f322c0d15a0 0x7f322c0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f322a7fc640 1 -- 172.21.15.83:0/1652764017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f322c0d15a0 msgr2=0x7f322c0b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f322a7fc640 1 --2- 172.21.15.83:0/1652764017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f322c0d15a0 0x7f322c0b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f322a7fc640 1 -- 172.21.15.83:0/1652764017 >> v1:172.21.15.153:6789/0 conn(0x7f322c15b170 legacy=0x7f322c0d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.592+0000 7f322a7fc640 1 -- 172.21.15.83:0/1652764017 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c0af5c0 con 0x7f322c15b550 2024-03-30T13:11:13.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f322a7fc640 1 --2- 172.21.15.83:0/1652764017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f322c15b550 0x7f322c0afe80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3220009870 tx=0x7f322001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86a4a01729b9769 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3229ffb640 1 -- 172.21.15.83:0/1652764017 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32200b1070 con 0x7f322c15b550 2024-03-30T13:11:13.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3229ffb640 1 -- 172.21.15.83:0/1652764017 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32200a8050 con 0x7f322c15b550 2024-03-30T13:11:13.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3229ffb640 1 -- 172.21.15.83:0/1652764017 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32200ac860 con 0x7f322c15b550 2024-03-30T13:11:13.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3231435640 1 -- 172.21.15.83:0/1652764017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f322c15b550 msgr2=0x7f322c0afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3231435640 1 --2- 172.21.15.83:0/1652764017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f322c15b550 0x7f322c0afe80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3220009870 tx=0x7f322001c4d0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3231435640 1 -- 172.21.15.83:0/1652764017 shutdown_connections 2024-03-30T13:11:13.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3231435640 1 --2- 172.21.15.83:0/1652764017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f322c0d15a0 0x7f322c0b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3231435640 1 --2- 172.21.15.83:0/1652764017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f322c15b550 0x7f322c0afe80 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3231435640 1 -- 172.21.15.83:0/1652764017 >> 172.21.15.83:0/1652764017 conn(0x7f322c09aa50 msgr2=0x7f322c0b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3231435640 1 -- 172.21.15.83:0/1652764017 shutdown_connections 2024-03-30T13:11:13.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3231435640 1 -- 172.21.15.83:0/1652764017 wait complete. 2024-03-30T13:11:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3231435640 1 Processor -- start 2024-03-30T13:11:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.596+0000 7f3231435640 1 -- start start 2024-03-30T13:11:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f3231435640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f322c0d15a0 0x7f322c0cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f3231435640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f322c15b170 0x7f322c1551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f3231435640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f322c14a780 0x7f322c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f3231435640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f322c0b5510 con 0x7f322c0d15a0 2024-03-30T13:11:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f3231435640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f322c168030 con 0x7f322c15b170 2024-03-30T13:11:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f3231435640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f322c0cf220 con 0x7f322c14a780 2024-03-30T13:11:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f322affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f322c0d15a0 0x7f322c0cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f322affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f322c0d15a0 0x7f322c0cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38210/0 (socket says 172.21.15.83:38210) 2024-03-30T13:11:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f322affd640 1 -- 172.21.15.83:0/2718679578 learned_addr learned my addr 172.21.15.83:0/2718679578 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f322a7fc640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f322c15b170 0x7f322c1551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f322b7fe640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f322c14a780 0x7f322c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f322affd640 1 -- 172.21.15.83:0/2718679578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f322c14a780 msgr2=0x7f322c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f322affd640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f322c14a780 0x7f322c1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f322affd640 1 -- 172.21.15.83:0/2718679578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f322c15b170 msgr2=0x7f322c1551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f322affd640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f322c15b170 0x7f322c1551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f322affd640 1 -- 172.21.15.83:0/2718679578 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c155730 con 0x7f322c0d15a0 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f322affd640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f322c0d15a0 0x7f322c0cece0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f321c00c3f0 tx=0x7f321c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f32137fe640 1 -- 172.21.15.83:0/2718679578 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c017070 con 0x7f322c0d15a0 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f32137fe640 1 -- 172.21.15.83:0/2718679578 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f321c0052d0 con 0x7f322c0d15a0 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f3231435640 1 -- 172.21.15.83:0/2718679578 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322c0cf450 con 0x7f322c0d15a0 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f32137fe640 1 -- 172.21.15.83:0/2718679578 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c003840 con 0x7f322c0d15a0 2024-03-30T13:11:13.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f3231435640 1 -- 172.21.15.83:0/2718679578 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f322c158ca0 con 0x7f322c0d15a0 2024-03-30T13:11:13.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f32137fe640 1 -- 172.21.15.83:0/2718679578 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f321c01a070 con 0x7f322c0d15a0 2024-03-30T13:11:13.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f32137fe640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3218067fc0 0x7f321806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f32137fe640 1 -- 172.21.15.83:0/2718679578 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5797+0+0 (secure 0 0 0) 0x7f321c085930 con 0x7f322c0d15a0 2024-03-30T13:11:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.600+0000 7f322a7fc640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3218067fc0 0x7f321806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322a7fc640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3218067fc0 0x7f321806a480 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f32200ae000 tx=0x7f3220008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 Processor -- start 2024-03-30T13:11:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 -- start start 2024-03-30T13:11:13.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5ded70 0x55b1ce5df150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 0x55b1ce5952f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce595830 0x55b1ce595c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b1ce3e3aa0 con 0x55b1ce5df690 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b1ce36aaf0 con 0x55b1ce5ded70 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b1ce3dfa50 con 0x55b1ce595830 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 0x55b1ce5952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 0x55b1ce5952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38224/0 (socket says 172.21.15.83:38224) 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322a7fc640 1 -- 172.21.15.83:0/447171591 learned_addr learned my addr 172.21.15.83:0/447171591 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322affd640 1 --2- 172.21.15.83:0/447171591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5ded70 0x55b1ce5df150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322b7fe640 1 --2- 172.21.15.83:0/447171591 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce595830 0x55b1ce595c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322a7fc640 1 -- 172.21.15.83:0/447171591 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce595830 msgr2=0x55b1ce595c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322a7fc640 1 --2- 172.21.15.83:0/447171591 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce595830 0x55b1ce595c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322a7fc640 1 -- 172.21.15.83:0/447171591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5ded70 msgr2=0x55b1ce5df150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322a7fc640 1 --2- 172.21.15.83:0/447171591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5ded70 0x55b1ce5df150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322a7fc640 1 -- 172.21.15.83:0/447171591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ce368d00 con 0x55b1ce5df690 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322b7fe640 1 --2- 172.21.15.83:0/447171591 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce595830 0x55b1ce595c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f322a7fc640 1 --2- 172.21.15.83:0/447171591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 0x55b1ce5952f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f32200af040 tx=0x7f3220004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efcad5b69c01f25b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f3210ff9640 1 -- 172.21.15.83:0/447171591 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32200c8070 con 0x55b1ce5df690 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f3210ff9640 1 -- 172.21.15.83:0/447171591 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32200a8040 con 0x55b1ce5df690 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f3210ff9640 1 -- 172.21.15.83:0/447171591 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32200b1040 con 0x55b1ce5df690 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 -- 172.21.15.83:0/447171591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 msgr2=0x55b1ce5952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 --2- 172.21.15.83:0/447171591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 0x55b1ce5952f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f32200af040 tx=0x7f3220004740 comp rx=0 tx=0).stop 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 -- 172.21.15.83:0/447171591 shutdown_connections 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 --2- 172.21.15.83:0/447171591 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce595830 0x55b1ce595c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 --2- 172.21.15.83:0/447171591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 0x55b1ce5952f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 --2- 172.21.15.83:0/447171591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5ded70 0x55b1ce5df150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 -- 172.21.15.83:0/447171591 >> 172.21.15.83:0/447171591 conn(0x55b1ce5917e0 msgr2=0x55b1ce593bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 -- 172.21.15.83:0/447171591 shutdown_connections 2024-03-30T13:11:13.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 -- 172.21.15.83:0/447171591 wait complete. 2024-03-30T13:11:13.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 -- start start 2024-03-30T13:11:13.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.604+0000 7f32345b7000 1 Processor -- start 2024-03-30T13:11:13.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 0x55b1ce59ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5ded70 0x55b1ce5c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5df690 0x55b1ce5c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b1ce3ab270 con 0x55b1ce595830 2024-03-30T13:11:13.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b1ce3a16a0 con 0x55b1ce5df690 2024-03-30T13:11:13.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b1ce37b880 con 0x55b1ce5ded70 2024-03-30T13:11:13.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 10 client.0 _ll_register_callbacks cb 0x55b1ce580490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:13.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 0x55b1ce59ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 0x55b1ce59ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38234/0 (socket says 172.21.15.83:38234) 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322affd640 1 -- 172.21.15.83:0/1203425544 learned_addr learned my addr 172.21.15.83:0/1203425544 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322a7fc640 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5ded70 0x55b1ce5c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322b7fe640 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5df690 0x55b1ce5c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322affd640 1 -- 172.21.15.83:0/1203425544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5ded70 msgr2=0x55b1ce5c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322affd640 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5ded70 0x55b1ce5c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322affd640 1 -- 172.21.15.83:0/1203425544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5df690 msgr2=0x55b1ce5c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322affd640 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5df690 0x55b1ce5c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322affd640 1 -- 172.21.15.83:0/1203425544 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1ce3a8730 con 0x55b1ce595830 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322affd640 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 0x55b1ce59ac40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f321c05e030 tx=0x7f321c0561c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3d180caafabe2d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f3209ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f3209ffb640 1 -- 172.21.15.83:0/1203425544 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c05e0d0 con 0x55b1ce595830 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f3209ffb640 1 -- 172.21.15.83:0/1203425544 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5797+0+0 (secure 0 0 0) 0x7f321c07ee70 con 0x55b1ce595830 2024-03-30T13:11:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 -- 172.21.15.83:0/1203425544 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32200a8040 con 0x55b1ce595830 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f3209ffb640 1 -- 172.21.15.83:0/1203425544 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f321c05e270 con 0x55b1ce595830 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 10 client.6369 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 -- 172.21.15.83:0/1203425544 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b1ce39bca0 con 0x55b1ce595830 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f3209ffb640 1 -- 172.21.15.83:0/1203425544 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32200a8040 con 0x55b1ce595830 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f3209ffb640 1 -- 172.21.15.83:0/1203425544 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f321c054dd0 con 0x55b1ce595830 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 10 client.6369 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 10 client.6369 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 20 client.6369 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1ce5e65d0 0x55b1ce5e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 4 client.6369 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 -- 172.21.15.83:0/1203425544 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1ce37ec90 con 0x55b1ce5e65d0 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322a7fc640 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1ce5e65d0 0x55b1ce5e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f3209ffb640 10 client.6369 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f322a7fc640 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1ce5e65d0 0x55b1ce5e69b0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75a68a273ad7e6d8 server_cookie=97d6260e7962d2fb in_seq=0 out_seq=0 2024-03-30T13:11:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f3209ffb640 1 -- 172.21.15.83:0/1203425544 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b1ce37ec90 con 0x55b1ce5e65d0 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f3209ffb640 10 client.6369 handle_command_reply: tid=0 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 client.6369 shutdown 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 -- 172.21.15.83:0/1203425544 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 msgr2=0x55b1ce59ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 0x55b1ce59ac40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f321c05e030 tx=0x7f321c0561c0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 -- 172.21.15.83:0/1203425544 shutdown_connections 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5df690 0x55b1ce5c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5ded70 0x55b1ce5c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1ce5e65d0 0x55b1ce5e69b0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 --2- 172.21.15.83:0/1203425544 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 0x55b1ce59ac40 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f3209ffb640 0 client.6369 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 -- 172.21.15.83:0/1203425544 >> 172.21.15.83:0/1203425544 conn(0x55b1ce5917e0 msgr2=0x55b1ce594460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 -- 172.21.15.83:0/1203425544 shutdown_connections 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 1 -- 172.21.15.83:0/1203425544 wait complete. 2024-03-30T13:11:13.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.608+0000 7f32345b7000 20 client.6369 trim_cache size 0 max 16384 2024-03-30T13:11:13.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 Processor -- start 2024-03-30T13:11:13.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 -- start start 2024-03-30T13:11:13.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce595830 0x55b1ce5c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5ded70 0x55b1ce593bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 0x55b1ce594110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f322c203ef0 con 0x55b1ce5df690 2024-03-30T13:11:13.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f322c202f60 con 0x55b1ce595830 2024-03-30T13:11:13.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f322c2023c0 con 0x55b1ce5ded70 2024-03-30T13:11:13.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f322b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 0x55b1ce594110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f322b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 0x55b1ce594110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38244/0 (socket says 172.21.15.83:38244) 2024-03-30T13:11:13.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f322b7fe640 1 -- 172.21.15.83:0/3097922176 learned_addr learned my addr 172.21.15.83:0/3097922176 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f322affd640 1 --2- 172.21.15.83:0/3097922176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce595830 0x55b1ce5c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f322a7fc640 1 --2- 172.21.15.83:0/3097922176 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5ded70 0x55b1ce593bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f322b7fe640 1 -- 172.21.15.83:0/3097922176 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5ded70 msgr2=0x55b1ce593bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f322b7fe640 1 --2- 172.21.15.83:0/3097922176 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5ded70 0x55b1ce593bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f322b7fe640 1 -- 172.21.15.83:0/3097922176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce595830 msgr2=0x55b1ce5c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f322b7fe640 1 --2- 172.21.15.83:0/3097922176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce595830 0x55b1ce5c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f322b7fe640 1 -- 172.21.15.83:0/3097922176 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ce36ad00 con 0x55b1ce5df690 2024-03-30T13:11:13.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f322b7fe640 1 --2- 172.21.15.83:0/3097922176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 0x55b1ce594110 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3224009d70 tx=0x7f3224007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97dd697532fa03c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f320bfff640 1 -- 172.21.15.83:0/3097922176 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322401b070 con 0x55b1ce5df690 2024-03-30T13:11:13.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f320bfff640 1 -- 172.21.15.83:0/3097922176 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3224007e10 con 0x55b1ce5df690 2024-03-30T13:11:13.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f320bfff640 1 -- 172.21.15.83:0/3097922176 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3224017840 con 0x55b1ce5df690 2024-03-30T13:11:13.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 -- 172.21.15.83:0/3097922176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 msgr2=0x55b1ce594110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 --2- 172.21.15.83:0/3097922176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 0x55b1ce594110 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3224009d70 tx=0x7f3224007700 comp rx=0 tx=0).stop 2024-03-30T13:11:13.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 -- 172.21.15.83:0/3097922176 shutdown_connections 2024-03-30T13:11:13.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 --2- 172.21.15.83:0/3097922176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce5df690 0x55b1ce594110 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 --2- 172.21.15.83:0/3097922176 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5ded70 0x55b1ce593bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 --2- 172.21.15.83:0/3097922176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce595830 0x55b1ce5c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 -- 172.21.15.83:0/3097922176 >> 172.21.15.83:0/3097922176 conn(0x55b1ce5917e0 msgr2=0x55b1ce5f5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 -- 172.21.15.83:0/3097922176 shutdown_connections 2024-03-30T13:11:13.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.624+0000 7f32345b7000 1 -- 172.21.15.83:0/3097922176 wait complete. 2024-03-30T13:11:13.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 -- start start 2024-03-30T13:11:13.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 Processor -- start 2024-03-30T13:11:13.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 0x55b1ce64cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5ded70 0x55b1ce5e2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5df690 0x55b1ce5e3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b1ce49fb00 con 0x55b1ce595830 2024-03-30T13:11:13.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f322c202910 con 0x55b1ce5ded70 2024-03-30T13:11:13.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55b1ce3ab270 con 0x55b1ce5df690 2024-03-30T13:11:13.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 10 client.0 _ll_register_callbacks cb 0x7f321c055540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:13.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 0x55b1ce64cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 0x55b1ce64cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38250/0 (socket says 172.21.15.83:38250) 2024-03-30T13:11:13.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322affd640 1 -- 172.21.15.83:0/2318320017 learned_addr learned my addr 172.21.15.83:0/2318320017 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322a7fc640 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5ded70 0x55b1ce5e2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322b7fe640 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5df690 0x55b1ce5e3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322affd640 1 -- 172.21.15.83:0/2318320017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5df690 msgr2=0x55b1ce5e3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322affd640 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5df690 0x55b1ce5e3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322affd640 1 -- 172.21.15.83:0/2318320017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5ded70 msgr2=0x55b1ce5e2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322affd640 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5ded70 0x55b1ce5e2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322affd640 1 -- 172.21.15.83:0/2318320017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1ce464f70 con 0x55b1ce595830 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322b7fe640 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5df690 0x55b1ce5e3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322affd640 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 0x55b1ce64cf20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f321c000fc0 tx=0x7f321c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56032b027bee150c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3209ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3209ffb640 1 -- 172.21.15.83:0/2318320017 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c05e0d0 con 0x55b1ce595830 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3209ffb640 1 -- 172.21.15.83:0/2318320017 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5797+0+0 (secure 0 0 0) 0x7f321c013b30 con 0x55b1ce595830 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 -- 172.21.15.83:0/2318320017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3224007e10 con 0x55b1ce595830 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3209ffb640 1 -- 172.21.15.83:0/2318320017 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f321c074340 con 0x55b1ce595830 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 10 client.6375 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 -- 172.21.15.83:0/2318320017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b1ce38a760 con 0x55b1ce595830 2024-03-30T13:11:13.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3209ffb640 1 -- 172.21.15.83:0/2318320017 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3224007e10 con 0x55b1ce595830 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3209ffb640 1 -- 172.21.15.83:0/2318320017 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f321c07d1a0 con 0x55b1ce595830 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 10 client.6375 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 10 client.6375 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 20 client.6375 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1ce5e3550 0x55b1ce5e3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 4 client.6375 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628430}] 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 -- 172.21.15.83:0/2318320017 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628430}) -- 0x55b1ce3f0fe0 con 0x55b1ce5e3550 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322a7fc640 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1ce5e3550 0x55b1ce5e3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3209ffb640 10 client.6375 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f322a7fc640 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1ce5e3550 0x55b1ce5e3960 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa826fea08fbd3bb server_cookie=e4439ee015dc4907 in_seq=0 out_seq=0 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3209ffb640 1 -- 172.21.15.83:0/2318320017 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3798 (crc 0 0 0) 0x55b1ce3f0fe0 con 0x55b1ce5e3550 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3209ffb640 10 client.6375 handle_command_reply: tid=0 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 client.6375 shutdown 2024-03-30T13:11:13.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 -- 172.21.15.83:0/2318320017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 msgr2=0x55b1ce64cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 0x55b1ce64cf20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f321c000fc0 tx=0x7f321c014040 comp rx=0 tx=0).stop 2024-03-30T13:11:13.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 -- 172.21.15.83:0/2318320017 shutdown_connections 2024-03-30T13:11:13.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55b1ce5df690 0x55b1ce5e3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1ce5ded70 0x55b1ce5e2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55b1ce5e3550 0x55b1ce5e3960 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 --2- 172.21.15.83:0/2318320017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b1ce595830 0x55b1ce64cf20 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3209ffb640 0 client.6375 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 -- 172.21.15.83:0/2318320017 >> 172.21.15.83:0/2318320017 conn(0x55b1ce5917e0 msgr2=0x55b1ce5f6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 -- 172.21.15.83:0/2318320017 shutdown_connections 2024-03-30T13:11:13.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 1 -- 172.21.15.83:0/2318320017 wait complete. 2024-03-30T13:11:13.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f32345b7000 20 client.6375 trim_cache size 0 max 16384 2024-03-30T13:11:13.645 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:13.645 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/symlink.c", 2024-03-30T13:11:13.645 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628430, 2024-03-30T13:11:13.645 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:13.645 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.746781+0000", 2024-03-30T13:11:13.645 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.211121+0000", 2024-03-30T13:11:13.645 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:13.645 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:13.645 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:13.645 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:13.646 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 497, 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.211121+0000", 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:13.647 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 497, 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.746781+0000" 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.648 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 497, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.746781+0000" 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 234, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 50, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:13.649 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:13.650 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:13.651 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.653 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:13.654 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:13.655 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:13.656 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:13.656 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:13.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3231435640 1 -- 172.21.15.83:0/2718679578 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3218067fc0 msgr2=0x7f321806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3231435640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3218067fc0 0x7f321806a480 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f32200ae000 tx=0x7f3220008040 comp rx=0 tx=0).stop 2024-03-30T13:11:13.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3231435640 1 -- 172.21.15.83:0/2718679578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f322c0d15a0 msgr2=0x7f322c0cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3231435640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f322c0d15a0 0x7f322c0cece0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f321c00c3f0 tx=0x7f321c00c8b0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3231435640 1 -- 172.21.15.83:0/2718679578 shutdown_connections 2024-03-30T13:11:13.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3231435640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3218067fc0 0x7f321806a480 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3231435640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f322c14a780 0x7f322c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3231435640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f322c15b170 0x7f322c1551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3231435640 1 --2- 172.21.15.83:0/2718679578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f322c0d15a0 0x7f322c0cece0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.628+0000 7f3231435640 1 -- 172.21.15.83:0/2718679578 >> 172.21.15.83:0/2718679578 conn(0x7f322c09aa50 msgr2=0x7f322c14d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.632+0000 7f3231435640 1 -- 172.21.15.83:0/2718679578 shutdown_connections 2024-03-30T13:11:13.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.632+0000 7f3231435640 1 -- 172.21.15.83:0/2718679578 wait complete. 2024-03-30T13:11:13.658 DEBUG:tasks.cephfs.test_uninlining:getting inode info #23 of 23:1099511628412 2024-03-30T13:11:13.658 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628412 2024-03-30T13:11:13.658 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628412 2024-03-30T13:11:13.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.776+0000 7f56eb016640 1 Processor -- start 2024-03-30T13:11:13.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56eb016640 1 -- start start 2024-03-30T13:11:13.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56eb016640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e40d31e0 0x7f56e40d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56eb016640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f56e40d1370 0x7f56e406c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56eb016640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e40d51f0 con 0x7f56e415e840 2024-03-30T13:11:13.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56eb016640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f56e415ec20 con 0x7f56e40d1370 2024-03-30T13:11:13.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56eb016640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f56e40d2d50 con 0x7f56e40d31e0 2024-03-30T13:11:13.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e8db2640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f56e415e840 0x7f56e40cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57508/0 (socket says 172.21.15.83:57508) 2024-03-30T13:11:13.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e8db2640 1 -- 172.21.15.83:0/3353804532 learned_addr learned my addr 172.21.15.83:0/3353804532 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:13.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1244298810 0 0) 0x7f56d8001120 con 0x7f56e415e840 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e95b3640 1 --2- 172.21.15.83:0/3353804532 >> v2:172.21.15.153:3300/0 conn(0x7f56e40d1370 0x7f56e406c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e3fff640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e40d31e0 0x7f56e40d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d4003530 con 0x7f56e415e840 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 758793172 0 0) 0x7f56d4003530 con 0x7f56e415e840 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e40d31e0 msgr2=0x7f56e40d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e40d31e0 0x7f56e40d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 >> v2:172.21.15.153:3300/0 conn(0x7f56e40d1370 msgr2=0x7f56e406c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 --2- 172.21.15.83:0/3353804532 >> v2:172.21.15.153:3300/0 conn(0x7f56e40d1370 0x7f56e406c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e40d2140 con 0x7f56e415e840 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f56d8001850 con 0x7f56e415e840 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 >> v1:172.21.15.83:6789/0 conn(0x7f56e415e840 legacy=0x7f56e40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56d40039c0 0x7f56d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56d4004810 0x7f56d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e40d31e0 0x7f56d40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f56e40d2d50 con 0x7f56d40039c0 2024-03-30T13:11:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f56d400bab0 con 0x7f56d4004810 2024-03-30T13:11:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f56d400bcb0 con 0x7f56e40d31e0 2024-03-30T13:11:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e8db2640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56d40039c0 0x7f56d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e3fff640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56d4004810 0x7f56d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e95b3640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e40d31e0 0x7f56d40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e8db2640 1 -- 172.21.15.83:0/3353804532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e40d31e0 msgr2=0x7f56d40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e8db2640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e40d31e0 0x7f56d40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e8db2640 1 -- 172.21.15.83:0/3353804532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56d4004810 msgr2=0x7f56d4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e8db2640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56d4004810 0x7f56d4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e8db2640 1 -- 172.21.15.83:0/3353804532 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d4003530 con 0x7f56d40039c0 2024-03-30T13:11:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e95b3640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e40d31e0 0x7f56d40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:13.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.780+0000 7f56e8db2640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56d40039c0 0x7f56d4003de0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c490 tx=0x7f56d801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970211f5b5cc798d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d800c0e0 con 0x7f56d40039c0 2024-03-30T13:11:13.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d80a9020 con 0x7f56d40039c0 2024-03-30T13:11:13.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e37fe640 1 -- 172.21.15.83:0/3353804532 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8005ae0 con 0x7f56d40039c0 2024-03-30T13:11:13.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 -- 172.21.15.83:0/3353804532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56d40039c0 msgr2=0x7f56d4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 --2- 172.21.15.83:0/3353804532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56d40039c0 0x7f56d4003de0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c490 tx=0x7f56d801cc80 comp rx=0 tx=0).stop 2024-03-30T13:11:13.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e95b3640 1 -- 172.21.15.83:0/3353804532 reap_dead start 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 -- 172.21.15.83:0/3353804532 shutdown_connections 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 -- 172.21.15.83:0/3353804532 >> 172.21.15.83:0/3353804532 conn(0x7f56e409d7f0 msgr2=0x7f56e40d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 -- 172.21.15.83:0/3353804532 shutdown_connections 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 -- 172.21.15.83:0/3353804532 wait complete. 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 Processor -- start 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 -- start start 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56d40039c0 0x7f56e40c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e415a650 0x7f56e415aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56e40b2d10 0x7f56e40b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f56e40d0320 con 0x7f56d40039c0 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f56e40d1780 con 0x7f56e40b2d10 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f56e40d04a0 con 0x7f56e415a650 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e8db2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56d40039c0 0x7f56e40c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e8db2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56d40039c0 0x7f56e40c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38272/0 (socket says 172.21.15.83:38272) 2024-03-30T13:11:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e8db2640 1 -- 172.21.15.83:0/1437448428 learned_addr learned my addr 172.21.15.83:0/1437448428 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e95b3640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56e40b2d10 0x7f56e40b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e8db2640 1 -- 172.21.15.83:0/1437448428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e415a650 msgr2=0x7f56e415aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e8db2640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e415a650 0x7f56e415aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e8db2640 1 -- 172.21.15.83:0/1437448428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56e40b2d10 msgr2=0x7f56e40b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e8db2640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56e40b2d10 0x7f56e40b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e8db2640 1 -- 172.21.15.83:0/1437448428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e40ca4f0 con 0x7f56d40039c0 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e95b3640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56e40b2d10 0x7f56e40b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e8db2640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56d40039c0 0x7f56e40c9fb0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f56d80ab040 tx=0x7f56d4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e17fa640 1 -- 172.21.15.83:0/1437448428 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d80049f0 con 0x7f56d40039c0 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e17fa640 1 -- 172.21.15.83:0/1437448428 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d8004b90 con 0x7f56d40039c0 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56e17fa640 1 -- 172.21.15.83:0/1437448428 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d80a5760 con 0x7f56d40039c0 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 -- 172.21.15.83:0/1437448428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e415ecc0 con 0x7f56d40039c0 2024-03-30T13:11:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.784+0000 7f56eb016640 1 -- 172.21.15.83:0/1437448428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e415f280 con 0x7f56d40039c0 2024-03-30T13:11:13.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e17fa640 1 -- 172.21.15.83:0/1437448428 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f56e406d470 con 0x7f56d40039c0 2024-03-30T13:11:13.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e17fa640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f56c8067fc0 0x7f56c806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e3fff640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f56c8067fc0 0x7f56c806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e17fa640 1 -- 172.21.15.83:0/1437448428 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5797+0+0 (secure 0 0 0) 0x7f56d811f360 con 0x7f56d40039c0 2024-03-30T13:11:13.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e3fff640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f56c8067fc0 0x7f56c806a480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f56e4163a30 tx=0x7f56d000b2c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56ee198000 1 Processor -- start 2024-03-30T13:11:13.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56ee198000 1 -- start start 2024-03-30T13:11:13.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56ee198000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 0x55d6e8912150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56ee198000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 0x55d6e88c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56ee198000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e88c8830 0x55d6e88c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56ee198000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55d6e8716aa0 con 0x55d6e8912690 2024-03-30T13:11:13.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56ee198000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d6e869daf0 con 0x55d6e8911d70 2024-03-30T13:11:13.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56ee198000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55d6e8712a50 con 0x55d6e88c8830 2024-03-30T13:11:13.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 0x55d6e88c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 0x55d6e88c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38274/0 (socket says 172.21.15.83:38274) 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e3fff640 1 -- 172.21.15.83:0/3961650427 learned_addr learned my addr 172.21.15.83:0/3961650427 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e95b3640 1 --2- 172.21.15.83:0/3961650427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e88c8830 0x55d6e88c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e3fff640 1 -- 172.21.15.83:0/3961650427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e88c8830 msgr2=0x55d6e88c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e3fff640 1 --2- 172.21.15.83:0/3961650427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e88c8830 0x55d6e88c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e3fff640 1 -- 172.21.15.83:0/3961650427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 msgr2=0x55d6e8912150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e8db2640 1 --2- 172.21.15.83:0/3961650427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 0x55d6e8912150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e3fff640 1 --2- 172.21.15.83:0/3961650427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 0x55d6e8912150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e3fff640 1 -- 172.21.15.83:0/3961650427 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e869bd00 con 0x55d6e8912690 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e95b3640 1 --2- 172.21.15.83:0/3961650427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e88c8830 0x55d6e88c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56e3fff640 1 --2- 172.21.15.83:0/3961650427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 0x55d6e88c82f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f56d000f9f0 tx=0x7f56d0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15432e2d863a1b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56ce7fc640 1 -- 172.21.15.83:0/3961650427 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d001b050 con 0x55d6e8912690 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56ce7fc640 1 -- 172.21.15.83:0/3961650427 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d0025070 con 0x55d6e8912690 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.788+0000 7f56ce7fc640 1 -- 172.21.15.83:0/3961650427 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0014dc0 con 0x55d6e8912690 2024-03-30T13:11:13.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 -- 172.21.15.83:0/3961650427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 msgr2=0x55d6e88c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 --2- 172.21.15.83:0/3961650427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 0x55d6e88c82f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f56d000f9f0 tx=0x7f56d0012000 comp rx=0 tx=0).stop 2024-03-30T13:11:13.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 -- 172.21.15.83:0/3961650427 shutdown_connections 2024-03-30T13:11:13.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 --2- 172.21.15.83:0/3961650427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e88c8830 0x55d6e88c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 --2- 172.21.15.83:0/3961650427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 0x55d6e88c82f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 --2- 172.21.15.83:0/3961650427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 0x55d6e8912150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 -- 172.21.15.83:0/3961650427 >> 172.21.15.83:0/3961650427 conn(0x55d6e88c47e0 msgr2=0x55d6e88c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 -- 172.21.15.83:0/3961650427 shutdown_connections 2024-03-30T13:11:13.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 -- 172.21.15.83:0/3961650427 wait complete. 2024-03-30T13:11:13.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 -- start start 2024-03-30T13:11:13.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 Processor -- start 2024-03-30T13:11:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e88c8830 0x55d6e88cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8911d70 0x55d6e88f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e8912690 0x55d6e88f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55d6e86de270 con 0x55d6e8911d70 2024-03-30T13:11:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d6e86d46a0 con 0x55d6e88c8830 2024-03-30T13:11:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55d6e86ae880 con 0x55d6e8912690 2024-03-30T13:11:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 10 client.0 _ll_register_callbacks cb 0x55d6e88b3490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56e3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8911d70 0x55d6e88f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56e3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8911d70 0x55d6e88f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38286/0 (socket says 172.21.15.83:38286) 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56e3fff640 1 -- 172.21.15.83:0/12385436 learned_addr learned my addr 172.21.15.83:0/12385436 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56e8db2640 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e88c8830 0x55d6e88cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56e3fff640 1 -- 172.21.15.83:0/12385436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e8912690 msgr2=0x55d6e88f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56e95b3640 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e8912690 0x55d6e88f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56e3fff640 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e8912690 0x55d6e88f72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56e3fff640 1 -- 172.21.15.83:0/12385436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e88c8830 msgr2=0x55d6e88cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56e3fff640 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e88c8830 0x55d6e88cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56e3fff640 1 -- 172.21.15.83:0/12385436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e86db730 con 0x55d6e8911d70 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56e3fff640 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8911d70 0x55d6e88f6da0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f56d0008010 tx=0x7f56d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25980e07ad26675 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56c37fe640 1 -- 172.21.15.83:0/12385436 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0020c80 con 0x55d6e8911d70 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56c37fe640 1 -- 172.21.15.83:0/12385436 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5797+0+0 (secure 0 0 0) 0x7f56d0034b50 con 0x55d6e8911d70 2024-03-30T13:11:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 -- 172.21.15.83:0/12385436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56d0025070 con 0x55d6e8911d70 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56c37fe640 1 -- 172.21.15.83:0/12385436 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f56d003b050 con 0x55d6e8911d70 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 10 client.6387 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.792+0000 7f56ee198000 1 -- 172.21.15.83:0/12385436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55d6e86ceca0 con 0x55d6e8911d70 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56c37fe640 1 -- 172.21.15.83:0/12385436 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d0025070 con 0x55d6e8911d70 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56c37fe640 1 -- 172.21.15.83:0/12385436 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f56d003e020 con 0x55d6e8911d70 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 10 client.6387 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 10 client.6387 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 20 client.6387 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d6e89195d0 0x55d6e89199e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 4 client.6387 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 -- 172.21.15.83:0/12385436 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6e86b1c90 con 0x55d6e89195d0 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56e8db2640 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d6e89195d0 0x55d6e89199e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56e8db2640 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d6e89195d0 0x55d6e89199e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3d60c08440b3dbd server_cookie=9a76d4947523da69 in_seq=0 out_seq=0 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56c37fe640 10 client.6387 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56c37fe640 1 -- 172.21.15.83:0/12385436 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55d6e86b1c90 con 0x55d6e89195d0 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56c37fe640 10 client.6387 handle_command_reply: tid=0 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 client.6387 shutdown 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 -- 172.21.15.83:0/12385436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8911d70 msgr2=0x55d6e88f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8911d70 0x55d6e88f6da0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f56d0008010 tx=0x7f56d0008040 comp rx=0 tx=0).stop 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 -- 172.21.15.83:0/12385436 shutdown_connections 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e8912690 0x55d6e88f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d6e89195d0 0x55d6e89199e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8911d70 0x55d6e88f6da0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 --2- 172.21.15.83:0/12385436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e88c8830 0x55d6e88cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 -- 172.21.15.83:0/12385436 >> 172.21.15.83:0/12385436 conn(0x55d6e88c47e0 msgr2=0x55d6e88c7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56c37fe640 0 client.6387 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 -- 172.21.15.83:0/12385436 shutdown_connections 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 1 -- 172.21.15.83:0/12385436 wait complete. 2024-03-30T13:11:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.796+0000 7f56ee198000 20 client.6387 trim_cache size 0 max 16384 2024-03-30T13:11:13.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 Processor -- start 2024-03-30T13:11:13.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 -- start start 2024-03-30T13:11:13.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e88c8830 0x55d6e88c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 0x55d6e88c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e8912690 0x55d6e88c7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f56e4204990 con 0x55d6e88c8830 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f56e4203a00 con 0x55d6e8911d70 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f56e40cc8e0 con 0x55d6e8912690 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56e8db2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e88c8830 0x55d6e88c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56e8db2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e88c8830 0x55d6e88c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38294/0 (socket says 172.21.15.83:38294) 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56e8db2640 1 -- 172.21.15.83:0/3443920914 learned_addr learned my addr 172.21.15.83:0/3443920914 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56e8db2640 1 -- 172.21.15.83:0/3443920914 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e8912690 msgr2=0x55d6e88c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56e8db2640 1 --2- 172.21.15.83:0/3443920914 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e8912690 0x55d6e88c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56e8db2640 1 -- 172.21.15.83:0/3443920914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 msgr2=0x55d6e88c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56e8db2640 1 --2- 172.21.15.83:0/3443920914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 0x55d6e88c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56e8db2640 1 -- 172.21.15.83:0/3443920914 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e869dd00 con 0x55d6e88c8830 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56e8db2640 1 --2- 172.21.15.83:0/3443920914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e88c8830 0x55d6e88c6bd0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f56d80ef0a0 tx=0x7f56d801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6301443c4487652 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56cdffb640 1 -- 172.21.15.83:0/3443920914 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d80bd040 con 0x55d6e88c8830 2024-03-30T13:11:13.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56cdffb640 1 -- 172.21.15.83:0/3443920914 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d80a9040 con 0x55d6e88c8830 2024-03-30T13:11:13.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56cdffb640 1 -- 172.21.15.83:0/3443920914 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d80f3750 con 0x55d6e88c8830 2024-03-30T13:11:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 -- 172.21.15.83:0/3443920914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e88c8830 msgr2=0x55d6e88c6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 --2- 172.21.15.83:0/3443920914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e88c8830 0x55d6e88c6bd0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f56d80ef0a0 tx=0x7f56d801cc80 comp rx=0 tx=0).stop 2024-03-30T13:11:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 -- 172.21.15.83:0/3443920914 shutdown_connections 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 --2- 172.21.15.83:0/3443920914 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e8912690 0x55d6e88c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 --2- 172.21.15.83:0/3443920914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 0x55d6e88c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 --2- 172.21.15.83:0/3443920914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e88c8830 0x55d6e88c6bd0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 -- 172.21.15.83:0/3443920914 >> 172.21.15.83:0/3443920914 conn(0x55d6e88c47e0 msgr2=0x55d6e8928680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 -- 172.21.15.83:0/3443920914 shutdown_connections 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 -- 172.21.15.83:0/3443920914 wait complete. 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 -- start start 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.824+0000 7f56ee198000 1 Processor -- start 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e88c8830 0x55d6e8983130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 0x55d6e8915ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 0x55d6e8916010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55d6e87d2b00 con 0x55d6e8912690 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f56e4203520 con 0x55d6e8911d70 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55d6e8929fb0 con 0x55d6e88c8830 2024-03-30T13:11:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 10 client.0 _ll_register_callbacks cb 0x7f56d000f8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e95b3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 0x55d6e8916010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e95b3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 0x55d6e8916010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38310/0 (socket says 172.21.15.83:38310) 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e95b3640 1 -- 172.21.15.83:0/3800873094 learned_addr learned my addr 172.21.15.83:0/3800873094 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e8db2640 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e88c8830 0x55d6e8983130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e3fff640 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 0x55d6e8915ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e95b3640 1 -- 172.21.15.83:0/3800873094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e88c8830 msgr2=0x55d6e8983130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e95b3640 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e88c8830 0x55d6e8983130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e95b3640 1 -- 172.21.15.83:0/3800873094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 msgr2=0x55d6e8915ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e95b3640 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 0x55d6e8915ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e95b3640 1 -- 172.21.15.83:0/3800873094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e8797f70 con 0x55d6e8912690 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e3fff640 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 0x55d6e8915ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e95b3640 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 0x55d6e8916010 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f56e408ed10 tx=0x7f56dc011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a513b7e2d03dbd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56c37fe640 1 -- 172.21.15.83:0/3800873094 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc01b020 con 0x55d6e8912690 2024-03-30T13:11:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56c37fe640 1 -- 172.21.15.83:0/3800873094 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5797+0+0 (secure 0 0 0) 0x7f56dc00f940 con 0x55d6e8912690 2024-03-30T13:11:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 -- 172.21.15.83:0/3800873094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56d80a9040 con 0x55d6e8912690 2024-03-30T13:11:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56c37fe640 1 -- 172.21.15.83:0/3800873094 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f56dc025050 con 0x55d6e8912690 2024-03-30T13:11:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 10 client.6393 fetch_fsmap learned FSMap version 18 2024-03-30T13:11:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 -- 172.21.15.83:0/3800873094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55d6e86bd760 con 0x55d6e8912690 2024-03-30T13:11:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56c37fe640 1 -- 172.21.15.83:0/3800873094 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d80a9040 con 0x55d6e8912690 2024-03-30T13:11:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56c37fe640 1 -- 172.21.15.83:0/3800873094 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f56dc028020 con 0x55d6e8912690 2024-03-30T13:11:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 10 client.6393 fetch_fsmap finished waiting for FSMap version 18 2024-03-30T13:11:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 10 client.6393 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:11:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 20 client.6393 populate_metadata read hostname 'smithi083' 2024-03-30T13:11:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d6e8916e20 0x55d6e898c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 4 client.6393 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628412}] 2024-03-30T13:11:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 -- 172.21.15.83:0/3800873094 --> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628412}) -- 0x55d6e8723fe0 con 0x55d6e8916e20 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e8db2640 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d6e8916e20 0x55d6e898c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56c37fe640 10 client.6393 ms_handle_connect on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56e8db2640 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d6e8916e20 0x55d6e898c7c0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46f268b28da6ea78 server_cookie=b2ef1abf13d03cf1 in_seq=0 out_seq=0 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56c37fe640 1 -- 172.21.15.83:0/3800873094 <== mds.0 v2:172.21.15.83:6835/1254317891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3802 (crc 0 0 0) 0x7f56d8118ef0 con 0x55d6e8916e20 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56c37fe640 10 client.6393 handle_command_reply: tid=0 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 client.6393 shutdown 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 -- 172.21.15.83:0/3800873094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 msgr2=0x55d6e8916010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 0x55d6e8916010 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f56e408ed10 tx=0x7f56dc011cc0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 -- 172.21.15.83:0/3800873094 shutdown_connections 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.83:6835/1254317891,v1:172.21.15.83:6837/1254317891] conn(0x55d6e8916e20 0x55d6e898c7c0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d6e8912690 0x55d6e8916010 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56c37fe640 0 client.6393 ms_handle_reset on v2:172.21.15.83:6835/1254317891 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6e8911d70 0x55d6e8915ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 --2- 172.21.15.83:0/3800873094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55d6e88c8830 0x55d6e8983130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 -- 172.21.15.83:0/3800873094 >> 172.21.15.83:0/3800873094 conn(0x55d6e88c47e0 msgr2=0x55d6e8928f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 -- 172.21.15.83:0/3800873094 shutdown_connections 2024-03-30T13:11:13.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 1 -- 172.21.15.83:0/3800873094 wait complete. 2024-03-30T13:11:13.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56ee198000 20 client.6393 trim_cache size 0 max 16384 2024-03-30T13:11:13.843 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:13.843 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/linux-5.4/fs/orangefs/downcall.h", 2024-03-30T13:11:13.843 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511628412, 2024-03-30T13:11:13.843 INFO:teuthology.orchestra.run.smithi083.stdout: "rdev": 0, 2024-03-30T13:11:13.843 INFO:teuthology.orchestra.run.smithi083.stdout: "ctime": "2024-03-30T13:10:37.749745+0000", 2024-03-30T13:11:13.843 INFO:teuthology.orchestra.run.smithi083.stdout: "btime": "2024-03-30T13:10:36.145817+0000", 2024-03-30T13:11:13.844 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": 33204, 2024-03-30T13:11:13.844 INFO:teuthology.orchestra.run.smithi083.stdout: "uid": 1000, 2024-03-30T13:11:13.844 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 1271, 2024-03-30T13:11:13.844 INFO:teuthology.orchestra.run.smithi083.stdout: "nlink": 1, 2024-03-30T13:11:13.844 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_layout": { 2024-03-30T13:11:13.844 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_hash": 0, 2024-03-30T13:11:13.844 INFO:teuthology.orchestra.run.smithi083.stdout: "unused1": 0, 2024-03-30T13:11:13.844 INFO:teuthology.orchestra.run.smithi083.stdout: "unused2": 0, 2024-03-30T13:11:13.844 INFO:teuthology.orchestra.run.smithi083.stdout: "unused3": 0 2024-03-30T13:11:13.844 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.844 INFO:teuthology.orchestra.run.smithi083.stdout: "layout": { 2024-03-30T13:11:13.844 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_unit": 4194304, 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "stripe_count": 1, 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "object_size": 4194304, 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_id": 5, 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ns": "" 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "old_pools": [], 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "size": 2953, 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_seq": 1, 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_from": 0, 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "truncate_pending": 0, 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "atime": "2024-03-30T13:10:36.145817+0000", 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "time_warp_seq": 1, 2024-03-30T13:11:13.845 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 3, 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "export_pin": -1, 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "quiesce_block": false, 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "client_ranges": [], 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "dirstat": { 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "mtime": "0.000000", 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "num_files": 0, 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "num_subdirs": 0, 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "change_attr": 0 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "rstat": { 2024-03-30T13:11:13.846 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 2953, 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.749745+0000" 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: "accounted_rstat": { 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 0, 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: "rbytes": 2953, 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: "rfiles": 1, 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: "rsubdirs": 0, 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: "rsnaps": 0, 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: "rctime": "2024-03-30T13:10:37.749745+0000" 2024-03-30T13:11:13.847 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.848 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 232, 2024-03-30T13:11:13.848 INFO:teuthology.orchestra.run.smithi083.stdout: "file_data_version": 0, 2024-03-30T13:11:13.848 INFO:teuthology.orchestra.run.smithi083.stdout: "xattr_version": 1, 2024-03-30T13:11:13.848 INFO:teuthology.orchestra.run.smithi083.stdout: "backtrace_version": 14, 2024-03-30T13:11:13.848 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:11:13.848 INFO:teuthology.orchestra.run.smithi083.stdout: "inline_data_length": 0, 2024-03-30T13:11:13.848 INFO:teuthology.orchestra.run.smithi083.stdout: "stray_prior_path": "", 2024-03-30T13:11:13.848 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_ever": 0, 2024-03-30T13:11:13.848 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-03-30T13:11:13.848 INFO:teuthology.orchestra.run.smithi083.stdout: "max_bytes": 0, 2024-03-30T13:11:13.848 INFO:teuthology.orchestra.run.smithi083.stdout: "max_files": 0 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: "last_scrub_version": 0, 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: "symlink": "", 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrs": [], 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtree": { 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: "splits": [] 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: "old_inodes": [], 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: "oldest_snap": 6, 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_flags": 0, 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: "is_auth": true, 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_state": { 2024-03-30T13:11:13.849 INFO:teuthology.orchestra.run.smithi083.stdout: "replicas": {} 2024-03-30T13:11:13.850 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.850 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_state": { 2024-03-30T13:11:13.850 INFO:teuthology.orchestra.run.smithi083.stdout: "authority": [ 2024-03-30T13:11:13.850 INFO:teuthology.orchestra.run.smithi083.stdout: 0, 2024-03-30T13:11:13.850 INFO:teuthology.orchestra.run.smithi083.stdout: -2 2024-03-30T13:11:13.850 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.850 INFO:teuthology.orchestra.run.smithi083.stdout: "replica_nonce": 0 2024-03-30T13:11:13.850 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.850 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_pins": 0, 2024-03-30T13:11:13.850 INFO:teuthology.orchestra.run.smithi083.stdout: "is_frozen": false, 2024-03-30T13:11:13.850 INFO:teuthology.orchestra.run.smithi083.stdout: "is_freezing": false, 2024-03-30T13:11:13.850 INFO:teuthology.orchestra.run.smithi083.stdout: "pins": { 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "ptrwaiter": 0, 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "lock": 0, 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1, 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent": 1, 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty": 1, 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "waiter": 0, 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "authpin": 0, 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubqueue": 0 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "nref": 3, 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "versionlock": { 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.851 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iversion", 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "authlock": {}, 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "linklock": {}, 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "dirfragtreelock": {}, 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "filelock": {}, 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "xattrlock": {}, 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "snaplock": {}, 2024-03-30T13:11:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: "nestlock": { 2024-03-30T13:11:13.853 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.853 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.853 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "inest", 2024-03-30T13:11:13.853 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.853 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.853 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.853 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.853 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.853 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.853 INFO:teuthology.orchestra.run.smithi083.stdout: "flocklock": {}, 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "policylock": {}, 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "quiescelock": { 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "gather_set": [], 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "lock", 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "iquiesce", 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "is_leased": false, 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rdlocks": 0, 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "num_wrlocks": 0, 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "num_xlocks": 0, 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "xlock_by": {} 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "states": [ 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "auth", 2024-03-30T13:11:13.854 INFO:teuthology.orchestra.run.smithi083.stdout: "dirty", 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtyparent", 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: "dirtypool" 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: "client_caps": [ 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: "client_id": 5400, 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: "pending": "pAsLsXsFscr", 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: "issued": "pAsLsXsFscr", 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: "wanted": "-", 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: "last_sent": 6 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: "loner": -1, 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: "want_loner": -1, 2024-03-30T13:11:13.855 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_caps_wanted": [], 2024-03-30T13:11:13.856 INFO:teuthology.orchestra.run.smithi083.stdout: "is_subvolume": false 2024-03-30T13:11:13.856 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:13.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56eb016640 1 -- 172.21.15.83:0/1437448428 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f56c8067fc0 msgr2=0x7f56c806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56eb016640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f56c8067fc0 0x7f56c806a480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f56e4163a30 tx=0x7f56d000b2c0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56eb016640 1 -- 172.21.15.83:0/1437448428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56d40039c0 msgr2=0x7f56e40c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:13.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56eb016640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56d40039c0 0x7f56e40c9fb0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f56d80ab040 tx=0x7f56d4005840 comp rx=0 tx=0).stop 2024-03-30T13:11:13.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56eb016640 1 -- 172.21.15.83:0/1437448428 shutdown_connections 2024-03-30T13:11:13.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56eb016640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f56c8067fc0 0x7f56c806a480 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56eb016640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56e40b2d10 0x7f56e40b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56eb016640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e415a650 0x7f56e415aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56eb016640 1 --2- 172.21.15.83:0/1437448428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56d40039c0 0x7f56e40c9fb0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:13.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56eb016640 1 -- 172.21.15.83:0/1437448428 >> 172.21.15.83:0/1437448428 conn(0x7f56e409d7f0 msgr2=0x7f56e415ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:13.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56eb016640 1 -- 172.21.15.83:0/1437448428 shutdown_connections 2024-03-30T13:11:13.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:13.828+0000 7f56eb016640 1 -- 172.21.15.83:0/1437448428 wait complete. 2024-03-30T13:11:13.858 DEBUG:tasks.cephfs.test_uninlining:removing dir linux-5.4 2024-03-30T13:11:13.858 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && rm -rf linux-5.4/ 2024-03-30T13:11:14.148 INFO:tasks.cephfs.test_uninlining:Found 23 files with inline_data_length == 0 2024-03-30T13:11:14.148 INFO:tasks.cephfs.test_uninlining:Found 23 files with inline_data_version == CEPH_INLINE_NONE 2024-03-30T13:11:14.148 INFO:tasks.cephfs.test_uninlining:Running Data Uninlining test with: clear cache before scrub, without unmount client, without mount.open_background, without multimds, without snapshots 2024-03-30T13:11:14.148 DEBUG:tasks.cephfs.test_uninlining:setting max_mds:1 2024-03-30T13:11:14.148 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-03-30T13:11:14.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9e0169640 1 Processor -- start 2024-03-30T13:11:14.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9e0169640 1 -- start start 2024-03-30T13:11:14.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9e0169640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc9d8145c40 0x7fc9d809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9e0169640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9d80b0690 con 0x7fc9d8160090 2024-03-30T13:11:14.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9e0169640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9d80b3520 con 0x7fc9d8160c30 2024-03-30T13:11:14.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9e0169640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc9d80ae3a0 con 0x7fc9d8145c40 2024-03-30T13:11:14.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9ddf05640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc9d8145c40 0x7fc9d809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:14.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9dd704640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc9d8160090 0x7fc9d8160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:57524/0 (socket says 172.21.15.83:57524) 2024-03-30T13:11:14.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9dd704640 1 -- 172.21.15.83:0/68736129 learned_addr learned my addr 172.21.15.83:0/68736129 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:14.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9dcf03640 1 -- 172.21.15.83:0/68736129 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 480769780 0 0) 0x7fc9d80b0690 con 0x7fc9d8160090 2024-03-30T13:11:14.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9dcf03640 1 -- 172.21.15.83:0/68736129 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9c4003530 con 0x7fc9d8160090 2024-03-30T13:11:14.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9ddf05640 1 -- 172.21.15.83:0/68736129 >> v1:172.21.15.153:6789/0 conn(0x7fc9d8160c30 legacy=0x7fc9d80b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:14.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9ddf05640 1 -- 172.21.15.83:0/68736129 >> v1:172.21.15.83:6789/0 conn(0x7fc9d8160090 legacy=0x7fc9d8160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:14.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9ddf05640 1 -- 172.21.15.83:0/68736129 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d80b3800 con 0x7fc9d8145c40 2024-03-30T13:11:14.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9ddf05640 1 --2- 172.21.15.83:0/68736129 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9d8145c40 0x7fc9d809aa50 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80097c0 tx=0x7fc9c801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edeeb6e1ee9a4986 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:14.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9dcf03640 1 -- 172.21.15.83:0/68736129 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80b0070 con 0x7fc9d8145c40 2024-03-30T13:11:14.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9dcf03640 1 -- 172.21.15.83:0/68736129 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c80ab600 con 0x7fc9d8145c40 2024-03-30T13:11:14.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.252+0000 7fc9dcf03640 1 -- 172.21.15.83:0/68736129 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80ab9d0 con 0x7fc9d8145c40 2024-03-30T13:11:14.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 -- 172.21.15.83:0/68736129 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9d8145c40 msgr2=0x7fc9d809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:14.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 --2- 172.21.15.83:0/68736129 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9d8145c40 0x7fc9d809aa50 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80097c0 tx=0x7fc9c801c460 comp rx=0 tx=0).stop 2024-03-30T13:11:14.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 -- 172.21.15.83:0/68736129 shutdown_connections 2024-03-30T13:11:14.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 --2- 172.21.15.83:0/68736129 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9d8145c40 0x7fc9d809aa50 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 -- 172.21.15.83:0/68736129 >> 172.21.15.83:0/68736129 conn(0x7fc9d8072d30 msgr2=0x7fc9d80b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:14.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 -- 172.21.15.83:0/68736129 shutdown_connections 2024-03-30T13:11:14.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 -- 172.21.15.83:0/68736129 wait complete. 2024-03-30T13:11:14.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 Processor -- start 2024-03-30T13:11:14.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 -- start start 2024-03-30T13:11:14.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9d8145c40 0x7fc9d80cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9d8160090 0x7fc9d80cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9d8160c30 0x7fc9d8144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d80b1ca0 con 0x7fc9d8160c30 2024-03-30T13:11:14.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d80b1b20 con 0x7fc9d8145c40 2024-03-30T13:11:14.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d80b1e20 con 0x7fc9d8160090 2024-03-30T13:11:14.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9de706640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9d8160c30 0x7fc9d8144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:14.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9de706640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9d8160c30 0x7fc9d8144af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38330/0 (socket says 172.21.15.83:38330) 2024-03-30T13:11:14.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9de706640 1 -- 172.21.15.83:0/833811484 learned_addr learned my addr 172.21.15.83:0/833811484 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:14.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9ddf05640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9d8145c40 0x7fc9d80cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:14.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9de706640 1 -- 172.21.15.83:0/833811484 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9d8160090 msgr2=0x7fc9d80cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:14.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9de706640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9d8160090 0x7fc9d80cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9de706640 1 -- 172.21.15.83:0/833811484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9d8145c40 msgr2=0x7fc9d80cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:14.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9de706640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9d8145c40 0x7fc9d80cfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9de706640 1 -- 172.21.15.83:0/833811484 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d80ce410 con 0x7fc9d8160c30 2024-03-30T13:11:14.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9de706640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9d8160c30 0x7fc9d8144af0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000b970 tx=0x7fc9d000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:14.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9ce7fc640 1 -- 172.21.15.83:0/833811484 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0019070 con 0x7fc9d8160c30 2024-03-30T13:11:14.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9ce7fc640 1 -- 172.21.15.83:0/833811484 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d000cb40 con 0x7fc9d8160c30 2024-03-30T13:11:14.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 -- 172.21.15.83:0/833811484 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d81fac80 con 0x7fc9d8160c30 2024-03-30T13:11:14.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9ce7fc640 1 -- 172.21.15.83:0/833811484 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0014440 con 0x7fc9d8160c30 2024-03-30T13:11:14.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 -- 172.21.15.83:0/833811484 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d81fb240 con 0x7fc9d8160c30 2024-03-30T13:11:14.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.256+0000 7fc9e0169640 1 -- 172.21.15.83:0/833811484 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d809f3d0 con 0x7fc9d8160c30 2024-03-30T13:11:14.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.260+0000 7fc9ce7fc640 1 -- 172.21.15.83:0/833811484 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc9d001c070 con 0x7fc9d8160c30 2024-03-30T13:11:14.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.260+0000 7fc9ce7fc640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc9bc067fc0 0x7fc9bc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.260+0000 7fc9ce7fc640 1 -- 172.21.15.83:0/833811484 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5797+0+0 (secure 0 0 0) 0x7fc9d0086460 con 0x7fc9d8160c30 2024-03-30T13:11:14.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.260+0000 7fc9ddf05640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc9bc067fc0 0x7fc9bc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:14.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.260+0000 7fc9ddf05640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc9bc067fc0 0x7fc9bc06a480 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80ad000 tx=0x7fc9c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:14.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.264+0000 7fc9ce7fc640 1 -- 172.21.15.83:0/833811484 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fc9d0023080 con 0x7fc9d8160c30 2024-03-30T13:11:14.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:14.452+0000 7fc9e0169640 1 -- 172.21.15.83:0/833811484 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7fc9d80b4170 con 0x7fc9d8160c30 2024-03-30T13:11:15.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.440+0000 7fc9ce7fc640 1 -- 172.21.15.83:0/833811484 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fc9d0056c90 con 0x7fc9d8160c30 2024-03-30T13:11:15.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.444+0000 7fc9e0169640 1 -- 172.21.15.83:0/833811484 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc9bc067fc0 msgr2=0x7fc9bc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:15.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.444+0000 7fc9e0169640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc9bc067fc0 0x7fc9bc06a480 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80ad000 tx=0x7fc9c8008040 comp rx=0 tx=0).stop 2024-03-30T13:11:15.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.444+0000 7fc9e0169640 1 -- 172.21.15.83:0/833811484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9d8160c30 msgr2=0x7fc9d8144af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:15.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.444+0000 7fc9e0169640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9d8160c30 0x7fc9d8144af0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000b970 tx=0x7fc9d000be30 comp rx=0 tx=0).stop 2024-03-30T13:11:15.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.444+0000 7fc9e0169640 1 -- 172.21.15.83:0/833811484 shutdown_connections 2024-03-30T13:11:15.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.444+0000 7fc9e0169640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc9bc067fc0 0x7fc9bc06a480 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:15.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.444+0000 7fc9e0169640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9d8160c30 0x7fc9d8144af0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:15.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.444+0000 7fc9e0169640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9d8160090 0x7fc9d80cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:15.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.444+0000 7fc9e0169640 1 --2- 172.21.15.83:0/833811484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9d8145c40 0x7fc9d80cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:15.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.444+0000 7fc9e0169640 1 -- 172.21.15.83:0/833811484 >> 172.21.15.83:0/833811484 conn(0x7fc9d8072d30 msgr2=0x7fc9d80b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:15.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.444+0000 7fc9e0169640 1 -- 172.21.15.83:0/833811484 shutdown_connections 2024-03-30T13:11:15.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:15.444+0000 7fc9e0169640 1 -- 172.21.15.83:0/833811484 wait complete. 2024-03-30T13:11:15.468 DEBUG:tasks.cephfs.test_uninlining:getting client_max_inline_size 2024-03-30T13:11:15.468 DEBUG:tasks.cephfs.test_uninlining:got client_max_inline_size:4096 2024-03-30T13:11:15.468 DEBUG:tasks.cephfs.test_uninlining:extracting tarball 2024-03-30T13:11:15.468 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && tar -x -z -f linux-5.4.tar.gz linux-5.4/fs/ceph linux-5.4/fs/orangefs linux-5.4/fs/ext2 2024-03-30T13:11:20.100 DEBUG:tasks.cephfs.test_uninlining:fetching dir list 2024-03-30T13:11:20.100 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -mindepth 2 -maxdepth 2 -type d 2024-03-30T13:11:20.131 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph 2024-03-30T13:11:20.131 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2 2024-03-30T13:11:20.131 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs 2024-03-30T13:11:20.131 DEBUG:tasks.cephfs.test_uninlining:distributing dir pins 2024-03-30T13:11:20.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:20.131 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ceph) 2024-03-30T13:11:20.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:20.185 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ext2) 2024-03-30T13:11:20.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:20.232 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/orangefs) 2024-03-30T13:11:20.280 DEBUG:tasks.cephfs.test_uninlining:listing files with size <= 4096 2024-03-30T13:11:20.281 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -type f -size -4097c 2024-03-30T13:11:20.364 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:11:20.364 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/Makefile 2024-03-30T13:11:20.364 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:11:20.364 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/io.h 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/Makefile 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/acl.h 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:11:20.365 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:11:20.366 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:11:20.366 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:11:20.366 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:11:20.366 INFO:teuthology.orchestra.run.smithi083.stdout:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:11:20.366 INFO:tasks.cephfs.test_uninlining:Found 23 inlined files 2024-03-30T13:11:20.366 DEBUG:tasks.cephfs.test_uninlining:clearing cache 2024-03-30T13:11:20.366 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-30T13:11:20.367 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T13:11:20.445 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T13:11:20.485 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-30T13:11:20.486 INFO:tasks.cephfs.mount:Terminating background process 2024-03-30T13:11:20.486 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:11:20.486 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:20.495 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:20.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.648+0000 7efc01298640 1 Processor -- start 2024-03-30T13:11:20.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.648+0000 7efc01298640 1 -- start start 2024-03-30T13:11:20.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efc01298640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efbfc15eee0 0x7efbfc09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efc01298640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efbfc15f2c0 0x7efbfc15f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efc01298640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efbfc15b7a0 0x7efbfc15bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efc01298640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7efbfc0b4d10 con 0x7efbfc15f2c0 2024-03-30T13:11:20.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efc01298640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efbfc0b4ff0 con 0x7efbfc15b7a0 2024-03-30T13:11:20.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efc01298640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc0b52d0 con 0x7efbfc15eee0 2024-03-30T13:11:20.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbfa7fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efbfc15f2c0 0x7efbfc15f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbfa7fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efbfc15f2c0 0x7efbfc15f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56134/0 (socket says 172.21.15.83:56134) 2024-03-30T13:11:20.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbfa7fc640 1 -- 172.21.15.83:0/4169193624 learned_addr learned my addr 172.21.15.83:0/4169193624 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:20.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbfb7fe640 1 --2- 172.21.15.83:0/4169193624 >> v2:172.21.15.153:3300/0 conn(0x7efbfc15b7a0 0x7efbfc15bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbfaffd640 1 --2- 172.21.15.83:0/4169193624 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efbfc15eee0 0x7efbfc09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbfa7fc640 1 -- 172.21.15.83:0/4169193624 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efbfc15eee0 msgr2=0x7efbfc09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:20.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbfa7fc640 1 --2- 172.21.15.83:0/4169193624 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efbfc15eee0 0x7efbfc09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbfa7fc640 1 -- 172.21.15.83:0/4169193624 >> v2:172.21.15.153:3300/0 conn(0x7efbfc15b7a0 msgr2=0x7efbfc15bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:20.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbfa7fc640 1 --2- 172.21.15.83:0/4169193624 >> v2:172.21.15.153:3300/0 conn(0x7efbfc15b7a0 0x7efbfc15bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbfa7fc640 1 -- 172.21.15.83:0/4169193624 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc0b55b0 con 0x7efbfc15f2c0 2024-03-30T13:11:20.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbfaffd640 1 --2- 172.21.15.83:0/4169193624 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efbfc15eee0 0x7efbfc09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:20.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbfa7fc640 1 --2- 172.21.15.83:0/4169193624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbfc15f2c0 0x7efbfc15f720 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efbfc06e160 tx=0x7efbec01eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad31012223e3525 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:20.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbf9ffb640 1 -- 172.21.15.83:0/4169193624 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec0b4070 con 0x7efbfc15f2c0 2024-03-30T13:11:20.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.652+0000 7efbf9ffb640 1 -- 172.21.15.83:0/4169193624 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbec0a79f0 con 0x7efbfc15f2c0 2024-03-30T13:11:20.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbf9ffb640 1 -- 172.21.15.83:0/4169193624 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec0a7dc0 con 0x7efbfc15f2c0 2024-03-30T13:11:20.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 -- 172.21.15.83:0/4169193624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbfc15f2c0 msgr2=0x7efbfc15f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:20.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 --2- 172.21.15.83:0/4169193624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbfc15f2c0 0x7efbfc15f720 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efbfc06e160 tx=0x7efbec01eb60 comp rx=0 tx=0).stop 2024-03-30T13:11:20.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 -- 172.21.15.83:0/4169193624 shutdown_connections 2024-03-30T13:11:20.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 --2- 172.21.15.83:0/4169193624 >> v2:172.21.15.153:3300/0 conn(0x7efbfc15b7a0 0x7efbfc15bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 --2- 172.21.15.83:0/4169193624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbfc15f2c0 0x7efbfc15f720 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 --2- 172.21.15.83:0/4169193624 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efbfc15eee0 0x7efbfc09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 -- 172.21.15.83:0/4169193624 >> 172.21.15.83:0/4169193624 conn(0x7efbfc0b68c0 msgr2=0x7efbfc0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:20.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 -- 172.21.15.83:0/4169193624 shutdown_connections 2024-03-30T13:11:20.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 -- 172.21.15.83:0/4169193624 wait complete. 2024-03-30T13:11:20.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 Processor -- start 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 -- start start 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbfc15b7a0 0x7efbfc13ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbfc15eee0 0x7efbfc152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efbfc15f2c0 0x7efbfc159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc06b9f0 con 0x7efbfc15eee0 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc06b870 con 0x7efbfc15b7a0 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc06bb70 con 0x7efbfc15f2c0 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbfa7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbfc15eee0 0x7efbfc152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbfa7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbfc15eee0 0x7efbfc152620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56140/0 (socket says 172.21.15.83:56140) 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbfa7fc640 1 -- 172.21.15.83:0/2768497805 learned_addr learned my addr 172.21.15.83:0/2768497805 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbfa7fc640 1 -- 172.21.15.83:0/2768497805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efbfc15f2c0 msgr2=0x7efbfc159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:20.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbfaffd640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbfc15b7a0 0x7efbfc13ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbfa7fc640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efbfc15f2c0 0x7efbfc159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbfa7fc640 1 -- 172.21.15.83:0/2768497805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbfc15b7a0 msgr2=0x7efbfc13ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:20.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbfa7fc640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbfc15b7a0 0x7efbfc13ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbfa7fc640 1 -- 172.21.15.83:0/2768497805 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc1530a0 con 0x7efbfc15eee0 2024-03-30T13:11:20.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbfa7fc640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbfc15eee0 0x7efbfc152620 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7efbec01d210 tx=0x7efbfc15c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:20.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbf37fe640 1 -- 172.21.15.83:0/2768497805 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec0be070 con 0x7efbfc15eee0 2024-03-30T13:11:20.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbf37fe640 1 -- 172.21.15.83:0/2768497805 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbec0af740 con 0x7efbfc15eee0 2024-03-30T13:11:20.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 -- 172.21.15.83:0/2768497805 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbfc153380 con 0x7efbfc15eee0 2024-03-30T13:11:20.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efbf37fe640 1 -- 172.21.15.83:0/2768497805 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec0b4040 con 0x7efbfc15eee0 2024-03-30T13:11:20.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.656+0000 7efc01298640 1 -- 172.21.15.83:0/2768497805 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbfc153940 con 0x7efbfc15eee0 2024-03-30T13:11:20.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.660+0000 7efc01298640 1 -- 172.21.15.83:0/2768497805 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbfc068dd0 con 0x7efbfc15eee0 2024-03-30T13:11:20.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.660+0000 7efbf37fe640 1 -- 172.21.15.83:0/2768497805 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7efbec0c1070 con 0x7efbfc15eee0 2024-03-30T13:11:20.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.660+0000 7efbf37fe640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efbe0067fc0 0x7efbe006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.660+0000 7efbfaffd640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efbe0067fc0 0x7efbe006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.660+0000 7efbf37fe640 1 -- 172.21.15.83:0/2768497805 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5781+0+0 (secure 0 0 0) 0x7efbec1233a0 con 0x7efbfc15eee0 2024-03-30T13:11:20.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.660+0000 7efbfaffd640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efbe0067fc0 0x7efbe006a480 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efbf4008f80 tx=0x7efbf40084d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:20.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.664+0000 7efbf37fe640 1 -- 172.21.15.83:0/2768497805 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7efbec0187e0 con 0x7efbfc15eee0 2024-03-30T13:11:20.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.932+0000 7efc01298640 1 -- 172.21.15.83:0/2768497805 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efbfc0cd160 con 0x7efbfc15eee0 2024-03-30T13:11:20.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.936+0000 7efbf37fe640 1 -- 172.21.15.83:0/2768497805 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16780 (secure 0 0 0) 0x7efbec0f3b10 con 0x7efbfc15eee0 2024-03-30T13:11:20.943 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":36,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:11:14.440267+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:09:27.405927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:09:28.161081+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":20}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":11,"length":1},{"begin":21,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:20.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.936+0000 7efc01298640 1 -- 172.21.15.83:0/2768497805 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efbe0067fc0 msgr2=0x7efbe006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:20.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.936+0000 7efc01298640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efbe0067fc0 0x7efbe006a480 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efbf4008f80 tx=0x7efbf40084d0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.940+0000 7efc01298640 1 -- 172.21.15.83:0/2768497805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbfc15eee0 msgr2=0x7efbfc152620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:20.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.940+0000 7efc01298640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbfc15eee0 0x7efbfc152620 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7efbec01d210 tx=0x7efbfc15c980 comp rx=0 tx=0).stop 2024-03-30T13:11:20.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.940+0000 7efc01298640 1 -- 172.21.15.83:0/2768497805 shutdown_connections 2024-03-30T13:11:20.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.940+0000 7efc01298640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efbe0067fc0 0x7efbe006a480 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.940+0000 7efc01298640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efbfc15f2c0 0x7efbfc159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.940+0000 7efc01298640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbfc15eee0 0x7efbfc152620 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.940+0000 7efc01298640 1 --2- 172.21.15.83:0/2768497805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbfc15b7a0 0x7efbfc13ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.940+0000 7efc01298640 1 -- 172.21.15.83:0/2768497805 >> 172.21.15.83:0/2768497805 conn(0x7efbfc0b68c0 msgr2=0x7efbfc0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:20.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.940+0000 7efc01298640 1 -- 172.21.15.83:0/2768497805 shutdown_connections 2024-03-30T13:11:20.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:20.940+0000 7efc01298640 1 -- 172.21.15.83:0/2768497805 wait complete. 2024-03-30T13:11:20.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:09:27.405927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:09:28.161081+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:20.970 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:21.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.080+0000 7fda1808d640 1 Processor -- start 2024-03-30T13:11:21.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.080+0000 7fda1808d640 1 -- start start 2024-03-30T13:11:21.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda1808d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda100d1540 0x7fda101695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda1808d640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda100d51f0 con 0x7fda1015e840 2024-03-30T13:11:21.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda1808d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda100d2140 con 0x7fda100d31e0 2024-03-30T13:11:21.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda1808d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fda1015ec20 con 0x7fda100d1540 2024-03-30T13:11:21.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda15e29640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fda1015e840 0x7fda100cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60938/0 (socket says 172.21.15.83:60938) 2024-03-30T13:11:21.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda15e29640 1 -- 172.21.15.83:0/2879777228 learned_addr learned my addr 172.21.15.83:0/2879777228 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:21.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1346104015 0 0) 0x7fda0c001120 con 0x7fda1015e840 2024-03-30T13:11:21.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9fc003530 con 0x7fda1015e840 2024-03-30T13:11:21.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda1662a640 1 --2- 172.21.15.83:0/2879777228 >> v2:172.21.15.153:3300/0 conn(0x7fda100d1540 0x7fda101695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 845248185 0 0) 0x7fd9fc003530 con 0x7fda1015e840 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 >> v2:172.21.15.153:3300/0 conn(0x7fda100d1540 msgr2=0x7fda101695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 --2- 172.21.15.83:0/2879777228 >> v2:172.21.15.153:3300/0 conn(0x7fda100d1540 0x7fda101695e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 >> v1:172.21.15.153:6789/0 conn(0x7fda100d31e0 legacy=0x7fda100d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda100d2420 con 0x7fda1015e840 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fda0c001850 con 0x7fda1015e840 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 >> v1:172.21.15.83:6789/0 conn(0x7fda1015e840 legacy=0x7fda100cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 --2- 172.21.15.83:0/2879777228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 0x7fd9fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 --2- 172.21.15.83:0/2879777228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9fc004810 0x7fd9fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 --2- 172.21.15.83:0/2879777228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9fc0051d0 0x7fd9fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc00c140 con 0x7fd9fc0039c0 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc00c2f0 con 0x7fd9fc0051d0 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd9fc00c4f0 con 0x7fd9fc004810 2024-03-30T13:11:21.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda15e29640 1 --2- 172.21.15.83:0/2879777228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 0x7fd9fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda15e29640 1 -- 172.21.15.83:0/2879777228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9fc004810 msgr2=0x7fd9fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:21.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda15e29640 1 --2- 172.21.15.83:0/2879777228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9fc004810 0x7fd9fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda15e29640 1 -- 172.21.15.83:0/2879777228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9fc0051d0 msgr2=0x7fd9fc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:21.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda15e29640 1 --2- 172.21.15.83:0/2879777228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9fc0051d0 0x7fd9fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda1662a640 1 -- 172.21.15.83:0/2879777228 reap_dead start 2024-03-30T13:11:21.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda15e29640 1 -- 172.21.15.83:0/2879777228 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc003530 con 0x7fd9fc0039c0 2024-03-30T13:11:21.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.084+0000 7fda15e29640 1 --2- 172.21.15.83:0/2879777228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 0x7fd9fc003de0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00c4c0 tx=0x7fda0c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1094ddc2f8b7c80 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:21.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c00c0e0 con 0x7fd9fc0039c0 2024-03-30T13:11:21.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0c0a9070 con 0x7fd9fc0039c0 2024-03-30T13:11:21.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda14e27640 1 -- 172.21.15.83:0/2879777228 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c005d80 con 0x7fd9fc0039c0 2024-03-30T13:11:21.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 -- 172.21.15.83:0/2879777228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 msgr2=0x7fd9fc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 --2- 172.21.15.83:0/2879777228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 0x7fd9fc003de0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00c4c0 tx=0x7fda0c01cc80 comp rx=0 tx=0).stop 2024-03-30T13:11:21.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 -- 172.21.15.83:0/2879777228 shutdown_connections 2024-03-30T13:11:21.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 --2- 172.21.15.83:0/2879777228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 0x7fd9fc003de0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 -- 172.21.15.83:0/2879777228 >> 172.21.15.83:0/2879777228 conn(0x7fda1009d7f0 msgr2=0x7fda100d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:21.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 -- 172.21.15.83:0/2879777228 shutdown_connections 2024-03-30T13:11:21.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 -- 172.21.15.83:0/2879777228 wait complete. 2024-03-30T13:11:21.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 Processor -- start 2024-03-30T13:11:21.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 -- start start 2024-03-30T13:11:21.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 0x7fda10161430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda1014ee40 0x7fda100a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda1009fd20 0x7fda1014e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fda10162430 con 0x7fd9fc0039c0 2024-03-30T13:11:21.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda101622b0 con 0x7fda1009fd20 2024-03-30T13:11:21.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1808d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fda101625b0 con 0x7fda1014ee40 2024-03-30T13:11:21.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda15e29640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 0x7fda10161430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda15e29640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 0x7fda10161430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56160/0 (socket says 172.21.15.83:56160) 2024-03-30T13:11:21.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda15e29640 1 -- 172.21.15.83:0/2031613369 learned_addr learned my addr 172.21.15.83:0/2031613369 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:21.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda15628640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda1014ee40 0x7fda100a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda15e29640 1 -- 172.21.15.83:0/2031613369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda1014ee40 msgr2=0x7fda100a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda1662a640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda1009fd20 0x7fda1014e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda15e29640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda1014ee40 0x7fda100a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda15e29640 1 -- 172.21.15.83:0/2031613369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda1009fd20 msgr2=0x7fda1014e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda15e29640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda1009fd20 0x7fda1014e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda15e29640 1 -- 172.21.15.83:0/2031613369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda100a0790 con 0x7fd9fc0039c0 2024-03-30T13:11:21.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda15e29640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 0x7fda10161430 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fda0c01cab0 tx=0x7fd9fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:21.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda027fc640 1 -- 172.21.15.83:0/2031613369 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c001120 con 0x7fd9fc0039c0 2024-03-30T13:11:21.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda027fc640 1 -- 172.21.15.83:0/2031613369 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0c007180 con 0x7fd9fc0039c0 2024-03-30T13:11:21.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.088+0000 7fda027fc640 1 -- 172.21.15.83:0/2031613369 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c007570 con 0x7fd9fc0039c0 2024-03-30T13:11:21.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.092+0000 7fda1808d640 1 -- 172.21.15.83:0/2031613369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda100a0a70 con 0x7fd9fc0039c0 2024-03-30T13:11:21.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.092+0000 7fda1808d640 1 -- 172.21.15.83:0/2031613369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda100a1030 con 0x7fd9fc0039c0 2024-03-30T13:11:21.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.092+0000 7fda1808d640 1 -- 172.21.15.83:0/2031613369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda100a23d0 con 0x7fd9fc0039c0 2024-03-30T13:11:21.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.092+0000 7fda027fc640 1 -- 172.21.15.83:0/2031613369 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fda0c0047f0 con 0x7fd9fc0039c0 2024-03-30T13:11:21.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.092+0000 7fda027fc640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd9f4067fc0 0x7fd9f406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.092+0000 7fda027fc640 1 -- 172.21.15.83:0/2031613369 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5781+0+0 (secure 0 0 0) 0x7fda0c11f710 con 0x7fd9fc0039c0 2024-03-30T13:11:21.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.092+0000 7fda15628640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd9f4067fc0 0x7fd9f406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.092+0000 7fda15628640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd9f4067fc0 0x7fd9f406a480 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fda1009f920 tx=0x7fda04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:21.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.100+0000 7fda027fc640 1 -- 172.21.15.83:0/2031613369 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fda0c0bf030 con 0x7fd9fc0039c0 2024-03-30T13:11:21.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.268+0000 7fda1808d640 1 -- 172.21.15.83:0/2031613369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fda1015e000 con 0x7fd9fc0039c0 2024-03-30T13:11:21.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.268+0000 7fda027fc640 1 -- 172.21.15.83:0/2031613369 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7fda100d51f0 con 0x7fd9fc0039c0 2024-03-30T13:11:21.276 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:11:21.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.272+0000 7fda1808d640 1 -- 172.21.15.83:0/2031613369 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd9f4067fc0 msgr2=0x7fd9f406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.272+0000 7fda1808d640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd9f4067fc0 0x7fd9f406a480 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fda1009f920 tx=0x7fda04009040 comp rx=0 tx=0).stop 2024-03-30T13:11:21.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.272+0000 7fda1808d640 1 -- 172.21.15.83:0/2031613369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 msgr2=0x7fda10161430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.272+0000 7fda1808d640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 0x7fda10161430 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fda0c01cab0 tx=0x7fd9fc005840 comp rx=0 tx=0).stop 2024-03-30T13:11:21.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.272+0000 7fda1808d640 1 -- 172.21.15.83:0/2031613369 shutdown_connections 2024-03-30T13:11:21.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.272+0000 7fda1808d640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd9f4067fc0 0x7fd9f406a480 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.272+0000 7fda1808d640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda1009fd20 0x7fda1014e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.272+0000 7fda1808d640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda1014ee40 0x7fda100a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.272+0000 7fda1808d640 1 --2- 172.21.15.83:0/2031613369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9fc0039c0 0x7fda10161430 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.272+0000 7fda1808d640 1 -- 172.21.15.83:0/2031613369 >> 172.21.15.83:0/2031613369 conn(0x7fda1009d7f0 msgr2=0x7fda100b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:21.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.272+0000 7fda1808d640 1 -- 172.21.15.83:0/2031613369 shutdown_connections 2024-03-30T13:11:21.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.272+0000 7fda1808d640 1 -- 172.21.15.83:0/2031613369 wait complete. 2024-03-30T13:11:21.293 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:21.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bfc95640 1 Processor -- start 2024-03-30T13:11:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bfc95640 1 -- start start 2024-03-30T13:11:21.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bfc95640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd3b815e860 0x7fd3b80b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bfc95640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd3b80b1bf0 0x7fd3b80ae430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bfc95640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3b80b2080 con 0x7fd3b80b6320 2024-03-30T13:11:21.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bfc95640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fd3b80b2360 con 0x7fd3b815e860 2024-03-30T13:11:21.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bfc95640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd3b80b2640 con 0x7fd3b80b1bf0 2024-03-30T13:11:21.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bda31640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd3b815e860 0x7fd3b80b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bd230640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd3b80b6320 0x7fd3b806b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60954/0 (socket says 172.21.15.83:60954) 2024-03-30T13:11:21.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bd230640 1 -- 172.21.15.83:0/1510233465 learned_addr learned my addr 172.21.15.83:0/1510233465 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:21.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3be232640 1 --2- 172.21.15.83:0/1510233465 >> v2:172.21.15.153:3300/0 conn(0x7fd3b80b1bf0 0x7fd3b80ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bda31640 1 -- 172.21.15.83:0/1510233465 >> v2:172.21.15.153:3300/0 conn(0x7fd3b80b1bf0 msgr2=0x7fd3b80ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:21.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bda31640 1 --2- 172.21.15.83:0/1510233465 >> v2:172.21.15.153:3300/0 conn(0x7fd3b80b1bf0 0x7fd3b80ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bda31640 1 -- 172.21.15.83:0/1510233465 >> v1:172.21.15.83:6789/0 conn(0x7fd3b80b6320 legacy=0x7fd3b806b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bda31640 1 -- 172.21.15.83:0/1510233465 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b80b2920 con 0x7fd3b815e860 2024-03-30T13:11:21.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.408+0000 7fd3bca2f640 1 -- 172.21.15.83:0/1510233465 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325269790 0 0) 0x7fd3b80b2080 con 0x7fd3b80b6320 2024-03-30T13:11:21.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.412+0000 7fd3bda31640 1 --2- 172.21.15.83:0/1510233465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3b815e860 0x7fd3b80b5de0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009d90 tx=0x7fd3b001f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d891e0d6c03c71c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:21.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.412+0000 7fd3bca2f640 1 -- 172.21.15.83:0/1510233465 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00b4070 con 0x7fd3b815e860 2024-03-30T13:11:21.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.412+0000 7fd3bca2f640 1 -- 172.21.15.83:0/1510233465 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b00af600 con 0x7fd3b815e860 2024-03-30T13:11:21.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.412+0000 7fd3bca2f640 1 -- 172.21.15.83:0/1510233465 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00af9d0 con 0x7fd3b815e860 2024-03-30T13:11:21.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.412+0000 7fd3bfc95640 1 -- 172.21.15.83:0/1510233465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3b815e860 msgr2=0x7fd3b80b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.412+0000 7fd3bfc95640 1 --2- 172.21.15.83:0/1510233465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3b815e860 0x7fd3b80b5de0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009d90 tx=0x7fd3b001f120 comp rx=0 tx=0).stop 2024-03-30T13:11:21.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.412+0000 7fd3bfc95640 1 -- 172.21.15.83:0/1510233465 shutdown_connections 2024-03-30T13:11:21.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.412+0000 7fd3bfc95640 1 --2- 172.21.15.83:0/1510233465 >> v2:172.21.15.153:3300/0 conn(0x7fd3b80b1bf0 0x7fd3b80ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.412+0000 7fd3bfc95640 1 --2- 172.21.15.83:0/1510233465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3b815e860 0x7fd3b80b5de0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.412+0000 7fd3bfc95640 1 -- 172.21.15.83:0/1510233465 >> 172.21.15.83:0/1510233465 conn(0x7fd3b8072d30 msgr2=0x7fd3b80b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:21.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.412+0000 7fd3bfc95640 1 -- 172.21.15.83:0/1510233465 shutdown_connections 2024-03-30T13:11:21.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.412+0000 7fd3bfc95640 1 -- 172.21.15.83:0/1510233465 wait complete. 2024-03-30T13:11:21.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bfc95640 1 Processor -- start 2024-03-30T13:11:21.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bfc95640 1 -- start start 2024-03-30T13:11:21.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bfc95640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3b80b6320 0x7fd3b81568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bfc95640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3b815e860 0x7fd3b8156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bfc95640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3b8155310 0x7fd3b8157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bfc95640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b806bef0 con 0x7fd3b815e860 2024-03-30T13:11:21.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bfc95640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b806bd70 con 0x7fd3b8155310 2024-03-30T13:11:21.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bfc95640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b80ae970 con 0x7fd3b80b6320 2024-03-30T13:11:21.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bd230640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3b815e860 0x7fd3b8156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bd230640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3b815e860 0x7fd3b8156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56184/0 (socket says 172.21.15.83:56184) 2024-03-30T13:11:21.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bd230640 1 -- 172.21.15.83:0/3466177586 learned_addr learned my addr 172.21.15.83:0/3466177586 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:21.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3be232640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3b8155310 0x7fd3b8157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bda31640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3b80b6320 0x7fd3b81568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bd230640 1 -- 172.21.15.83:0/3466177586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3b80b6320 msgr2=0x7fd3b81568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bd230640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3b80b6320 0x7fd3b81568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bd230640 1 -- 172.21.15.83:0/3466177586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3b8155310 msgr2=0x7fd3b8157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bd230640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3b8155310 0x7fd3b8157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bd230640 1 -- 172.21.15.83:0/3466177586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b8155890 con 0x7fd3b815e860 2024-03-30T13:11:21.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3be232640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3b8155310 0x7fd3b8157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:21.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bda31640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3b80b6320 0x7fd3b81568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:21.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bd230640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3b815e860 0x7fd3b8156e20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80011f0 tx=0x7fd3a800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:21.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3ae7fc640 1 -- 172.21.15.83:0/3466177586 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8018070 con 0x7fd3b815e860 2024-03-30T13:11:21.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3ae7fc640 1 -- 172.21.15.83:0/3466177586 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a80074e0 con 0x7fd3b815e860 2024-03-30T13:11:21.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bfc95640 1 -- 172.21.15.83:0/3466177586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b8155b70 con 0x7fd3b815e860 2024-03-30T13:11:21.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3ae7fc640 1 -- 172.21.15.83:0/3466177586 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8004a10 con 0x7fd3b815e860 2024-03-30T13:11:21.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.416+0000 7fd3bfc95640 1 -- 172.21.15.83:0/3466177586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b8159570 con 0x7fd3b815e860 2024-03-30T13:11:21.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.420+0000 7fd3bfc95640 1 -- 172.21.15.83:0/3466177586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3b809f3d0 con 0x7fd3b815e860 2024-03-30T13:11:21.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.420+0000 7fd3ae7fc640 1 -- 172.21.15.83:0/3466177586 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fd3a801b070 con 0x7fd3b815e860 2024-03-30T13:11:21.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.420+0000 7fd3ae7fc640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd39c067fc0 0x7fd39c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.420+0000 7fd3bda31640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd39c067fc0 0x7fd39c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.420+0000 7fd3ae7fc640 1 -- 172.21.15.83:0/3466177586 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7fd3a80857c0 con 0x7fd3b815e860 2024-03-30T13:11:21.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.420+0000 7fd3bda31640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd39c067fc0 0x7fd39c06a480 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00b1000 tx=0x7fd3b00aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:21.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.424+0000 7fd3ae7fc640 1 -- 172.21.15.83:0/3466177586 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fd3a8055fe0 con 0x7fd3b815e860 2024-03-30T13:11:21.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 -- 172.21.15.83:0/3466177586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd3b804f9e0 con 0x7fd3b815e860 2024-03-30T13:11:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3ae7fc640 1 -- 172.21.15.83:0/3466177586 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) ==== 104+0+11 (secure 0 0 0) 0x7fd3a805ae20 con 0x7fd3b815e860 2024-03-30T13:11:21.619 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:11:21.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 -- 172.21.15.83:0/3466177586 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd39c067fc0 msgr2=0x7fd39c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd39c067fc0 0x7fd39c06a480 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00b1000 tx=0x7fd3b00aa000 comp rx=0 tx=0).stop 2024-03-30T13:11:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 -- 172.21.15.83:0/3466177586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3b815e860 msgr2=0x7fd3b8156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3b815e860 0x7fd3b8156e20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80011f0 tx=0x7fd3a800c9b0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 -- 172.21.15.83:0/3466177586 shutdown_connections 2024-03-30T13:11:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd39c067fc0 0x7fd39c06a480 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3b8155310 0x7fd3b8157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3b815e860 0x7fd3b8156e20 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 --2- 172.21.15.83:0/3466177586 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3b80b6320 0x7fd3b81568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 -- 172.21.15.83:0/3466177586 >> 172.21.15.83:0/3466177586 conn(0x7fd3b8072d30 msgr2=0x7fd3b80b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 -- 172.21.15.83:0/3466177586 shutdown_connections 2024-03-30T13:11:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.612+0000 7fd3bfc95640 1 -- 172.21.15.83:0/3466177586 wait complete. 2024-03-30T13:11:21.638 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:21.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.756+0000 7fc69e574640 1 Processor -- start 2024-03-30T13:11:21.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc69e574640 1 -- start start 2024-03-30T13:11:21.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc69e574640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc698155710 0x7fc6980b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc69e574640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc698155af0 0x7fc6980b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc69e574640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6980b40d0 con 0x7fc69815c2a0 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc69e574640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc6980b43b0 con 0x7fc698155710 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc69e574640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc6980b4690 con 0x7fc698155af0 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc697fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc698155710 0x7fc6980b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc69cb11640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc69815c2a0 0x7fc69806f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60956/0 (socket says 172.21.15.83:60956) 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc69cb11640 1 -- 172.21.15.83:0/3943407242 learned_addr learned my addr 172.21.15.83:0/3943407242 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc6977fe640 1 --2- 172.21.15.83:0/3943407242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc698155af0 0x7fc6980b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc696ffd640 1 -- 172.21.15.83:0/3943407242 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364647048 0 0) 0x7fc6980b40d0 con 0x7fc69815c2a0 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc696ffd640 1 -- 172.21.15.83:0/3943407242 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc680005740 con 0x7fc69815c2a0 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc697fff640 1 -- 172.21.15.83:0/3943407242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc698155af0 msgr2=0x7fc6980b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc697fff640 1 --2- 172.21.15.83:0/3943407242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc698155af0 0x7fc6980b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc697fff640 1 -- 172.21.15.83:0/3943407242 >> v1:172.21.15.83:6789/0 conn(0x7fc69815c2a0 legacy=0x7fc69806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc697fff640 1 -- 172.21.15.83:0/3943407242 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6980b4970 con 0x7fc698155710 2024-03-30T13:11:21.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.760+0000 7fc697fff640 1 --2- 172.21.15.83:0/3943407242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc698155710 0x7fc6980b3af0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc690009d90 tx=0x7fc69001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf34f7fd60393919 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:21.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc696ffd640 1 -- 172.21.15.83:0/3943407242 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6900b2070 con 0x7fc698155710 2024-03-30T13:11:21.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc696ffd640 1 -- 172.21.15.83:0/3943407242 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6900a5840 con 0x7fc698155710 2024-03-30T13:11:21.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc696ffd640 1 -- 172.21.15.83:0/3943407242 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6900a5bf0 con 0x7fc698155710 2024-03-30T13:11:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc69e574640 1 -- 172.21.15.83:0/3943407242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc698155710 msgr2=0x7fc6980b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc69e574640 1 --2- 172.21.15.83:0/3943407242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc698155710 0x7fc6980b3af0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc690009d90 tx=0x7fc69001c970 comp rx=0 tx=0).stop 2024-03-30T13:11:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc69e574640 1 -- 172.21.15.83:0/3943407242 shutdown_connections 2024-03-30T13:11:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc69e574640 1 --2- 172.21.15.83:0/3943407242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc698155af0 0x7fc6980b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc69e574640 1 --2- 172.21.15.83:0/3943407242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc698155710 0x7fc6980b3af0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc69e574640 1 -- 172.21.15.83:0/3943407242 >> 172.21.15.83:0/3943407242 conn(0x7fc698072ec0 msgr2=0x7fc69806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc69e574640 1 -- 172.21.15.83:0/3943407242 shutdown_connections 2024-03-30T13:11:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc69e574640 1 -- 172.21.15.83:0/3943407242 wait complete. 2024-03-30T13:11:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc69e574640 1 Processor -- start 2024-03-30T13:11:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.764+0000 7fc69e574640 1 -- start start 2024-03-30T13:11:21.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc69e574640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc698155710 0x7fc69814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc69e574640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc69815c2a0 0x7fc698148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc69e574640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6981f3b10 0x7fc6981f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc69e574640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc6980d0350 con 0x7fc698155710 2024-03-30T13:11:21.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc69e574640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc69806fb70 con 0x7fc69815c2a0 2024-03-30T13:11:21.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc69e574640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc6980d04d0 con 0x7fc6981f3b10 2024-03-30T13:11:21.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc697fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc698155710 0x7fc69814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc697fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc698155710 0x7fc69814abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56200/0 (socket says 172.21.15.83:56200) 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc697fff640 1 -- 172.21.15.83:0/1530683009 learned_addr learned my addr 172.21.15.83:0/1530683009 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc697fff640 1 -- 172.21.15.83:0/1530683009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6981f3b10 msgr2=0x7fc6981f3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc697fff640 1 --2- 172.21.15.83:0/1530683009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6981f3b10 0x7fc6981f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc697fff640 1 -- 172.21.15.83:0/1530683009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc69815c2a0 msgr2=0x7fc698148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc697fff640 1 --2- 172.21.15.83:0/1530683009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc69815c2a0 0x7fc698148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc697fff640 1 -- 172.21.15.83:0/1530683009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6981f44c0 con 0x7fc698155710 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc697fff640 1 --2- 172.21.15.83:0/1530683009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc698155710 0x7fc69814abe0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc69001b020 tx=0x7fc690019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc694ff9640 1 -- 172.21.15.83:0/1530683009 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6900be020 con 0x7fc698155710 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc694ff9640 1 -- 172.21.15.83:0/1530683009 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6900039a0 con 0x7fc698155710 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc69e574640 1 -- 172.21.15.83:0/1530683009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6981f4790 con 0x7fc698155710 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc694ff9640 1 -- 172.21.15.83:0/1530683009 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6900b2040 con 0x7fc698155710 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc69e574640 1 -- 172.21.15.83:0/1530683009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6981f4d50 con 0x7fc698155710 2024-03-30T13:11:21.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc69e574640 1 -- 172.21.15.83:0/1530683009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc698073790 con 0x7fc698155710 2024-03-30T13:11:21.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc694ff9640 1 -- 172.21.15.83:0/1530683009 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc6900c1070 con 0x7fc698155710 2024-03-30T13:11:21.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc694ff9640 1 --2- 172.21.15.83:0/1530683009 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc684067fc0 0x7fc68406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc6977fe640 1 --2- 172.21.15.83:0/1530683009 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc684067fc0 0x7fc68406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.768+0000 7fc694ff9640 1 -- 172.21.15.83:0/1530683009 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7fc690120a40 con 0x7fc698155710 2024-03-30T13:11:21.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.772+0000 7fc6977fe640 1 --2- 172.21.15.83:0/1530683009 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc684067fc0 0x7fc68406a480 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc68c006aa0 tx=0x7fc68c006a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:21.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.776+0000 7fc694ff9640 1 -- 172.21.15.83:0/1530683009 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fc690016560 con 0x7fc698155710 2024-03-30T13:11:21.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.940+0000 7fc69e574640 1 -- 172.21.15.83:0/1530683009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc69814b120 con 0x7fc698155710 2024-03-30T13:11:21.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.940+0000 7fc694ff9640 1 -- 172.21.15.83:0/1530683009 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) ==== 100+0+11 (secure 0 0 0) 0x7fc690120e20 con 0x7fc698155710 2024-03-30T13:11:21.951 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:11:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.944+0000 7fc69e574640 1 -- 172.21.15.83:0/1530683009 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc684067fc0 msgr2=0x7fc68406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.944+0000 7fc69e574640 1 --2- 172.21.15.83:0/1530683009 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc684067fc0 0x7fc68406a480 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc68c006aa0 tx=0x7fc68c006a30 comp rx=0 tx=0).stop 2024-03-30T13:11:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.944+0000 7fc69e574640 1 -- 172.21.15.83:0/1530683009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc698155710 msgr2=0x7fc69814abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.944+0000 7fc69e574640 1 --2- 172.21.15.83:0/1530683009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc698155710 0x7fc69814abe0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc69001b020 tx=0x7fc690019710 comp rx=0 tx=0).stop 2024-03-30T13:11:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.944+0000 7fc69e574640 1 -- 172.21.15.83:0/1530683009 shutdown_connections 2024-03-30T13:11:21.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.944+0000 7fc69e574640 1 --2- 172.21.15.83:0/1530683009 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc684067fc0 0x7fc68406a480 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.944+0000 7fc69e574640 1 --2- 172.21.15.83:0/1530683009 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6981f3b10 0x7fc6981f3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.944+0000 7fc69e574640 1 --2- 172.21.15.83:0/1530683009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc69815c2a0 0x7fc698148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.944+0000 7fc69e574640 1 --2- 172.21.15.83:0/1530683009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc698155710 0x7fc69814abe0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.944+0000 7fc69e574640 1 -- 172.21.15.83:0/1530683009 >> 172.21.15.83:0/1530683009 conn(0x7fc698072ec0 msgr2=0x7fc69806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:21.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.944+0000 7fc69e574640 1 -- 172.21.15.83:0/1530683009 shutdown_connections 2024-03-30T13:11:21.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:21.944+0000 7fc69e574640 1 -- 172.21.15.83:0/1530683009 wait complete. 2024-03-30T13:11:21.969 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:11:22.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.084+0000 7f20b6ce2640 1 Processor -- start 2024-03-30T13:11:22.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.084+0000 7f20b6ce2640 1 -- start start 2024-03-30T13:11:22.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.084+0000 7f20b6ce2640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f20b015b550 0x7f20b00afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.084+0000 7f20b6ce2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b00d15a0 0x7f20b00b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.084+0000 7f20b6ce2640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b00af2e0 con 0x7f20b015b170 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.084+0000 7f20b6ce2640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f20b00b09b0 con 0x7f20b015b550 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.084+0000 7f20b6ce2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f20b00b40e0 con 0x7f20b00d15a0 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.084+0000 7f20b4a7e640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f20b015b170 0x7f20b00d0e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60968/0 (socket says 172.21.15.83:60968) 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.084+0000 7f20b4a7e640 1 -- 172.21.15.83:0/817249319 learned_addr learned my addr 172.21.15.83:0/817249319 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20b527f640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b00d15a0 0x7f20b00b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20affff640 1 --2- 172.21.15.83:0/817249319 >> v2:172.21.15.153:3300/0 conn(0x7f20b015b550 0x7f20b00afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2376179050 0 0) 0x7f20b00af2e0 con 0x7f20b015b170 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2098003530 con 0x7f20b015b170 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1650329587 0 0) 0x7f2098003530 con 0x7f20b015b170 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b00d15a0 msgr2=0x7f20b00b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b00d15a0 0x7f20b00b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 >> v2:172.21.15.153:3300/0 conn(0x7f20b015b550 msgr2=0x7f20b00afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 --2- 172.21.15.83:0/817249319 >> v2:172.21.15.153:3300/0 conn(0x7f20b015b550 0x7f20b00afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b00af5c0 con 0x7f20b015b170 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f20a0001680 con 0x7f20b015b170 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 >> v1:172.21.15.83:6789/0 conn(0x7f20b015b170 legacy=0x7f20b00d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b00d15a0 0x7f20980039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2098003f40 0x7f2098004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2098004d50 0x7f20980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f20b00b40e0 con 0x7f2098004d50 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f209800b9d0 con 0x7f2098003f40 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f209800ddb0 con 0x7f20b00d15a0 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20b527f640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2098004d50 0x7f20980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20b4a7e640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b00d15a0 0x7f20980039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20affff640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2098003f40 0x7f2098004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20b527f640 1 -- 172.21.15.83:0/817249319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b00d15a0 msgr2=0x7f20980039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20b527f640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b00d15a0 0x7f20980039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20b527f640 1 -- 172.21.15.83:0/817249319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2098003f40 msgr2=0x7f2098004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20b527f640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2098003f40 0x7f2098004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20b527f640 1 -- 172.21.15.83:0/817249319 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2098003530 con 0x7f2098004d50 2024-03-30T13:11:22.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.088+0000 7f20b4a7e640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b00d15a0 0x7f20980039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:22.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b527f640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2098004d50 0x7f20980051d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009fc0 tx=0x7f20a801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec89b566d7b81ea server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a80b2070 con 0x7f2098004d50 2024-03-30T13:11:22.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a80a5c50 con 0x7f2098004d50 2024-03-30T13:11:22.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20af7fe640 1 -- 172.21.15.83:0/817249319 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8009c10 con 0x7f2098004d50 2024-03-30T13:11:22.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 -- 172.21.15.83:0/817249319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2098004d50 msgr2=0x7f20980051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 --2- 172.21.15.83:0/817249319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2098004d50 0x7f20980051d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009fc0 tx=0x7f20a801cc40 comp rx=0 tx=0).stop 2024-03-30T13:11:22.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b527f640 1 -- 172.21.15.83:0/817249319 reap_dead start 2024-03-30T13:11:22.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 -- 172.21.15.83:0/817249319 shutdown_connections 2024-03-30T13:11:22.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 -- 172.21.15.83:0/817249319 >> 172.21.15.83:0/817249319 conn(0x7f20b009aa50 msgr2=0x7f20b00b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 -- 172.21.15.83:0/817249319 shutdown_connections 2024-03-30T13:11:22.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 -- 172.21.15.83:0/817249319 wait complete. 2024-03-30T13:11:22.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 Processor -- start 2024-03-30T13:11:22.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 -- start start 2024-03-30T13:11:22.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f20b013ec20 0x7f20b013f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b013fa30 0x7f20b014f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20b014f810 0x7f20b00cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f20b00b6d10 con 0x7f20b013ec20 2024-03-30T13:11:22.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20b00b0690 con 0x7f20b014f810 2024-03-30T13:11:22.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b6ce2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f20b00b6e90 con 0x7f20b013fa30 2024-03-30T13:11:22.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b4a7e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f20b013ec20 0x7f20b013f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b4a7e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f20b013ec20 0x7f20b013f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56218/0 (socket says 172.21.15.83:56218) 2024-03-30T13:11:22.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.092+0000 7f20b4a7e640 1 -- 172.21.15.83:0/469525579 learned_addr learned my addr 172.21.15.83:0/469525579 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:22.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20affff640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b013fa30 0x7f20b014f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20b4a7e640 1 -- 172.21.15.83:0/469525579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b013fa30 msgr2=0x7f20b014f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20b527f640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20b014f810 0x7f20b00cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20b4a7e640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b013fa30 0x7f20b014f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20b4a7e640 1 -- 172.21.15.83:0/469525579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20b014f810 msgr2=0x7f20b00cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20b4a7e640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20b014f810 0x7f20b00cf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20b4a7e640 1 -- 172.21.15.83:0/469525579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b014fd20 con 0x7f20b013ec20 2024-03-30T13:11:22.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20b4a7e640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f20b013ec20 0x7f20b013f4f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f20a0004850 tx=0x7f20a0011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20ad7fa640 1 -- 172.21.15.83:0/469525579 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0010040 con 0x7f20b013ec20 2024-03-30T13:11:22.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20ad7fa640 1 -- 172.21.15.83:0/469525579 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a001a070 con 0x7f20b013ec20 2024-03-30T13:11:22.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20b6ce2640 1 -- 172.21.15.83:0/469525579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b00cdd10 con 0x7f20b013ec20 2024-03-30T13:11:22.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20ad7fa640 1 -- 172.21.15.83:0/469525579 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a000fd60 con 0x7f20b013ec20 2024-03-30T13:11:22.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20b6ce2640 1 -- 172.21.15.83:0/469525579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b00ce2d0 con 0x7f20b013ec20 2024-03-30T13:11:22.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20b6ce2640 1 -- 172.21.15.83:0/469525579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b00ce4d0 con 0x7f20b013ec20 2024-03-30T13:11:22.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20ad7fa640 1 -- 172.21.15.83:0/469525579 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f20a001f460 con 0x7f20b013ec20 2024-03-30T13:11:22.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20ad7fa640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f209c067ff0 0x7f209c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20ad7fa640 1 -- 172.21.15.83:0/469525579 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f20a00896c0 con 0x7f20b013ec20 2024-03-30T13:11:22.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20affff640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f209c067ff0 0x7f209c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.096+0000 7f20affff640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f209c067ff0 0x7f209c06a4b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f20b00b7580 tx=0x7f20a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.104+0000 7f20ad7fa640 1 -- 172.21.15.83:0/469525579 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f20b00ce4d0 con 0x7f20b013ec20 2024-03-30T13:11:22.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.348+0000 7f20b6ce2640 1 -- 172.21.15.83:0/469525579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f20b009f440 con 0x7f20b013ec20 2024-03-30T13:11:22.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.348+0000 7f20ad7fa640 1 -- 172.21.15.83:0/469525579 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) ==== 80+0+0 (secure 0 0 0) 0x7f20a0059ee0 con 0x7f20b013ec20 2024-03-30T13:11:22.356 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-03-30T13:11:22.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.352+0000 7f20b6ce2640 1 -- 172.21.15.83:0/469525579 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f209c067ff0 msgr2=0x7f209c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.352+0000 7f20b6ce2640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f209c067ff0 0x7f209c06a4b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f20b00b7580 tx=0x7f20a4008040 comp rx=0 tx=0).stop 2024-03-30T13:11:22.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.352+0000 7f20b6ce2640 1 -- 172.21.15.83:0/469525579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f20b013ec20 msgr2=0x7f20b013f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.352+0000 7f20b6ce2640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f20b013ec20 0x7f20b013f4f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f20a0004850 tx=0x7f20a0011d60 comp rx=0 tx=0).stop 2024-03-30T13:11:22.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.352+0000 7f20b6ce2640 1 -- 172.21.15.83:0/469525579 shutdown_connections 2024-03-30T13:11:22.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.352+0000 7f20b6ce2640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f209c067ff0 0x7f209c06a4b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.352+0000 7f20b6ce2640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20b014f810 0x7f20b00cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.352+0000 7f20b6ce2640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20b013fa30 0x7f20b014f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.352+0000 7f20b6ce2640 1 --2- 172.21.15.83:0/469525579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f20b013ec20 0x7f20b013f4f0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.352+0000 7f20b6ce2640 1 -- 172.21.15.83:0/469525579 >> 172.21.15.83:0/469525579 conn(0x7f20b009aa50 msgr2=0x7f20b006f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.352+0000 7f20b6ce2640 1 -- 172.21.15.83:0/469525579 shutdown_connections 2024-03-30T13:11:22.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.352+0000 7f20b6ce2640 1 -- 172.21.15.83:0/469525579 wait complete. 2024-03-30T13:11:22.381 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi083.front.sepia.ceph.com... 2024-03-30T13:11:22.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:22.381 DEBUG:teuthology.orchestra.run.smithi083:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-30T13:11:22.392 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:ceph-fuse[37969]: fuse finished with error 0 and tester_r 0 2024-03-30T13:11:22.412 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:22.413 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-30T13:11:22.543 INFO:tasks.cephfs.mount:Terminating background process 2024-03-30T13:11:22.543 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:11:22.543 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:22.556 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:22.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.652+0000 7f3cb6821640 1 Processor -- start 2024-03-30T13:11:22.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.652+0000 7f3cb6821640 1 -- start start 2024-03-30T13:11:22.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.652+0000 7f3cb6821640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3cb00b6ca0 0x7f3cb00b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.652+0000 7f3cb6821640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb00b2ba0 con 0x7f3cb0162c20 2024-03-30T13:11:22.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.652+0000 7f3cb6821640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb00b46d0 con 0x7f3cb006b660 2024-03-30T13:11:22.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.652+0000 7f3cb6821640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb00b2710 con 0x7f3cb00b6ca0 2024-03-30T13:11:22.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.652+0000 7f3caf7fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3cb0162c20 0x7f3cb00b0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60974/0 (socket says 172.21.15.83:60974) 2024-03-30T13:11:22.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.652+0000 7f3caf7fe640 1 -- 172.21.15.83:0/4244682244 learned_addr learned my addr 172.21.15.83:0/4244682244 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1118832474 0 0) 0x7f3cb00b2ba0 con 0x7f3cb0162c20 2024-03-30T13:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c98003530 con 0x7f3cb0162c20 2024-03-30T13:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3cb4dbe640 1 --2- 172.21.15.83:0/4244682244 >> v2:172.21.15.153:3300/0 conn(0x7f3cb00b6ca0 0x7f3cb00b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1979019075 0 0) 0x7f3c98003530 con 0x7f3cb0162c20 2024-03-30T13:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 >> v2:172.21.15.153:3300/0 conn(0x7f3cb00b6ca0 msgr2=0x7f3cb00b5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 --2- 172.21.15.83:0/4244682244 >> v2:172.21.15.153:3300/0 conn(0x7f3cb00b6ca0 0x7f3cb00b5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 >> v1:172.21.15.153:6789/0 conn(0x7f3cb006b660 legacy=0x7f3cb006ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb0163120 con 0x7f3cb0162c20 2024-03-30T13:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f3ca4001680 con 0x7f3cb0162c20 2024-03-30T13:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 >> v1:172.21.15.83:6789/0 conn(0x7f3cb0162c20 legacy=0x7f3cb00b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 --2- 172.21.15.83:0/4244682244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 0x7f3c98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 --2- 172.21.15.83:0/4244682244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c98004810 0x7f3c98004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 --2- 172.21.15.83:0/4244682244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c980052f0 0x7f3c9800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb00b2710 con 0x7f3c980039c0 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9800c1c0 con 0x7f3c98004810 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3c9800c3c0 con 0x7f3c980052f0 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caffff640 1 --2- 172.21.15.83:0/4244682244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 0x7f3c98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caf7fe640 1 --2- 172.21.15.83:0/4244682244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c98004810 0x7f3c98004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3cb4dbe640 1 --2- 172.21.15.83:0/4244682244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c980052f0 0x7f3c9800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caffff640 1 -- 172.21.15.83:0/4244682244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c980052f0 msgr2=0x7f3c9800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caffff640 1 --2- 172.21.15.83:0/4244682244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c980052f0 0x7f3c9800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caffff640 1 -- 172.21.15.83:0/4244682244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c98004810 msgr2=0x7f3c98004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caffff640 1 --2- 172.21.15.83:0/4244682244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c98004810 0x7f3c98004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3cb4dbe640 1 -- 172.21.15.83:0/4244682244 reap_dead start 2024-03-30T13:11:22.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caffff640 1 -- 172.21.15.83:0/4244682244 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c98003530 con 0x7f3c980039c0 2024-03-30T13:11:22.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caffff640 1 --2- 172.21.15.83:0/4244682244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 0x7f3c98003de0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8001e40 tx=0x7f3ca801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf34c992c86b4ed0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8001a90 con 0x7f3c980039c0 2024-03-30T13:11:22.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca8003b80 con 0x7f3c980039c0 2024-03-30T13:11:22.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.656+0000 7f3caeffd640 1 -- 172.21.15.83:0/4244682244 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8005080 con 0x7f3c980039c0 2024-03-30T13:11:22.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 -- 172.21.15.83:0/4244682244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 msgr2=0x7f3c98003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 --2- 172.21.15.83:0/4244682244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 0x7f3c98003de0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8001e40 tx=0x7f3ca801c700 comp rx=0 tx=0).stop 2024-03-30T13:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 -- 172.21.15.83:0/4244682244 shutdown_connections 2024-03-30T13:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 --2- 172.21.15.83:0/4244682244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 0x7f3c98003de0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 -- 172.21.15.83:0/4244682244 >> 172.21.15.83:0/4244682244 conn(0x7f3cb009aa50 msgr2=0x7f3cb00b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 -- 172.21.15.83:0/4244682244 shutdown_connections 2024-03-30T13:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 -- 172.21.15.83:0/4244682244 wait complete. 2024-03-30T13:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 Processor -- start 2024-03-30T13:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 -- start start 2024-03-30T13:11:22.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 0x7f3cb01fa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cb01577e0 0x7f3cb0154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cb01f73f0 0x7f3cb01f7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb00b08b0 con 0x7f3c980039c0 2024-03-30T13:11:22.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb00b43f0 con 0x7f3cb01577e0 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb6821640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb015e9e0 con 0x7f3cb01f73f0 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3caffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 0x7f3cb01fa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3caffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 0x7f3cb01fa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56232/0 (socket says 172.21.15.83:56232) 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3caffff640 1 -- 172.21.15.83:0/2800145580 learned_addr learned my addr 172.21.15.83:0/2800145580 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3caf7fe640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cb01577e0 0x7f3cb0154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cb4dbe640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cb01f73f0 0x7f3cb01f7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3caffff640 1 -- 172.21.15.83:0/2800145580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cb01f73f0 msgr2=0x7f3cb01f7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3caffff640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cb01f73f0 0x7f3cb01f7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3caffff640 1 -- 172.21.15.83:0/2800145580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cb01577e0 msgr2=0x7f3cb0154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3caffff640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cb01577e0 0x7f3cb0154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3caffff640 1 -- 172.21.15.83:0/2800145580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb01fb8c0 con 0x7f3c980039c0 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3caffff640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 0x7f3cb01fa960 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8000f90 tx=0x7f3c98005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cacff9640 1 -- 172.21.15.83:0/2800145580 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8001a90 con 0x7f3c980039c0 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cacff9640 1 -- 172.21.15.83:0/2800145580 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca8005710 con 0x7f3c980039c0 2024-03-30T13:11:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.660+0000 7f3cacff9640 1 -- 172.21.15.83:0/2800145580 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8006d60 con 0x7f3c980039c0 2024-03-30T13:11:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.664+0000 7f3cb6821640 1 -- 172.21.15.83:0/2800145580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb01fb020 con 0x7f3c980039c0 2024-03-30T13:11:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.664+0000 7f3cb6821640 1 -- 172.21.15.83:0/2800145580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb01fb5e0 con 0x7f3c980039c0 2024-03-30T13:11:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.664+0000 7f3cb6821640 1 -- 172.21.15.83:0/2800145580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb0068dd0 con 0x7f3c980039c0 2024-03-30T13:11:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.664+0000 7f3cacff9640 1 -- 172.21.15.83:0/2800145580 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f3ca80a6490 con 0x7f3c980039c0 2024-03-30T13:11:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.664+0000 7f3cacff9640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3c9c067fc0 0x7f3c9c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.664+0000 7f3cacff9640 1 -- 172.21.15.83:0/2800145580 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f3ca81200c0 con 0x7f3c980039c0 2024-03-30T13:11:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.664+0000 7f3caf7fe640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3c9c067fc0 0x7f3c9c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.664+0000 7f3caf7fe640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3c9c067fc0 0x7f3c9c06a480 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3cb01615c0 tx=0x7f3ca4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.668+0000 7f3cacff9640 1 -- 172.21.15.83:0/2800145580 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3ca80c0020 con 0x7f3c980039c0 2024-03-30T13:11:22.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.824+0000 7f3cb6821640 1 -- 172.21.15.83:0/2800145580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3cb00d0f30 con 0x7f3c980039c0 2024-03-30T13:11:22.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.824+0000 7f3cacff9640 1 -- 172.21.15.83:0/2800145580 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16712 (secure 0 0 0) 0x7f3ca80b5030 con 0x7f3c980039c0 2024-03-30T13:11:22.832 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:22.832 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":37,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:11:21.134552+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:09:27.405927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:09:28.161081+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:22.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.828+0000 7f3cb6821640 1 -- 172.21.15.83:0/2800145580 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3c9c067fc0 msgr2=0x7f3c9c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.828+0000 7f3cb6821640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3c9c067fc0 0x7f3c9c06a480 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3cb01615c0 tx=0x7f3ca4009040 comp rx=0 tx=0).stop 2024-03-30T13:11:22.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.828+0000 7f3cb6821640 1 -- 172.21.15.83:0/2800145580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 msgr2=0x7f3cb01fa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.828+0000 7f3cb6821640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 0x7f3cb01fa960 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8000f90 tx=0x7f3c98005840 comp rx=0 tx=0).stop 2024-03-30T13:11:22.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.828+0000 7f3cb6821640 1 -- 172.21.15.83:0/2800145580 shutdown_connections 2024-03-30T13:11:22.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.828+0000 7f3cb6821640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3c9c067fc0 0x7f3c9c06a480 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.828+0000 7f3cb6821640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cb01f73f0 0x7f3cb01f7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.828+0000 7f3cb6821640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cb01577e0 0x7f3cb0154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.828+0000 7f3cb6821640 1 --2- 172.21.15.83:0/2800145580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c980039c0 0x7f3cb01fa960 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.828+0000 7f3cb6821640 1 -- 172.21.15.83:0/2800145580 >> 172.21.15.83:0/2800145580 conn(0x7f3cb009aa50 msgr2=0x7f3cb006e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.828+0000 7f3cb6821640 1 -- 172.21.15.83:0/2800145580 shutdown_connections 2024-03-30T13:11:22.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.828+0000 7f3cb6821640 1 -- 172.21.15.83:0/2800145580 wait complete. 2024-03-30T13:11:22.856 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:09:27.405927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:09:28.161081+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:22.856 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:22.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.960+0000 7f5a6145e640 1 Processor -- start 2024-03-30T13:11:22.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.960+0000 7f5a6145e640 1 -- start start 2024-03-30T13:11:22.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a6145e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5a5c145ed0 0x7f5a5c15d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a6145e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a5c06bd70 0x7f5a5c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a6145e640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a5c0b71c0 con 0x7f5a5c0b6d10 2024-03-30T13:11:22.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a6145e640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f5a5c0d2030 con 0x7f5a5c145ed0 2024-03-30T13:11:22.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a6145e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5a5c0d1020 con 0x7f5a5c06bd70 2024-03-30T13:11:22.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5affd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5a5c145ed0 0x7f5a5c15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5affd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5a5c145ed0 0x7f5a5c15d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56248/0 (socket says 172.21.15.83:56248) 2024-03-30T13:11:22.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a527fc640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f5a5c0b6d10 0x7f5a5c06b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60982/0 (socket says 172.21.15.83:60982) 2024-03-30T13:11:22.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5affd640 1 -- 172.21.15.83:0/140552164 learned_addr learned my addr 172.21.15.83:0/140552164 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:22.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5b7fe640 1 --2- 172.21.15.83:0/140552164 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a5c06bd70 0x7f5a5c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5affd640 1 -- 172.21.15.83:0/140552164 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a5c06bd70 msgr2=0x7f5a5c15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5affd640 1 --2- 172.21.15.83:0/140552164 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a5c06bd70 0x7f5a5c15dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5affd640 1 -- 172.21.15.83:0/140552164 >> v1:172.21.15.83:6789/0 conn(0x7f5a5c0b6d10 legacy=0x7f5a5c06b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5affd640 1 -- 172.21.15.83:0/140552164 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5c0d1270 con 0x7f5a5c145ed0 2024-03-30T13:11:22.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5a7fc640 1 -- 172.21.15.83:0/140552164 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 834261411 0 0) 0x7f5a5c0b71c0 con 0x7f5a5c0b6d10 2024-03-30T13:11:22.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5affd640 1 --2- 172.21.15.83:0/140552164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a5c145ed0 0x7f5a5c15d490 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009870 tx=0x7f5a4c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147152dbe628de37 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5a7fc640 1 -- 172.21.15.83:0/140552164 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0aa600 con 0x7f5a5c145ed0 2024-03-30T13:11:22.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5a7fc640 1 -- 172.21.15.83:0/140552164 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a4c0af070 con 0x7f5a5c145ed0 2024-03-30T13:11:22.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.964+0000 7f5a5a7fc640 1 -- 172.21.15.83:0/140552164 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0aa9c0 con 0x7f5a5c145ed0 2024-03-30T13:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 -- 172.21.15.83:0/140552164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a5c145ed0 msgr2=0x7f5a5c15d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 --2- 172.21.15.83:0/140552164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a5c145ed0 0x7f5a5c15d490 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009870 tx=0x7f5a4c01c4a0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 -- 172.21.15.83:0/140552164 shutdown_connections 2024-03-30T13:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 --2- 172.21.15.83:0/140552164 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a5c06bd70 0x7f5a5c15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 --2- 172.21.15.83:0/140552164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a5c145ed0 0x7f5a5c15d490 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 -- 172.21.15.83:0/140552164 >> 172.21.15.83:0/140552164 conn(0x7f5a5c09aa50 msgr2=0x7f5a5c0b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 -- 172.21.15.83:0/140552164 shutdown_connections 2024-03-30T13:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 -- 172.21.15.83:0/140552164 wait complete. 2024-03-30T13:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 Processor -- start 2024-03-30T13:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 -- start start 2024-03-30T13:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a5c06bd70 0x7f5a5c0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a5c0b6d10 0x7f5a5c13e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a5c145ed0 0x7f5a5c0afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c15eaa0 con 0x7f5a5c06bd70 2024-03-30T13:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c15e920 con 0x7f5a5c0b6d10 2024-03-30T13:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5a5c15ec20 con 0x7f5a5c145ed0 2024-03-30T13:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a5affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a5c06bd70 0x7f5a5c0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a5affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a5c06bd70 0x7f5a5c0ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56258/0 (socket says 172.21.15.83:56258) 2024-03-30T13:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a5affd640 1 -- 172.21.15.83:0/829793148 learned_addr learned my addr 172.21.15.83:0/829793148 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a5b7fe640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a5c145ed0 0x7f5a5c0afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a527fc640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a5c0b6d10 0x7f5a5c13e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a5affd640 1 -- 172.21.15.83:0/829793148 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a5c145ed0 msgr2=0x7f5a5c0afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a5affd640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a5c145ed0 0x7f5a5c0afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a5affd640 1 -- 172.21.15.83:0/829793148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a5c0b6d10 msgr2=0x7f5a5c13e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a5affd640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a5c0b6d10 0x7f5a5c13e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a5affd640 1 -- 172.21.15.83:0/829793148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5c0b1640 con 0x7f5a5c06bd70 2024-03-30T13:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a5b7fe640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a5c145ed0 0x7f5a5c0afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a5affd640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a5c06bd70 0x7f5a5c0ce460 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c01a0d0 tx=0x7f5a4c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a53fff640 1 -- 172.21.15.83:0/829793148 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0bd5f0 con 0x7f5a5c06bd70 2024-03-30T13:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a53fff640 1 -- 172.21.15.83:0/829793148 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a4c0bd7b0 con 0x7f5a5c06bd70 2024-03-30T13:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 -- 172.21.15.83:0/829793148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5c13e7e0 con 0x7f5a5c06bd70 2024-03-30T13:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a53fff640 1 -- 172.21.15.83:0/829793148 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0bdba0 con 0x7f5a5c06bd70 2024-03-30T13:11:22.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 -- 172.21.15.83:0/829793148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a5c13eda0 con 0x7f5a5c06bd70 2024-03-30T13:11:22.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.968+0000 7f5a6145e640 1 -- 172.21.15.83:0/829793148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a5c09f440 con 0x7f5a5c06bd70 2024-03-30T13:11:22.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.972+0000 7f5a53fff640 1 -- 172.21.15.83:0/829793148 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5a4c0a9070 con 0x7f5a5c06bd70 2024-03-30T13:11:22.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.972+0000 7f5a53fff640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5a3c067fc0 0x7f5a3c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.972+0000 7f5a527fc640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5a3c067fc0 0x7f5a3c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.972+0000 7f5a53fff640 1 -- 172.21.15.83:0/829793148 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f5a4c1210d0 con 0x7f5a5c06bd70 2024-03-30T13:11:22.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.972+0000 7f5a527fc640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5a3c067fc0 0x7f5a3c06a480 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c13f320 tx=0x7f5a44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:22.976+0000 7f5a53fff640 1 -- 172.21.15.83:0/829793148 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5a4c0c3060 con 0x7f5a5c06bd70 2024-03-30T13:11:23.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.124+0000 7f5a6145e640 1 -- 172.21.15.83:0/829793148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5a5c04f9e0 con 0x7f5a5c06bd70 2024-03-30T13:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.124+0000 7f5a53fff640 1 -- 172.21.15.83:0/829793148 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f5a4c016150 con 0x7f5a5c06bd70 2024-03-30T13:11:23.134 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.128+0000 7f5a6145e640 1 -- 172.21.15.83:0/829793148 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5a3c067fc0 msgr2=0x7f5a3c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.128+0000 7f5a6145e640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5a3c067fc0 0x7f5a3c06a480 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c13f320 tx=0x7f5a44009040 comp rx=0 tx=0).stop 2024-03-30T13:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.128+0000 7f5a6145e640 1 -- 172.21.15.83:0/829793148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a5c06bd70 msgr2=0x7f5a5c0ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.128+0000 7f5a6145e640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a5c06bd70 0x7f5a5c0ce460 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c01a0d0 tx=0x7f5a4c01ace0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.128+0000 7f5a6145e640 1 -- 172.21.15.83:0/829793148 shutdown_connections 2024-03-30T13:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.128+0000 7f5a6145e640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f5a3c067fc0 0x7f5a3c06a480 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.128+0000 7f5a6145e640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a5c145ed0 0x7f5a5c0afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.128+0000 7f5a6145e640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a5c0b6d10 0x7f5a5c13e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.128+0000 7f5a6145e640 1 --2- 172.21.15.83:0/829793148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a5c06bd70 0x7f5a5c0ce460 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.128+0000 7f5a6145e640 1 -- 172.21.15.83:0/829793148 >> 172.21.15.83:0/829793148 conn(0x7f5a5c09aa50 msgr2=0x7f5a5c15eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:23.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.128+0000 7f5a6145e640 1 -- 172.21.15.83:0/829793148 shutdown_connections 2024-03-30T13:11:23.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.128+0000 7f5a6145e640 1 -- 172.21.15.83:0/829793148 wait complete. 2024-03-30T13:11:23.151 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:23.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5382d68640 1 Processor -- start 2024-03-30T13:11:23.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5382d68640 1 -- start start 2024-03-30T13:11:23.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5382d68640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c15ec80 0x7f537c06b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5382d68640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f537c146580 con 0x7f537c06bba0 2024-03-30T13:11:23.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5382d68640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f537c146860 con 0x7f537c161d30 2024-03-30T13:11:23.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5382d68640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f537c15f110 con 0x7f537c15ec80 2024-03-30T13:11:23.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5381305640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f537c06bba0 0x7f537c147620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60990/0 (socket says 172.21.15.83:60990) 2024-03-30T13:11:23.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5381305640 1 -- 172.21.15.83:0/4204785733 learned_addr learned my addr 172.21.15.83:0/4204785733 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:23.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537bfff640 1 --2- 172.21.15.83:0/4204785733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c15ec80 0x7f537c06b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035125069 0 0) 0x7f537c146580 con 0x7f537c06bba0 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5368003530 con 0x7f537c06bba0 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3111819137 0 0) 0x7f5368003530 con 0x7f537c06bba0 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c15ec80 msgr2=0x7f537c06b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 --2- 172.21.15.83:0/4204785733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c15ec80 0x7f537c06b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 >> v1:172.21.15.153:6789/0 conn(0x7f537c161d30 legacy=0x7f537c0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c146b40 con 0x7f537c06bba0 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f5374001680 con 0x7f537c06bba0 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 >> v1:172.21.15.83:6789/0 conn(0x7f537c06bba0 legacy=0x7f537c147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 --2- 172.21.15.83:0/4204785733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c15ec80 0x7f53680039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 --2- 172.21.15.83:0/4204785733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5368003f70 0x7f5368004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 --2- 172.21.15.83:0/4204785733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5368004d50 0x7f53680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f536800bb60 con 0x7f5368004d50 2024-03-30T13:11:23.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f536800bce0 con 0x7f5368003f70 2024-03-30T13:11:23.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f536800bee0 con 0x7f537c15ec80 2024-03-30T13:11:23.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5381305640 1 --2- 172.21.15.83:0/4204785733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5368004d50 0x7f53680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5381305640 1 -- 172.21.15.83:0/4204785733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c15ec80 msgr2=0x7f53680039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:23.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5381305640 1 --2- 172.21.15.83:0/4204785733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f537c15ec80 0x7f53680039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f537bfff640 1 --2- 172.21.15.83:0/4204785733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5368003f70 0x7f5368004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5381305640 1 -- 172.21.15.83:0/4204785733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5368003f70 msgr2=0x7f5368004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:23.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5381305640 1 --2- 172.21.15.83:0/4204785733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5368003f70 0x7f5368004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.260+0000 7f5381305640 1 -- 172.21.15.83:0/4204785733 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5368003530 con 0x7f5368004d50 2024-03-30T13:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5381305640 1 --2- 172.21.15.83:0/4204785733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5368004d50 0x7f53680051d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f537400c240 tx=0x7f537401f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366a734db3c6f9aa server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374007d20 con 0x7f5368004d50 2024-03-30T13:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5374005ae0 con 0x7f5368004d50 2024-03-30T13:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f537b7fe640 1 -- 172.21.15.83:0/4204785733 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374007070 con 0x7f5368004d50 2024-03-30T13:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 -- 172.21.15.83:0/4204785733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5368004d50 msgr2=0x7f53680051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 --2- 172.21.15.83:0/4204785733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5368004d50 0x7f53680051d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f537400c240 tx=0x7f537401f3f0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5381305640 1 -- 172.21.15.83:0/4204785733 reap_dead start 2024-03-30T13:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 -- 172.21.15.83:0/4204785733 shutdown_connections 2024-03-30T13:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 -- 172.21.15.83:0/4204785733 >> 172.21.15.83:0/4204785733 conn(0x7f537c09aa50 msgr2=0x7f537c0b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 -- 172.21.15.83:0/4204785733 shutdown_connections 2024-03-30T13:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 -- 172.21.15.83:0/4204785733 wait complete. 2024-03-30T13:11:23.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 Processor -- start 2024-03-30T13:11:23.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 -- start start 2024-03-30T13:11:23.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5368004d50 0x7f537c13dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f537c13f7e0 0x7f537c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c13c770 0x7f537c13cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f537c0b2b40 con 0x7f537c13c770 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f537c147100 con 0x7f537c13f7e0 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5382d68640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f537c0b4300 con 0x7f5368004d50 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5381305640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c13c770 0x7f537c13cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5381305640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c13c770 0x7f537c13cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56276/0 (socket says 172.21.15.83:56276) 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5381305640 1 -- 172.21.15.83:0/596416320 learned_addr learned my addr 172.21.15.83:0/596416320 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f5380b04640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5368004d50 0x7f537c13dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.264+0000 7f537bfff640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f537c13f7e0 0x7f537c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f5381305640 1 -- 172.21.15.83:0/596416320 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5368004d50 msgr2=0x7f537c13dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f5381305640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5368004d50 0x7f537c13dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f5381305640 1 -- 172.21.15.83:0/596416320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f537c13f7e0 msgr2=0x7f537c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f5381305640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f537c13f7e0 0x7f537c1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f5381305640 1 -- 172.21.15.83:0/596416320 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c151e30 con 0x7f537c13c770 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f537bfff640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f537c13f7e0 0x7f537c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f5380b04640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5368004d50 0x7f537c13dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f5381305640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c13c770 0x7f537c13cbf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f537409bb40 tx=0x7f5368005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f53797fa640 1 -- 172.21.15.83:0/596416320 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374007d20 con 0x7f537c13c770 2024-03-30T13:11:23.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f53797fa640 1 -- 172.21.15.83:0/596416320 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5374001480 con 0x7f537c13c770 2024-03-30T13:11:23.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f5382d68640 1 -- 172.21.15.83:0/596416320 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537c13e740 con 0x7f537c13c770 2024-03-30T13:11:23.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f53797fa640 1 -- 172.21.15.83:0/596416320 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374007750 con 0x7f537c13c770 2024-03-30T13:11:23.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f5382d68640 1 -- 172.21.15.83:0/596416320 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f537c13ed00 con 0x7f537c13c770 2024-03-30T13:11:23.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f5382d68640 1 -- 172.21.15.83:0/596416320 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f537c09f440 con 0x7f537c13c770 2024-03-30T13:11:23.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f53797fa640 1 -- 172.21.15.83:0/596416320 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f53740047f0 con 0x7f537c13c770 2024-03-30T13:11:23.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f53797fa640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f535c068160 0x7f535c06a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f53797fa640 1 -- 172.21.15.83:0/596416320 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f53741234a0 con 0x7f537c13c770 2024-03-30T13:11:23.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f5380b04640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f535c068160 0x7f535c06a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.268+0000 7f5380b04640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f535c068160 0x7f535c06a620 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f536c001e70 tx=0x7f536c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.272+0000 7f53797fa640 1 -- 172.21.15.83:0/596416320 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f53740b7070 con 0x7f537c13c770 2024-03-30T13:11:23.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 -- 172.21.15.83:0/596416320 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f537c0d1bb0 con 0x7f537c13c770 2024-03-30T13:11:23.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f53797fa640 1 -- 172.21.15.83:0/596416320 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) ==== 104+0+11 (secure 0 0 0) 0x7f5374019100 con 0x7f537c13c770 2024-03-30T13:11:23.440 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 -- 172.21.15.83:0/596416320 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f535c068160 msgr2=0x7f535c06a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f535c068160 0x7f535c06a620 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f536c001e70 tx=0x7f536c009040 comp rx=0 tx=0).stop 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 -- 172.21.15.83:0/596416320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c13c770 msgr2=0x7f537c13cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c13c770 0x7f537c13cbf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f537409bb40 tx=0x7f5368005840 comp rx=0 tx=0).stop 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 -- 172.21.15.83:0/596416320 shutdown_connections 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f535c068160 0x7f535c06a620 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c13c770 0x7f537c13cbf0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f537c13f7e0 0x7f537c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 --2- 172.21.15.83:0/596416320 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5368004d50 0x7f537c13dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 -- 172.21.15.83:0/596416320 >> 172.21.15.83:0/596416320 conn(0x7f537c09aa50 msgr2=0x7f537c06fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:23.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 -- 172.21.15.83:0/596416320 shutdown_connections 2024-03-30T13:11:23.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.432+0000 7f5382d68640 1 -- 172.21.15.83:0/596416320 wait complete. 2024-03-30T13:11:23.464 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:23.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.568+0000 7faf964f5640 1 Processor -- start 2024-03-30T13:11:23.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.568+0000 7faf964f5640 1 -- start start 2024-03-30T13:11:23.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.568+0000 7faf964f5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf9015ca80 0x7faf9009b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.568+0000 7faf964f5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faf900b1300 0x7faf9009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.568+0000 7faf964f5640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf900cd910 con 0x7faf9009af90 2024-03-30T13:11:23.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.568+0000 7faf964f5640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7faf900ce450 con 0x7faf900b1300 2024-03-30T13:11:23.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.568+0000 7faf964f5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faf900cdbb0 con 0x7faf9015ca80 2024-03-30T13:11:23.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.568+0000 7faf8f7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faf900b1300 0x7faf9009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.568+0000 7faf94a92640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7faf9009af90 0x7faf900d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:60994/0 (socket says 172.21.15.83:60994) 2024-03-30T13:11:23.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.568+0000 7faf94a92640 1 -- 172.21.15.83:0/2458336558 learned_addr learned my addr 172.21.15.83:0/2458336558 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:23.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.568+0000 7faf8ffff640 1 --2- 172.21.15.83:0/2458336558 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf9015ca80 0x7faf9009b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf8f7fe640 1 -- 172.21.15.83:0/2458336558 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf9015ca80 msgr2=0x7faf9009b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:23.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf8f7fe640 1 --2- 172.21.15.83:0/2458336558 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf9015ca80 0x7faf9009b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf8f7fe640 1 -- 172.21.15.83:0/2458336558 >> v1:172.21.15.83:6789/0 conn(0x7faf9009af90 legacy=0x7faf900d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf8f7fe640 1 -- 172.21.15.83:0/2458336558 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf900cde90 con 0x7faf900b1300 2024-03-30T13:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf8f7fe640 1 --2- 172.21.15.83:0/2458336558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf900b1300 0x7faf9009aa50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7faf840097c0 tx=0x7faf8401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12dfda6501772535 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf8effd640 1 -- 172.21.15.83:0/2458336558 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840b0070 con 0x7faf900b1300 2024-03-30T13:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf8effd640 1 -- 172.21.15.83:0/2458336558 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf840ab600 con 0x7faf900b1300 2024-03-30T13:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf8effd640 1 -- 172.21.15.83:0/2458336558 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840ab9d0 con 0x7faf900b1300 2024-03-30T13:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf964f5640 1 -- 172.21.15.83:0/2458336558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf900b1300 msgr2=0x7faf9009aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf964f5640 1 --2- 172.21.15.83:0/2458336558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf900b1300 0x7faf9009aa50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7faf840097c0 tx=0x7faf8401c380 comp rx=0 tx=0).stop 2024-03-30T13:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf964f5640 1 -- 172.21.15.83:0/2458336558 shutdown_connections 2024-03-30T13:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf964f5640 1 --2- 172.21.15.83:0/2458336558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf900b1300 0x7faf9009aa50 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf964f5640 1 --2- 172.21.15.83:0/2458336558 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf9015ca80 0x7faf9009b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf964f5640 1 -- 172.21.15.83:0/2458336558 >> 172.21.15.83:0/2458336558 conn(0x7faf900b3d90 msgr2=0x7faf900b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf964f5640 1 -- 172.21.15.83:0/2458336558 shutdown_connections 2024-03-30T13:11:23.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.572+0000 7faf964f5640 1 -- 172.21.15.83:0/2458336558 wait complete. 2024-03-30T13:11:23.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf964f5640 1 Processor -- start 2024-03-30T13:11:23.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf964f5640 1 -- start start 2024-03-30T13:11:23.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf964f5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf9009af90 0x7faf900c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf964f5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf900b1300 0x7faf901578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf964f5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf9015ca80 0x7faf9015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf964f5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7faf90169850 con 0x7faf900b1300 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf964f5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf901696d0 con 0x7faf9015ca80 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf964f5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faf901699d0 con 0x7faf9009af90 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf900b1300 0x7faf901578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf900b1300 0x7faf901578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56292/0 (socket says 172.21.15.83:56292) 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8f7fe640 1 -- 172.21.15.83:0/3039474853 learned_addr learned my addr 172.21.15.83:0/3039474853 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf94a92640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf9015ca80 0x7faf9015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8ffff640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf9009af90 0x7faf900c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8f7fe640 1 -- 172.21.15.83:0/3039474853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf9009af90 msgr2=0x7faf900c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8f7fe640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf9009af90 0x7faf900c5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8f7fe640 1 -- 172.21.15.83:0/3039474853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf9015ca80 msgr2=0x7faf9015a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8f7fe640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf9015ca80 0x7faf9015a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8f7fe640 1 -- 172.21.15.83:0/3039474853 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf900b7b40 con 0x7faf900b1300 2024-03-30T13:11:23.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8f7fe640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf900b1300 0x7faf901578f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7faf84019fb0 tx=0x7faf84019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8cff9640 1 -- 172.21.15.83:0/3039474853 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840b8020 con 0x7faf900b1300 2024-03-30T13:11:23.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8cff9640 1 -- 172.21.15.83:0/3039474853 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf840b4410 con 0x7faf900b1300 2024-03-30T13:11:23.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf964f5640 1 -- 172.21.15.83:0/3039474853 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf90156e10 con 0x7faf900b1300 2024-03-30T13:11:23.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf8cff9640 1 -- 172.21.15.83:0/3039474853 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840b0040 con 0x7faf900b1300 2024-03-30T13:11:23.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf964f5640 1 -- 172.21.15.83:0/3039474853 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf900c5a50 con 0x7faf900b1300 2024-03-30T13:11:23.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.576+0000 7faf964f5640 1 -- 172.21.15.83:0/3039474853 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf900a03d0 con 0x7faf900b1300 2024-03-30T13:11:23.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.580+0000 7faf8cff9640 1 -- 172.21.15.83:0/3039474853 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7faf840bb020 con 0x7faf900b1300 2024-03-30T13:11:23.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.580+0000 7faf8cff9640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faf7c067ff0 0x7faf7c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.580+0000 7faf8cff9640 1 -- 172.21.15.83:0/3039474853 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7faf841204c0 con 0x7faf900b1300 2024-03-30T13:11:23.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.580+0000 7faf8ffff640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faf7c067ff0 0x7faf7c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.580+0000 7faf8ffff640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faf7c067ff0 0x7faf7c06a4b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faf80009790 tx=0x7faf80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.584+0000 7faf8cff9640 1 -- 172.21.15.83:0/3039474853 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7faf840c2030 con 0x7faf900b1300 2024-03-30T13:11:23.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.732+0000 7faf964f5640 1 -- 172.21.15.83:0/3039474853 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faf9004f9e0 con 0x7faf900b1300 2024-03-30T13:11:23.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.732+0000 7faf8cff9640 1 -- 172.21.15.83:0/3039474853 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) ==== 100+0+11 (secure 0 0 0) 0x7faf84016090 con 0x7faf900b1300 2024-03-30T13:11:23.740 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.736+0000 7faf964f5640 1 -- 172.21.15.83:0/3039474853 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faf7c067ff0 msgr2=0x7faf7c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.736+0000 7faf964f5640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faf7c067ff0 0x7faf7c06a4b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faf80009790 tx=0x7faf80008040 comp rx=0 tx=0).stop 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.736+0000 7faf964f5640 1 -- 172.21.15.83:0/3039474853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf900b1300 msgr2=0x7faf901578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.736+0000 7faf964f5640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf900b1300 0x7faf901578f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7faf84019fb0 tx=0x7faf84019120 comp rx=0 tx=0).stop 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.736+0000 7faf964f5640 1 -- 172.21.15.83:0/3039474853 shutdown_connections 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.736+0000 7faf964f5640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faf7c067ff0 0x7faf7c06a4b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.736+0000 7faf964f5640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf9015ca80 0x7faf9015a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.736+0000 7faf964f5640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf900b1300 0x7faf901578f0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.736+0000 7faf964f5640 1 --2- 172.21.15.83:0/3039474853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf9009af90 0x7faf900c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.736+0000 7faf964f5640 1 -- 172.21.15.83:0/3039474853 >> 172.21.15.83:0/3039474853 conn(0x7faf900b3d90 msgr2=0x7faf9006faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.736+0000 7faf964f5640 1 -- 172.21.15.83:0/3039474853 shutdown_connections 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.736+0000 7faf964f5640 1 -- 172.21.15.83:0/3039474853 wait complete. 2024-03-30T13:11:23.760 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:11:23.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1f09c640 1 Processor -- start 2024-03-30T13:11:23.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1f09c640 1 -- start start 2024-03-30T13:11:23.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1f09c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181620e0 0x7f3d18162540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1f09c640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d180adc80 con 0x7f3d180b67b0 2024-03-30T13:11:23.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1f09c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d180adf60 con 0x7f3d1806e410 2024-03-30T13:11:23.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1f09c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d18162a80 con 0x7f3d181620e0 2024-03-30T13:11:23.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1ce38640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3d180b67b0 0x7f3d180afdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:32768/0 (socket says 172.21.15.83:32768) 2024-03-30T13:11:23.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1ce38640 1 -- 172.21.15.83:0/2292150025 learned_addr learned my addr 172.21.15.83:0/2292150025 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:23.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904617900 0 0) 0x7f3d180adc80 con 0x7f3d180b67b0 2024-03-30T13:11:23.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d00003530 con 0x7f3d180b67b0 2024-03-30T13:11:23.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d17fff640 1 --2- 172.21.15.83:0/2292150025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181620e0 0x7f3d18162540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3322126993 0 0) 0x7f3d00003530 con 0x7f3d180b67b0 2024-03-30T13:11:23.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181620e0 msgr2=0x7f3d18162540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:23.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 --2- 172.21.15.83:0/2292150025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181620e0 0x7f3d18162540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 >> v1:172.21.15.153:6789/0 conn(0x7f3d1806e410 legacy=0x7f3d1806e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d180ae240 con 0x7f3d180b67b0 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f3d0c001680 con 0x7f3d180b67b0 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 >> v1:172.21.15.83:6789/0 conn(0x7f3d180b67b0 legacy=0x7f3d180afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 --2- 172.21.15.83:0/2292150025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d000039f0 0x7f3d00003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 --2- 172.21.15.83:0/2292150025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181620e0 0x7f3d00004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 --2- 172.21.15.83:0/2292150025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d00004d50 0x7f3d000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0000bb80 con 0x7f3d000039f0 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0000bd30 con 0x7f3d00004d50 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d0000bf30 con 0x7f3d181620e0 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1ce38640 1 --2- 172.21.15.83:0/2292150025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d000039f0 0x7f3d00003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d17fff640 1 --2- 172.21.15.83:0/2292150025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181620e0 0x7f3d00004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1ce38640 1 -- 172.21.15.83:0/2292150025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181620e0 msgr2=0x7f3d00004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1ce38640 1 --2- 172.21.15.83:0/2292150025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181620e0 0x7f3d00004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1ce38640 1 -- 172.21.15.83:0/2292150025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d00004d50 msgr2=0x7f3d000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:23.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1d639640 1 --2- 172.21.15.83:0/2292150025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d00004d50 0x7f3d000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1ce38640 1 --2- 172.21.15.83:0/2292150025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d00004d50 0x7f3d000051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.872+0000 7f3d1ce38640 1 -- 172.21.15.83:0/2292150025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d00003530 con 0x7f3d000039f0 2024-03-30T13:11:23.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d1ce38640 1 --2- 172.21.15.83:0/2292150025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d000039f0 0x7f3d00003e10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00c1c0 tx=0x7f3d0c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955a68fc6fddf33b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c007d00 con 0x7f3d000039f0 2024-03-30T13:11:23.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0c0a9020 con 0x7f3d000039f0 2024-03-30T13:11:23.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d177fe640 1 -- 172.21.15.83:0/2292150025 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c005b20 con 0x7f3d000039f0 2024-03-30T13:11:23.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d1f09c640 1 -- 172.21.15.83:0/2292150025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d000039f0 msgr2=0x7f3d00003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d1f09c640 1 --2- 172.21.15.83:0/2292150025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d000039f0 0x7f3d00003e10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00c1c0 tx=0x7f3d0c01cc60 comp rx=0 tx=0).stop 2024-03-30T13:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d1d639640 1 -- 172.21.15.83:0/2292150025 reap_dead start 2024-03-30T13:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d1f09c640 1 -- 172.21.15.83:0/2292150025 shutdown_connections 2024-03-30T13:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d1f09c640 1 -- 172.21.15.83:0/2292150025 >> 172.21.15.83:0/2292150025 conn(0x7f3d18072ea0 msgr2=0x7f3d1806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d1f09c640 1 -- 172.21.15.83:0/2292150025 shutdown_connections 2024-03-30T13:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d1f09c640 1 -- 172.21.15.83:0/2292150025 wait complete. 2024-03-30T13:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d1f09c640 1 Processor -- start 2024-03-30T13:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.876+0000 7f3d1f09c640 1 -- start start 2024-03-30T13:11:23.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1f09c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d000039f0 0x7f3d18168d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1f09c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181605c0 0x7f3d18160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1f09c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d18153cd0 0x7f3d18154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1f09c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1816a230 con 0x7f3d18153cd0 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1f09c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d181628d0 con 0x7f3d000039f0 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1f09c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d1816a3b0 con 0x7f3d181605c0 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1d639640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d18153cd0 0x7f3d18154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1d639640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d18153cd0 0x7f3d18154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56316/0 (socket says 172.21.15.83:56316) 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1d639640 1 -- 172.21.15.83:0/3968163073 learned_addr learned my addr 172.21.15.83:0/3968163073 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1ce38640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d000039f0 0x7f3d18168d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d17fff640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181605c0 0x7f3d18160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1d639640 1 -- 172.21.15.83:0/3968163073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181605c0 msgr2=0x7f3d18160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1d639640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181605c0 0x7f3d18160a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1d639640 1 -- 172.21.15.83:0/3968163073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d000039f0 msgr2=0x7f3d18168d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1d639640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d000039f0 0x7f3d18168d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1d639640 1 -- 172.21.15.83:0/3968163073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d181525b0 con 0x7f3d18153cd0 2024-03-30T13:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1d639640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d18153cd0 0x7f3d18154150 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3d180d08f0 tx=0x7f3d1000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d157fa640 1 -- 172.21.15.83:0/3968163073 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10018070 con 0x7f3d18153cd0 2024-03-30T13:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d157fa640 1 -- 172.21.15.83:0/3968163073 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d10003b80 con 0x7f3d18153cd0 2024-03-30T13:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1f09c640 1 -- 172.21.15.83:0/3968163073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d18152890 con 0x7f3d18153cd0 2024-03-30T13:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d157fa640 1 -- 172.21.15.83:0/3968163073 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10005070 con 0x7f3d18153cd0 2024-03-30T13:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1f09c640 1 -- 172.21.15.83:0/3968163073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d18152e50 con 0x7f3d18153cd0 2024-03-30T13:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1f09c640 1 -- 172.21.15.83:0/3968163073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d18160f80 con 0x7f3d18153cd0 2024-03-30T13:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d157fa640 1 -- 172.21.15.83:0/3968163073 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f3d1001b070 con 0x7f3d18153cd0 2024-03-30T13:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d157fa640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d04067ff0 0x7f3d0406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1ce38640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d04067ff0 0x7f3d0406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d157fa640 1 -- 172.21.15.83:0/3968163073 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f3d10085b70 con 0x7f3d18153cd0 2024-03-30T13:11:23.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.880+0000 7f3d1ce38640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d04067ff0 0x7f3d0406a4b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0aa000 tx=0x7f3d181590b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:23.884+0000 7f3d157fa640 1 -- 172.21.15.83:0/3968163073 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3d10056390 con 0x7f3d18153cd0 2024-03-30T13:11:24.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.052+0000 7f3d1f09c640 1 -- 172.21.15.83:0/3968163073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3d18158e90 con 0x7f3d18153cd0 2024-03-30T13:11:24.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.052+0000 7f3d157fa640 1 -- 172.21.15.83:0/3968163073 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) ==== 80+0+0 (secure 0 0 0) 0x7f3d10055c90 con 0x7f3d18153cd0 2024-03-30T13:11:24.061 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-03-30T13:11:24.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.056+0000 7f3d1f09c640 1 -- 172.21.15.83:0/3968163073 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d04067ff0 msgr2=0x7f3d0406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.056+0000 7f3d1f09c640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d04067ff0 0x7f3d0406a4b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0aa000 tx=0x7f3d181590b0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.056+0000 7f3d1f09c640 1 -- 172.21.15.83:0/3968163073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d18153cd0 msgr2=0x7f3d18154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.056+0000 7f3d1f09c640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d18153cd0 0x7f3d18154150 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3d180d08f0 tx=0x7f3d1000dc00 comp rx=0 tx=0).stop 2024-03-30T13:11:24.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.056+0000 7f3d1f09c640 1 -- 172.21.15.83:0/3968163073 shutdown_connections 2024-03-30T13:11:24.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.056+0000 7f3d1f09c640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3d04067ff0 0x7f3d0406a4b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.056+0000 7f3d1f09c640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d18153cd0 0x7f3d18154150 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.056+0000 7f3d1f09c640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d181605c0 0x7f3d18160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.056+0000 7f3d1f09c640 1 --2- 172.21.15.83:0/3968163073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d000039f0 0x7f3d18168d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.056+0000 7f3d1f09c640 1 -- 172.21.15.83:0/3968163073 >> 172.21.15.83:0/3968163073 conn(0x7f3d18072ea0 msgr2=0x7f3d1806e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:24.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.056+0000 7f3d1f09c640 1 -- 172.21.15.83:0/3968163073 shutdown_connections 2024-03-30T13:11:24.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.056+0000 7f3d1f09c640 1 -- 172.21.15.83:0/3968163073 wait complete. 2024-03-30T13:11:24.078 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-03-30T13:11:24.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:24.079 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-30T13:11:24.095 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33195]: fuse finished with error 0 and tester_r 0 2024-03-30T13:11:24.101 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:11:24.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:24.104 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-30T13:11:24.247 INFO:tasks.cephfs.mount:Terminating background process 2024-03-30T13:11:24.247 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:11:24.247 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:24.256 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336512k,nr_inodes=4084128,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16917 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-30T13:11:24.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:11:24.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:24.256 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-30T13:11:24.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:11:24.309 INFO:teuthology.orchestra.run.smithi083.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-03-30T13:11:24.309 INFO:tasks.cephfs.mount:Terminating background process 2024-03-30T13:11:24.309 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:11:24.309 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:24.323 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336524k,nr_inodes=4084131,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20907 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T13:11:24.323 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:11:24.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:24.324 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-30T13:11:24.371 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-03-30T13:11:24.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:11:24.373 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:24.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a8eaf7640 1 Processor -- start 2024-03-30T13:11:24.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a8eaf7640 1 -- start start 2024-03-30T13:11:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a8eaf7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9a880b0240 0x7f9a88072e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a8eaf7640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8815ebb0 con 0x7f9a8815e7d0 2024-03-30T13:11:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a8eaf7640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8809ae60 con 0x7f9a8806b660 2024-03-30T13:11:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a8eaf7640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f9a880b0a70 con 0x7f9a880b0240 2024-03-30T13:11:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a87fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9a880b0240 0x7f9a88072e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a8c893640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f9a8815e7d0 0x7f9a880b4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:32784/0 (socket says 172.21.15.83:32784) 2024-03-30T13:11:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a87fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9a880b0240 0x7f9a88072e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56318/0 (socket says 172.21.15.83:56318) 2024-03-30T13:11:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a8c893640 1 -- 172.21.15.83:0/2840186503 learned_addr learned my addr 172.21.15.83:0/2840186503 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a87fff640 1 -- 172.21.15.83:0/2840186503 >> v1:172.21.15.153:6789/0 conn(0x7f9a8806b660 legacy=0x7f9a880aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a87fff640 1 -- 172.21.15.83:0/2840186503 >> v1:172.21.15.83:6789/0 conn(0x7f9a8815e7d0 legacy=0x7f9a880b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a87fff640 1 -- 172.21.15.83:0/2840186503 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a880b60b0 con 0x7f9a880b0240 2024-03-30T13:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.492+0000 7f9a87fff640 1 --2- 172.21.15.83:0/2840186503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a880b0240 0x7f9a88072e00 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9a740097c0 tx=0x7f9a7401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617d4a274b2b1084 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a877fe640 1 -- 172.21.15.83:0/2840186503 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a740b1070 con 0x7f9a880b0240 2024-03-30T13:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a877fe640 1 -- 172.21.15.83:0/2840186503 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a740ac630 con 0x7f9a880b0240 2024-03-30T13:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a877fe640 1 -- 172.21.15.83:0/2840186503 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a740a8050 con 0x7f9a880b0240 2024-03-30T13:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/2840186503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a880b0240 msgr2=0x7f9a88072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 --2- 172.21.15.83:0/2840186503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a880b0240 0x7f9a88072e00 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9a740097c0 tx=0x7f9a7401c3d0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/2840186503 shutdown_connections 2024-03-30T13:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 --2- 172.21.15.83:0/2840186503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a880b0240 0x7f9a88072e00 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/2840186503 >> 172.21.15.83:0/2840186503 conn(0x7f9a880b68c0 msgr2=0x7f9a880b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:24.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/2840186503 shutdown_connections 2024-03-30T13:11:24.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/2840186503 wait complete. 2024-03-30T13:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 Processor -- start 2024-03-30T13:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 -- start start 2024-03-30T13:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a8806b660 0x7f9a880b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a880b0240 0x7f9a881fb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a8815e7d0 0x7f9a881fbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9a880af660 con 0x7f9a880b0240 2024-03-30T13:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8806bee0 con 0x7f9a8815e7d0 2024-03-30T13:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8eaf7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8816cdf0 con 0x7f9a8806b660 2024-03-30T13:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a880b0240 0x7f9a881fb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a880b0240 0x7f9a881fb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56334/0 (socket says 172.21.15.83:56334) 2024-03-30T13:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a87fff640 1 -- 172.21.15.83:0/1030573853 learned_addr learned my addr 172.21.15.83:0/1030573853 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8d094640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a8815e7d0 0x7f9a881fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a8c893640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a8806b660 0x7f9a880b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a87fff640 1 -- 172.21.15.83:0/1030573853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a8806b660 msgr2=0x7f9a880b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a87fff640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a8806b660 0x7f9a880b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a87fff640 1 -- 172.21.15.83:0/1030573853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a8815e7d0 msgr2=0x7f9a881fbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a87fff640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a8815e7d0 0x7f9a881fbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a87fff640 1 -- 172.21.15.83:0/1030573853 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a88149c10 con 0x7f9a880b0240 2024-03-30T13:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a87fff640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a880b0240 0x7f9a881fb720 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f9a74018fe0 tx=0x7f9a74019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a857fa640 1 -- 172.21.15.83:0/1030573853 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a740b9020 con 0x7f9a880b0240 2024-03-30T13:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a857fa640 1 -- 172.21.15.83:0/1030573853 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a740ab650 con 0x7f9a880b0240 2024-03-30T13:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.496+0000 7f9a857fa640 1 -- 172.21.15.83:0/1030573853 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a740b1040 con 0x7f9a880b0240 2024-03-30T13:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.500+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/1030573853 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a881528d0 con 0x7f9a880b0240 2024-03-30T13:11:24.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.500+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/1030573853 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a88153450 con 0x7f9a880b0240 2024-03-30T13:11:24.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.500+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/1030573853 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a88068dd0 con 0x7f9a880b0240 2024-03-30T13:11:24.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.500+0000 7f9a857fa640 1 -- 172.21.15.83:0/1030573853 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9a740bc020 con 0x7f9a880b0240 2024-03-30T13:11:24.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.500+0000 7f9a857fa640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9a6c067fc0 0x7f9a6c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.500+0000 7f9a857fa640 1 -- 172.21.15.83:0/1030573853 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f9a741204a0 con 0x7f9a880b0240 2024-03-30T13:11:24.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.500+0000 7f9a8c893640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9a6c067fc0 0x7f9a6c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.500+0000 7f9a8c893640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9a6c067fc0 0x7f9a6c06a480 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c000f70 tx=0x7f9a7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:24.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.508+0000 7f9a857fa640 1 -- 172.21.15.83:0/1030573853 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9a74016050 con 0x7f9a880b0240 2024-03-30T13:11:24.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/1030573853 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a880aefb0 con 0x7f9a880b0240 2024-03-30T13:11:24.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a857fa640 1 -- 172.21.15.83:0/1030573853 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5184 (secure 0 0 0) 0x7f9a740f0cc0 con 0x7f9a880b0240 2024-03-30T13:11:24.700 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:24.700 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2103427036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2103427036},{"type":"v1","addr":"172.21.15.153:6833","nonce":2103427036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/718325648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":718325648},{"type":"v1","addr":"172.21.15.153:6835","nonce":718325648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2547254149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2547254149},{"type":"v1","addr":"172.21.15.83:6836","nonce":2547254149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:09:29.206969+0000","modified":"2024-03-30T13:11:14.456996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1254317891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1254317891},{"type":"v1","addr":"172.21.15.83:6837","nonce":1254317891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":2}]} 2024-03-30T13:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 19 2024-03-30T13:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/1030573853 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9a6c067fc0 msgr2=0x7f9a6c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9a6c067fc0 0x7f9a6c06a480 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c000f70 tx=0x7f9a7c009040 comp rx=0 tx=0).stop 2024-03-30T13:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/1030573853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a880b0240 msgr2=0x7f9a881fb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a880b0240 0x7f9a881fb720 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f9a74018fe0 tx=0x7f9a74019170 comp rx=0 tx=0).stop 2024-03-30T13:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/1030573853 shutdown_connections 2024-03-30T13:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9a6c067fc0 0x7f9a6c06a480 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a8815e7d0 0x7f9a881fbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a880b0240 0x7f9a881fb720 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 --2- 172.21.15.83:0/1030573853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a8806b660 0x7f9a880b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/1030573853 >> 172.21.15.83:0/1030573853 conn(0x7f9a880b68c0 msgr2=0x7f9a8806fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:24.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/1030573853 shutdown_connections 2024-03-30T13:11:24.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.692+0000 7f9a8eaf7640 1 -- 172.21.15.83:0/1030573853 wait complete. 2024-03-30T13:11:24.717 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:24.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.852+0000 7fab02fcd640 1 Processor -- start 2024-03-30T13:11:24.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.852+0000 7fab02fcd640 1 -- start start 2024-03-30T13:11:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab02fcd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faafc15fb60 0x7faafc0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab02fcd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faafc0ccc50 0x7faafc09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab02fcd640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faafc0cd130 con 0x7faafc0b1200 2024-03-30T13:11:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab02fcd640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7faafc0cd410 con 0x7faafc15fb60 2024-03-30T13:11:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab02fcd640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7faafc0cd6f0 con 0x7faafc0ccc50 2024-03-30T13:11:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab00d69640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faafc15fb60 0x7faafc0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab00d69640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faafc15fb60 0x7faafc0d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56350/0 (socket says 172.21.15.83:56350) 2024-03-30T13:11:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab00d69640 1 -- 172.21.15.83:0/1603336749 learned_addr learned my addr 172.21.15.83:0/1603336749 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab0156a640 1 --2- 172.21.15.83:0/1603336749 >> v2:172.21.15.153:3300/0 conn(0x7faafc0ccc50 0x7faafc09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab00d69640 1 -- 172.21.15.83:0/1603336749 >> v2:172.21.15.153:3300/0 conn(0x7faafc0ccc50 msgr2=0x7faafc09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab00d69640 1 --2- 172.21.15.83:0/1603336749 >> v2:172.21.15.153:3300/0 conn(0x7faafc0ccc50 0x7faafc09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab00d69640 1 -- 172.21.15.83:0/1603336749 >> v1:172.21.15.83:6789/0 conn(0x7faafc0b1200 legacy=0x7faafc0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab00d69640 1 -- 172.21.15.83:0/1603336749 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc0cd9d0 con 0x7faafc15fb60 2024-03-30T13:11:24.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab00d69640 1 --2- 172.21.15.83:0/1603336749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc15fb60 0x7faafc0d0cf0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7faafc0d21f0 tx=0x7faaf401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be37017721a96359 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7faafb7fe640 1 -- 172.21.15.83:0/1603336749 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf40a5670 con 0x7faafc15fb60 2024-03-30T13:11:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7faafb7fe640 1 -- 172.21.15.83:0/1603336749 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf40a5810 con 0x7faafc15fb60 2024-03-30T13:11:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7faafb7fe640 1 -- 172.21.15.83:0/1603336749 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf40a5be0 con 0x7faafc15fb60 2024-03-30T13:11:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab02fcd640 1 -- 172.21.15.83:0/1603336749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc15fb60 msgr2=0x7faafc0d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab02fcd640 1 --2- 172.21.15.83:0/1603336749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc15fb60 0x7faafc0d0cf0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7faafc0d21f0 tx=0x7faaf401c8a0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab02fcd640 1 -- 172.21.15.83:0/1603336749 shutdown_connections 2024-03-30T13:11:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab02fcd640 1 --2- 172.21.15.83:0/1603336749 >> v2:172.21.15.153:3300/0 conn(0x7faafc0ccc50 0x7faafc09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab02fcd640 1 --2- 172.21.15.83:0/1603336749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc15fb60 0x7faafc0d0cf0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.856+0000 7fab02fcd640 1 -- 172.21.15.83:0/1603336749 >> 172.21.15.83:0/1603336749 conn(0x7faafc0b3dd0 msgr2=0x7faafc0b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 -- 172.21.15.83:0/1603336749 shutdown_connections 2024-03-30T13:11:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 -- 172.21.15.83:0/1603336749 wait complete. 2024-03-30T13:11:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 Processor -- start 2024-03-30T13:11:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 -- start start 2024-03-30T13:11:24.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc0b1200 0x7faafc1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faafc0ccc50 0x7faafc0c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faafc15fb60 0x7faafc0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7faafc1697b0 con 0x7faafc0b1200 2024-03-30T13:11:24.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faafc169630 con 0x7faafc0ccc50 2024-03-30T13:11:24.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faafc169930 con 0x7faafc15fb60 2024-03-30T13:11:24.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab00d69640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc0b1200 0x7faafc1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab00d69640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc0b1200 0x7faafc1552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56354/0 (socket says 172.21.15.83:56354) 2024-03-30T13:11:24.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab00d69640 1 -- 172.21.15.83:0/31856248 learned_addr learned my addr 172.21.15.83:0/31856248 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:24.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab0156a640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faafc15fb60 0x7faafc0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7faafbfff640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faafc0ccc50 0x7faafc0c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab00d69640 1 -- 172.21.15.83:0/31856248 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faafc15fb60 msgr2=0x7faafc0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab00d69640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faafc15fb60 0x7faafc0c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab00d69640 1 -- 172.21.15.83:0/31856248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faafc0ccc50 msgr2=0x7faafc0c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab00d69640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faafc0ccc50 0x7faafc0c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab00d69640 1 -- 172.21.15.83:0/31856248 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc0c8ca0 con 0x7faafc0b1200 2024-03-30T13:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab00d69640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc0b1200 0x7faafc1552f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7faaf40194b0 tx=0x7faaf4019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7faaf97fa640 1 -- 172.21.15.83:0/31856248 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf40bc020 con 0x7faafc0b1200 2024-03-30T13:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7faaf97fa640 1 -- 172.21.15.83:0/31856248 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf40b8670 con 0x7faafc0b1200 2024-03-30T13:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 -- 172.21.15.83:0/31856248 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faafc0ca610 con 0x7faafc0b1200 2024-03-30T13:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7faaf97fa640 1 -- 172.21.15.83:0/31856248 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf4009510 con 0x7faafc0b1200 2024-03-30T13:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 -- 172.21.15.83:0/31856248 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faafc0caeb0 con 0x7faafc0b1200 2024-03-30T13:11:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.860+0000 7fab02fcd640 1 -- 172.21.15.83:0/31856248 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faafc068dd0 con 0x7faafc0b1200 2024-03-30T13:11:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.864+0000 7faaf97fa640 1 -- 172.21.15.83:0/31856248 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7faaf40bf020 con 0x7faafc0b1200 2024-03-30T13:11:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.864+0000 7faaf97fa640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faadc067fc0 0x7faadc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.864+0000 7faaf97fa640 1 -- 172.21.15.83:0/31856248 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7faaf4121500 con 0x7faafc0b1200 2024-03-30T13:11:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.864+0000 7faafbfff640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faadc067fc0 0x7faadc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.864+0000 7faafbfff640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faadc067fc0 0x7faadc06a480 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faae4007fd0 tx=0x7faae4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:24.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:24.868+0000 7faaf97fa640 1 -- 172.21.15.83:0/31856248 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7faaf40c6030 con 0x7faafc0b1200 2024-03-30T13:11:25.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.048+0000 7fab02fcd640 1 -- 172.21.15.83:0/31856248 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faafc0cff90 con 0x7faafc0b1200 2024-03-30T13:11:25.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.048+0000 7faaf97fa640 1 -- 172.21.15.83:0/31856248 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16712 (secure 0 0 0) 0x7faaf40165e0 con 0x7faafc0b1200 2024-03-30T13:11:25.057 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:25.057 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":37,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:11:21.134552+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:09:27.405927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:09:28.161081+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:25.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.052+0000 7fab02fcd640 1 -- 172.21.15.83:0/31856248 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faadc067fc0 msgr2=0x7faadc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.052+0000 7fab02fcd640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faadc067fc0 0x7faadc06a480 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faae4007fd0 tx=0x7faae4009040 comp rx=0 tx=0).stop 2024-03-30T13:11:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.052+0000 7fab02fcd640 1 -- 172.21.15.83:0/31856248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc0b1200 msgr2=0x7faafc1552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.052+0000 7fab02fcd640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc0b1200 0x7faafc1552f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7faaf40194b0 tx=0x7faaf4019640 comp rx=0 tx=0).stop 2024-03-30T13:11:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.052+0000 7fab02fcd640 1 -- 172.21.15.83:0/31856248 shutdown_connections 2024-03-30T13:11:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.052+0000 7fab02fcd640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faadc067fc0 0x7faadc06a480 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.052+0000 7fab02fcd640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faafc15fb60 0x7faafc0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.052+0000 7fab02fcd640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faafc0ccc50 0x7faafc0c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.052+0000 7fab02fcd640 1 --2- 172.21.15.83:0/31856248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc0b1200 0x7faafc1552f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.052+0000 7fab02fcd640 1 -- 172.21.15.83:0/31856248 >> 172.21.15.83:0/31856248 conn(0x7faafc0b3dd0 msgr2=0x7faafc070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.052+0000 7fab02fcd640 1 -- 172.21.15.83:0/31856248 shutdown_connections 2024-03-30T13:11:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.052+0000 7fab02fcd640 1 -- 172.21.15.83:0/31856248 wait complete. 2024-03-30T13:11:25.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:08:10.237302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:09:27.405927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:09:28.161081+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:25.077 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:25.085 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:11:25.123 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:11:25.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.196+0000 7efd46015640 1 Processor -- start 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.196+0000 7efd46015640 1 -- start start 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.196+0000 7efd46015640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efd40145c40 0x7efd4009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.196+0000 7efd46015640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd40160090 0x7efd401604f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.196+0000 7efd46015640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efd40160a30 0x7efd4006b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.196+0000 7efd46015640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7efd400ae3a0 con 0x7efd40145c40 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.196+0000 7efd46015640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efd40160ea0 con 0x7efd40160a30 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.196+0000 7efd46015640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efd400b0690 con 0x7efd40160090 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.196+0000 7efd3f7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efd40145c40 0x7efd4009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.196+0000 7efd3f7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efd40145c40 0x7efd4009aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56356/0 (socket says 172.21.15.83:56356) 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.196+0000 7efd3f7fe640 1 -- 172.21.15.83:0/483220600 learned_addr learned my addr 172.21.15.83:0/483220600 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd3ffff640 1 --2- 172.21.15.83:0/483220600 >> v2:172.21.15.153:3300/0 conn(0x7efd40160a30 0x7efd4006b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd3f7fe640 1 -- 172.21.15.83:0/483220600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd40160090 msgr2=0x7efd401604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:25.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd3f7fe640 1 --2- 172.21.15.83:0/483220600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd40160090 0x7efd401604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd3f7fe640 1 -- 172.21.15.83:0/483220600 >> v2:172.21.15.153:3300/0 conn(0x7efd40160a30 msgr2=0x7efd4006b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:25.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd3f7fe640 1 --2- 172.21.15.83:0/483220600 >> v2:172.21.15.153:3300/0 conn(0x7efd40160a30 0x7efd4006b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd3f7fe640 1 -- 172.21.15.83:0/483220600 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd400b3520 con 0x7efd40145c40 2024-03-30T13:11:25.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd3f7fe640 1 --2- 172.21.15.83:0/483220600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd40145c40 0x7efd4009aa50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7efd400711c0 tx=0x7efd3801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4308f15e741a6c2d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd3e7fc640 1 -- 172.21.15.83:0/483220600 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd380a5700 con 0x7efd40145c40 2024-03-30T13:11:25.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd3e7fc640 1 -- 172.21.15.83:0/483220600 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd380a58a0 con 0x7efd40145c40 2024-03-30T13:11:25.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd3e7fc640 1 -- 172.21.15.83:0/483220600 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd380a5c70 con 0x7efd40145c40 2024-03-30T13:11:25.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd46015640 1 -- 172.21.15.83:0/483220600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd40145c40 msgr2=0x7efd4009aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd46015640 1 --2- 172.21.15.83:0/483220600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd40145c40 0x7efd4009aa50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7efd400711c0 tx=0x7efd3801c9f0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd46015640 1 -- 172.21.15.83:0/483220600 shutdown_connections 2024-03-30T13:11:25.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd46015640 1 --2- 172.21.15.83:0/483220600 >> v2:172.21.15.153:3300/0 conn(0x7efd40160a30 0x7efd4006b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd46015640 1 --2- 172.21.15.83:0/483220600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd40160090 0x7efd401604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd46015640 1 --2- 172.21.15.83:0/483220600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd40145c40 0x7efd4009aa50 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd46015640 1 -- 172.21.15.83:0/483220600 >> 172.21.15.83:0/483220600 conn(0x7efd40072d30 msgr2=0x7efd400b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:25.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd46015640 1 -- 172.21.15.83:0/483220600 shutdown_connections 2024-03-30T13:11:25.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.200+0000 7efd46015640 1 -- 172.21.15.83:0/483220600 wait complete. 2024-03-30T13:11:25.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd46015640 1 Processor -- start 2024-03-30T13:11:25.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd46015640 1 -- start start 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd46015640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd40145c40 0x7efd401585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd46015640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd40160090 0x7efd401417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd46015640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd40160a30 0x7efd4013d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd46015640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efd400b0af0 con 0x7efd40145c40 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd46015640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd400b0970 con 0x7efd40160090 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd46015640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efd400b0c70 con 0x7efd40160a30 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd3f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd40145c40 0x7efd401585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd3f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd40145c40 0x7efd401585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56360/0 (socket says 172.21.15.83:56360) 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd3f7fe640 1 -- 172.21.15.83:0/2710578025 learned_addr learned my addr 172.21.15.83:0/2710578025 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd3effd640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd40160090 0x7efd401417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd3ffff640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd40160a30 0x7efd4013d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd3f7fe640 1 -- 172.21.15.83:0/2710578025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd40160a30 msgr2=0x7efd4013d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd3f7fe640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd40160a30 0x7efd4013d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd3f7fe640 1 -- 172.21.15.83:0/2710578025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd40160090 msgr2=0x7efd401417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd3f7fe640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd40160090 0x7efd401417e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd3f7fe640 1 -- 172.21.15.83:0/2710578025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd40143570 con 0x7efd40145c40 2024-03-30T13:11:25.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd3f7fe640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd40145c40 0x7efd401585e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7efd380af040 tx=0x7efd38019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd37fff640 1 -- 172.21.15.83:0/2710578025 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd380b8670 con 0x7efd40145c40 2024-03-30T13:11:25.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd37fff640 1 -- 172.21.15.83:0/2710578025 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd380be070 con 0x7efd40145c40 2024-03-30T13:11:25.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd46015640 1 -- 172.21.15.83:0/2710578025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd40143850 con 0x7efd40145c40 2024-03-30T13:11:25.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd37fff640 1 -- 172.21.15.83:0/2710578025 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd380b8a50 con 0x7efd40145c40 2024-03-30T13:11:25.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd46015640 1 -- 172.21.15.83:0/2710578025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd40143e10 con 0x7efd40145c40 2024-03-30T13:11:25.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd46015640 1 -- 172.21.15.83:0/2710578025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd4009f3d0 con 0x7efd40145c40 2024-03-30T13:11:25.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.204+0000 7efd37fff640 1 -- 172.21.15.83:0/2710578025 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7efd380b8bf0 con 0x7efd40145c40 2024-03-30T13:11:25.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.208+0000 7efd37fff640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efd24067fc0 0x7efd2406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.208+0000 7efd37fff640 1 -- 172.21.15.83:0/2710578025 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7efd381217c0 con 0x7efd40145c40 2024-03-30T13:11:25.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.208+0000 7efd3effd640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efd24067fc0 0x7efd2406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.208+0000 7efd3effd640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efd24067fc0 0x7efd2406a480 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efd400d0bd0 tx=0x7efd28009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.216+0000 7efd37fff640 1 -- 172.21.15.83:0/2710578025 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7efd380165e0 con 0x7efd40145c40 2024-03-30T13:11:25.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.364+0000 7efd46015640 1 -- 172.21.15.83:0/2710578025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efd4004f9e0 con 0x7efd40145c40 2024-03-30T13:11:25.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd37fff640 1 -- 172.21.15.83:0/2710578025 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7efd380f2130 con 0x7efd40145c40 2024-03-30T13:11:25.374 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-03-30T13:11:25.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd46015640 1 -- 172.21.15.83:0/2710578025 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efd24067fc0 msgr2=0x7efd2406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd46015640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efd24067fc0 0x7efd2406a480 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efd400d0bd0 tx=0x7efd28009110 comp rx=0 tx=0).stop 2024-03-30T13:11:25.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd46015640 1 -- 172.21.15.83:0/2710578025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd40145c40 msgr2=0x7efd401585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd46015640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd40145c40 0x7efd401585e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7efd380af040 tx=0x7efd38019790 comp rx=0 tx=0).stop 2024-03-30T13:11:25.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd46015640 1 -- 172.21.15.83:0/2710578025 shutdown_connections 2024-03-30T13:11:25.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd46015640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efd24067fc0 0x7efd2406a480 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd46015640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd40160a30 0x7efd4013d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd46015640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd40160090 0x7efd401417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd46015640 1 --2- 172.21.15.83:0/2710578025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd40145c40 0x7efd401585e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd46015640 1 -- 172.21.15.83:0/2710578025 >> 172.21.15.83:0/2710578025 conn(0x7efd40072d30 msgr2=0x7efd400cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:25.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd46015640 1 -- 172.21.15.83:0/2710578025 shutdown_connections 2024-03-30T13:11:25.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.368+0000 7efd46015640 1 -- 172.21.15.83:0/2710578025 wait complete. 2024-03-30T13:11:25.392 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:25.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6228507640 1 Processor -- start 2024-03-30T13:11:25.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6228507640 1 -- start start 2024-03-30T13:11:25.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6228507640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f622015c7f0 0x7f62200d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6228507640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f62201605a0 0x7f622009b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6228507640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62200aff40 con 0x7f6220160140 2024-03-30T13:11:25.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6228507640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f62200b0fe0 con 0x7f62201605a0 2024-03-30T13:11:25.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6228507640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f62200b3ca0 con 0x7f622015c7f0 2024-03-30T13:11:25.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6226aa4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f62201605a0 0x7f622009b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6226aa4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f62201605a0 0x7f622009b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56370/0 (socket says 172.21.15.83:56370) 2024-03-30T13:11:25.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6226aa4640 1 -- 172.21.15.83:0/2929209363 learned_addr learned my addr 172.21.15.83:0/2929209363 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:25.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f62262a3640 1 --2- 172.21.15.83:0/2929209363 >> v2:172.21.15.153:3300/0 conn(0x7f622015c7f0 0x7f62200d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6226aa4640 1 -- 172.21.15.83:0/2929209363 >> v2:172.21.15.153:3300/0 conn(0x7f622015c7f0 msgr2=0x7f62200d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:25.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6226aa4640 1 --2- 172.21.15.83:0/2929209363 >> v2:172.21.15.153:3300/0 conn(0x7f622015c7f0 0x7f62200d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6226aa4640 1 -- 172.21.15.83:0/2929209363 >> v1:172.21.15.83:6789/0 conn(0x7f6220160140 legacy=0x7f622009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f62252a1640 1 -- 172.21.15.83:0/2929209363 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260332391 0 0) 0x7f62200aff40 con 0x7f6220160140 2024-03-30T13:11:25.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f6226aa4640 1 -- 172.21.15.83:0/2929209363 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62200b0220 con 0x7f62201605a0 2024-03-30T13:11:25.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.552+0000 7f62262a3640 1 --2- 172.21.15.83:0/2929209363 >> v2:172.21.15.153:3300/0 conn(0x7f622015c7f0 0x7f62200d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:25.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6226aa4640 1 --2- 172.21.15.83:0/2929209363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62201605a0 0x7f622009b160 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6220072dc0 tx=0x7f621c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea276657d8c65fc2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f62252a1640 1 -- 172.21.15.83:0/2929209363 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0a57a0 con 0x7f62201605a0 2024-03-30T13:11:25.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f62252a1640 1 -- 172.21.15.83:0/2929209363 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621c0a5940 con 0x7f62201605a0 2024-03-30T13:11:25.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f62252a1640 1 -- 172.21.15.83:0/2929209363 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0a5d10 con 0x7f62201605a0 2024-03-30T13:11:25.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 -- 172.21.15.83:0/2929209363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62201605a0 msgr2=0x7f622009b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 --2- 172.21.15.83:0/2929209363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62201605a0 0x7f622009b160 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6220072dc0 tx=0x7f621c01c9f0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 -- 172.21.15.83:0/2929209363 shutdown_connections 2024-03-30T13:11:25.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 --2- 172.21.15.83:0/2929209363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62201605a0 0x7f622009b160 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 --2- 172.21.15.83:0/2929209363 >> v2:172.21.15.153:3300/0 conn(0x7f622015c7f0 0x7f62200d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 -- 172.21.15.83:0/2929209363 >> 172.21.15.83:0/2929209363 conn(0x7f62200b3e70 msgr2=0x7f62200b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:25.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 -- 172.21.15.83:0/2929209363 shutdown_connections 2024-03-30T13:11:25.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 -- 172.21.15.83:0/2929209363 wait complete. 2024-03-30T13:11:25.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 Processor -- start 2024-03-30T13:11:25.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 -- start start 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f622015c7f0 0x7f6220166cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6220160140 0x7f62200b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62201605a0 0x7f622015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f62200d1ee0 con 0x7f622015c7f0 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f62201609f0 con 0x7f6220160140 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f6228507640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f62200afb60 con 0x7f62201605a0 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f62262a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f622015c7f0 0x7f6220166cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f62262a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f622015c7f0 0x7f6220166cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56380/0 (socket says 172.21.15.83:56380) 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.556+0000 7f62262a3640 1 -- 172.21.15.83:0/466188185 learned_addr learned my addr 172.21.15.83:0/466188185 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f6226aa4640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62201605a0 0x7f622015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f62262a3640 1 -- 172.21.15.83:0/466188185 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62201605a0 msgr2=0x7f622015a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f62262a3640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62201605a0 0x7f622015a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f62262a3640 1 -- 172.21.15.83:0/466188185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6220160140 msgr2=0x7f62200b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f62262a3640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6220160140 0x7f62200b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f62262a3640 1 -- 172.21.15.83:0/466188185 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62200b50a0 con 0x7f622015c7f0 2024-03-30T13:11:25.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f62262a3640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f622015c7f0 0x7f6220166cb0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f621800c7f0 tx=0x7f621800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f6216ffd640 1 -- 172.21.15.83:0/466188185 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218015070 con 0x7f622015c7f0 2024-03-30T13:11:25.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f6216ffd640 1 -- 172.21.15.83:0/466188185 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6218007820 con 0x7f622015c7f0 2024-03-30T13:11:25.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f6228507640 1 -- 172.21.15.83:0/466188185 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62201f8080 con 0x7f622015c7f0 2024-03-30T13:11:25.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f6216ffd640 1 -- 172.21.15.83:0/466188185 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218007c10 con 0x7f622015c7f0 2024-03-30T13:11:25.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f6228507640 1 -- 172.21.15.83:0/466188185 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62200b5620 con 0x7f622015c7f0 2024-03-30T13:11:25.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f6228507640 1 -- 172.21.15.83:0/466188185 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62200a04d0 con 0x7f622015c7f0 2024-03-30T13:11:25.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f6216ffd640 1 -- 172.21.15.83:0/466188185 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6218018070 con 0x7f622015c7f0 2024-03-30T13:11:25.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f6216ffd640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6204067fc0 0x7f620406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f6216ffd640 1 -- 172.21.15.83:0/466188185 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f62180866a0 con 0x7f622015c7f0 2024-03-30T13:11:25.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f6225aa2640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6204067fc0 0x7f620406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.560+0000 7f6225aa2640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6204067fc0 0x7f620406a480 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6210007fd0 tx=0x7f6210007940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.564+0000 7f6216ffd640 1 -- 172.21.15.83:0/466188185 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6218056e30 con 0x7f622015c7f0 2024-03-30T13:11:25.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.724+0000 7f6228507640 1 -- 172.21.15.83:0/466188185 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f622009bba0 con 0x7f622015c7f0 2024-03-30T13:11:25.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.724+0000 7f6216ffd640 1 -- 172.21.15.83:0/466188185 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) ==== 104+0+11 (secure 0 0 0) 0x7f6218056730 con 0x7f622015c7f0 2024-03-30T13:11:25.732 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-03-30T13:11:25.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.724+0000 7f6228507640 1 -- 172.21.15.83:0/466188185 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6204067fc0 msgr2=0x7f620406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.724+0000 7f6228507640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6204067fc0 0x7f620406a480 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6210007fd0 tx=0x7f6210007940 comp rx=0 tx=0).stop 2024-03-30T13:11:25.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.724+0000 7f6228507640 1 -- 172.21.15.83:0/466188185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f622015c7f0 msgr2=0x7f6220166cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.724+0000 7f6228507640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f622015c7f0 0x7f6220166cb0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f621800c7f0 tx=0x7f621800ccb0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.728+0000 7f6228507640 1 -- 172.21.15.83:0/466188185 shutdown_connections 2024-03-30T13:11:25.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.728+0000 7f6228507640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6204067fc0 0x7f620406a480 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.728+0000 7f6228507640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62201605a0 0x7f622015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.728+0000 7f6228507640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6220160140 0x7f62200b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.728+0000 7f6228507640 1 --2- 172.21.15.83:0/466188185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f622015c7f0 0x7f6220166cb0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.728+0000 7f6228507640 1 -- 172.21.15.83:0/466188185 >> 172.21.15.83:0/466188185 conn(0x7f62200b3e70 msgr2=0x7f62200b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:25.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.728+0000 7f6228507640 1 -- 172.21.15.83:0/466188185 shutdown_connections 2024-03-30T13:11:25.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.728+0000 7f6228507640 1 -- 172.21.15.83:0/466188185 wait complete. 2024-03-30T13:11:25.751 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:25.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc622c18640 1 Processor -- start 2024-03-30T13:11:25.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc622c18640 1 -- start start 2024-03-30T13:11:25.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc622c18640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c160140 0x7fc61c1605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc622c18640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc61c0aff40 con 0x7fc61c0b1b60 2024-03-30T13:11:25.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc622c18640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc61c0b0220 con 0x7fc61c15c7f0 2024-03-30T13:11:25.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc622c18640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc61c0b0fe0 con 0x7fc61c160140 2024-03-30T13:11:25.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc6211b5640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc61c0b1b60 0x7fc61c0b1ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:32806/0 (socket says 172.21.15.83:32806) 2024-03-30T13:11:25.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc6211b5640 1 -- 172.21.15.83:0/3863583457 learned_addr learned my addr 172.21.15.83:0/3863583457 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:25.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61bfff640 1 --2- 172.21.15.83:0/3863583457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c160140 0x7fc61c1605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660564862 0 0) 0x7fc61c0aff40 con 0x7fc61c0b1b60 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc60c003530 con 0x7fc61c0b1b60 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1008220506 0 0) 0x7fc60c003530 con 0x7fc61c0b1b60 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c160140 msgr2=0x7fc61c1605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 --2- 172.21.15.83:0/3863583457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c160140 0x7fc61c1605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 >> v1:172.21.15.153:6789/0 conn(0x7fc61c15c7f0 legacy=0x7fc61c0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61c0b0500 con 0x7fc61c0b1b60 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fc614001a00 con 0x7fc61c0b1b60 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 >> v1:172.21.15.83:6789/0 conn(0x7fc61c0b1b60 legacy=0x7fc61c0b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 --2- 172.21.15.83:0/3863583457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0039f0 0x7fc60c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 --2- 172.21.15.83:0/3863583457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc60c004810 0x7fc60c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 --2- 172.21.15.83:0/3863583457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c160140 0x7fc60c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c00ba80 con 0x7fc60c004810 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c00bc00 con 0x7fc60c0039f0 2024-03-30T13:11:25.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc60c00be00 con 0x7fc61c160140 2024-03-30T13:11:25.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61bfff640 1 --2- 172.21.15.83:0/3863583457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc60c004810 0x7fc60c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc6211b5640 1 --2- 172.21.15.83:0/3863583457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c160140 0x7fc60c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc6209b4640 1 --2- 172.21.15.83:0/3863583457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0039f0 0x7fc60c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61bfff640 1 -- 172.21.15.83:0/3863583457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c160140 msgr2=0x7fc60c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:25.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61bfff640 1 --2- 172.21.15.83:0/3863583457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c160140 0x7fc60c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61bfff640 1 -- 172.21.15.83:0/3863583457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0039f0 msgr2=0x7fc60c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:25.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61bfff640 1 --2- 172.21.15.83:0/3863583457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0039f0 0x7fc60c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.872+0000 7fc61bfff640 1 -- 172.21.15.83:0/3863583457 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60c003530 con 0x7fc60c004810 2024-03-30T13:11:25.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc61bfff640 1 --2- 172.21.15.83:0/3863583457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc60c004810 0x7fc60c004c90 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc608009ab0 tx=0x7fc60801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddefee916e72deb3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6080b2070 con 0x7fc60c004810 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6080a5510 con 0x7fc60c004810 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc61b7fe640 1 -- 172.21.15.83:0/3863583457 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6080096b0 con 0x7fc60c004810 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc622c18640 1 -- 172.21.15.83:0/3863583457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc60c004810 msgr2=0x7fc60c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc622c18640 1 --2- 172.21.15.83:0/3863583457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc60c004810 0x7fc60c004c90 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc608009ab0 tx=0x7fc60801ca30 comp rx=0 tx=0).stop 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc6211b5640 1 -- 172.21.15.83:0/3863583457 reap_dead start 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc622c18640 1 -- 172.21.15.83:0/3863583457 shutdown_connections 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc622c18640 1 -- 172.21.15.83:0/3863583457 >> 172.21.15.83:0/3863583457 conn(0x7fc61c0b3e70 msgr2=0x7fc61c0b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc622c18640 1 -- 172.21.15.83:0/3863583457 shutdown_connections 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc622c18640 1 -- 172.21.15.83:0/3863583457 wait complete. 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc622c18640 1 Processor -- start 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.876+0000 7fc622c18640 1 -- start start 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc622c18640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c004810 0x7fc61c152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc622c18640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc61c15cc40 0x7fc61c159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc622c18640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c15d0a0 0x7fc61c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc622c18640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c0b0b50 con 0x7fc61c15cc40 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc622c18640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c0b3ca0 con 0x7fc60c004810 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc622c18640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc61c160f00 con 0x7fc61c15d0a0 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc61c15cc40 0x7fc61c159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc61c15cc40 0x7fc61c159950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56386/0 (socket says 172.21.15.83:56386) 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc61bfff640 1 -- 172.21.15.83:0/1945061698 learned_addr learned my addr 172.21.15.83:0/1945061698 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc6211b5640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c15d0a0 0x7fc61c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc6209b4640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c004810 0x7fc61c152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc61bfff640 1 -- 172.21.15.83:0/1945061698 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c15d0a0 msgr2=0x7fc61c159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc61bfff640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c15d0a0 0x7fc61c159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc61bfff640 1 -- 172.21.15.83:0/1945061698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c004810 msgr2=0x7fc61c152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc61bfff640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c004810 0x7fc61c152310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc61bfff640 1 -- 172.21.15.83:0/1945061698 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61c15d5e0 con 0x7fc61c15cc40 2024-03-30T13:11:25.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc61bfff640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc61c15cc40 0x7fc61c159950 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc6080b0040 tx=0x7fc60c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc6197fa640 1 -- 172.21.15.83:0/1945061698 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6080bc030 con 0x7fc61c15cc40 2024-03-30T13:11:25.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc6197fa640 1 -- 172.21.15.83:0/1945061698 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60800f000 con 0x7fc61c15cc40 2024-03-30T13:11:25.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc622c18640 1 -- 172.21.15.83:0/1945061698 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61c15d8c0 con 0x7fc61c15cc40 2024-03-30T13:11:25.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc6197fa640 1 -- 172.21.15.83:0/1945061698 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6080b2040 con 0x7fc61c15cc40 2024-03-30T13:11:25.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc622c18640 1 -- 172.21.15.83:0/1945061698 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61c15de80 con 0x7fc61c15cc40 2024-03-30T13:11:25.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc622c18640 1 -- 172.21.15.83:0/1945061698 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc61c0a04d0 con 0x7fc61c15cc40 2024-03-30T13:11:25.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc6197fa640 1 -- 172.21.15.83:0/1945061698 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc6080bf070 con 0x7fc61c15cc40 2024-03-30T13:11:25.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc6197fa640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc600067ff0 0x7fc60006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc6197fa640 1 -- 172.21.15.83:0/1945061698 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7fc6081206d0 con 0x7fc61c15cc40 2024-03-30T13:11:25.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc6209b4640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc600067ff0 0x7fc60006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.880+0000 7fc6209b4640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc600067ff0 0x7fc60006a4b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc610001620 tx=0x7fc610009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:25.892+0000 7fc6197fa640 1 -- 172.21.15.83:0/1945061698 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fc608016740 con 0x7fc61c15cc40 2024-03-30T13:11:26.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.048+0000 7fc622c18640 1 -- 172.21.15.83:0/1945061698 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc61c0b1730 con 0x7fc61c15cc40 2024-03-30T13:11:26.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc6197fa640 1 -- 172.21.15.83:0/1945061698 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) ==== 100+0+11 (secure 0 0 0) 0x7fc6080f0e60 con 0x7fc61c15cc40 2024-03-30T13:11:26.059 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-03-30T13:11:26.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc622c18640 1 -- 172.21.15.83:0/1945061698 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc600067ff0 msgr2=0x7fc60006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc622c18640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc600067ff0 0x7fc60006a4b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc610001620 tx=0x7fc610009040 comp rx=0 tx=0).stop 2024-03-30T13:11:26.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc622c18640 1 -- 172.21.15.83:0/1945061698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc61c15cc40 msgr2=0x7fc61c159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc622c18640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc61c15cc40 0x7fc61c159950 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc6080b0040 tx=0x7fc60c005840 comp rx=0 tx=0).stop 2024-03-30T13:11:26.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc622c18640 1 -- 172.21.15.83:0/1945061698 shutdown_connections 2024-03-30T13:11:26.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc622c18640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc600067ff0 0x7fc60006a4b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc622c18640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc61c15d0a0 0x7fc61c159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc622c18640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc61c15cc40 0x7fc61c159950 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc622c18640 1 --2- 172.21.15.83:0/1945061698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c004810 0x7fc61c152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc622c18640 1 -- 172.21.15.83:0/1945061698 >> 172.21.15.83:0/1945061698 conn(0x7fc61c0b3e70 msgr2=0x7fc61c0d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:26.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc622c18640 1 -- 172.21.15.83:0/1945061698 shutdown_connections 2024-03-30T13:11:26.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.052+0000 7fc622c18640 1 -- 172.21.15.83:0/1945061698 wait complete. 2024-03-30T13:11:26.079 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:26.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.192+0000 7f1f0bd90640 1 Processor -- start 2024-03-30T13:11:26.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.192+0000 7f1f0bd90640 1 -- start start 2024-03-30T13:11:26.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1f0415b3a0 0x7f1f040b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1f0415b780 0x7f1f040d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f0406f2d0 con 0x7f1f040b6050 2024-03-30T13:11:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f1f0406f5b0 con 0x7f1f0415b3a0 2024-03-30T13:11:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1f0406f890 con 0x7f1f0415b780 2024-03-30T13:11:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f09b2c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1f0415b3a0 0x7f1f040b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f09b2c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1f0415b3a0 0x7f1f040b6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56394/0 (socket says 172.21.15.83:56394) 2024-03-30T13:11:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f09b2c640 1 -- 172.21.15.83:0/2624271548 learned_addr learned my addr 172.21.15.83:0/2624271548 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0932b640 1 --2- 172.21.15.83:0/2624271548 >> v2:172.21.15.153:3300/0 conn(0x7f1f0415b780 0x7f1f040d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f09b2c640 1 -- 172.21.15.83:0/2624271548 >> v2:172.21.15.153:3300/0 conn(0x7f1f0415b780 msgr2=0x7f1f040d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f09b2c640 1 --2- 172.21.15.83:0/2624271548 >> v2:172.21.15.153:3300/0 conn(0x7f1f0415b780 0x7f1f040d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f09b2c640 1 -- 172.21.15.83:0/2624271548 >> v1:172.21.15.153:6789/0 conn(0x7f1f040b6050 legacy=0x7f1f0406b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f09b2c640 1 -- 172.21.15.83:0/2624271548 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0406fb70 con 0x7f1f0415b3a0 2024-03-30T13:11:26.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f09b2c640 1 --2- 172.21.15.83:0/2624271548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f0415b3a0 0x7f1f040b6e20 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1f04072440 tx=0x7f1f0001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4dd613af0de37b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f08b2a640 1 -- 172.21.15.83:0/2624271548 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f000a5670 con 0x7f1f0415b3a0 2024-03-30T13:11:26.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f08b2a640 1 -- 172.21.15.83:0/2624271548 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f000a5810 con 0x7f1f0415b3a0 2024-03-30T13:11:26.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f08b2a640 1 -- 172.21.15.83:0/2624271548 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f000a5be0 con 0x7f1f0415b3a0 2024-03-30T13:11:26.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 -- 172.21.15.83:0/2624271548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f0415b3a0 msgr2=0x7f1f040b6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 --2- 172.21.15.83:0/2624271548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f0415b3a0 0x7f1f040b6e20 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1f04072440 tx=0x7f1f0001c9b0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 -- 172.21.15.83:0/2624271548 shutdown_connections 2024-03-30T13:11:26.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 --2- 172.21.15.83:0/2624271548 >> v2:172.21.15.153:3300/0 conn(0x7f1f0415b780 0x7f1f040d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 --2- 172.21.15.83:0/2624271548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f0415b3a0 0x7f1f040b6e20 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 -- 172.21.15.83:0/2624271548 >> 172.21.15.83:0/2624271548 conn(0x7f1f0409aa50 msgr2=0x7f1f040b6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:26.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 -- 172.21.15.83:0/2624271548 shutdown_connections 2024-03-30T13:11:26.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.196+0000 7f1f0bd90640 1 -- 172.21.15.83:0/2624271548 wait complete. 2024-03-30T13:11:26.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0bd90640 1 Processor -- start 2024-03-30T13:11:26.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0bd90640 1 -- start start 2024-03-30T13:11:26.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0bd90640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f040b6050 0x7f1f0414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0bd90640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f0415b3a0 0x7f1f040ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0bd90640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f0415b780 0x7f1f0414d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0bd90640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04168520 con 0x7f1f0415b780 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0bd90640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1f041683a0 con 0x7f1f040b6050 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0bd90640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1f041686a0 con 0x7f1f0415b3a0 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0a32d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f0415b780 0x7f1f0414d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0a32d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f0415b780 0x7f1f0414d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56396/0 (socket says 172.21.15.83:56396) 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0a32d640 1 -- 172.21.15.83:0/43307611 learned_addr learned my addr 172.21.15.83:0/43307611 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0932b640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f0415b3a0 0x7f1f040ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f09b2c640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f040b6050 0x7f1f0414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0a32d640 1 -- 172.21.15.83:0/43307611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f0415b3a0 msgr2=0x7f1f040ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0a32d640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f0415b3a0 0x7f1f040ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0a32d640 1 -- 172.21.15.83:0/43307611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f040b6050 msgr2=0x7f1f0414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0a32d640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f040b6050 0x7f1f0414cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0a32d640 1 -- 172.21.15.83:0/43307611 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0415d3b0 con 0x7f1f0415b780 2024-03-30T13:11:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0932b640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f0415b3a0 0x7f1f040ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:26.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0a32d640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f0415b780 0x7f1f0414d9b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00b440 tx=0x7f1efc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1efa7fc640 1 -- 172.21.15.83:0/43307611 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc015020 con 0x7f1f0415b780 2024-03-30T13:11:26.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1efa7fc640 1 -- 172.21.15.83:0/43307611 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1efc011850 con 0x7f1f0415b780 2024-03-30T13:11:26.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0bd90640 1 -- 172.21.15.83:0/43307611 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0415d690 con 0x7f1f0415b780 2024-03-30T13:11:26.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1efa7fc640 1 -- 172.21.15.83:0/43307611 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc011c40 con 0x7f1f0415b780 2024-03-30T13:11:26.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0bd90640 1 -- 172.21.15.83:0/43307611 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0415dc50 con 0x7f1f0415b780 2024-03-30T13:11:26.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1f0bd90640 1 -- 172.21.15.83:0/43307611 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0404f900 con 0x7f1f0415b780 2024-03-30T13:11:26.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.200+0000 7f1efa7fc640 1 -- 172.21.15.83:0/43307611 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f1efc018020 con 0x7f1f0415b780 2024-03-30T13:11:26.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.204+0000 7f1efa7fc640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1ee8067fc0 0x7f1ee806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.204+0000 7f1f09b2c640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1ee8067fc0 0x7f1ee806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.204+0000 7f1efa7fc640 1 -- 172.21.15.83:0/43307611 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f1efc086070 con 0x7f1f0415b780 2024-03-30T13:11:26.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.204+0000 7f1f09b2c640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1ee8067fc0 0x7f1ee806a480 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1f000ae000 tx=0x7f1f000a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.208+0000 7f1efa7fc640 1 -- 172.21.15.83:0/43307611 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f1efc01f030 con 0x7f1f0415b780 2024-03-30T13:11:26.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.412+0000 7f1f0bd90640 1 -- 172.21.15.83:0/43307611 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f040cd720 con 0x7f1f0415b780 2024-03-30T13:11:26.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1efa7fc640 1 -- 172.21.15.83:0/43307611 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5184 (secure 0 0 0) 0x7f1efc056890 con 0x7f1f0415b780 2024-03-30T13:11:26.422 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:26.423 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2103427036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2103427036},{"type":"v1","addr":"172.21.15.153:6833","nonce":2103427036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/718325648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":718325648},{"type":"v1","addr":"172.21.15.153:6835","nonce":718325648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2547254149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2547254149},{"type":"v1","addr":"172.21.15.83:6836","nonce":2547254149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:09:29.206969+0000","modified":"2024-03-30T13:11:14.456996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1254317891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1254317891},{"type":"v1","addr":"172.21.15.83:6837","nonce":1254317891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":2}]} 2024-03-30T13:11:26.423 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 19 2024-03-30T13:11:26.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1f0bd90640 1 -- 172.21.15.83:0/43307611 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1ee8067fc0 msgr2=0x7f1ee806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1f0bd90640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1ee8067fc0 0x7f1ee806a480 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1f000ae000 tx=0x7f1f000a7070 comp rx=0 tx=0).stop 2024-03-30T13:11:26.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1f0bd90640 1 -- 172.21.15.83:0/43307611 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f0415b780 msgr2=0x7f1f0414d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1f0bd90640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f0415b780 0x7f1f0414d9b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00b440 tx=0x7f1efc00b900 comp rx=0 tx=0).stop 2024-03-30T13:11:26.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1f0bd90640 1 -- 172.21.15.83:0/43307611 shutdown_connections 2024-03-30T13:11:26.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1f0bd90640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f1ee8067fc0 0x7f1ee806a480 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1f0bd90640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f0415b780 0x7f1f0414d9b0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1f0bd90640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f0415b3a0 0x7f1f040ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1f0bd90640 1 --2- 172.21.15.83:0/43307611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f040b6050 0x7f1f0414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1f0bd90640 1 -- 172.21.15.83:0/43307611 >> 172.21.15.83:0/43307611 conn(0x7f1f0409aa50 msgr2=0x7f1f040b0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1f0bd90640 1 -- 172.21.15.83:0/43307611 shutdown_connections 2024-03-30T13:11:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.416+0000 7f1f0bd90640 1 -- 172.21.15.83:0/43307611 wait complete. 2024-03-30T13:11:26.446 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:26.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.552+0000 7f08f70bb640 1 Processor -- start 2024-03-30T13:11:26.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.552+0000 7f08f70bb640 1 -- start start 2024-03-30T13:11:26.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f70bb640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f08f015fb60 0x7f08f00d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f70bb640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08f00ccc50 0x7f08f009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f70bb640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f00cd130 con 0x7f08f00b1200 2024-03-30T13:11:26.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f70bb640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f08f00cd410 con 0x7f08f015fb60 2024-03-30T13:11:26.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f70bb640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f08f00cd6f0 con 0x7f08f00ccc50 2024-03-30T13:11:26.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f5658640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08f00ccc50 0x7f08f009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f5658640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08f00ccc50 0x7f08f009aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:51970/0 (socket says 172.21.15.83:51970) 2024-03-30T13:11:26.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f5658640 1 -- 172.21.15.83:0/3794560392 learned_addr learned my addr 172.21.15.83:0/3794560392 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:26.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f4e57640 1 --2- 172.21.15.83:0/3794560392 >> v2:172.21.15.153:3300/0 conn(0x7f08f015fb60 0x7f08f00d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f5658640 1 -- 172.21.15.83:0/3794560392 >> v2:172.21.15.153:3300/0 conn(0x7f08f015fb60 msgr2=0x7f08f00d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f5658640 1 --2- 172.21.15.83:0/3794560392 >> v2:172.21.15.153:3300/0 conn(0x7f08f015fb60 0x7f08f00d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f5658640 1 -- 172.21.15.83:0/3794560392 >> v1:172.21.15.153:6789/0 conn(0x7f08f00b1200 legacy=0x7f08f00af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.556+0000 7f08f5658640 1 -- 172.21.15.83:0/3794560392 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f00cd9d0 con 0x7f08f00ccc50 2024-03-30T13:11:26.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f5658640 1 --2- 172.21.15.83:0/3794560392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08f00ccc50 0x7f08f009aa50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009e50 tx=0x7f08e001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=797e9db3e94e76e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08ef7fe640 1 -- 172.21.15.83:0/3794560392 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e00a56b0 con 0x7f08f00ccc50 2024-03-30T13:11:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08ef7fe640 1 -- 172.21.15.83:0/3794560392 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e00a5850 con 0x7f08f00ccc50 2024-03-30T13:11:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08ef7fe640 1 -- 172.21.15.83:0/3794560392 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e00a5c20 con 0x7f08f00ccc50 2024-03-30T13:11:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 -- 172.21.15.83:0/3794560392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08f00ccc50 msgr2=0x7f08f009aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 --2- 172.21.15.83:0/3794560392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08f00ccc50 0x7f08f009aa50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009e50 tx=0x7f08e001c8e0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 -- 172.21.15.83:0/3794560392 shutdown_connections 2024-03-30T13:11:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 --2- 172.21.15.83:0/3794560392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08f00ccc50 0x7f08f009aa50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 --2- 172.21.15.83:0/3794560392 >> v2:172.21.15.153:3300/0 conn(0x7f08f015fb60 0x7f08f00d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 -- 172.21.15.83:0/3794560392 >> 172.21.15.83:0/3794560392 conn(0x7f08f00b3dd0 msgr2=0x7f08f00b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 -- 172.21.15.83:0/3794560392 shutdown_connections 2024-03-30T13:11:26.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 -- 172.21.15.83:0/3794560392 wait complete. 2024-03-30T13:11:26.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 Processor -- start 2024-03-30T13:11:26.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 -- start start 2024-03-30T13:11:26.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08f00b1200 0x7f08f006ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08f00ccc50 0x7f08f014fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08f015fb60 0x7f08f01503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f08f01697b0 con 0x7f08f00ccc50 2024-03-30T13:11:26.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f08f0169630 con 0x7f08f00b1200 2024-03-30T13:11:26.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f08f0169930 con 0x7f08f015fb60 2024-03-30T13:11:26.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08effff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08f00ccc50 0x7f08f014fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08effff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08f00ccc50 0x7f08f014fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56406/0 (socket says 172.21.15.83:56406) 2024-03-30T13:11:26.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08effff640 1 -- 172.21.15.83:0/2832220875 learned_addr learned my addr 172.21.15.83:0/2832220875 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:26.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f4e57640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08f00b1200 0x7f08f006ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f5658640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08f015fb60 0x7f08f01503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08effff640 1 -- 172.21.15.83:0/2832220875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08f015fb60 msgr2=0x7f08f01503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08effff640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08f015fb60 0x7f08f01503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08effff640 1 -- 172.21.15.83:0/2832220875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08f00b1200 msgr2=0x7f08f006ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08effff640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08f00b1200 0x7f08f006ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08effff640 1 -- 172.21.15.83:0/2832220875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f00ca2c0 con 0x7f08f00ccc50 2024-03-30T13:11:26.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f4e57640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08f00b1200 0x7f08f006ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:26.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08effff640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08f00ccc50 0x7f08f014fe70 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f08d800c420 tx=0x7f08d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08ed7fa640 1 -- 172.21.15.83:0/2832220875 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d80052d0 con 0x7f08f00ccc50 2024-03-30T13:11:26.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08ed7fa640 1 -- 172.21.15.83:0/2832220875 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d8005470 con 0x7f08f00ccc50 2024-03-30T13:11:26.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 -- 172.21.15.83:0/2832220875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f00ca5a0 con 0x7f08f00ccc50 2024-03-30T13:11:26.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08ed7fa640 1 -- 172.21.15.83:0/2832220875 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d8007260 con 0x7f08f00ccc50 2024-03-30T13:11:26.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.560+0000 7f08f70bb640 1 -- 172.21.15.83:0/2832220875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f00cab60 con 0x7f08f00ccc50 2024-03-30T13:11:26.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.564+0000 7f08f70bb640 1 -- 172.21.15.83:0/2832220875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f0068dd0 con 0x7f08f00ccc50 2024-03-30T13:11:26.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.564+0000 7f08ed7fa640 1 -- 172.21.15.83:0/2832220875 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f08d8007400 con 0x7f08f00ccc50 2024-03-30T13:11:26.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.564+0000 7f08ed7fa640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f08d0067fc0 0x7f08d006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.564+0000 7f08ed7fa640 1 -- 172.21.15.83:0/2832220875 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f08d80859f0 con 0x7f08f00ccc50 2024-03-30T13:11:26.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.564+0000 7f08f4e57640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f08d0067fc0 0x7f08d006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.564+0000 7f08f4e57640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f08d0067fc0 0x7f08d006a480 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009a40 tx=0x7f08e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.572+0000 7f08ed7fa640 1 -- 172.21.15.83:0/2832220875 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f08d8056210 con 0x7f08f00ccc50 2024-03-30T13:11:26.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.748+0000 7f08f70bb640 1 -- 172.21.15.83:0/2832220875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08f00b8260 con 0x7f08f00ccc50 2024-03-30T13:11:26.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.748+0000 7f08ed7fa640 1 -- 172.21.15.83:0/2832220875 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16712 (secure 0 0 0) 0x7f08d8055b10 con 0x7f08f00ccc50 2024-03-30T13:11:26.758 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:26.758 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":37,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:11:21.134552+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:09:27.405927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:09:28.161081+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:26.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.752+0000 7f08f70bb640 1 -- 172.21.15.83:0/2832220875 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f08d0067fc0 msgr2=0x7f08d006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.752+0000 7f08f70bb640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f08d0067fc0 0x7f08d006a480 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009a40 tx=0x7f08e8008040 comp rx=0 tx=0).stop 2024-03-30T13:11:26.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.752+0000 7f08f70bb640 1 -- 172.21.15.83:0/2832220875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08f00ccc50 msgr2=0x7f08f014fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.752+0000 7f08f70bb640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08f00ccc50 0x7f08f014fe70 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f08d800c420 tx=0x7f08d800c8e0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.752+0000 7f08f70bb640 1 -- 172.21.15.83:0/2832220875 shutdown_connections 2024-03-30T13:11:26.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.752+0000 7f08f70bb640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f08d0067fc0 0x7f08d006a480 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.752+0000 7f08f70bb640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08f015fb60 0x7f08f01503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.752+0000 7f08f70bb640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08f00ccc50 0x7f08f014fe70 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.752+0000 7f08f70bb640 1 --2- 172.21.15.83:0/2832220875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08f00b1200 0x7f08f006ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.752+0000 7f08f70bb640 1 -- 172.21.15.83:0/2832220875 >> 172.21.15.83:0/2832220875 conn(0x7f08f00b3dd0 msgr2=0x7f08f00af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:26.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.752+0000 7f08f70bb640 1 -- 172.21.15.83:0/2832220875 shutdown_connections 2024-03-30T13:11:26.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.752+0000 7f08f70bb640 1 -- 172.21.15.83:0/2832220875 wait complete. 2024-03-30T13:11:26.776 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T13:11:26.776 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:26.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.880+0000 7f36114bf640 1 Processor -- start 2024-03-30T13:11:26.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f36114bf640 1 -- start start 2024-03-30T13:11:26.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f36114bf640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f360c15e5d0 0x7f360c0ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f36114bf640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f360c15e9b0 con 0x7f360c162b80 2024-03-30T13:11:26.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f36114bf640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f360c0aeed0 con 0x7f360c06cd80 2024-03-30T13:11:26.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f36114bf640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f360c0afae0 con 0x7f360c15e5d0 2024-03-30T13:11:26.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f360a7fc640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f360c162b80 0x7f360c06c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:45464/0 (socket says 172.21.15.83:45464) 2024-03-30T13:11:26.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f360a7fc640 1 -- 172.21.15.83:0/1995491793 learned_addr learned my addr 172.21.15.83:0/1995491793 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:26.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f360affd640 1 --2- 172.21.15.83:0/1995491793 >> v2:172.21.15.83:3300/0 conn(0x7f360c15e5d0 0x7f360c0ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f3609ffb640 1 -- 172.21.15.83:0/1995491793 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2128830095 0 0) 0x7f360c15e9b0 con 0x7f360c162b80 2024-03-30T13:11:26.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f3609ffb640 1 -- 172.21.15.83:0/1995491793 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35f4003530 con 0x7f360c162b80 2024-03-30T13:11:26.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f360affd640 1 -- 172.21.15.83:0/1995491793 >> v1:172.21.15.153:6789/0 conn(0x7f360c06cd80 legacy=0x7f360c06e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f360affd640 1 -- 172.21.15.83:0/1995491793 >> v1:172.21.15.83:6789/0 conn(0x7f360c162b80 legacy=0x7f360c06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f360affd640 1 -- 172.21.15.83:0/1995491793 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360c0af1b0 con 0x7f360c15e5d0 2024-03-30T13:11:26.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f360affd640 1 --2- 172.21.15.83:0/1995491793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c15e5d0 0x7f360c0ae7f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0097c0 tx=0x7f35fc01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5d6ea158a0558f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f3609ffb640 1 -- 172.21.15.83:0/1995491793 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0b0070 con 0x7f360c15e5d0 2024-03-30T13:11:26.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f3609ffb640 1 -- 172.21.15.83:0/1995491793 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35fc0ab600 con 0x7f360c15e5d0 2024-03-30T13:11:26.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.884+0000 7f3609ffb640 1 -- 172.21.15.83:0/1995491793 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0ab9d0 con 0x7f360c15e5d0 2024-03-30T13:11:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 -- 172.21.15.83:0/1995491793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c15e5d0 msgr2=0x7f360c0ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 --2- 172.21.15.83:0/1995491793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c15e5d0 0x7f360c0ae7f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0097c0 tx=0x7f35fc01c340 comp rx=0 tx=0).stop 2024-03-30T13:11:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 -- 172.21.15.83:0/1995491793 shutdown_connections 2024-03-30T13:11:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 --2- 172.21.15.83:0/1995491793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c15e5d0 0x7f360c0ae7f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 -- 172.21.15.83:0/1995491793 >> 172.21.15.83:0/1995491793 conn(0x7f360c072030 msgr2=0x7f360c072440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 -- 172.21.15.83:0/1995491793 shutdown_connections 2024-03-30T13:11:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 -- 172.21.15.83:0/1995491793 wait complete. 2024-03-30T13:11:26.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 Processor -- start 2024-03-30T13:11:26.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 -- start start 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c06cd80 0x7f360c147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f360c15e5d0 0x7f360c15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f360c162b80 0x7f360c14cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f360c1630e0 con 0x7f360c06cd80 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f360c162f60 con 0x7f360c162b80 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f36114bf640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f360c16c520 con 0x7f360c15e5d0 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f360affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c06cd80 0x7f360c147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f360affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c06cd80 0x7f360c147110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43600/0 (socket says 172.21.15.83:43600) 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.888+0000 7f360affd640 1 -- 172.21.15.83:0/3551245644 learned_addr learned my addr 172.21.15.83:0/3551245644 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f360a7fc640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f360c15e5d0 0x7f360c15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f360affd640 1 -- 172.21.15.83:0/3551245644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f360c15e5d0 msgr2=0x7f360c15ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f360affd640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f360c15e5d0 0x7f360c15ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f360affd640 1 -- 172.21.15.83:0/3551245644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f360c162b80 msgr2=0x7f360c14cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f360b7fe640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f360c162b80 0x7f360c14cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f360affd640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f360c162b80 0x7f360c14cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f360affd640 1 -- 172.21.15.83:0/3551245644 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360c06cbb0 con 0x7f360c06cd80 2024-03-30T13:11:26.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f360affd640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c06cd80 0x7f360c147110 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0ae040 tx=0x7f35fc01ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f35f37fe640 1 -- 172.21.15.83:0/3551245644 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0b0050 con 0x7f360c06cd80 2024-03-30T13:11:26.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f35f37fe640 1 -- 172.21.15.83:0/3551245644 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35fc0b1040 con 0x7f360c06cd80 2024-03-30T13:11:26.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f36114bf640 1 -- 172.21.15.83:0/3551245644 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f360c067550 con 0x7f360c06cd80 2024-03-30T13:11:26.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f35f37fe640 1 -- 172.21.15.83:0/3551245644 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0b5610 con 0x7f360c06cd80 2024-03-30T13:11:26.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f36114bf640 1 -- 172.21.15.83:0/3551245644 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f360c147c20 con 0x7f360c06cd80 2024-03-30T13:11:26.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f36114bf640 1 -- 172.21.15.83:0/3551245644 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f360c068dd0 con 0x7f360c06cd80 2024-03-30T13:11:26.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f35f37fe640 1 -- 172.21.15.83:0/3551245644 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f35fc0be030 con 0x7f360c06cd80 2024-03-30T13:11:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f35f37fe640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f35f8067fc0 0x7f35f806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f35f37fe640 1 -- 172.21.15.83:0/3551245644 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f35fc120170 con 0x7f360c06cd80 2024-03-30T13:11:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f360a7fc640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f35f8067fc0 0x7f35f806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.892+0000 7f360a7fc640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f35f8067fc0 0x7f35f806a480 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3600007fd0 tx=0x7f3600009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:26.900+0000 7f35f37fe640 1 -- 172.21.15.83:0/3551245644 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f35fc0c5060 con 0x7f360c06cd80 2024-03-30T13:11:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.092+0000 7f36114bf640 1 -- 172.21.15.83:0/3551245644 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f360c0b5300 con 0x7f360c06cd80 2024-03-30T13:11:27.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.092+0000 7f35f37fe640 1 -- 172.21.15.83:0/3551245644 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5184 (secure 0 0 0) 0x7f35fc016050 con 0x7f360c06cd80 2024-03-30T13:11:27.101 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:27.101 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2103427036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2103427036},{"type":"v1","addr":"172.21.15.153:6833","nonce":2103427036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/718325648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":718325648},{"type":"v1","addr":"172.21.15.153:6835","nonce":718325648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2547254149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2547254149},{"type":"v1","addr":"172.21.15.83:6836","nonce":2547254149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:09:29.206969+0000","modified":"2024-03-30T13:11:14.456996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1254317891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1254317891},{"type":"v1","addr":"172.21.15.83:6837","nonce":1254317891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":2}]} 2024-03-30T13:11:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 19 2024-03-30T13:11:27.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.096+0000 7f36114bf640 1 -- 172.21.15.83:0/3551245644 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f35f8067fc0 msgr2=0x7f35f806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.096+0000 7f36114bf640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f35f8067fc0 0x7f35f806a480 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3600007fd0 tx=0x7f3600009040 comp rx=0 tx=0).stop 2024-03-30T13:11:27.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.096+0000 7f36114bf640 1 -- 172.21.15.83:0/3551245644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c06cd80 msgr2=0x7f360c147110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.096+0000 7f36114bf640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c06cd80 0x7f360c147110 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0ae040 tx=0x7f35fc01ab80 comp rx=0 tx=0).stop 2024-03-30T13:11:27.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.096+0000 7f36114bf640 1 -- 172.21.15.83:0/3551245644 shutdown_connections 2024-03-30T13:11:27.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.096+0000 7f36114bf640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f35f8067fc0 0x7f35f806a480 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.096+0000 7f36114bf640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f360c162b80 0x7f360c14cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.096+0000 7f36114bf640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f360c15e5d0 0x7f360c15ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.096+0000 7f36114bf640 1 --2- 172.21.15.83:0/3551245644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c06cd80 0x7f360c147110 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.096+0000 7f36114bf640 1 -- 172.21.15.83:0/3551245644 >> 172.21.15.83:0/3551245644 conn(0x7f360c072030 msgr2=0x7f360c0b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:27.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.096+0000 7f36114bf640 1 -- 172.21.15.83:0/3551245644 shutdown_connections 2024-03-30T13:11:27.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.096+0000 7f36114bf640 1 -- 172.21.15.83:0/3551245644 wait complete. 2024-03-30T13:11:27.120 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.224+0000 7efc81be4640 1 Processor -- start 2024-03-30T13:11:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.224+0000 7efc81be4640 1 -- start start 2024-03-30T13:11:27.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc81be4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efc7c15fb60 0x7efc7c0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc81be4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc7c0ccc50 0x7efc7c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc81be4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc7c0cd130 con 0x7efc7c0b1200 2024-03-30T13:11:27.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc81be4640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7efc7c0cd410 con 0x7efc7c15fb60 2024-03-30T13:11:27.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc81be4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efc7c0cd6f0 con 0x7efc7c0ccc50 2024-03-30T13:11:27.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7b7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efc7c15fb60 0x7efc7c0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7b7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efc7c15fb60 0x7efc7c0d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43614/0 (socket says 172.21.15.83:43614) 2024-03-30T13:11:27.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7b7fe640 1 -- 172.21.15.83:0/1821462001 learned_addr learned my addr 172.21.15.83:0/1821462001 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:27.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7bfff640 1 --2- 172.21.15.83:0/1821462001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc7c0ccc50 0x7efc7c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7b7fe640 1 -- 172.21.15.83:0/1821462001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc7c0ccc50 msgr2=0x7efc7c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:27.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7b7fe640 1 --2- 172.21.15.83:0/1821462001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc7c0ccc50 0x7efc7c09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7b7fe640 1 -- 172.21.15.83:0/1821462001 >> v1:172.21.15.153:6789/0 conn(0x7efc7c0b1200 legacy=0x7efc7c0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:27.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7b7fe640 1 -- 172.21.15.83:0/1821462001 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7c0cd9d0 con 0x7efc7c15fb60 2024-03-30T13:11:27.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7bfff640 1 --2- 172.21.15.83:0/1821462001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc7c0ccc50 0x7efc7c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:27.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7b7fe640 1 --2- 172.21.15.83:0/1821462001 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc7c15fb60 0x7efc7c0d0cf0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7efc64009870 tx=0x7efc6401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab3c2a95494758b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7a7fc640 1 -- 172.21.15.83:0/1821462001 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc640b0070 con 0x7efc7c15fb60 2024-03-30T13:11:27.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7a7fc640 1 -- 172.21.15.83:0/1821462001 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc640ab600 con 0x7efc7c15fb60 2024-03-30T13:11:27.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.228+0000 7efc7a7fc640 1 -- 172.21.15.83:0/1821462001 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc640ab9d0 con 0x7efc7c15fb60 2024-03-30T13:11:27.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 -- 172.21.15.83:0/1821462001 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc7c15fb60 msgr2=0x7efc7c0d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 --2- 172.21.15.83:0/1821462001 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc7c15fb60 0x7efc7c0d0cf0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7efc64009870 tx=0x7efc6401c3d0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 -- 172.21.15.83:0/1821462001 shutdown_connections 2024-03-30T13:11:27.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 --2- 172.21.15.83:0/1821462001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc7c0ccc50 0x7efc7c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 --2- 172.21.15.83:0/1821462001 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc7c15fb60 0x7efc7c0d0cf0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 -- 172.21.15.83:0/1821462001 >> 172.21.15.83:0/1821462001 conn(0x7efc7c0b3dd0 msgr2=0x7efc7c0b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:27.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 -- 172.21.15.83:0/1821462001 shutdown_connections 2024-03-30T13:11:27.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 -- 172.21.15.83:0/1821462001 wait complete. 2024-03-30T13:11:27.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 Processor -- start 2024-03-30T13:11:27.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 -- start start 2024-03-30T13:11:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc7c0b1200 0x7efc7c0c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc7c0ccc50 0x7efc7c0c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc7c15fb60 0x7efc7c0b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1697b0 con 0x7efc7c15fb60 2024-03-30T13:11:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c169630 con 0x7efc7c0ccc50 2024-03-30T13:11:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc81be4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efc7c169930 con 0x7efc7c0b1200 2024-03-30T13:11:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc7c15fb60 0x7efc7c0b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc7c15fb60 0x7efc7c0b75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43628/0 (socket says 172.21.15.83:43628) 2024-03-30T13:11:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc7bfff640 1 -- 172.21.15.83:0/3956475949 learned_addr learned my addr 172.21.15.83:0/3956475949 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc7b7fe640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc7c0b1200 0x7efc7c0c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc7affd640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc7c0ccc50 0x7efc7c0c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc7bfff640 1 -- 172.21.15.83:0/3956475949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc7c0b1200 msgr2=0x7efc7c0c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc7bfff640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc7c0b1200 0x7efc7c0c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc7bfff640 1 -- 172.21.15.83:0/3956475949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc7c0ccc50 msgr2=0x7efc7c0c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc7bfff640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc7c0ccc50 0x7efc7c0c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc7bfff640 1 -- 172.21.15.83:0/3956475949 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7c0c8bd0 con 0x7efc7c15fb60 2024-03-30T13:11:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc7affd640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc7c0ccc50 0x7efc7c0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc7bfff640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc7c15fb60 0x7efc7c0b75d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7efc7400ce70 tx=0x7efc7400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.232+0000 7efc73fff640 1 -- 172.21.15.83:0/3956475949 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74003ba0 con 0x7efc7c15fb60 2024-03-30T13:11:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.236+0000 7efc73fff640 1 -- 172.21.15.83:0/3956475949 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc74003d60 con 0x7efc7c15fb60 2024-03-30T13:11:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.236+0000 7efc81be4640 1 -- 172.21.15.83:0/3956475949 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7c070de0 con 0x7efc7c15fb60 2024-03-30T13:11:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.236+0000 7efc73fff640 1 -- 172.21.15.83:0/3956475949 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7400d880 con 0x7efc7c15fb60 2024-03-30T13:11:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.236+0000 7efc81be4640 1 -- 172.21.15.83:0/3956475949 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc7c0c8850 con 0x7efc7c15fb60 2024-03-30T13:11:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.236+0000 7efc81be4640 1 -- 172.21.15.83:0/3956475949 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7c0711d0 con 0x7efc7c15fb60 2024-03-30T13:11:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.236+0000 7efc73fff640 1 -- 172.21.15.83:0/3956475949 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7efc7400da20 con 0x7efc7c15fb60 2024-03-30T13:11:27.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.236+0000 7efc73fff640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efc5c067fc0 0x7efc5c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.236+0000 7efc7b7fe640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efc5c067fc0 0x7efc5c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.236+0000 7efc73fff640 1 -- 172.21.15.83:0/3956475949 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7efc74086f10 con 0x7efc7c15fb60 2024-03-30T13:11:27.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.236+0000 7efc7b7fe640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efc5c067fc0 0x7efc5c06a480 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc640ad000 tx=0x7efc64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.240+0000 7efc73fff640 1 -- 172.21.15.83:0/3956475949 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7efc740576a0 con 0x7efc7c15fb60 2024-03-30T13:11:27.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.448+0000 7efc81be4640 1 -- 172.21.15.83:0/3956475949 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc7c070fb0 con 0x7efc7c15fb60 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.448+0000 7efc73fff640 1 -- 172.21.15.83:0/3956475949 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5184 (secure 0 0 0) 0x7efc74056fa0 con 0x7efc7c15fb60 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2103427036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2103427036},{"type":"v1","addr":"172.21.15.153:6833","nonce":2103427036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/718325648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":718325648},{"type":"v1","addr":"172.21.15.153:6835","nonce":718325648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2547254149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2547254149},{"type":"v1","addr":"172.21.15.83:6836","nonce":2547254149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:09:29.206969+0000","modified":"2024-03-30T13:11:14.456996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1254317891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1254317891},{"type":"v1","addr":"172.21.15.83:6837","nonce":1254317891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":2}]} 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 19 2024-03-30T13:11:27.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.452+0000 7efc81be4640 1 -- 172.21.15.83:0/3956475949 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efc5c067fc0 msgr2=0x7efc5c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.452+0000 7efc81be4640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efc5c067fc0 0x7efc5c06a480 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc640ad000 tx=0x7efc64008040 comp rx=0 tx=0).stop 2024-03-30T13:11:27.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.452+0000 7efc81be4640 1 -- 172.21.15.83:0/3956475949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc7c15fb60 msgr2=0x7efc7c0b75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.452+0000 7efc81be4640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc7c15fb60 0x7efc7c0b75d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7efc7400ce70 tx=0x7efc7400a710 comp rx=0 tx=0).stop 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.452+0000 7efc81be4640 1 -- 172.21.15.83:0/3956475949 shutdown_connections 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.452+0000 7efc81be4640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efc5c067fc0 0x7efc5c06a480 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.452+0000 7efc81be4640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc7c15fb60 0x7efc7c0b75d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.452+0000 7efc81be4640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc7c0ccc50 0x7efc7c0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.452+0000 7efc81be4640 1 --2- 172.21.15.83:0/3956475949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc7c0b1200 0x7efc7c0c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.452+0000 7efc81be4640 1 -- 172.21.15.83:0/3956475949 >> 172.21.15.83:0/3956475949 conn(0x7efc7c0b3dd0 msgr2=0x7efc7c160260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.452+0000 7efc81be4640 1 -- 172.21.15.83:0/3956475949 shutdown_connections 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.452+0000 7efc81be4640 1 -- 172.21.15.83:0/3956475949 wait complete. 2024-03-30T13:11:27.484 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:27.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b18098640 1 Processor -- start 2024-03-30T13:11:27.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b18098640 1 -- start start 2024-03-30T13:11:27.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b18098640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3b100b1200 0x7f3b100d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b18098640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b100cd130 con 0x7f3b1015fb60 2024-03-30T13:11:27.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b18098640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b100cd410 con 0x7f3b100ccc50 2024-03-30T13:11:27.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b18098640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f3b100cd6f0 con 0x7f3b100b1200 2024-03-30T13:11:27.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b15633640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3b100b1200 0x7f3b100d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b15633640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3b100b1200 0x7f3b100d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43638/0 (socket says 172.21.15.83:43638) 2024-03-30T13:11:27.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b15633640 1 -- 172.21.15.83:0/2467073146 learned_addr learned my addr 172.21.15.83:0/2467073146 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:27.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b15633640 1 -- 172.21.15.83:0/2467073146 >> v1:172.21.15.153:6789/0 conn(0x7f3b100ccc50 legacy=0x7f3b1009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:27.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b15633640 1 -- 172.21.15.83:0/2467073146 >> v1:172.21.15.83:6789/0 conn(0x7f3b1015fb60 legacy=0x7f3b100af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b15633640 1 -- 172.21.15.83:0/2467073146 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b100cd9d0 con 0x7f3b100b1200 2024-03-30T13:11:27.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.600+0000 7f3b14e32640 1 -- 172.21.15.83:0/2467073146 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181322590 0 0) 0x7f3b100cd130 con 0x7f3b1015fb60 2024-03-30T13:11:27.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b15633640 1 --2- 172.21.15.83:0/2467073146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b100b1200 0x7f3b100d0cf0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009870 tx=0x7f3b0001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4706ac4cf21b081 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b14e32640 1 -- 172.21.15.83:0/2467073146 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b000ab5f0 con 0x7f3b100b1200 2024-03-30T13:11:27.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b14e32640 1 -- 172.21.15.83:0/2467073146 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b000b0070 con 0x7f3b100b1200 2024-03-30T13:11:27.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b14e32640 1 -- 172.21.15.83:0/2467073146 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b000ab9b0 con 0x7f3b100b1200 2024-03-30T13:11:27.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b18098640 1 -- 172.21.15.83:0/2467073146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b100b1200 msgr2=0x7f3b100d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b18098640 1 --2- 172.21.15.83:0/2467073146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b100b1200 0x7f3b100d0cf0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009870 tx=0x7f3b0001c3d0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b18098640 1 -- 172.21.15.83:0/2467073146 shutdown_connections 2024-03-30T13:11:27.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b18098640 1 --2- 172.21.15.83:0/2467073146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b100b1200 0x7f3b100d0cf0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b18098640 1 -- 172.21.15.83:0/2467073146 >> 172.21.15.83:0/2467073146 conn(0x7f3b100b3dd0 msgr2=0x7f3b100b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:27.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b18098640 1 -- 172.21.15.83:0/2467073146 shutdown_connections 2024-03-30T13:11:27.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b18098640 1 -- 172.21.15.83:0/2467073146 wait complete. 2024-03-30T13:11:27.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b18098640 1 Processor -- start 2024-03-30T13:11:27.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.604+0000 7f3b18098640 1 -- start start 2024-03-30T13:11:27.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b18098640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b100b1200 0x7f3b10156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b18098640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b100ccc50 0x7f3b101657f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b18098640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b1015fb60 0x7f3b1006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b18098640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3b100ceb60 con 0x7f3b1015fb60 2024-03-30T13:11:27.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b18098640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3b100ce9e0 con 0x7f3b100ccc50 2024-03-30T13:11:27.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b18098640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1009b160 con 0x7f3b100b1200 2024-03-30T13:11:27.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b16635640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b1015fb60 0x7f3b1006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b16635640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b1015fb60 0x7f3b1006cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43654/0 (socket says 172.21.15.83:43654) 2024-03-30T13:11:27.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b16635640 1 -- 172.21.15.83:0/2351984830 learned_addr learned my addr 172.21.15.83:0/2351984830 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:27.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b15e34640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b100b1200 0x7f3b10156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b15633640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b100ccc50 0x7f3b101657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b16635640 1 -- 172.21.15.83:0/2351984830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b100b1200 msgr2=0x7f3b10156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b16635640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b100b1200 0x7f3b10156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b16635640 1 -- 172.21.15.83:0/2351984830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b100ccc50 msgr2=0x7f3b101657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b16635640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b100ccc50 0x7f3b101657f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b16635640 1 -- 172.21.15.83:0/2351984830 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b10157080 con 0x7f3b1015fb60 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b15e34640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b100b1200 0x7f3b10156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b16635640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b1015fb60 0x7f3b1006cd30 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800c780 tx=0x7f3b0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b067fc640 1 -- 172.21.15.83:0/2351984830 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08016020 con 0x7f3b1015fb60 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b067fc640 1 -- 172.21.15.83:0/2351984830 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b0800a9f0 con 0x7f3b1015fb60 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b18098640 1 -- 172.21.15.83:0/2351984830 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b100b7600 con 0x7f3b1015fb60 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b067fc640 1 -- 172.21.15.83:0/2351984830 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800ae20 con 0x7f3b1015fb60 2024-03-30T13:11:27.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b18098640 1 -- 172.21.15.83:0/2351984830 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b100b7bc0 con 0x7f3b1015fb60 2024-03-30T13:11:27.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b18098640 1 -- 172.21.15.83:0/2351984830 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b10068dd0 con 0x7f3b1015fb60 2024-03-30T13:11:27.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b067fc640 1 -- 172.21.15.83:0/2351984830 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f3b08019020 con 0x7f3b1015fb60 2024-03-30T13:11:27.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b067fc640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3af4067fc0 0x7f3af406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b067fc640 1 -- 172.21.15.83:0/2351984830 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f3b080864a0 con 0x7f3b1015fb60 2024-03-30T13:11:27.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.608+0000 7f3b15e34640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3af4067fc0 0x7f3af406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.612+0000 7f3b15e34640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3af4067fc0 0x7f3af406a480 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c000f70 tx=0x7f3b0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.612+0000 7f3b067fc640 1 -- 172.21.15.83:0/2351984830 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3b08020030 con 0x7f3b1015fb60 2024-03-30T13:11:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.776+0000 7f3b18098640 1 -- 172.21.15.83:0/2351984830 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b100b8260 con 0x7f3b1015fb60 2024-03-30T13:11:27.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.776+0000 7f3b067fc640 1 -- 172.21.15.83:0/2351984830 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16712 (secure 0 0 0) 0x7f3b08056c30 con 0x7f3b1015fb60 2024-03-30T13:11:27.786 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:27.786 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":37,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:11:21.134552+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:09:27.405927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:09:28.161081+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.780+0000 7f3b18098640 1 -- 172.21.15.83:0/2351984830 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3af4067fc0 msgr2=0x7f3af406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.780+0000 7f3b18098640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3af4067fc0 0x7f3af406a480 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c000f70 tx=0x7f3b0c009040 comp rx=0 tx=0).stop 2024-03-30T13:11:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.780+0000 7f3b18098640 1 -- 172.21.15.83:0/2351984830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b1015fb60 msgr2=0x7f3b1006cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.780+0000 7f3b18098640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b1015fb60 0x7f3b1006cd30 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800c780 tx=0x7f3b0800cc40 comp rx=0 tx=0).stop 2024-03-30T13:11:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.780+0000 7f3b18098640 1 -- 172.21.15.83:0/2351984830 shutdown_connections 2024-03-30T13:11:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.780+0000 7f3b18098640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3af4067fc0 0x7f3af406a480 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.780+0000 7f3b18098640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b1015fb60 0x7f3b1006cd30 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.780+0000 7f3b18098640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b100ccc50 0x7f3b101657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.780+0000 7f3b18098640 1 --2- 172.21.15.83:0/2351984830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b100b1200 0x7f3b10156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.780+0000 7f3b18098640 1 -- 172.21.15.83:0/2351984830 >> 172.21.15.83:0/2351984830 conn(0x7f3b100b3dd0 msgr2=0x7f3b100af070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.780+0000 7f3b18098640 1 -- 172.21.15.83:0/2351984830 shutdown_connections 2024-03-30T13:11:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.780+0000 7f3b18098640 1 -- 172.21.15.83:0/2351984830 wait complete. 2024-03-30T13:11:27.803 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-30T13:11:27.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859ffe2640 1 Processor -- start 2024-03-30T13:11:27.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859ffe2640 1 -- start start 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859ffe2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8598147d40 0x7f85980b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859ffe2640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f85980b4320 0x7f859815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859ffe2640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8598163120 con 0x7f859815f480 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859ffe2640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f85980b4780 con 0x7f85980b4320 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859ffe2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8598162360 con 0x7f8598147d40 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859dd7e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8598147d40 0x7f85980b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859dd7e640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8598147d40 0x7f85980b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:52892/0 (socket says 172.21.15.83:52892) 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859dd7e640 1 -- 172.21.15.83:0/1230316989 learned_addr learned my addr 172.21.15.83:0/1230316989 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859d57d640 1 --2- 172.21.15.83:0/1230316989 >> v2:172.21.15.153:3300/0 conn(0x7f85980b4320 0x7f859815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859dd7e640 1 -- 172.21.15.83:0/1230316989 >> v2:172.21.15.153:3300/0 conn(0x7f85980b4320 msgr2=0x7f859815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:27.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859dd7e640 1 --2- 172.21.15.83:0/1230316989 >> v2:172.21.15.153:3300/0 conn(0x7f85980b4320 0x7f859815ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859dd7e640 1 -- 172.21.15.83:0/1230316989 >> v1:172.21.15.153:6789/0 conn(0x7f859815f480 legacy=0x7f859806f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.904+0000 7f859dd7e640 1 -- 172.21.15.83:0/1230316989 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8598162640 con 0x7f8598147d40 2024-03-30T13:11:27.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859dd7e640 1 --2- 172.21.15.83:0/1230316989 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8598147d40 0x7f85980b3de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8594009870 tx=0x7f859401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29c355c187597c92 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859cd7c640 1 -- 172.21.15.83:0/1230316989 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85940ab680 con 0x7f8598147d40 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859cd7c640 1 -- 172.21.15.83:0/1230316989 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85940b0070 con 0x7f8598147d40 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859cd7c640 1 -- 172.21.15.83:0/1230316989 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85940aba40 con 0x7f8598147d40 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 -- 172.21.15.83:0/1230316989 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8598147d40 msgr2=0x7f85980b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 --2- 172.21.15.83:0/1230316989 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8598147d40 0x7f85980b3de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8594009870 tx=0x7f859401c560 comp rx=0 tx=0).stop 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 -- 172.21.15.83:0/1230316989 shutdown_connections 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 --2- 172.21.15.83:0/1230316989 >> v2:172.21.15.153:3300/0 conn(0x7f85980b4320 0x7f859815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 --2- 172.21.15.83:0/1230316989 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8598147d40 0x7f85980b3de0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 -- 172.21.15.83:0/1230316989 >> 172.21.15.83:0/1230316989 conn(0x7f85980b7670 msgr2=0x7f85980b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 -- 172.21.15.83:0/1230316989 shutdown_connections 2024-03-30T13:11:27.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 -- 172.21.15.83:0/1230316989 wait complete. 2024-03-30T13:11:27.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 Processor -- start 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 -- start start 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85980b4320 0x7f8598145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8598147d40 0x7f8598146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f859815f480 0x7f85980b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f859815f890 con 0x7f85980b4320 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8598148120 con 0x7f859815f480 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859ffe2640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f859815fa10 con 0x7f8598147d40 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859dd7e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85980b4320 0x7f8598145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859dd7e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85980b4320 0x7f8598145810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43658/0 (socket says 172.21.15.83:43658) 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859dd7e640 1 -- 172.21.15.83:0/733872949 learned_addr learned my addr 172.21.15.83:0/733872949 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859e57f640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f859815f480 0x7f85980b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859d57d640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8598147d40 0x7f8598146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859dd7e640 1 -- 172.21.15.83:0/733872949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8598147d40 msgr2=0x7f8598146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859dd7e640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8598147d40 0x7f8598146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859dd7e640 1 -- 172.21.15.83:0/733872949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f859815f480 msgr2=0x7f85980b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.908+0000 7f859dd7e640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f859815f480 0x7f85980b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f859dd7e640 1 -- 172.21.15.83:0/733872949 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8598145ea0 con 0x7f85980b4320 2024-03-30T13:11:27.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f859e57f640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f859815f480 0x7f85980b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:27.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f859dd7e640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85980b4320 0x7f8598145810 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f85940ad040 tx=0x7f859401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f858a7fc640 1 -- 172.21.15.83:0/733872949 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85940be5f0 con 0x7f85980b4320 2024-03-30T13:11:27.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f858a7fc640 1 -- 172.21.15.83:0/733872949 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85940a7070 con 0x7f85980b4320 2024-03-30T13:11:27.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f859ffe2640 1 -- 172.21.15.83:0/733872949 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8598146180 con 0x7f85980b4320 2024-03-30T13:11:27.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f858a7fc640 1 -- 172.21.15.83:0/733872949 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85940be9d0 con 0x7f85980b4320 2024-03-30T13:11:27.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f859ffe2640 1 -- 172.21.15.83:0/733872949 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8598146a20 con 0x7f85980b4320 2024-03-30T13:11:27.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f859ffe2640 1 -- 172.21.15.83:0/733872949 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8598146570 con 0x7f85980b4320 2024-03-30T13:11:27.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f858a7fc640 1 -- 172.21.15.83:0/733872949 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f85940b43f0 con 0x7f85980b4320 2024-03-30T13:11:27.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f858a7fc640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f857c067fc0 0x7f857c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f858a7fc640 1 -- 172.21.15.83:0/733872949 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f8594120790 con 0x7f85980b4320 2024-03-30T13:11:27.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f859d57d640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f857c067fc0 0x7f857c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.912+0000 7f859d57d640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f857c067fc0 0x7f857c06a480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f85981fada0 tx=0x7f858c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:27.916+0000 7f858a7fc640 1 -- 172.21.15.83:0/733872949 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f8594016150 con 0x7f85980b4320 2024-03-30T13:11:28.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.100+0000 7f859ffe2640 1 -- 172.21.15.83:0/733872949 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8598070ec0 con 0x7f85980b4320 2024-03-30T13:11:28.107 INFO:tasks.ceph.mon.a.smithi083.stderr:2024-03-30T13:11:28.100+0000 7f84d7d64640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T13:11:28.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.100+0000 7f858a7fc640 1 -- 172.21.15.83:0/733872949 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7f85940f0970 con 0x7f85980b4320 2024-03-30T13:11:28.110 INFO:teuthology.orchestra.run.smithi083.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-30T13:11:28.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.104+0000 7f859ffe2640 1 -- 172.21.15.83:0/733872949 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f857c067fc0 msgr2=0x7f857c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.104+0000 7f859ffe2640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f857c067fc0 0x7f857c06a480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f85981fada0 tx=0x7f858c008040 comp rx=0 tx=0).stop 2024-03-30T13:11:28.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.104+0000 7f859ffe2640 1 -- 172.21.15.83:0/733872949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85980b4320 msgr2=0x7f8598145810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.104+0000 7f859ffe2640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85980b4320 0x7f8598145810 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f85940ad040 tx=0x7f859401ada0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.104+0000 7f859ffe2640 1 -- 172.21.15.83:0/733872949 shutdown_connections 2024-03-30T13:11:28.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.104+0000 7f859ffe2640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f857c067fc0 0x7f857c06a480 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.104+0000 7f859ffe2640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f859815f480 0x7f85980b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.104+0000 7f859ffe2640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8598147d40 0x7f8598146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.104+0000 7f859ffe2640 1 --2- 172.21.15.83:0/733872949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85980b4320 0x7f8598145810 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.104+0000 7f859ffe2640 1 -- 172.21.15.83:0/733872949 >> 172.21.15.83:0/733872949 conn(0x7f85980b7670 msgr2=0x7f8598140990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:28.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.104+0000 7f859ffe2640 1 -- 172.21.15.83:0/733872949 shutdown_connections 2024-03-30T13:11:28.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.104+0000 7f859ffe2640 1 -- 172.21.15.83:0/733872949 wait complete. 2024-03-30T13:11:28.137 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-30T13:11:28.166 INFO:tasks.ceph.mds.a.smithi083.stdout:starting mds.a at 2024-03-30T13:11:28.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd60a55f640 1 Processor -- start 2024-03-30T13:11:28.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd60a55f640 1 -- start start 2024-03-30T13:11:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd60a55f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd6041608a0 0x7fd6040710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd60a55f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd604160d30 0x7fd604071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd60a55f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60415d380 con 0x7fd6041604c0 2024-03-30T13:11:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd60a55f640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fd60415d660 con 0x7fd6041608a0 2024-03-30T13:11:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd60a55f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd60415d940 con 0x7fd604160d30 2024-03-30T13:11:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd603fff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd6041604c0 0x7fd60415cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:45480/0 (socket says 172.21.15.83:45480) 2024-03-30T13:11:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd603fff640 1 -- 172.21.15.83:0/3775167583 learned_addr learned my addr 172.21.15.83:0/3775167583 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd6037fe640 1 --2- 172.21.15.83:0/3775167583 >> v2:172.21.15.83:3300/0 conn(0x7fd6041608a0 0x7fd6040710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd608afc640 1 --2- 172.21.15.83:0/3775167583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd604160d30 0x7fd604071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd602ffd640 1 -- 172.21.15.83:0/3775167583 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 184258104 0 0) 0x7fd60415d380 con 0x7fd6041604c0 2024-03-30T13:11:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd602ffd640 1 -- 172.21.15.83:0/3775167583 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5ec003530 con 0x7fd6041604c0 2024-03-30T13:11:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd6037fe640 1 -- 172.21.15.83:0/3775167583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd604160d30 msgr2=0x7fd604071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:28.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd6037fe640 1 --2- 172.21.15.83:0/3775167583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd604160d30 0x7fd604071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd6037fe640 1 -- 172.21.15.83:0/3775167583 >> v1:172.21.15.83:6789/0 conn(0x7fd6041604c0 legacy=0x7fd60415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.252+0000 7fd6037fe640 1 -- 172.21.15.83:0/3775167583 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6040d1140 con 0x7fd6041608a0 2024-03-30T13:11:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd6037fe640 1 --2- 172.21.15.83:0/3775167583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6041608a0 0x7fd6040710d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80097c0 tx=0x7fd5f801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86756cc3749bd07a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd602ffd640 1 -- 172.21.15.83:0/3775167583 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f80b0070 con 0x7fd6041608a0 2024-03-30T13:11:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd602ffd640 1 -- 172.21.15.83:0/3775167583 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f80ab600 con 0x7fd6041608a0 2024-03-30T13:11:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd602ffd640 1 -- 172.21.15.83:0/3775167583 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f80ab9d0 con 0x7fd6041608a0 2024-03-30T13:11:28.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd60a55f640 1 -- 172.21.15.83:0/3775167583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6041608a0 msgr2=0x7fd6040710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd60a55f640 1 --2- 172.21.15.83:0/3775167583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6041608a0 0x7fd6040710d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80097c0 tx=0x7fd5f801c4a0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd60a55f640 1 -- 172.21.15.83:0/3775167583 shutdown_connections 2024-03-30T13:11:28.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd60a55f640 1 --2- 172.21.15.83:0/3775167583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd604160d30 0x7fd604071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd60a55f640 1 --2- 172.21.15.83:0/3775167583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6041608a0 0x7fd6040710d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd60a55f640 1 -- 172.21.15.83:0/3775167583 >> 172.21.15.83:0/3775167583 conn(0x7fd6040b3ec0 msgr2=0x7fd6040b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:28.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd60a55f640 1 -- 172.21.15.83:0/3775167583 shutdown_connections 2024-03-30T13:11:28.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd60a55f640 1 -- 172.21.15.83:0/3775167583 wait complete. 2024-03-30T13:11:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd60a55f640 1 Processor -- start 2024-03-30T13:11:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.256+0000 7fd60a55f640 1 -- start start 2024-03-30T13:11:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd60a55f640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6041604c0 0x7fd604137590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd60a55f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6041608a0 0x7fd604142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd60a55f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd604160d30 0x7fd604156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd60a55f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd6040d21e0 con 0x7fd604160d30 2024-03-30T13:11:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd60a55f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd6040d2060 con 0x7fd6041608a0 2024-03-30T13:11:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd60a55f640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd6040d2360 con 0x7fd6041604c0 2024-03-30T13:11:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd608afc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd604160d30 0x7fd604156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd608afc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd604160d30 0x7fd604156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43680/0 (socket says 172.21.15.83:43680) 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd608afc640 1 -- 172.21.15.83:0/2648954138 learned_addr learned my addr 172.21.15.83:0/2648954138 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd6037fe640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6041608a0 0x7fd604142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd603fff640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6041604c0 0x7fd604137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd608afc640 1 -- 172.21.15.83:0/2648954138 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6041604c0 msgr2=0x7fd604137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd608afc640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6041604c0 0x7fd604137590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd608afc640 1 -- 172.21.15.83:0/2648954138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6041608a0 msgr2=0x7fd604142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd608afc640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6041608a0 0x7fd604142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd608afc640 1 -- 172.21.15.83:0/2648954138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd604137ad0 con 0x7fd604160d30 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd6037fe640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6041608a0 0x7fd604142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd608afc640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd604160d30 0x7fd604156030 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc006e90 tx=0x7fd5fc00d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd600ff9640 1 -- 172.21.15.83:0/2648954138 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0125f0 con 0x7fd604160d30 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd600ff9640 1 -- 172.21.15.83:0/2648954138 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5fc019070 con 0x7fd604160d30 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd600ff9640 1 -- 172.21.15.83:0/2648954138 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0129d0 con 0x7fd604160d30 2024-03-30T13:11:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd60a55f640 1 -- 172.21.15.83:0/2648954138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6041416c0 con 0x7fd604160d30 2024-03-30T13:11:28.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd60a55f640 1 -- 172.21.15.83:0/2648954138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd604141c80 con 0x7fd604160d30 2024-03-30T13:11:28.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd60a55f640 1 -- 172.21.15.83:0/2648954138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd604070ec0 con 0x7fd604160d30 2024-03-30T13:11:28.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd600ff9640 1 -- 172.21.15.83:0/2648954138 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fd5fc012b70 con 0x7fd604160d30 2024-03-30T13:11:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd600ff9640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd5f0067fc0 0x7fd5f006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd600ff9640 1 -- 172.21.15.83:0/2648954138 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5795+0+0 (secure 0 0 0) 0x7fd5fc086a10 con 0x7fd604160d30 2024-03-30T13:11:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd603fff640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd5f0067fc0 0x7fd5f006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.260+0000 7fd603fff640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd5f0067fc0 0x7fd5f006a480 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40012f0 tx=0x7fd5f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:28.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.264+0000 7fd600ff9640 1 -- 172.21.15.83:0/2648954138 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fd5fc0570d0 con 0x7fd604160d30 2024-03-30T13:11:28.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:28.448+0000 7fd60a55f640 1 -- 172.21.15.83:0/2648954138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd6040cf1b0 con 0x7fd604160d30 2024-03-30T13:11:29.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd600ff9640 1 -- 172.21.15.83:0/2648954138 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7fd5fc0569d0 con 0x7fd604160d30 2024-03-30T13:11:29.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd60a55f640 1 -- 172.21.15.83:0/2648954138 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd5f0067fc0 msgr2=0x7fd5f006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd60a55f640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd5f0067fc0 0x7fd5f006a480 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40012f0 tx=0x7fd5f4009040 comp rx=0 tx=0).stop 2024-03-30T13:11:29.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd60a55f640 1 -- 172.21.15.83:0/2648954138 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd604160d30 msgr2=0x7fd604156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd60a55f640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd604160d30 0x7fd604156030 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc006e90 tx=0x7fd5fc00d9e0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd60a55f640 1 -- 172.21.15.83:0/2648954138 shutdown_connections 2024-03-30T13:11:29.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd60a55f640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd5f0067fc0 0x7fd5f006a480 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd60a55f640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd604160d30 0x7fd604156030 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd60a55f640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6041608a0 0x7fd604142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd60a55f640 1 --2- 172.21.15.83:0/2648954138 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6041604c0 0x7fd604137590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd60a55f640 1 -- 172.21.15.83:0/2648954138 >> 172.21.15.83:0/2648954138 conn(0x7fd6040b3ec0 msgr2=0x7fd6040b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:29.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd60a55f640 1 -- 172.21.15.83:0/2648954138 shutdown_connections 2024-03-30T13:11:29.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.112+0000 7fd60a55f640 1 -- 172.21.15.83:0/2648954138 wait complete. 2024-03-30T13:11:29.142 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-30T13:11:29.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf88c5640 1 Processor -- start 2024-03-30T13:11:29.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf88c5640 1 -- start start 2024-03-30T13:11:29.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf88c5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9cf4070340 0x7f9cf415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf88c5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf40b0040 0x7f9cf40ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf88c5640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9cf406c670 0x7f9cf406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf88c5640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f9cf406d010 con 0x7f9cf4070340 2024-03-30T13:11:29.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf88c5640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9cf4070720 con 0x7f9cf406c670 2024-03-30T13:11:29.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf88c5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf415f340 con 0x7f9cf40b0040 2024-03-30T13:11:29.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf259c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9cf4070340 0x7f9cf415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf259c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9cf4070340 0x7f9cf415eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43696/0 (socket says 172.21.15.83:43696) 2024-03-30T13:11:29.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf259c640 1 -- 172.21.15.83:0/3427183833 learned_addr learned my addr 172.21.15.83:0/3427183833 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:29.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf1d9b640 1 --2- 172.21.15.83:0/3427183833 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf40b0040 0x7f9cf40ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf2d9d640 1 --2- 172.21.15.83:0/3427183833 >> v2:172.21.15.153:3300/0 conn(0x7f9cf406c670 0x7f9cf406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf259c640 1 -- 172.21.15.83:0/3427183833 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf40b0040 msgr2=0x7f9cf40ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:29.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf259c640 1 --2- 172.21.15.83:0/3427183833 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf40b0040 0x7f9cf40ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf259c640 1 -- 172.21.15.83:0/3427183833 >> v2:172.21.15.153:3300/0 conn(0x7f9cf406c670 msgr2=0x7f9cf406cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:29.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf259c640 1 --2- 172.21.15.83:0/3427183833 >> v2:172.21.15.153:3300/0 conn(0x7f9cf406c670 0x7f9cf406cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf259c640 1 -- 172.21.15.83:0/3427183833 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf415f620 con 0x7f9cf4070340 2024-03-30T13:11:29.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.312+0000 7f9cf2d9d640 1 --2- 172.21.15.83:0/3427183833 >> v2:172.21.15.153:3300/0 conn(0x7f9cf406c670 0x7f9cf406cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:29.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf259c640 1 --2- 172.21.15.83:0/3427183833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf4070340 0x7f9cf415eb10 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40b5350 tx=0x7f9ce401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a9fa256a2644d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:29.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf159a640 1 -- 172.21.15.83:0/3427183833 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40b0070 con 0x7f9cf4070340 2024-03-30T13:11:29.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf159a640 1 -- 172.21.15.83:0/3427183833 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce40ab600 con 0x7f9cf4070340 2024-03-30T13:11:29.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf159a640 1 -- 172.21.15.83:0/3427183833 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40ab9d0 con 0x7f9cf4070340 2024-03-30T13:11:29.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf88c5640 1 -- 172.21.15.83:0/3427183833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf4070340 msgr2=0x7f9cf415eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf88c5640 1 --2- 172.21.15.83:0/3427183833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf4070340 0x7f9cf415eb10 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40b5350 tx=0x7f9ce401c520 comp rx=0 tx=0).stop 2024-03-30T13:11:29.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf88c5640 1 -- 172.21.15.83:0/3427183833 shutdown_connections 2024-03-30T13:11:29.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf88c5640 1 --2- 172.21.15.83:0/3427183833 >> v2:172.21.15.153:3300/0 conn(0x7f9cf406c670 0x7f9cf406cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf88c5640 1 --2- 172.21.15.83:0/3427183833 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf40b0040 0x7f9cf40ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf88c5640 1 --2- 172.21.15.83:0/3427183833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf4070340 0x7f9cf415eb10 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf88c5640 1 -- 172.21.15.83:0/3427183833 >> 172.21.15.83:0/3427183833 conn(0x7f9cf4072080 msgr2=0x7f9cf4072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:29.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf88c5640 1 -- 172.21.15.83:0/3427183833 shutdown_connections 2024-03-30T13:11:29.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.316+0000 7f9cf88c5640 1 -- 172.21.15.83:0/3427183833 wait complete. 2024-03-30T13:11:29.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf88c5640 1 Processor -- start 2024-03-30T13:11:29.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf88c5640 1 -- start start 2024-03-30T13:11:29.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf88c5640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf406c670 0x7f9cf4152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf88c5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf4070340 0x7f9cf41381c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf88c5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf40b0040 0x7f9cf4138700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf88c5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf40aef20 con 0x7f9cf40b0040 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf88c5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf40aeda0 con 0x7f9cf4070340 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf88c5640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf40b4a30 con 0x7f9cf406c670 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf2d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf40b0040 0x7f9cf4138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf2d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf40b0040 0x7f9cf4138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43698/0 (socket says 172.21.15.83:43698) 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf2d9d640 1 -- 172.21.15.83:0/2241791267 learned_addr learned my addr 172.21.15.83:0/2241791267 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf259c640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf406c670 0x7f9cf4152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf1d9b640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf4070340 0x7f9cf41381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf2d9d640 1 -- 172.21.15.83:0/2241791267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf406c670 msgr2=0x7f9cf4152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf2d9d640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf406c670 0x7f9cf4152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf2d9d640 1 -- 172.21.15.83:0/2241791267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf4070340 msgr2=0x7f9cf41381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf2d9d640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf4070340 0x7f9cf41381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf2d9d640 1 -- 172.21.15.83:0/2241791267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf414dbe0 con 0x7f9cf40b0040 2024-03-30T13:11:29.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf259c640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf406c670 0x7f9cf4152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:29.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf2d9d640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf40b0040 0x7f9cf4138700 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00c820 tx=0x7f9cdc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:29.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9ceaffd640 1 -- 172.21.15.83:0/2241791267 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc015070 con 0x7f9cf40b0040 2024-03-30T13:11:29.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9ceaffd640 1 -- 172.21.15.83:0/2241791267 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cdc007a30 con 0x7f9cf40b0040 2024-03-30T13:11:29.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9ceaffd640 1 -- 172.21.15.83:0/2241791267 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc007e20 con 0x7f9cf40b0040 2024-03-30T13:11:29.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf88c5640 1 -- 172.21.15.83:0/2241791267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf414dec0 con 0x7f9cf40b0040 2024-03-30T13:11:29.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf88c5640 1 -- 172.21.15.83:0/2241791267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf4138eb0 con 0x7f9cf40b0040 2024-03-30T13:11:29.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9cf88c5640 1 -- 172.21.15.83:0/2241791267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf4068dd0 con 0x7f9cf40b0040 2024-03-30T13:11:29.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.320+0000 7f9ceaffd640 1 -- 172.21.15.83:0/2241791267 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9cdc018070 con 0x7f9cf40b0040 2024-03-30T13:11:29.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.324+0000 7f9ceaffd640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9cd8067fc0 0x7f9cd806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.324+0000 7f9ceaffd640 1 -- 172.21.15.83:0/2241791267 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5795+0+0 (secure 0 0 0) 0x7f9cdc086500 con 0x7f9cf40b0040 2024-03-30T13:11:29.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.324+0000 7f9cf259c640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9cd8067fc0 0x7f9cd806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.324+0000 7f9cf259c640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9cd8067fc0 0x7f9cd806a480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40ad000 tx=0x7f9ce40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:29.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.328+0000 7f9ceaffd640 1 -- 172.21.15.83:0/2241791267 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9cdc056c80 con 0x7f9cf40b0040 2024-03-30T13:11:29.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:29.488+0000 7f9cf88c5640 1 -- 172.21.15.83:0/2241791267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9cf40b5380 con 0x7f9cf40b0040 2024-03-30T13:11:30.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.292+0000 7f9ceaffd640 1 -- 172.21.15.83:0/2241791267 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) ==== 181+0+0 (secure 0 0 0) 0x7f9cdc056580 con 0x7f9cf40b0040 2024-03-30T13:11:30.302 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' removed 2024-03-30T13:11:30.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.296+0000 7f9cf88c5640 1 -- 172.21.15.83:0/2241791267 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9cd8067fc0 msgr2=0x7f9cd806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.296+0000 7f9cf88c5640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9cd8067fc0 0x7f9cd806a480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40ad000 tx=0x7f9ce40a6000 comp rx=0 tx=0).stop 2024-03-30T13:11:30.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.296+0000 7f9cf88c5640 1 -- 172.21.15.83:0/2241791267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf40b0040 msgr2=0x7f9cf4138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.296+0000 7f9cf88c5640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf40b0040 0x7f9cf4138700 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00c820 tx=0x7f9cdc00cce0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.300+0000 7f9cf88c5640 1 -- 172.21.15.83:0/2241791267 shutdown_connections 2024-03-30T13:11:30.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.300+0000 7f9cf88c5640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9cd8067fc0 0x7f9cd806a480 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.300+0000 7f9cf88c5640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf40b0040 0x7f9cf4138700 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.300+0000 7f9cf88c5640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf4070340 0x7f9cf41381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.300+0000 7f9cf88c5640 1 --2- 172.21.15.83:0/2241791267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cf406c670 0x7f9cf4152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.300+0000 7f9cf88c5640 1 -- 172.21.15.83:0/2241791267 >> 172.21.15.83:0/2241791267 conn(0x7f9cf4072080 msgr2=0x7f9cf414ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:30.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.300+0000 7f9cf88c5640 1 -- 172.21.15.83:0/2241791267 shutdown_connections 2024-03-30T13:11:30.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.300+0000 7f9cf88c5640 1 -- 172.21.15.83:0/2241791267 wait complete. 2024-03-30T13:11:30.332 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-30T13:11:30.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efce5fa8640 1 Processor -- start 2024-03-30T13:11:30.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efce5fa8640 1 -- start start 2024-03-30T13:11:30.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efce5fa8640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efce00d0290 0x7efce00af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efce5fa8640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce00ad490 con 0x7efce00d0670 2024-03-30T13:11:30.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efce5fa8640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce00cf790 con 0x7efce00738a0 2024-03-30T13:11:30.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efce5fa8640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7efce00ad770 con 0x7efce00d0290 2024-03-30T13:11:30.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efcdf7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efce00d0290 0x7efce00af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efcdffff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7efce00d0670 0x7efce015cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:45494/0 (socket says 172.21.15.83:45494) 2024-03-30T13:11:30.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efcdffff640 1 -- 172.21.15.83:0/3796984338 learned_addr learned my addr 172.21.15.83:0/3796984338 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:30.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efcdf7fe640 1 -- 172.21.15.83:0/3796984338 >> v1:172.21.15.153:6789/0 conn(0x7efce00738a0 legacy=0x7efce006d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efcdf7fe640 1 -- 172.21.15.83:0/3796984338 >> v1:172.21.15.83:6789/0 conn(0x7efce00d0670 legacy=0x7efce015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efcde7fc640 1 -- 172.21.15.83:0/3796984338 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526787448 0 0) 0x7efce00ad490 con 0x7efce00d0670 2024-03-30T13:11:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.452+0000 7efcdf7fe640 1 -- 172.21.15.83:0/3796984338 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce00cfa70 con 0x7efce00d0290 2024-03-30T13:11:30.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.456+0000 7efcdf7fe640 1 --2- 172.21.15.83:0/3796984338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce00d0290 0x7efce00af690 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efcd00097c0 tx=0x7efcd001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c1121a22164545 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:30.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.456+0000 7efcde7fc640 1 -- 172.21.15.83:0/3796984338 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd00ab610 con 0x7efce00d0290 2024-03-30T13:11:30.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.456+0000 7efcde7fc640 1 -- 172.21.15.83:0/3796984338 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd00b0070 con 0x7efce00d0290 2024-03-30T13:11:30.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.456+0000 7efcde7fc640 1 -- 172.21.15.83:0/3796984338 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd00ab9d0 con 0x7efce00d0290 2024-03-30T13:11:30.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.456+0000 7efce5fa8640 1 -- 172.21.15.83:0/3796984338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce00d0290 msgr2=0x7efce00af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.456+0000 7efce5fa8640 1 --2- 172.21.15.83:0/3796984338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce00d0290 0x7efce00af690 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efcd00097c0 tx=0x7efcd001c430 comp rx=0 tx=0).stop 2024-03-30T13:11:30.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.456+0000 7efce5fa8640 1 -- 172.21.15.83:0/3796984338 shutdown_connections 2024-03-30T13:11:30.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.456+0000 7efce5fa8640 1 --2- 172.21.15.83:0/3796984338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce00d0290 0x7efce00af690 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.456+0000 7efce5fa8640 1 -- 172.21.15.83:0/3796984338 >> 172.21.15.83:0/3796984338 conn(0x7efce00b21d0 msgr2=0x7efce00b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:30.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.456+0000 7efce5fa8640 1 -- 172.21.15.83:0/3796984338 shutdown_connections 2024-03-30T13:11:30.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.456+0000 7efce5fa8640 1 -- 172.21.15.83:0/3796984338 wait complete. 2024-03-30T13:11:30.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efce5fa8640 1 Processor -- start 2024-03-30T13:11:30.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efce5fa8640 1 -- start start 2024-03-30T13:11:30.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efce5fa8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce00738a0 0x7efce0156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efce5fa8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efce00d0290 0x7efce0158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efce5fa8640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efce00d0670 0x7efce01595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efce5fa8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efce00ad230 con 0x7efce00738a0 2024-03-30T13:11:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efce5fa8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efce00ad0b0 con 0x7efce00d0290 2024-03-30T13:11:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efce5fa8640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efce00d0aa0 con 0x7efce00d0670 2024-03-30T13:11:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcdf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce00738a0 0x7efce0156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcdf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce00738a0 0x7efce0156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43722/0 (socket says 172.21.15.83:43722) 2024-03-30T13:11:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcdf7fe640 1 -- 172.21.15.83:0/1847538879 learned_addr learned my addr 172.21.15.83:0/1847538879 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcdffff640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efce00d0670 0x7efce01595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcdeffd640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efce00d0290 0x7efce0158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcdf7fe640 1 -- 172.21.15.83:0/1847538879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efce00d0670 msgr2=0x7efce01595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcdf7fe640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efce00d0670 0x7efce01595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcdf7fe640 1 -- 172.21.15.83:0/1847538879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efce00d0290 msgr2=0x7efce0158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcdf7fe640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efce00d0290 0x7efce0158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcdf7fe640 1 -- 172.21.15.83:0/1847538879 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce0157560 con 0x7efce00738a0 2024-03-30T13:11:30.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcdf7fe640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce00738a0 0x7efce0156ef0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efcd00ad040 tx=0x7efcd001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:30.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcc7fff640 1 -- 172.21.15.83:0/1847538879 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0004220 con 0x7efce00738a0 2024-03-30T13:11:30.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcc7fff640 1 -- 172.21.15.83:0/1847538879 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd00043c0 con 0x7efce00738a0 2024-03-30T13:11:30.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efce5fa8640 1 -- 172.21.15.83:0/1847538879 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce0157840 con 0x7efce00738a0 2024-03-30T13:11:30.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcc7fff640 1 -- 172.21.15.83:0/1847538879 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0003820 con 0x7efce00738a0 2024-03-30T13:11:30.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efce5fa8640 1 -- 172.21.15.83:0/1847538879 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce0157e00 con 0x7efce00738a0 2024-03-30T13:11:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efce5fa8640 1 -- 172.21.15.83:0/1847538879 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce00686c0 con 0x7efce00738a0 2024-03-30T13:11:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.460+0000 7efcc7fff640 1 -- 172.21.15.83:0/1847538879 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7efcd00039c0 con 0x7efce00738a0 2024-03-30T13:11:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.464+0000 7efcc7fff640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efccc067fc0 0x7efccc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.464+0000 7efcdeffd640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efccc067fc0 0x7efccc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.464+0000 7efcc7fff640 1 -- 172.21.15.83:0/1847538879 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5357+0+0 (secure 0 0 0) 0x7efcd0121130 con 0x7efce00738a0 2024-03-30T13:11:30.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.464+0000 7efcdeffd640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efccc067fc0 0x7efccc06a480 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efce0151e20 tx=0x7efcd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:30.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.464+0000 7efcc7fff640 1 -- 172.21.15.83:0/1847538879 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7efcd00a8050 con 0x7efce00738a0 2024-03-30T13:11:30.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:30.628+0000 7efce5fa8640 1 -- 172.21.15.83:0/1847538879 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7efce006f1a0 con 0x7efce00738a0 2024-03-30T13:11:31.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.304+0000 7efcc7fff640 1 -- 172.21.15.83:0/1847538879 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) ==== 169+0+0 (secure 0 0 0) 0x7efcd0016050 con 0x7efce00738a0 2024-03-30T13:11:31.312 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' removed 2024-03-30T13:11:31.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.308+0000 7efce5fa8640 1 -- 172.21.15.83:0/1847538879 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efccc067fc0 msgr2=0x7efccc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.308+0000 7efce5fa8640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efccc067fc0 0x7efccc06a480 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efce0151e20 tx=0x7efcd4009040 comp rx=0 tx=0).stop 2024-03-30T13:11:31.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.308+0000 7efce5fa8640 1 -- 172.21.15.83:0/1847538879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce00738a0 msgr2=0x7efce0156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.308+0000 7efce5fa8640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce00738a0 0x7efce0156ef0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efcd00ad040 tx=0x7efcd001ac70 comp rx=0 tx=0).stop 2024-03-30T13:11:31.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.308+0000 7efce5fa8640 1 -- 172.21.15.83:0/1847538879 shutdown_connections 2024-03-30T13:11:31.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.308+0000 7efce5fa8640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7efccc067fc0 0x7efccc06a480 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.308+0000 7efce5fa8640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efce00d0670 0x7efce01595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.308+0000 7efce5fa8640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efce00d0290 0x7efce0158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.308+0000 7efce5fa8640 1 --2- 172.21.15.83:0/1847538879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce00738a0 0x7efce0156ef0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.308+0000 7efce5fa8640 1 -- 172.21.15.83:0/1847538879 >> 172.21.15.83:0/1847538879 conn(0x7efce00b21d0 msgr2=0x7efce00b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:31.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.308+0000 7efce5fa8640 1 -- 172.21.15.83:0/1847538879 shutdown_connections 2024-03-30T13:11:31.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.308+0000 7efce5fa8640 1 -- 172.21.15.83:0/1847538879 wait complete. 2024-03-30T13:11:31.345 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-30T13:11:31.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.460+0000 7f46cc7e6640 1 Processor -- start 2024-03-30T13:11:31.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.460+0000 7f46cc7e6640 1 -- start start 2024-03-30T13:11:31.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.460+0000 7f46cc7e6640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46c4161bc0 0x7f46c40b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.460+0000 7f46cc7e6640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c40add40 con 0x7f46c406ede0 2024-03-30T13:11:31.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.460+0000 7f46cc7e6640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c40b4440 con 0x7f46c40721d0 2024-03-30T13:11:31.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.460+0000 7f46cc7e6640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f46c40b4720 con 0x7f46c4161bc0 2024-03-30T13:11:31.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46cad83640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f46c406ede0 0x7f46c40ae500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:45502/0 (socket says 172.21.15.83:45502) 2024-03-30T13:11:31.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46cad83640 1 -- 172.21.15.83:0/3402606412 learned_addr learned my addr 172.21.15.83:0/3402606412 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:31.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46ca582640 1 --2- 172.21.15.83:0/3402606412 >> v2:172.21.15.153:3300/0 conn(0x7f46c4161bc0 0x7f46c40b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1559480495 0 0) 0x7f46c40add40 con 0x7f46c406ede0 2024-03-30T13:11:31.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46b0003530 con 0x7f46c406ede0 2024-03-30T13:11:31.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3027381815 0 0) 0x7f46b0003530 con 0x7f46c406ede0 2024-03-30T13:11:31.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 >> v2:172.21.15.153:3300/0 conn(0x7f46c4161bc0 msgr2=0x7f46c40b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:31.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 --2- 172.21.15.83:0/3402606412 >> v2:172.21.15.153:3300/0 conn(0x7f46c4161bc0 0x7f46c40b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 >> v1:172.21.15.153:6789/0 conn(0x7f46c40721d0 legacy=0x7f46c406e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c40b4a00 con 0x7f46c406ede0 2024-03-30T13:11:31.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f46b80016a0 con 0x7f46c406ede0 2024-03-30T13:11:31.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 >> v1:172.21.15.83:6789/0 conn(0x7f46c406ede0 legacy=0x7f46c40ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 --2- 172.21.15.83:0/3402606412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b00039c0 0x7f46b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 --2- 172.21.15.83:0/3402606412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 0x7f46b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 --2- 172.21.15.83:0/3402606412 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46b00051d0 0x7f46b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f46c40b4720 con 0x7f46b0004810 2024-03-30T13:11:31.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46b000c070 con 0x7f46b00039c0 2024-03-30T13:11:31.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f46b000c270 con 0x7f46b00051d0 2024-03-30T13:11:31.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9d81640 1 --2- 172.21.15.83:0/3402606412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 0x7f46b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46ca582640 1 --2- 172.21.15.83:0/3402606412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b00039c0 0x7f46b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46cad83640 1 --2- 172.21.15.83:0/3402606412 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46b00051d0 0x7f46b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9d81640 1 -- 172.21.15.83:0/3402606412 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46b00051d0 msgr2=0x7f46b000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:31.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9d81640 1 --2- 172.21.15.83:0/3402606412 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46b00051d0 0x7f46b000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9d81640 1 -- 172.21.15.83:0/3402606412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b00039c0 msgr2=0x7f46b0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:31.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9d81640 1 --2- 172.21.15.83:0/3402606412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b00039c0 0x7f46b0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9d81640 1 -- 172.21.15.83:0/3402606412 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b0003530 con 0x7f46b0004810 2024-03-30T13:11:31.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46cad83640 1 -- 172.21.15.83:0/3402606412 reap_dead start 2024-03-30T13:11:31.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9d81640 1 --2- 172.21.15.83:0/3402606412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 0x7f46b0004c90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f46bc001780 tx=0x7f46bc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a730dac95416d1c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:31.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0013a0 con 0x7f46b0004810 2024-03-30T13:11:31.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46bc0052f0 con 0x7f46b0004810 2024-03-30T13:11:31.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.464+0000 7f46c9580640 1 -- 172.21.15.83:0/3402606412 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc003840 con 0x7f46b0004810 2024-03-30T13:11:31.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 -- 172.21.15.83:0/3402606412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 msgr2=0x7f46b0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 --2- 172.21.15.83:0/3402606412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 0x7f46b0004c90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f46bc001780 tx=0x7f46bc01c400 comp rx=0 tx=0).stop 2024-03-30T13:11:31.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 -- 172.21.15.83:0/3402606412 shutdown_connections 2024-03-30T13:11:31.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 --2- 172.21.15.83:0/3402606412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 0x7f46b0004c90 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 -- 172.21.15.83:0/3402606412 >> 172.21.15.83:0/3402606412 conn(0x7f46c406b660 msgr2=0x7f46c406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:31.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 -- 172.21.15.83:0/3402606412 shutdown_connections 2024-03-30T13:11:31.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 -- 172.21.15.83:0/3402606412 wait complete. 2024-03-30T13:11:31.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 Processor -- start 2024-03-30T13:11:31.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 -- start start 2024-03-30T13:11:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 0x7f46c4145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46c415e130 0x7f46c41f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46c4157c90 0x7f46c4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f46c406e850 con 0x7f46b0004810 2024-03-30T13:11:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46c406e6d0 con 0x7f46c4157c90 2024-03-30T13:11:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f46c406e9d0 con 0x7f46c415e130 2024-03-30T13:11:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46ca582640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 0x7f46c4145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46ca582640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 0x7f46c4145920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43740/0 (socket says 172.21.15.83:43740) 2024-03-30T13:11:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46ca582640 1 -- 172.21.15.83:0/2046355899 learned_addr learned my addr 172.21.15.83:0/2046355899 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46ca582640 1 -- 172.21.15.83:0/2046355899 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46c415e130 msgr2=0x7f46c41f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46c9d81640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46c415e130 0x7f46c41f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cad83640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46c4157c90 0x7f46c4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46ca582640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46c415e130 0x7f46c41f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46ca582640 1 -- 172.21.15.83:0/2046355899 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46c4157c90 msgr2=0x7f46c4158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46ca582640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46c4157c90 0x7f46c4158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46ca582640 1 -- 172.21.15.83:0/2046355899 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c4145e60 con 0x7f46b0004810 2024-03-30T13:11:31.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46ca582640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 0x7f46c4145920 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f46c0007f60 tx=0x7f46c0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:31.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46b6ffd640 1 -- 172.21.15.83:0/2046355899 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c001a020 con 0x7f46b0004810 2024-03-30T13:11:31.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46b6ffd640 1 -- 172.21.15.83:0/2046355899 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c0016470 con 0x7f46b0004810 2024-03-30T13:11:31.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 -- 172.21.15.83:0/2046355899 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c41f82e0 con 0x7f46b0004810 2024-03-30T13:11:31.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46b6ffd640 1 -- 172.21.15.83:0/2046355899 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0016860 con 0x7f46b0004810 2024-03-30T13:11:31.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 -- 172.21.15.83:0/2046355899 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c41462a0 con 0x7f46b0004810 2024-03-30T13:11:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.468+0000 7f46cc7e6640 1 -- 172.21.15.83:0/2046355899 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c409e540 con 0x7f46b0004810 2024-03-30T13:11:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.472+0000 7f46b6ffd640 1 -- 172.21.15.83:0/2046355899 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f46c001d020 con 0x7f46b0004810 2024-03-30T13:11:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.472+0000 7f46b6ffd640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f46a8067fc0 0x7f46a806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.472+0000 7f46b6ffd640 1 -- 172.21.15.83:0/2046355899 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f46c0087360 con 0x7f46b0004810 2024-03-30T13:11:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.472+0000 7f46c9d81640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f46a8067fc0 0x7f46a806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.472+0000 7f46c9d81640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f46a8067fc0 0x7f46a806a480 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f46bc004000 tx=0x7f46bc0011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.476+0000 7f46b6ffd640 1 -- 172.21.15.83:0/2046355899 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f46c0024030 con 0x7f46b0004810 2024-03-30T13:11:31.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.636+0000 7f46cc7e6640 1 -- 172.21.15.83:0/2046355899 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f46c404f9e0 con 0x7f46b0004810 2024-03-30T13:11:31.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.644+0000 7f46b6ffd640 1 -- 172.21.15.83:0/2046355899 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f46c0057ea0 con 0x7f46b0004810 2024-03-30T13:11:31.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.648+0000 7f46cc7e6640 1 -- 172.21.15.83:0/2046355899 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f46a8067fc0 msgr2=0x7f46a806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.648+0000 7f46cc7e6640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f46a8067fc0 0x7f46a806a480 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f46bc004000 tx=0x7f46bc0011a0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.648+0000 7f46cc7e6640 1 -- 172.21.15.83:0/2046355899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 msgr2=0x7f46c4145920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.648+0000 7f46cc7e6640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 0x7f46c4145920 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f46c0007f60 tx=0x7f46c0007f90 comp rx=0 tx=0).stop 2024-03-30T13:11:31.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.648+0000 7f46cc7e6640 1 -- 172.21.15.83:0/2046355899 shutdown_connections 2024-03-30T13:11:31.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.648+0000 7f46cc7e6640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f46a8067fc0 0x7f46a806a480 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.648+0000 7f46cc7e6640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46c4157c90 0x7f46c4158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.648+0000 7f46cc7e6640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46c415e130 0x7f46c41f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.648+0000 7f46cc7e6640 1 --2- 172.21.15.83:0/2046355899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b0004810 0x7f46c4145920 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.648+0000 7f46cc7e6640 1 -- 172.21.15.83:0/2046355899 >> 172.21.15.83:0/2046355899 conn(0x7f46c406b660 msgr2=0x7f46c40b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:31.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.648+0000 7f46cc7e6640 1 -- 172.21.15.83:0/2046355899 shutdown_connections 2024-03-30T13:11:31.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.648+0000 7f46cc7e6640 1 -- 172.21.15.83:0/2046355899 wait complete. 2024-03-30T13:11:31.672 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining' 2024-03-30T13:11:31.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f46905d7640 1 Processor -- start 2024-03-30T13:11:31.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f46905d7640 1 -- start start 2024-03-30T13:11:31.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f46905d7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f468813f590 0x7f46880b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f46905d7640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4688160b30 0x7f468813fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f46905d7640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46880b5110 con 0x7f468806c670 2024-03-30T13:11:31.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f46905d7640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f46880b4be0 con 0x7f468813f590 2024-03-30T13:11:31.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f46905d7640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f46880b4340 con 0x7f4688160b30 2024-03-30T13:11:31.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f468e373640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f468813f590 0x7f46880b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f468e373640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f468813f590 0x7f46880b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43742/0 (socket says 172.21.15.83:43742) 2024-03-30T13:11:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f468e373640 1 -- 172.21.15.83:0/1053250653 learned_addr learned my addr 172.21.15.83:0/1053250653 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f468e373640 1 -- 172.21.15.83:0/1053250653 >> v2:172.21.15.153:3300/0 conn(0x7f4688160b30 msgr2=0x7f468813fb30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-30T13:11:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f468e373640 1 --2- 172.21.15.83:0/1053250653 >> v2:172.21.15.153:3300/0 conn(0x7f4688160b30 0x7f468813fb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f468e373640 1 -- 172.21.15.83:0/1053250653 >> v1:172.21.15.153:6789/0 conn(0x7f468806c670 legacy=0x7f46880b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.788+0000 7f468e373640 1 -- 172.21.15.83:0/1053250653 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46880b4620 con 0x7f468813f590 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.792+0000 7f468e373640 1 --2- 172.21.15.83:0/1053250653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f468813f590 0x7f46880b3af0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4688146180 tx=0x7f468401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a42d91e2cab362 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.792+0000 7f468d371640 1 -- 172.21.15.83:0/1053250653 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46840aa5f0 con 0x7f468813f590 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.792+0000 7f468d371640 1 -- 172.21.15.83:0/1053250653 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46840af070 con 0x7f468813f590 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.792+0000 7f468d371640 1 -- 172.21.15.83:0/1053250653 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46840aa9b0 con 0x7f468813f590 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.792+0000 7f46905d7640 1 -- 172.21.15.83:0/1053250653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f468813f590 msgr2=0x7f46880b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.792+0000 7f46905d7640 1 --2- 172.21.15.83:0/1053250653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f468813f590 0x7f46880b3af0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4688146180 tx=0x7f468401c4d0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.792+0000 7f46905d7640 1 -- 172.21.15.83:0/1053250653 shutdown_connections 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.792+0000 7f46905d7640 1 --2- 172.21.15.83:0/1053250653 >> v2:172.21.15.153:3300/0 conn(0x7f4688160b30 0x7f468813fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.792+0000 7f46905d7640 1 --2- 172.21.15.83:0/1053250653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f468813f590 0x7f46880b3af0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.792+0000 7f46905d7640 1 -- 172.21.15.83:0/1053250653 >> 172.21.15.83:0/1053250653 conn(0x7f4688072030 msgr2=0x7f4688072440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.792+0000 7f46905d7640 1 -- 172.21.15.83:0/1053250653 shutdown_connections 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.792+0000 7f46905d7640 1 -- 172.21.15.83:0/1053250653 wait complete. 2024-03-30T13:11:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f46905d7640 1 Processor -- start 2024-03-30T13:11:31.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f46905d7640 1 -- start start 2024-03-30T13:11:31.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f46905d7640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f468806c670 0x7f468815d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f46905d7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f468813f590 0x7f468815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f46905d7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688160b30 0x7f46880ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f46905d7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f46881401f0 con 0x7f468813f590 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f46905d7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4688140070 con 0x7f4688160b30 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f46905d7640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4688169890 con 0x7f468806c670 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f468db72640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f468813f590 0x7f468815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f468db72640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f468813f590 0x7f468815bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43758/0 (socket says 172.21.15.83:43758) 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f468db72640 1 -- 172.21.15.83:0/2602205237 learned_addr learned my addr 172.21.15.83:0/2602205237 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f468e373640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f468806c670 0x7f468815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f468eb74640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688160b30 0x7f46880ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f468db72640 1 -- 172.21.15.83:0/2602205237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f468806c670 msgr2=0x7f468815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f468db72640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f468806c670 0x7f468815d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f468db72640 1 -- 172.21.15.83:0/2602205237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688160b30 msgr2=0x7f46880ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f468db72640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688160b30 0x7f46880ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f468db72640 1 -- 172.21.15.83:0/2602205237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468815e850 con 0x7f468813f590 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f468eb74640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688160b30 0x7f46880ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f468db72640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f468813f590 0x7f468815bc20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f467800b3e0 tx=0x7f467800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f467effd640 1 -- 172.21.15.83:0/2602205237 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678015020 con 0x7f468813f590 2024-03-30T13:11:31.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f467effd640 1 -- 172.21.15.83:0/2602205237 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4678011850 con 0x7f468813f590 2024-03-30T13:11:31.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f46905d7640 1 -- 172.21.15.83:0/2602205237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468815eb30 con 0x7f468813f590 2024-03-30T13:11:31.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f467effd640 1 -- 172.21.15.83:0/2602205237 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678011c40 con 0x7f468813f590 2024-03-30T13:11:31.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f46905d7640 1 -- 172.21.15.83:0/2602205237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468815c160 con 0x7f468813f590 2024-03-30T13:11:31.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.796+0000 7f46905d7640 1 -- 172.21.15.83:0/2602205237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4688068dd0 con 0x7f468813f590 2024-03-30T13:11:31.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.800+0000 7f467effd640 1 -- 172.21.15.83:0/2602205237 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f4678018020 con 0x7f468813f590 2024-03-30T13:11:31.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.800+0000 7f467effd640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f466c067fc0 0x7f466c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.800+0000 7f467effd640 1 -- 172.21.15.83:0/2602205237 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f46780860a0 con 0x7f468813f590 2024-03-30T13:11:31.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.800+0000 7f468e373640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f466c067fc0 0x7f466c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.800+0000 7f468e373640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f466c067fc0 0x7f466c06a480 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f46840ae000 tx=0x7f46840a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:31.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:31.804+0000 7f467effd640 1 -- 172.21.15.83:0/2602205237 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f467801f020 con 0x7f468813f590 2024-03-30T13:11:32.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.032+0000 7f46905d7640 1 -- 172.21.15.83:0/2602205237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]} v 0) -- 0x7f468813fb10 con 0x7f468813f590 2024-03-30T13:11:32.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f467effd640 1 -- 172.21.15.83:0/2602205237 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]}]=0 v158) ==== 147+0+0 (secure 0 0 0) 0x7f46780172c0 con 0x7f468813f590 2024-03-30T13:11:32.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f46905d7640 1 -- 172.21.15.83:0/2602205237 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f466c067fc0 msgr2=0x7f466c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f46905d7640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f466c067fc0 0x7f466c06a480 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f46840ae000 tx=0x7f46840a7000 comp rx=0 tx=0).stop 2024-03-30T13:11:32.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f46905d7640 1 -- 172.21.15.83:0/2602205237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f468813f590 msgr2=0x7f468815bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f46905d7640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f468813f590 0x7f468815bc20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f467800b3e0 tx=0x7f467800b8a0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f46905d7640 1 -- 172.21.15.83:0/2602205237 shutdown_connections 2024-03-30T13:11:32.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f46905d7640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f466c067fc0 0x7f466c06a480 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f46905d7640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688160b30 0x7f46880ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f46905d7640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f468813f590 0x7f468815bc20 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f46905d7640 1 --2- 172.21.15.83:0/2602205237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f468806c670 0x7f468815d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f46905d7640 1 -- 172.21.15.83:0/2602205237 >> 172.21.15.83:0/2602205237 conn(0x7f4688072030 msgr2=0x7f4688165cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:32.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f46905d7640 1 -- 172.21.15.83:0/2602205237 shutdown_connections 2024-03-30T13:11:32.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:32.308+0000 7f46905d7640 1 -- 172.21.15.83:0/2602205237 wait complete. 2024-03-30T13:11:32.345 INFO:tasks.cephfs_test_runner:test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) ... ERROR 2024-03-30T13:11:32.345 INFO:tasks.cephfs_test_runner: 2024-03-30T13:11:32.345 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-30T13:11:32.345 INFO:tasks.cephfs_test_runner:ERROR: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:11:32.345 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-30T13:11:32.345 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-30T13:11:32.345 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/test_uninlining.py", line 322, in test_data_uninlining 2024-03-30T13:11:32.345 INFO:tasks.cephfs_test_runner: self.run_test_worker(opt_clear_cache, 2024-03-30T13:11:32.345 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/test_uninlining.py", line 219, in run_test_worker 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: self.fs.mds_tell(['cache', 'drop'], i) 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1313, in mds_tell 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: return self.rank_tell(*args, **kwargs) 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1332, in rank_tell 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: return self.mds_tell(*args, mds_id=f"{self.id}:{rank}", **kwargs) 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1319, in mds_tell 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: out = self.get_ceph_cmd_stdout("tell", f"mds.{mds_id}", *args, **kwargs) 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 447, in run 2024-03-30T13:11:32.346 INFO:tasks.cephfs_test_runner: r = RemoteProcess(client, args, check_status=check_status, hostname=name, 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 65, in __init__ 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner: self.command = quote(args) 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 257, in quote 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner: return ' '.join(_quote(args)) 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 255, in _quote 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner: yield pipes.quote(a) 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/shlex.py", line 325, in quote 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner: if _find_unsafe(s) is None: 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner:TypeError: expected string or bytes-like object 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner: 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner:Ran 1 test in 151.881s 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner: 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-03-30T13:11:32.347 INFO:tasks.cephfs_test_runner: 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner:ERROR: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/test_uninlining.py", line 322, in test_data_uninlining 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: self.run_test_worker(opt_clear_cache, 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/test_uninlining.py", line 219, in run_test_worker 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: self.fs.mds_tell(['cache', 'drop'], i) 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1313, in mds_tell 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: return self.rank_tell(*args, **kwargs) 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1332, in rank_tell 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: return self.mds_tell(*args, mds_id=f"{self.id}:{rank}", **kwargs) 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1319, in mds_tell 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: out = self.get_ceph_cmd_stdout("tell", f"mds.{mds_id}", *args, **kwargs) 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-03-30T13:11:32.348 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 447, in run 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: r = RemoteProcess(client, args, check_status=check_status, hostname=name, 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 65, in __init__ 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: self.command = quote(args) 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 257, in quote 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: return ' '.join(_quote(args)) 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 255, in _quote 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: yield pipes.quote(a) 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/shlex.py", line 325, in quote 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: if _find_unsafe(s) is None: 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner:TypeError: expected string or bytes-like object 2024-03-30T13:11:32.349 INFO:tasks.cephfs_test_runner: 2024-03-30T13:11:32.350 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:11:32.598 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=07875d0cb1b147bf875dd90c403953d7 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:11:32.599 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-30T13:11:32.608 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-30T13:11:32.632 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-30T13:11:32.632 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:11:32.632 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:32.646 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336512k,nr_inodes=4084128,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16917 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-30T13:11:32.646 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-03-30T13:11:32.646 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:32.696 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336512k,nr_inodes=4084128,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16917 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-30T13:11:32.697 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:11:32.697 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:32.703 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336524k,nr_inodes=4084131,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20907 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T13:11:32.703 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-30T13:11:32.703 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:32.752 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336524k,nr_inodes=4084131,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20907 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T13:11:32.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:32.753 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-03-30T13:11:32.759 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-30T13:11:32.759 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-30T13:11:32.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:32.759 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:11:32.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:32.817 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:11:32.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:32.883 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-03-30T13:11:33.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:33.080 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-03-30T13:11:33.087 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-30T13:11:33.087 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-30T13:11:33.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:33.088 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:11:33.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:33.146 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:11:33.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:33.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-03-30T13:11:33.393 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-30T13:11:33.403 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-30T13:11:33.403 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:11:33.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.524+0000 7fc4dc714640 1 Processor -- start 2024-03-30T13:11:33.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.524+0000 7fc4dc714640 1 -- start start 2024-03-30T13:11:33.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4dc714640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc4d40735d0 0x7fc4d406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4dc714640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4d40b3770 0x7fc4d406dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4dc714640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d415edd0 con 0x7fc4d40739b0 2024-03-30T13:11:33.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4dc714640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40b3c40 con 0x7fc4d40735d0 2024-03-30T13:11:33.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4dc714640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d40b3f20 con 0x7fc4d40b3770 2024-03-30T13:11:33.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4da4b0640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc4d40735d0 0x7fc4d406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4d9caf640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc4d40739b0 0x7fc4d40b3060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:45512/0 (socket says 172.21.15.83:45512) 2024-03-30T13:11:33.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4d9caf640 1 -- 172.21.15.83:0/1874657283 learned_addr learned my addr 172.21.15.83:0/1874657283 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:33.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4dacb1640 1 --2- 172.21.15.83:0/1874657283 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4d40b3770 0x7fc4d406dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4da4b0640 1 -- 172.21.15.83:0/1874657283 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4d40b3770 msgr2=0x7fc4d406dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4da4b0640 1 --2- 172.21.15.83:0/1874657283 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4d40b3770 0x7fc4d406dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4da4b0640 1 -- 172.21.15.83:0/1874657283 >> v1:172.21.15.83:6789/0 conn(0x7fc4d40739b0 legacy=0x7fc4d40b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4da4b0640 1 -- 172.21.15.83:0/1874657283 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40b4200 con 0x7fc4d40735d0 2024-03-30T13:11:33.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.528+0000 7fc4d94ae640 1 -- 172.21.15.83:0/1874657283 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217210719 0 0) 0x7fc4c4001120 con 0x7fc4d40739b0 2024-03-30T13:11:33.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4da4b0640 1 --2- 172.21.15.83:0/1874657283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4d40735d0 0x7fc4d406d7a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00097c0 tx=0x7fc4d001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d42907e8554d3c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4d94ae640 1 -- 172.21.15.83:0/1874657283 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00a7070 con 0x7fc4d40735d0 2024-03-30T13:11:33.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4d94ae640 1 -- 172.21.15.83:0/1874657283 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d00b0070 con 0x7fc4d40735d0 2024-03-30T13:11:33.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4d94ae640 1 -- 172.21.15.83:0/1874657283 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00ab890 con 0x7fc4d40735d0 2024-03-30T13:11:33.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4dc714640 1 -- 172.21.15.83:0/1874657283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4d40735d0 msgr2=0x7fc4d406d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4dc714640 1 --2- 172.21.15.83:0/1874657283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4d40735d0 0x7fc4d406d7a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00097c0 tx=0x7fc4d001c470 comp rx=0 tx=0).stop 2024-03-30T13:11:33.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4dc714640 1 -- 172.21.15.83:0/1874657283 shutdown_connections 2024-03-30T13:11:33.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4dc714640 1 --2- 172.21.15.83:0/1874657283 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4d40b3770 0x7fc4d406dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4dc714640 1 --2- 172.21.15.83:0/1874657283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4d40735d0 0x7fc4d406d7a0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4dc714640 1 -- 172.21.15.83:0/1874657283 >> 172.21.15.83:0/1874657283 conn(0x7fc4d40b1d60 msgr2=0x7fc4d40b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:33.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4dc714640 1 -- 172.21.15.83:0/1874657283 shutdown_connections 2024-03-30T13:11:33.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4dc714640 1 -- 172.21.15.83:0/1874657283 wait complete. 2024-03-30T13:11:33.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4dc714640 1 Processor -- start 2024-03-30T13:11:33.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.532+0000 7fc4dc714640 1 -- start start 2024-03-30T13:11:33.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4dc714640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4d40735d0 0x7fc4d409dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4dc714640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4d40739b0 0x7fc4d4162340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4dc714640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4d40b3770 0x7fc4d4147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4dc714640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d4071d10 con 0x7fc4d40735d0 2024-03-30T13:11:33.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4dc714640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40afa80 con 0x7fc4d40b3770 2024-03-30T13:11:33.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4dc714640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d4071e90 con 0x7fc4d40739b0 2024-03-30T13:11:33.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4da4b0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4d40735d0 0x7fc4d409dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4da4b0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4d40735d0 0x7fc4d409dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43774/0 (socket says 172.21.15.83:43774) 2024-03-30T13:11:33.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4da4b0640 1 -- 172.21.15.83:0/1702629527 learned_addr learned my addr 172.21.15.83:0/1702629527 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:33.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4d9caf640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4d40739b0 0x7fc4d4162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4da4b0640 1 -- 172.21.15.83:0/1702629527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4d40739b0 msgr2=0x7fc4d4162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4dacb1640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4d40b3770 0x7fc4d4147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4da4b0640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4d40739b0 0x7fc4d4162340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4da4b0640 1 -- 172.21.15.83:0/1702629527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4d40b3770 msgr2=0x7fc4d4147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4da4b0640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4d40b3770 0x7fc4d4147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4da4b0640 1 -- 172.21.15.83:0/1702629527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d409e1c0 con 0x7fc4d40735d0 2024-03-30T13:11:33.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4dacb1640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4d40b3770 0x7fc4d4147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:33.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4da4b0640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4d40735d0 0x7fc4d409dc80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00097c0 tx=0x7fc4d001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4caffd640 1 -- 172.21.15.83:0/1702629527 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00bf610 con 0x7fc4d40735d0 2024-03-30T13:11:33.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4caffd640 1 -- 172.21.15.83:0/1702629527 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d00bf7d0 con 0x7fc4d40735d0 2024-03-30T13:11:33.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4dc714640 1 -- 172.21.15.83:0/1702629527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d4162880 con 0x7fc4d40735d0 2024-03-30T13:11:33.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4caffd640 1 -- 172.21.15.83:0/1702629527 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00bfbc0 con 0x7fc4d40735d0 2024-03-30T13:11:33.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4dc714640 1 -- 172.21.15.83:0/1702629527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d41612a0 con 0x7fc4d40735d0 2024-03-30T13:11:33.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4caffd640 1 -- 172.21.15.83:0/1702629527 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc4d00bd020 con 0x7fc4d40735d0 2024-03-30T13:11:33.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4dc714640 1 -- 172.21.15.83:0/1702629527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d40686c0 con 0x7fc4d40735d0 2024-03-30T13:11:33.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4caffd640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc4b8067fc0 0x7fc4b806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4caffd640 1 -- 172.21.15.83:0/1702629527 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fc4d01209e0 con 0x7fc4d40735d0 2024-03-30T13:11:33.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.536+0000 7fc4d9caf640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc4b8067fc0 0x7fc4b806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.540+0000 7fc4d9caf640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc4b8067fc0 0x7fc4b806a480 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40cfe90 tx=0x7fc4c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.544+0000 7fc4caffd640 1 -- 172.21.15.83:0/1702629527 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fc4d4162880 con 0x7fc4d40735d0 2024-03-30T13:11:33.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.700+0000 7fc4dc714640 1 -- 172.21.15.83:0/1702629527 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4d40b5020 con 0x7fc4b8067fc0 2024-03-30T13:11:33.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.700+0000 7fc4caffd640 1 -- 172.21.15.83:0/1702629527 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13510 (secure 0 0 0) 0x7fc4d40b5020 con 0x7fc4b8067fc0 2024-03-30T13:11:33.709 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:33.709 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:11:33.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.704+0000 7fc4dc714640 1 -- 172.21.15.83:0/1702629527 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc4b8067fc0 msgr2=0x7fc4b806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.704+0000 7fc4dc714640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc4b8067fc0 0x7fc4b806a480 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40cfe90 tx=0x7fc4c4009040 comp rx=0 tx=0).stop 2024-03-30T13:11:33.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.704+0000 7fc4dc714640 1 -- 172.21.15.83:0/1702629527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4d40735d0 msgr2=0x7fc4d409dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.704+0000 7fc4dc714640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4d40735d0 0x7fc4d409dc80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00097c0 tx=0x7fc4d001acb0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.704+0000 7fc4dc714640 1 -- 172.21.15.83:0/1702629527 shutdown_connections 2024-03-30T13:11:33.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.704+0000 7fc4dc714640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fc4b8067fc0 0x7fc4b806a480 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.704+0000 7fc4dc714640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4d40b3770 0x7fc4d4147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.704+0000 7fc4dc714640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4d40739b0 0x7fc4d4162340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.704+0000 7fc4dc714640 1 --2- 172.21.15.83:0/1702629527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4d40735d0 0x7fc4d409dc80 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.704+0000 7fc4dc714640 1 -- 172.21.15.83:0/1702629527 >> 172.21.15.83:0/1702629527 conn(0x7fc4d40b1d60 msgr2=0x7fc4d40ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:33.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.704+0000 7fc4dc714640 1 -- 172.21.15.83:0/1702629527 shutdown_connections 2024-03-30T13:11:33.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.704+0000 7fc4dc714640 1 -- 172.21.15.83:0/1702629527 wait complete. 2024-03-30T13:11:33.728 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-03-30T13:11:32.197748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":594736,"kb_used_data":349460,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754379984,"statfs":{"total":773094113280,"available":772485103616,"internally_reserved":0,"allocated":357847040,"data_stored":355558173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-176513651,"num_objects":-116,"num_object_clones":0,"num_object_copies":-232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-116,"num_whiteouts":0,"num_read":-110,"num_read_kb":-23,"num_write":-904,"num_write_kb":-175130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001303"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-30T13:11:28.113670+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:11:28.113670+0000","last_peered":"2024-03-30T13:11:28.113670+0000","last_clean":"2024-03-30T13:11:28.113670+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:11:28.113670+0000","last_undegraded":"2024-03-30T13:11:28.113670+0000","last_fullsized":"2024-03-30T13:11:28.113670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77520,"kb_used_data":46340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94294320,"statfs":{"total":96636764160,"available":96557383680,"internally_reserved":0,"allocated":47452160,"data_stored":47169774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509484,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52244,"kb_used_data":25224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94319596,"statfs":{"total":96636764160,"available":96583266304,"internally_reserved":0,"allocated":25829376,"data_stored":25553275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93328,"kb_used_data":62148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94278512,"statfs":{"total":96636764160,"available":96541196288,"internally_reserved":0,"allocated":63639552,"data_stored":63346685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71612,"kb_used_data":40436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94300228,"statfs":{"total":96636764160,"available":96563433472,"internally_reserved":0,"allocated":41406464,"data_stored":41111531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88420,"kb_used_data":57244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94283420,"statfs":{"total":96636764160,"available":96546222080,"internally_reserved":0,"allocated":58617856,"data_stored":58332124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65076,"kb_used_data":33896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94306764,"statfs":{"total":96636764160,"available":96570126336,"internally_reserved":0,"allocated":34709504,"data_stored":34437306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89988,"kb_used_data":58804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94281852,"statfs":{"total":96636764160,"available":96544616448,"internally_reserved":0,"allocated":60215296,"data_stored":59922285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56548,"kb_used_data":25368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94315292,"statfs":{"total":96636764160,"available":96578859008,"internally_reserved":0,"allocated":25976832,"data_stored":25685193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:11:33.728 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:11:33.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcb145d640 1 Processor -- start 2024-03-30T13:11:33.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcb145d640 1 -- start start 2024-03-30T13:11:33.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcb145d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbcac15e700 0x7fbcac0cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcb145d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbcac09b160 0x7fbcac0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcb145d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcac0cd380 con 0x7fbcac0d03f0 2024-03-30T13:11:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcb145d640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fbcac0cdcb0 con 0x7fbcac09b160 2024-03-30T13:11:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcb145d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbcac0cd660 con 0x7fbcac15e700 2024-03-30T13:11:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcab7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbcac09b160 0x7fbcac0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcab7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbcac09b160 0x7fbcac0b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43776/0 (socket says 172.21.15.83:43776) 2024-03-30T13:11:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcab7fe640 1 -- 172.21.15.83:0/3489601531 learned_addr learned my addr 172.21.15.83:0/3489601531 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcaaffd640 1 --2- 172.21.15.83:0/3489601531 >> v2:172.21.15.153:3300/0 conn(0x7fbcac15e700 0x7fbcac0cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcab7fe640 1 -- 172.21.15.83:0/3489601531 >> v2:172.21.15.153:3300/0 conn(0x7fbcac15e700 msgr2=0x7fbcac0cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcab7fe640 1 --2- 172.21.15.83:0/3489601531 >> v2:172.21.15.153:3300/0 conn(0x7fbcac15e700 0x7fbcac0cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcab7fe640 1 -- 172.21.15.83:0/3489601531 >> v1:172.21.15.153:6789/0 conn(0x7fbcac0d03f0 legacy=0x7fbcac09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.844+0000 7fbcab7fe640 1 -- 172.21.15.83:0/3489601531 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac0cd940 con 0x7fbcac09b160 2024-03-30T13:11:33.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbcab7fe640 1 --2- 172.21.15.83:0/3489601531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcac09b160 0x7fbcac0b1c40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbcac073570 tx=0x7fbca401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d874c6d656091b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbca9ffb640 1 -- 172.21.15.83:0/3489601531 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca40a5870 con 0x7fbcac09b160 2024-03-30T13:11:33.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbca9ffb640 1 -- 172.21.15.83:0/3489601531 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca40a5a10 con 0x7fbcac09b160 2024-03-30T13:11:33.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbca9ffb640 1 -- 172.21.15.83:0/3489601531 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca40a5de0 con 0x7fbcac09b160 2024-03-30T13:11:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbcb145d640 1 -- 172.21.15.83:0/3489601531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcac09b160 msgr2=0x7fbcac0b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbcb145d640 1 --2- 172.21.15.83:0/3489601531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcac09b160 0x7fbcac0b1c40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbcac073570 tx=0x7fbca401c990 comp rx=0 tx=0).stop 2024-03-30T13:11:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbcb145d640 1 -- 172.21.15.83:0/3489601531 shutdown_connections 2024-03-30T13:11:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbcb145d640 1 --2- 172.21.15.83:0/3489601531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcac09b160 0x7fbcac0b1c40 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbcb145d640 1 --2- 172.21.15.83:0/3489601531 >> v2:172.21.15.153:3300/0 conn(0x7fbcac15e700 0x7fbcac0cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbcb145d640 1 -- 172.21.15.83:0/3489601531 >> 172.21.15.83:0/3489601531 conn(0x7fbcac0b3dd0 msgr2=0x7fbcac0b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbcb145d640 1 -- 172.21.15.83:0/3489601531 shutdown_connections 2024-03-30T13:11:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbcb145d640 1 -- 172.21.15.83:0/3489601531 wait complete. 2024-03-30T13:11:33.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbcb145d640 1 Processor -- start 2024-03-30T13:11:33.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.848+0000 7fbcb145d640 1 -- start start 2024-03-30T13:11:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcb145d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcac09b160 0x7fbcac1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcb145d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcac0d03f0 0x7fbcac161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcb145d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcac15e700 0x7fbcac156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcb145d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac16b5b0 con 0x7fbcac09b160 2024-03-30T13:11:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcb145d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac09bc30 con 0x7fbcac15e700 2024-03-30T13:11:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcb145d640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbcac16b730 con 0x7fbcac0d03f0 2024-03-30T13:11:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcaaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcac09b160 0x7fbcac1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcaaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcac09b160 0x7fbcac1569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43788/0 (socket says 172.21.15.83:43788) 2024-03-30T13:11:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcaaffd640 1 -- 172.21.15.83:0/2450525686 learned_addr learned my addr 172.21.15.83:0/2450525686 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcab7fe640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcac15e700 0x7fbcac156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcaa7fc640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcac0d03f0 0x7fbcac161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcaaffd640 1 -- 172.21.15.83:0/2450525686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcac0d03f0 msgr2=0x7fbcac161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcaaffd640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcac0d03f0 0x7fbcac161190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcaaffd640 1 -- 172.21.15.83:0/2450525686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcac15e700 msgr2=0x7fbcac156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcaaffd640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcac15e700 0x7fbcac156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcaaffd640 1 -- 172.21.15.83:0/2450525686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac157810 con 0x7fbcac09b160 2024-03-30T13:11:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcab7fe640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcac15e700 0x7fbcac156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:33.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcaaffd640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcac09b160 0x7fbcac1569d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00d5f0 tx=0x7fbc9c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbc937fe640 1 -- 172.21.15.83:0/2450525686 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0125f0 con 0x7fbcac09b160 2024-03-30T13:11:33.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbc937fe640 1 -- 172.21.15.83:0/2450525686 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9c019070 con 0x7fbcac09b160 2024-03-30T13:11:33.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcb145d640 1 -- 172.21.15.83:0/2450525686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcac157af0 con 0x7fbcac09b160 2024-03-30T13:11:33.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbc937fe640 1 -- 172.21.15.83:0/2450525686 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0129d0 con 0x7fbcac09b160 2024-03-30T13:11:33.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcb145d640 1 -- 172.21.15.83:0/2450525686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcac1580b0 con 0x7fbcac09b160 2024-03-30T13:11:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcb145d640 1 -- 172.21.15.83:0/2450525686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcac068dd0 con 0x7fbcac09b160 2024-03-30T13:11:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbc937fe640 1 -- 172.21.15.83:0/2450525686 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fbc9c012b70 con 0x7fbcac09b160 2024-03-30T13:11:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbc937fe640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbc98067fc0 0x7fbc9806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbc937fe640 1 -- 172.21.15.83:0/2450525686 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fbc9c086610 con 0x7fbcac09b160 2024-03-30T13:11:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcaa7fc640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbc98067fc0 0x7fbc9806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.852+0000 7fbcaa7fc640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbc98067fc0 0x7fbc9806a480 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbca0007fd0 tx=0x7fbca0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:33.856+0000 7fbc937fe640 1 -- 172.21.15.83:0/2450525686 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fbc9c057150 con 0x7fbcac09b160 2024-03-30T13:11:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.016+0000 7fbcb145d640 1 -- 172.21.15.83:0/2450525686 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbcac0b1320 con 0x7fbc98067fc0 2024-03-30T13:11:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.016+0000 7fbc937fe640 1 -- 172.21.15.83:0/2450525686 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13510 (secure 0 0 0) 0x7fbcac0b1320 con 0x7fbc98067fc0 2024-03-30T13:11:34.026 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:34.031 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:11:34.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.020+0000 7fbcb145d640 1 -- 172.21.15.83:0/2450525686 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbc98067fc0 msgr2=0x7fbc9806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.020+0000 7fbcb145d640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbc98067fc0 0x7fbc9806a480 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbca0007fd0 tx=0x7fbca0009040 comp rx=0 tx=0).stop 2024-03-30T13:11:34.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.020+0000 7fbcb145d640 1 -- 172.21.15.83:0/2450525686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcac09b160 msgr2=0x7fbcac1569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.020+0000 7fbcb145d640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcac09b160 0x7fbcac1569d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00d5f0 tx=0x7fbc9c00dab0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.020+0000 7fbcb145d640 1 -- 172.21.15.83:0/2450525686 shutdown_connections 2024-03-30T13:11:34.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.020+0000 7fbcb145d640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fbc98067fc0 0x7fbc9806a480 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.020+0000 7fbcb145d640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcac15e700 0x7fbcac156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.020+0000 7fbcb145d640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcac0d03f0 0x7fbcac161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.020+0000 7fbcb145d640 1 --2- 172.21.15.83:0/2450525686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcac09b160 0x7fbcac1569d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.020+0000 7fbcb145d640 1 -- 172.21.15.83:0/2450525686 >> 172.21.15.83:0/2450525686 conn(0x7fbcac0b3dd0 msgr2=0x7fbcac0745e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:34.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.020+0000 7fbcb145d640 1 -- 172.21.15.83:0/2450525686 shutdown_connections 2024-03-30T13:11:34.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.020+0000 7fbcb145d640 1 -- 172.21.15.83:0/2450525686 wait complete. 2024-03-30T13:11:34.044 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-03-30T13:11:32.197748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":594736,"kb_used_data":349460,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754379984,"statfs":{"total":773094113280,"available":772485103616,"internally_reserved":0,"allocated":357847040,"data_stored":355558173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-176513651,"num_objects":-116,"num_object_clones":0,"num_object_copies":-232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-116,"num_whiteouts":0,"num_read":-110,"num_read_kb":-23,"num_write":-904,"num_write_kb":-175130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001303"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-30T13:11:28.113670+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:11:28.113670+0000","last_peered":"2024-03-30T13:11:28.113670+0000","last_clean":"2024-03-30T13:11:28.113670+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:11:28.113670+0000","last_undegraded":"2024-03-30T13:11:28.113670+0000","last_fullsized":"2024-03-30T13:11:28.113670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77520,"kb_used_data":46340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94294320,"statfs":{"total":96636764160,"available":96557383680,"internally_reserved":0,"allocated":47452160,"data_stored":47169774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509484,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52244,"kb_used_data":25224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94319596,"statfs":{"total":96636764160,"available":96583266304,"internally_reserved":0,"allocated":25829376,"data_stored":25553275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93328,"kb_used_data":62148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94278512,"statfs":{"total":96636764160,"available":96541196288,"internally_reserved":0,"allocated":63639552,"data_stored":63346685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71612,"kb_used_data":40436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94300228,"statfs":{"total":96636764160,"available":96563433472,"internally_reserved":0,"allocated":41406464,"data_stored":41111531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88420,"kb_used_data":57244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94283420,"statfs":{"total":96636764160,"available":96546222080,"internally_reserved":0,"allocated":58617856,"data_stored":58332124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65076,"kb_used_data":33896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94306764,"statfs":{"total":96636764160,"available":96570126336,"internally_reserved":0,"allocated":34709504,"data_stored":34437306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89988,"kb_used_data":58804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94281852,"statfs":{"total":96636764160,"available":96544616448,"internally_reserved":0,"allocated":60215296,"data_stored":59922285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56548,"kb_used_data":25368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94315292,"statfs":{"total":96636764160,"available":96578859008,"internally_reserved":0,"allocated":25976832,"data_stored":25685193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:11:34.045 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-30T13:11:34.046 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:11:34.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.160+0000 7f2abadaf640 1 Processor -- start 2024-03-30T13:11:34.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.160+0000 7f2abadaf640 1 -- start start 2024-03-30T13:11:34.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2abadaf640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ab40735d0 0x7f2ab406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2abadaf640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ab40b3770 0x7f2ab406dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2abadaf640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab415edd0 con 0x7f2ab40739b0 2024-03-30T13:11:34.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2abadaf640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2ab40b3c40 con 0x7f2ab40b3770 2024-03-30T13:11:34.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2abadaf640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab40b3f20 con 0x7f2ab40735d0 2024-03-30T13:11:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2ab8b4b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ab40735d0 0x7f2ab406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2ab8b4b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ab40735d0 0x7f2ab406d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.83:53018/0 (socket says 172.21.15.83:53018) 2024-03-30T13:11:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2ab8b4b640 1 -- 172.21.15.83:0/2501094795 learned_addr learned my addr 172.21.15.83:0/2501094795 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2ab934c640 1 --2- 172.21.15.83:0/2501094795 >> v2:172.21.15.153:3300/0 conn(0x7f2ab40b3770 0x7f2ab406dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2ab8b4b640 1 -- 172.21.15.83:0/2501094795 >> v2:172.21.15.153:3300/0 conn(0x7f2ab40b3770 msgr2=0x7f2ab406dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2ab8b4b640 1 --2- 172.21.15.83:0/2501094795 >> v2:172.21.15.153:3300/0 conn(0x7f2ab40b3770 0x7f2ab406dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2ab8b4b640 1 -- 172.21.15.83:0/2501094795 >> v1:172.21.15.153:6789/0 conn(0x7f2ab40739b0 legacy=0x7f2ab40b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.164+0000 7f2ab8b4b640 1 -- 172.21.15.83:0/2501094795 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab40b4200 con 0x7f2ab40735d0 2024-03-30T13:11:34.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2ab8b4b640 1 --2- 172.21.15.83:0/2501094795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ab40735d0 0x7f2ab406d7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009870 tx=0x7f2ab001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa3953eb2a879761 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:34.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2aab7fe640 1 -- 172.21.15.83:0/2501094795 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00a95f0 con 0x7f2ab40735d0 2024-03-30T13:11:34.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2aab7fe640 1 -- 172.21.15.83:0/2501094795 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab00a9790 con 0x7f2ab40735d0 2024-03-30T13:11:34.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2aab7fe640 1 -- 172.21.15.83:0/2501094795 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00a9b60 con 0x7f2ab40735d0 2024-03-30T13:11:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2abadaf640 1 -- 172.21.15.83:0/2501094795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ab40735d0 msgr2=0x7f2ab406d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2abadaf640 1 --2- 172.21.15.83:0/2501094795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ab40735d0 0x7f2ab406d7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009870 tx=0x7f2ab001c530 comp rx=0 tx=0).stop 2024-03-30T13:11:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2abadaf640 1 -- 172.21.15.83:0/2501094795 shutdown_connections 2024-03-30T13:11:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2abadaf640 1 --2- 172.21.15.83:0/2501094795 >> v2:172.21.15.153:3300/0 conn(0x7f2ab40b3770 0x7f2ab406dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2abadaf640 1 --2- 172.21.15.83:0/2501094795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ab40735d0 0x7f2ab406d7a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2abadaf640 1 -- 172.21.15.83:0/2501094795 >> 172.21.15.83:0/2501094795 conn(0x7f2ab40b1d60 msgr2=0x7f2ab40b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2abadaf640 1 -- 172.21.15.83:0/2501094795 shutdown_connections 2024-03-30T13:11:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2abadaf640 1 -- 172.21.15.83:0/2501094795 wait complete. 2024-03-30T13:11:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2abadaf640 1 Processor -- start 2024-03-30T13:11:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2abadaf640 1 -- start start 2024-03-30T13:11:34.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2abadaf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab40735d0 0x7f2ab414c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.168+0000 7f2abadaf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ab40739b0 0x7f2ab4159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2abadaf640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ab40b3770 0x7f2ab41464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2abadaf640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab4071d10 con 0x7f2ab40739b0 2024-03-30T13:11:34.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2abadaf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab40afa80 con 0x7f2ab40735d0 2024-03-30T13:11:34.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2abadaf640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab4071e90 con 0x7f2ab40b3770 2024-03-30T13:11:34.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aabfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ab40739b0 0x7f2ab4159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aabfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ab40739b0 0x7f2ab4159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43798/0 (socket says 172.21.15.83:43798) 2024-03-30T13:11:34.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aabfff640 1 -- 172.21.15.83:0/1895505759 learned_addr learned my addr 172.21.15.83:0/1895505759 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:34.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2ab8b4b640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab40735d0 0x7f2ab414c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2ab934c640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ab40b3770 0x7f2ab41464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aabfff640 1 -- 172.21.15.83:0/1895505759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ab40b3770 msgr2=0x7f2ab41464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aabfff640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ab40b3770 0x7f2ab41464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aabfff640 1 -- 172.21.15.83:0/1895505759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab40735d0 msgr2=0x7f2ab414c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aabfff640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab40735d0 0x7f2ab414c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aabfff640 1 -- 172.21.15.83:0/1895505759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab4159550 con 0x7f2ab40739b0 2024-03-30T13:11:34.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aabfff640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ab40739b0 0x7f2ab4159010 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c450 tx=0x7f2aa400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:34.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aa97fa640 1 -- 172.21.15.83:0/1895505759 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4016020 con 0x7f2ab40739b0 2024-03-30T13:11:34.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aa97fa640 1 -- 172.21.15.83:0/1895505759 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa40052d0 con 0x7f2ab40739b0 2024-03-30T13:11:34.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2abadaf640 1 -- 172.21.15.83:0/1895505759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab414d520 con 0x7f2ab40739b0 2024-03-30T13:11:34.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aa97fa640 1 -- 172.21.15.83:0/1895505759 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4007260 con 0x7f2ab40739b0 2024-03-30T13:11:34.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2abadaf640 1 -- 172.21.15.83:0/1895505759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab414d240 con 0x7f2ab40739b0 2024-03-30T13:11:34.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2abadaf640 1 -- 172.21.15.83:0/1895505759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab40686c0 con 0x7f2ab40739b0 2024-03-30T13:11:34.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aa97fa640 1 -- 172.21.15.83:0/1895505759 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2aa4007400 con 0x7f2ab40739b0 2024-03-30T13:11:34.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aa97fa640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2aa0067fc0 0x7f2aa006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2aa97fa640 1 -- 172.21.15.83:0/1895505759 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f2aa4085ae0 con 0x7f2ab40739b0 2024-03-30T13:11:34.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2ab8b4b640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2aa0067fc0 0x7f2aa006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.172+0000 7f2ab8b4b640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2aa0067fc0 0x7f2aa006a480 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00ae000 tx=0x7f2ab00b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:34.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.176+0000 7f2aa97fa640 1 -- 172.21.15.83:0/1895505759 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f2aa4020020 con 0x7f2ab40739b0 2024-03-30T13:11:34.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.324+0000 7f2abadaf640 1 -- 172.21.15.83:0/1895505759 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ab4156ce0 con 0x7f2aa0067fc0 2024-03-30T13:11:34.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.324+0000 7f2aa97fa640 1 -- 172.21.15.83:0/1895505759 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13518 (secure 0 0 0) 0x7f2ab4156ce0 con 0x7f2aa0067fc0 2024-03-30T13:11:34.334 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:34.334 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:11:34.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.328+0000 7f2abadaf640 1 -- 172.21.15.83:0/1895505759 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2aa0067fc0 msgr2=0x7f2aa006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.328+0000 7f2abadaf640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2aa0067fc0 0x7f2aa006a480 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00ae000 tx=0x7f2ab00b3040 comp rx=0 tx=0).stop 2024-03-30T13:11:34.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.328+0000 7f2abadaf640 1 -- 172.21.15.83:0/1895505759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ab40739b0 msgr2=0x7f2ab4159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.328+0000 7f2abadaf640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ab40739b0 0x7f2ab4159010 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c450 tx=0x7f2aa400c910 comp rx=0 tx=0).stop 2024-03-30T13:11:34.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.328+0000 7f2abadaf640 1 -- 172.21.15.83:0/1895505759 shutdown_connections 2024-03-30T13:11:34.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.328+0000 7f2abadaf640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2aa0067fc0 0x7f2aa006a480 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.328+0000 7f2abadaf640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ab40b3770 0x7f2ab41464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.328+0000 7f2abadaf640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ab40739b0 0x7f2ab4159010 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.328+0000 7f2abadaf640 1 --2- 172.21.15.83:0/1895505759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab40735d0 0x7f2ab414c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.328+0000 7f2abadaf640 1 -- 172.21.15.83:0/1895505759 >> 172.21.15.83:0/1895505759 conn(0x7f2ab40b1d60 msgr2=0x7f2ab40b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:34.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.328+0000 7f2abadaf640 1 -- 172.21.15.83:0/1895505759 shutdown_connections 2024-03-30T13:11:34.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.328+0000 7f2abadaf640 1 -- 172.21.15.83:0/1895505759 wait complete. 2024-03-30T13:11:34.351 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-03-30T13:11:34.198182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":333328,"kb_used_data":88020,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754641392,"statfs":{"total":773094113280,"available":772752785408,"internally_reserved":0,"allocated":90132480,"data_stored":87900068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-176513651,"num_objects":-116,"num_object_clones":0,"num_object_copies":-232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-116,"num_whiteouts":0,"num_read":-110,"num_read_kb":-23,"num_write":-904,"num_write_kb":-175130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.085322"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":206,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-30T13:11:31.978415+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:11:31.978415+0000","last_peered":"2024-03-30T13:11:31.978415+0000","last_clean":"2024-03-30T13:11:31.978415+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:11:31.978415+0000","last_undegraded":"2024-03-30T13:11:31.978415+0000","last_fullsized":"2024-03-30T13:11:31.978415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":775677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":775677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89988,"kb_used_data":58804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94281852,"statfs":{"total":96636764160,"available":96544616448,"internally_reserved":0,"allocated":60215296,"data_stored":59922285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56548,"kb_used_data":25368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94315292,"statfs":{"total":96636764160,"available":96578859008,"internally_reserved":0,"allocated":25976832,"data_stored":25685193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:11:34.352 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:34.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.448+0000 7f27d3d58640 1 Processor -- start 2024-03-30T13:11:34.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.448+0000 7f27d3d58640 1 -- start start 2024-03-30T13:11:34.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f27cc0730e0 0x7f27cc15b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f27cc06f140 0x7f27cc06f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27cc0734c0 con 0x7f27cc0b4bb0 2024-03-30T13:11:34.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f27cc15fed0 con 0x7f27cc06f140 2024-03-30T13:11:34.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f27cc06fab0 con 0x7f27cc0730e0 2024-03-30T13:11:34.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d22f5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f27cc06f140 0x7f27cc06f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d22f5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f27cc06f140 0x7f27cc06f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43802/0 (socket says 172.21.15.83:43802) 2024-03-30T13:11:34.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d22f5640 1 -- 172.21.15.83:0/2293386267 learned_addr learned my addr 172.21.15.83:0/2293386267 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:34.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d22f5640 1 -- 172.21.15.83:0/2293386267 >> v2:172.21.15.153:3300/0 conn(0x7f27cc0730e0 msgr2=0x7f27cc15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:34.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d22f5640 1 --2- 172.21.15.83:0/2293386267 >> v2:172.21.15.153:3300/0 conn(0x7f27cc0730e0 0x7f27cc15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d22f5640 1 -- 172.21.15.83:0/2293386267 >> v1:172.21.15.153:6789/0 conn(0x7f27cc0b4bb0 legacy=0x7f27cc15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:34.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d22f5640 1 -- 172.21.15.83:0/2293386267 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc15c2a0 con 0x7f27cc06f140 2024-03-30T13:11:34.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d22f5640 1 --2- 172.21.15.83:0/2293386267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27cc06f140 0x7f27cc06f570 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f27cc070f30 tx=0x7f27c401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810808316885c10f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:34.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d0af2640 1 -- 172.21.15.83:0/2293386267 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c40a5840 con 0x7f27cc06f140 2024-03-30T13:11:34.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d0af2640 1 -- 172.21.15.83:0/2293386267 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c40a59e0 con 0x7f27cc06f140 2024-03-30T13:11:34.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d0af2640 1 -- 172.21.15.83:0/2293386267 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c40a5db0 con 0x7f27cc06f140 2024-03-30T13:11:34.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 -- 172.21.15.83:0/2293386267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27cc06f140 msgr2=0x7f27cc06f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 --2- 172.21.15.83:0/2293386267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27cc06f140 0x7f27cc06f570 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f27cc070f30 tx=0x7f27c401c980 comp rx=0 tx=0).stop 2024-03-30T13:11:34.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 -- 172.21.15.83:0/2293386267 shutdown_connections 2024-03-30T13:11:34.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 --2- 172.21.15.83:0/2293386267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27cc06f140 0x7f27cc06f570 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 --2- 172.21.15.83:0/2293386267 >> v2:172.21.15.153:3300/0 conn(0x7f27cc0730e0 0x7f27cc15b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 -- 172.21.15.83:0/2293386267 >> 172.21.15.83:0/2293386267 conn(0x7f27cc0b1d60 msgr2=0x7f27cc0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:34.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 -- 172.21.15.83:0/2293386267 shutdown_connections 2024-03-30T13:11:34.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.452+0000 7f27d3d58640 1 -- 172.21.15.83:0/2293386267 wait complete. 2024-03-30T13:11:34.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d3d58640 1 Processor -- start 2024-03-30T13:11:34.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d3d58640 1 -- start start 2024-03-30T13:11:34.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d3d58640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27cc06f140 0x7f27cc14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d3d58640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27cc0730e0 0x7f27cc157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d3d58640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27cc0b4bb0 0x7f27cc157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d3d58640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc15be90 con 0x7f27cc06f140 2024-03-30T13:11:34.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d3d58640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc15f2a0 con 0x7f27cc0730e0 2024-03-30T13:11:34.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d3d58640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f27cc15c010 con 0x7f27cc0b4bb0 2024-03-30T13:11:34.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d1af4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27cc06f140 0x7f27cc14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d1af4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27cc06f140 0x7f27cc14e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43818/0 (socket says 172.21.15.83:43818) 2024-03-30T13:11:34.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d1af4640 1 -- 172.21.15.83:0/1466707399 learned_addr learned my addr 172.21.15.83:0/1466707399 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:34.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d22f5640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27cc0b4bb0 0x7f27cc157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d1af4640 1 -- 172.21.15.83:0/1466707399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27cc0b4bb0 msgr2=0x7f27cc157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d1af4640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27cc0b4bb0 0x7f27cc157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d1af4640 1 -- 172.21.15.83:0/1466707399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27cc0730e0 msgr2=0x7f27cc157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d1af4640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27cc0730e0 0x7f27cc157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d1af4640 1 -- 172.21.15.83:0/1466707399 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc14ed00 con 0x7f27cc06f140 2024-03-30T13:11:34.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d1af4640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27cc06f140 0x7f27cc14e7c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f27c000b410 tx=0x7f27c000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:34.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27be7fc640 1 -- 172.21.15.83:0/1466707399 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0015020 con 0x7f27cc06f140 2024-03-30T13:11:34.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27be7fc640 1 -- 172.21.15.83:0/1466707399 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c0011830 con 0x7f27cc06f140 2024-03-30T13:11:34.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d3d58640 1 -- 172.21.15.83:0/1466707399 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27cc156360 con 0x7f27cc06f140 2024-03-30T13:11:34.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27be7fc640 1 -- 172.21.15.83:0/1466707399 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0011c20 con 0x7f27cc06f140 2024-03-30T13:11:34.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d3d58640 1 -- 172.21.15.83:0/1466707399 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27cc156c00 con 0x7f27cc06f140 2024-03-30T13:11:34.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.456+0000 7f27d3d58640 1 -- 172.21.15.83:0/1466707399 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27cc0686c0 con 0x7f27cc06f140 2024-03-30T13:11:34.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.460+0000 7f27be7fc640 1 -- 172.21.15.83:0/1466707399 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f27c0018020 con 0x7f27cc06f140 2024-03-30T13:11:34.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.460+0000 7f27be7fc640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f27b0067fc0 0x7f27b006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.460+0000 7f27be7fc640 1 -- 172.21.15.83:0/1466707399 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f27c0086100 con 0x7f27cc06f140 2024-03-30T13:11:34.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.460+0000 7f27d12f3640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f27b0067fc0 0x7f27b006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.460+0000 7f27d12f3640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f27b0067fc0 0x7f27b006a480 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f27c8007fd0 tx=0x7f27c80079a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:34.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.464+0000 7f27be7fc640 1 -- 172.21.15.83:0/1466707399 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f27c001f020 con 0x7f27cc06f140 2024-03-30T13:11:34.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.612+0000 7f27d3d58640 1 -- 172.21.15.83:0/1466707399 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27cc06da70 con 0x7f27cc06f140 2024-03-30T13:11:34.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.612+0000 7f27be7fc640 1 -- 172.21.15.83:0/1466707399 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+12996 (secure 0 0 0) 0x7f27c00172c0 con 0x7f27cc06f140 2024-03-30T13:11:34.622 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:34.622 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":40,"fsid":"7979f39b-f62b-4bbb-8ee9-a3dd267196bf","created":"2024-03-30T13:08:01.392441+0000","modified":"2024-03-30T13:11:31.299997+0000","last_up_change":"2024-03-30T13:08:12.296426+0000","last_in_change":"2024-03-30T13:08:03.688519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:08:10.237302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f4b62fd-e4b8-4990-ac0a-d75d844e8146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6820","nonce":3103341004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6823","nonce":3103341004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6830","nonce":3103341004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":3103341004},{"type":"v1","addr":"172.21.15.83:6827","nonce":3103341004}]},"public_addr":"172.21.15.83:6820/3103341004","cluster_addr":"172.21.15.83:6823/3103341004","heartbeat_back_addr":"172.21.15.83:6830/3103341004","heartbeat_front_addr":"172.21.15.83:6827/3103341004","state":["exists","up"]},{"osd":1,"uuid":"06572364-7263-4434-bda6-0e1edc421e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6809","nonce":2476462919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6811","nonce":2476462919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6815","nonce":2476462919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2476462919},{"type":"v1","addr":"172.21.15.83:6813","nonce":2476462919}]},"public_addr":"172.21.15.83:6809/2476462919","cluster_addr":"172.21.15.83:6811/2476462919","heartbeat_back_addr":"172.21.15.83:6815/2476462919","heartbeat_front_addr":"172.21.15.83:6813/2476462919","state":["exists","up"]},{"osd":2,"uuid":"85aa5927-8ebb-4656-b91d-bde732b70aaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6801","nonce":75156071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6803","nonce":75156071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6807","nonce":75156071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":75156071},{"type":"v1","addr":"172.21.15.83:6805","nonce":75156071}]},"public_addr":"172.21.15.83:6801/75156071","cluster_addr":"172.21.15.83:6803/75156071","heartbeat_back_addr":"172.21.15.83:6807/75156071","heartbeat_front_addr":"172.21.15.83:6805/75156071","state":["exists","up"]},{"osd":3,"uuid":"4383c8a6-0444-41db-8822-cce69ccf3d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6817","nonce":3821265814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6819","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6821","nonce":3821265814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6829","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6831","nonce":3821265814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3821265814},{"type":"v1","addr":"172.21.15.83:6826","nonce":3821265814}]},"public_addr":"172.21.15.83:6817/3821265814","cluster_addr":"172.21.15.83:6821/3821265814","heartbeat_back_addr":"172.21.15.83:6831/3821265814","heartbeat_front_addr":"172.21.15.83:6826/3821265814","state":["exists","up"]},{"osd":4,"uuid":"af22fa24-f711-47fb-b881-bc286aee1fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6825","nonce":258447987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6827","nonce":258447987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6831","nonce":258447987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":258447987},{"type":"v1","addr":"172.21.15.153:6829","nonce":258447987}]},"public_addr":"172.21.15.153:6825/258447987","cluster_addr":"172.21.15.153:6827/258447987","heartbeat_back_addr":"172.21.15.153:6831/258447987","heartbeat_front_addr":"172.21.15.153:6829/258447987","state":["exists","up"]},{"osd":5,"uuid":"128453ed-4f4c-4eb0-b707-c287024cb5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6809","nonce":2082548959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6814","nonce":2082548959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6823","nonce":2082548959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":2082548959},{"type":"v1","addr":"172.21.15.153:6819","nonce":2082548959}]},"public_addr":"172.21.15.153:6809/2082548959","cluster_addr":"172.21.15.153:6814/2082548959","heartbeat_back_addr":"172.21.15.153:6823/2082548959","heartbeat_front_addr":"172.21.15.153:6819/2082548959","state":["exists","up"]},{"osd":6,"uuid":"8b13f094-13cf-47c4-ad57-a47e1e3ce236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6802","nonce":3641147652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6808","nonce":3641147652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6821","nonce":3641147652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":3641147652},{"type":"v1","addr":"172.21.15.153:6815","nonce":3641147652}]},"public_addr":"172.21.15.153:6802/3641147652","cluster_addr":"172.21.15.153:6808/3641147652","heartbeat_back_addr":"172.21.15.153:6821/3641147652","heartbeat_front_addr":"172.21.15.153:6815/3641147652","state":["exists","up"]},{"osd":7,"uuid":"a37635eb-ed0e-4c95-9d84-557cd88d1c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6803","nonce":1008345868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6807","nonce":1008345868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6820","nonce":1008345868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1008345868},{"type":"v1","addr":"172.21.15.153:6813","nonce":1008345868}]},"public_addr":"172.21.15.153:6803/1008345868","cluster_addr":"172.21.15.153:6807/1008345868","heartbeat_back_addr":"172.21.15.153:6820/1008345868","heartbeat_front_addr":"172.21.15.153:6813/1008345868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.310301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.245888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.796430+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.334983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:08.820557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.181274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.185907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:08:09.329999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6837/1254317891":"2024-03-31T13:11:28.105516+0000","172.21.15.83:6835/1254317891":"2024-03-31T13:11:28.105516+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:34.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.616+0000 7f27d3d58640 1 -- 172.21.15.83:0/1466707399 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f27b0067fc0 msgr2=0x7f27b006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.616+0000 7f27d3d58640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f27b0067fc0 0x7f27b006a480 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f27c8007fd0 tx=0x7f27c80079a0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.616+0000 7f27d3d58640 1 -- 172.21.15.83:0/1466707399 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27cc06f140 msgr2=0x7f27cc14e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.616+0000 7f27d3d58640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27cc06f140 0x7f27cc14e7c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f27c000b410 tx=0x7f27c000b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.616+0000 7f27d3d58640 1 -- 172.21.15.83:0/1466707399 shutdown_connections 2024-03-30T13:11:34.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.616+0000 7f27d3d58640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f27b0067fc0 0x7f27b006a480 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.616+0000 7f27d3d58640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27cc0b4bb0 0x7f27cc157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.616+0000 7f27d3d58640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27cc0730e0 0x7f27cc157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.616+0000 7f27d3d58640 1 --2- 172.21.15.83:0/1466707399 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27cc06f140 0x7f27cc14e7c0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.616+0000 7f27d3d58640 1 -- 172.21.15.83:0/1466707399 >> 172.21.15.83:0/1466707399 conn(0x7f27cc0b1d60 msgr2=0x7f27cc0721a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:34.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.616+0000 7f27d3d58640 1 -- 172.21.15.83:0/1466707399 shutdown_connections 2024-03-30T13:11:34.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:34.616+0000 7f27d3d58640 1 -- 172.21.15.83:0/1466707399 wait complete. 2024-03-30T13:11:35.643 INFO:tasks.ceph:Scrubbing osd.0 2024-03-30T13:11:35.643 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:11:35.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.768+0000 7f8b01174640 1 Processor -- start 2024-03-30T13:11:35.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.768+0000 7f8b01174640 1 -- start start 2024-03-30T13:11:35.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.768+0000 7f8b01174640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8afc1550d0 0x7f8afc072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.768+0000 7f8b01174640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc06f1b0 con 0x7f8afc0b4a90 2024-03-30T13:11:35.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.768+0000 7f8b01174640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc15f350 con 0x7f8afc15e580 2024-03-30T13:11:35.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.768+0000 7f8b01174640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f8afc06e5a0 con 0x7f8afc1550d0 2024-03-30T13:11:35.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.768+0000 7f8afad9d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8afc1550d0 0x7f8afc072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.768+0000 7f8afad9d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8afc1550d0 0x7f8afc072210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43830/0 (socket says 172.21.15.83:43830) 2024-03-30T13:11:35.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.768+0000 7f8afad9d640 1 -- 172.21.15.83:0/974651562 learned_addr learned my addr 172.21.15.83:0/974651562 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:35.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.768+0000 7f8afad9d640 1 -- 172.21.15.83:0/974651562 >> v1:172.21.15.153:6789/0 conn(0x7f8afc15e580 legacy=0x7f8afc15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:35.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.768+0000 7f8afad9d640 1 -- 172.21.15.83:0/974651562 >> v1:172.21.15.83:6789/0 conn(0x7f8afc0b4a90 legacy=0x7f8afc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.768+0000 7f8afad9d640 1 -- 172.21.15.83:0/974651562 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc06e880 con 0x7f8afc1550d0 2024-03-30T13:11:35.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.772+0000 7f8afad9d640 1 --2- 172.21.15.83:0/974651562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8afc1550d0 0x7f8afc072210 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009870 tx=0x7f8aec01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f541c3be0c309ca1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:35.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.772+0000 7f8af9d9b640 1 -- 172.21.15.83:0/974651562 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0b2070 con 0x7f8afc1550d0 2024-03-30T13:11:35.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.772+0000 7f8af9d9b640 1 -- 172.21.15.83:0/974651562 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aec0ad640 con 0x7f8afc1550d0 2024-03-30T13:11:35.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.772+0000 7f8af9d9b640 1 -- 172.21.15.83:0/974651562 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0ada10 con 0x7f8afc1550d0 2024-03-30T13:11:35.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.772+0000 7f8b01174640 1 -- 172.21.15.83:0/974651562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8afc1550d0 msgr2=0x7f8afc072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.772+0000 7f8b01174640 1 --2- 172.21.15.83:0/974651562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8afc1550d0 0x7f8afc072210 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009870 tx=0x7f8aec01c3b0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.772+0000 7f8b01174640 1 -- 172.21.15.83:0/974651562 shutdown_connections 2024-03-30T13:11:35.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.772+0000 7f8b01174640 1 --2- 172.21.15.83:0/974651562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8afc1550d0 0x7f8afc072210 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.772+0000 7f8b01174640 1 -- 172.21.15.83:0/974651562 >> 172.21.15.83:0/974651562 conn(0x7f8afc0b21d0 msgr2=0x7f8afc0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:35.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.772+0000 7f8b01174640 1 -- 172.21.15.83:0/974651562 shutdown_connections 2024-03-30T13:11:35.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.772+0000 7f8b01174640 1 -- 172.21.15.83:0/974651562 wait complete. 2024-03-30T13:11:35.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8b01174640 1 Processor -- start 2024-03-30T13:11:35.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8b01174640 1 -- start start 2024-03-30T13:11:35.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8b01174640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8afc0b4a90 0x7f8afc1e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8b01174640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8afc1550d0 0x7f8afc1f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8b01174640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8afc15e580 0x7f8afc1f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8b01174640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc15bdb0 con 0x7f8afc0b4a90 2024-03-30T13:11:35.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8b01174640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc06ee40 con 0x7f8afc15e580 2024-03-30T13:11:35.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8b01174640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8afc06e270 con 0x7f8afc1550d0 2024-03-30T13:11:35.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8afad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8afc0b4a90 0x7f8afc1e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8afad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8afc0b4a90 0x7f8afc1e72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43838/0 (socket says 172.21.15.83:43838) 2024-03-30T13:11:35.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8afad9d640 1 -- 172.21.15.83:0/46582700 learned_addr learned my addr 172.21.15.83:0/46582700 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:35.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8afad9d640 1 -- 172.21.15.83:0/46582700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8afc1550d0 msgr2=0x7f8afc1f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8afad9d640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8afc1550d0 0x7f8afc1f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8afad9d640 1 -- 172.21.15.83:0/46582700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8afc15e580 msgr2=0x7f8afc1f4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8afb59e640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8afc15e580 0x7f8afc1f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8afad9d640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8afc15e580 0x7f8afc1f4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8afad9d640 1 -- 172.21.15.83:0/46582700 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc1e55e0 con 0x7f8afc0b4a90 2024-03-30T13:11:35.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8afad9d640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8afc0b4a90 0x7f8afc1e72d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8aec019fe0 tx=0x7f8aec019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:35.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8ae37fe640 1 -- 172.21.15.83:0/46582700 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0b2040 con 0x7f8afc0b4a90 2024-03-30T13:11:35.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8ae37fe640 1 -- 172.21.15.83:0/46582700 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aec0bb070 con 0x7f8afc0b4a90 2024-03-30T13:11:35.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8b01174640 1 -- 172.21.15.83:0/46582700 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8afc1e58c0 con 0x7f8afc0b4a90 2024-03-30T13:11:35.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8ae37fe640 1 -- 172.21.15.83:0/46582700 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0abb30 con 0x7f8afc0b4a90 2024-03-30T13:11:35.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8b01174640 1 -- 172.21.15.83:0/46582700 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8afc1e5e80 con 0x7f8afc0b4a90 2024-03-30T13:11:35.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8b01174640 1 -- 172.21.15.83:0/46582700 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8afc0686c0 con 0x7f8afc0b4a90 2024-03-30T13:11:35.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.776+0000 7f8ae37fe640 1 -- 172.21.15.83:0/46582700 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f8aec0abcd0 con 0x7f8afc0b4a90 2024-03-30T13:11:35.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.780+0000 7f8ae37fe640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8ae8067fc0 0x7f8ae806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.780+0000 7f8ae37fe640 1 -- 172.21.15.83:0/46582700 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f8aec1210a0 con 0x7f8afc0b4a90 2024-03-30T13:11:35.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.780+0000 7f8afa59c640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8ae8067fc0 0x7f8ae806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.780+0000 7f8ae37fe640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] conn(0x7f8ae806de80 0x7f8ae80702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.780+0000 7f8ae37fe640 1 -- 172.21.15.83:0/46582700 --> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ae8070950 con 0x7f8ae806de80 2024-03-30T13:11:35.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.780+0000 7f8ae37fe640 1 -- 172.21.15.83:0/46582700 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f8aec121530 con 0x7f8afc0b4a90 2024-03-30T13:11:35.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.780+0000 7f8afb59e640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] conn(0x7f8ae806de80 0x7f8ae80702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.780+0000 7f8afa59c640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8ae8067fc0 0x7f8ae806a480 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8afc1f7d10 tx=0x7f8af0006bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:35.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.780+0000 7f8afb59e640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] conn(0x7f8ae806de80 0x7f8ae80702a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:35.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.780+0000 7f8ae37fe640 1 -- 172.21.15.83:0/46582700 <== osd.0 v2:172.21.15.83:6818/3103341004 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ae8070950 con 0x7f8ae806de80 2024-03-30T13:11:35.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8b01174640 1 -- 172.21.15.83:0/46582700 --> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8afc0b35c0 con 0x7f8ae806de80 2024-03-30T13:11:35.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8ae37fe640 1 -- 172.21.15.83:0/46582700 <== osd.0 v2:172.21.15.83:6818/3103341004 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8afc0b35c0 con 0x7f8ae806de80 2024-03-30T13:11:35.800 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:35.801 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:11:35.801 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:35.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8b01174640 1 -- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] conn(0x7f8ae806de80 msgr2=0x7f8ae80702a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8b01174640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:6818/3103341004,v1:172.21.15.83:6820/3103341004] conn(0x7f8ae806de80 0x7f8ae80702a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8b01174640 1 -- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8ae8067fc0 msgr2=0x7f8ae806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8b01174640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f8ae8067fc0 0x7f8ae806a480 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8afc1f7d10 tx=0x7f8af0006bd0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8b01174640 1 -- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8afc0b4a90 msgr2=0x7f8afc1e72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8b01174640 1 --2- 172.21.15.83:0/46582700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8afc0b4a90 0x7f8afc1e72d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8aec019fe0 tx=0x7f8aec019150 comp rx=0 tx=0).stop 2024-03-30T13:11:35.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8afb59e640 1 -- 172.21.15.83:0/46582700 reap_dead start 2024-03-30T13:11:35.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8b01174640 1 -- 172.21.15.83:0/46582700 shutdown_connections 2024-03-30T13:11:35.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8b01174640 1 -- 172.21.15.83:0/46582700 >> 172.21.15.83:0/46582700 conn(0x7f8afc0b21d0 msgr2=0x7f8afc0aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:35.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8b01174640 1 -- 172.21.15.83:0/46582700 shutdown_connections 2024-03-30T13:11:35.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.792+0000 7f8b01174640 1 -- 172.21.15.83:0/46582700 wait complete. 2024-03-30T13:11:35.816 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-30T13:11:35.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6036d94640 1 Processor -- start 2024-03-30T13:11:35.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6036d94640 1 -- start start 2024-03-30T13:11:35.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6036d94640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f603015d3d0 0x7f6030166ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6036d94640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60300ae040 con 0x7f603015c8e0 2024-03-30T13:11:35.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6036d94640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60300ae320 con 0x7f60300b4680 2024-03-30T13:11:35.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6036d94640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f60300b31e0 con 0x7f603015d3d0 2024-03-30T13:11:35.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6034b30640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f603015c8e0 0x7f60300ad580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:45524/0 (socket says 172.21.15.83:45524) 2024-03-30T13:11:35.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6034b30640 1 -- 172.21.15.83:0/1928534526 learned_addr learned my addr 172.21.15.83:0/1928534526 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:35.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6035331640 1 --2- 172.21.15.83:0/1928534526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f603015d3d0 0x7f6030166ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2334991452 0 0) 0x7f60300ae040 con 0x7f603015c8e0 2024-03-30T13:11:35.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6020003530 con 0x7f603015c8e0 2024-03-30T13:11:35.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3199623766 0 0) 0x7f6020003530 con 0x7f603015c8e0 2024-03-30T13:11:35.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f603015d3d0 msgr2=0x7f6030166ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:35.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 --2- 172.21.15.83:0/1928534526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f603015d3d0 0x7f6030166ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 >> v1:172.21.15.153:6789/0 conn(0x7f60300b4680 legacy=0x7f603015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60300ae600 con 0x7f603015c8e0 2024-03-30T13:11:35.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f6024001680 con 0x7f603015c8e0 2024-03-30T13:11:35.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 >> v1:172.21.15.83:6789/0 conn(0x7f603015c8e0 legacy=0x7f60300ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 --2- 172.21.15.83:0/1928534526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60200039f0 0x7f6020003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 --2- 172.21.15.83:0/1928534526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f603015d3d0 0x7f6020004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 --2- 172.21.15.83:0/1928534526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6020004d50 0x7f60200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f60300b31e0 con 0x7f6020004d50 2024-03-30T13:11:35.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f602000bb30 con 0x7f60200039f0 2024-03-30T13:11:35.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f602000bd30 con 0x7f603015d3d0 2024-03-30T13:11:35.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6035331640 1 --2- 172.21.15.83:0/1928534526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6020004d50 0x7f60200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6034b30640 1 --2- 172.21.15.83:0/1928534526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60200039f0 0x7f6020003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6035331640 1 -- 172.21.15.83:0/1928534526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f603015d3d0 msgr2=0x7f6020004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:35.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6035331640 1 --2- 172.21.15.83:0/1928534526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f603015d3d0 0x7f6020004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6035331640 1 -- 172.21.15.83:0/1928534526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60200039f0 msgr2=0x7f6020003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:35.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6035331640 1 --2- 172.21.15.83:0/1928534526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60200039f0 0x7f6020003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.924+0000 7f6035331640 1 -- 172.21.15.83:0/1928534526 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6020003530 con 0x7f6020004d50 2024-03-30T13:11:35.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6035331640 1 --2- 172.21.15.83:0/1928534526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6020004d50 0x7f60200051d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6028009fc0 tx=0x7f602801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9441e1cc91994e3b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60280b2070 con 0x7f6020004d50 2024-03-30T13:11:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60280a5ad0 con 0x7f6020004d50 2024-03-30T13:11:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f602f7fe640 1 -- 172.21.15.83:0/1928534526 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028009c10 con 0x7f6020004d50 2024-03-30T13:11:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 -- 172.21.15.83:0/1928534526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6020004d50 msgr2=0x7f60200051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 --2- 172.21.15.83:0/1928534526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6020004d50 0x7f60200051d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6028009fc0 tx=0x7f602801ccc0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6035331640 1 -- 172.21.15.83:0/1928534526 reap_dead start 2024-03-30T13:11:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 -- 172.21.15.83:0/1928534526 shutdown_connections 2024-03-30T13:11:35.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 -- 172.21.15.83:0/1928534526 >> 172.21.15.83:0/1928534526 conn(0x7f603006b660 msgr2=0x7f603006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 -- 172.21.15.83:0/1928534526 shutdown_connections 2024-03-30T13:11:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 -- 172.21.15.83:0/1928534526 wait complete. 2024-03-30T13:11:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 Processor -- start 2024-03-30T13:11:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 -- start start 2024-03-30T13:11:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6020004d50 0x7f60301f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60300cecf0 0x7f6030071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f603014e4d0 0x7f6030155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f60300adc90 con 0x7f603014e4d0 2024-03-30T13:11:35.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f603006f8e0 con 0x7f6020004d50 2024-03-30T13:11:35.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6036d94640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6030071cd0 con 0x7f60300cecf0 2024-03-30T13:11:35.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6035331640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f603014e4d0 0x7f6030155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6035331640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f603014e4d0 0x7f6030155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43852/0 (socket says 172.21.15.83:43852) 2024-03-30T13:11:35.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6035331640 1 -- 172.21.15.83:0/1300242856 learned_addr learned my addr 172.21.15.83:0/1300242856 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:35.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f6034b30640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6020004d50 0x7f60301f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.928+0000 7f602ffff640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60300cecf0 0x7f6030071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f6035331640 1 -- 172.21.15.83:0/1300242856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60300cecf0 msgr2=0x7f6030071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f6035331640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60300cecf0 0x7f6030071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f6035331640 1 -- 172.21.15.83:0/1300242856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6020004d50 msgr2=0x7f60301f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f6035331640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6020004d50 0x7f60301f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f6035331640 1 -- 172.21.15.83:0/1300242856 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60300b1c90 con 0x7f603014e4d0 2024-03-30T13:11:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f6035331640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f603014e4d0 0x7f6030155a30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f60280b0040 tx=0x7f6028009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:35.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f602d7fa640 1 -- 172.21.15.83:0/1300242856 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60280bd070 con 0x7f603014e4d0 2024-03-30T13:11:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f602d7fa640 1 -- 172.21.15.83:0/1300242856 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60280ae9d0 con 0x7f603014e4d0 2024-03-30T13:11:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f6036d94640 1 -- 172.21.15.83:0/1300242856 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60301f8560 con 0x7f603014e4d0 2024-03-30T13:11:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f602d7fa640 1 -- 172.21.15.83:0/1300242856 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60280b2040 con 0x7f603014e4d0 2024-03-30T13:11:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f6036d94640 1 -- 172.21.15.83:0/1300242856 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60301f8b20 con 0x7f603014e4d0 2024-03-30T13:11:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f6036d94640 1 -- 172.21.15.83:0/1300242856 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60301f8cf0 con 0x7f603014e4d0 2024-03-30T13:11:35.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f602d7fa640 1 -- 172.21.15.83:0/1300242856 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f60280039a0 con 0x7f603014e4d0 2024-03-30T13:11:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f602d7fa640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6014067fc0 0x7f601406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f6034b30640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6014067fc0 0x7f601406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f602d7fa640 1 -- 172.21.15.83:0/1300242856 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f6028120450 con 0x7f603014e4d0 2024-03-30T13:11:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.932+0000 7f6034b30640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6014067fc0 0x7f601406a480 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6024001ec0 tx=0x7f6024001dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:35.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:35.936+0000 7f602d7fa640 1 -- 172.21.15.83:0/1300242856 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f60300b1c90 con 0x7f603014e4d0 2024-03-30T13:11:36.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.084+0000 7f6036d94640 1 -- 172.21.15.83:0/1300242856 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f603004f9e0 con 0x7f6014067fc0 2024-03-30T13:11:36.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.084+0000 7f602d7fa640 1 -- 172.21.15.83:0/1300242856 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f603004f9e0 con 0x7f6014067fc0 2024-03-30T13:11:36.096 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 0 to deep-scrub 2024-03-30T13:11:36.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.088+0000 7f6036d94640 1 -- 172.21.15.83:0/1300242856 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6014067fc0 msgr2=0x7f601406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.088+0000 7f6036d94640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6014067fc0 0x7f601406a480 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6024001ec0 tx=0x7f6024001dd0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.088+0000 7f6036d94640 1 -- 172.21.15.83:0/1300242856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f603014e4d0 msgr2=0x7f6030155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.088+0000 7f6036d94640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f603014e4d0 0x7f6030155a30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f60280b0040 tx=0x7f6028009750 comp rx=0 tx=0).stop 2024-03-30T13:11:36.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.088+0000 7f6036d94640 1 -- 172.21.15.83:0/1300242856 shutdown_connections 2024-03-30T13:11:36.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.088+0000 7f6036d94640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6014067fc0 0x7f601406a480 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.088+0000 7f6036d94640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f603014e4d0 0x7f6030155a30 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.088+0000 7f6036d94640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60300cecf0 0x7f6030071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.088+0000 7f6036d94640 1 --2- 172.21.15.83:0/1300242856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6020004d50 0x7f60301f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.088+0000 7f6036d94640 1 -- 172.21.15.83:0/1300242856 >> 172.21.15.83:0/1300242856 conn(0x7f603006b660 msgr2=0x7f6030152780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.088+0000 7f6036d94640 1 -- 172.21.15.83:0/1300242856 shutdown_connections 2024-03-30T13:11:36.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.088+0000 7f6036d94640 1 -- 172.21.15.83:0/1300242856 wait complete. 2024-03-30T13:11:36.110 INFO:tasks.ceph:Scrubbing osd.1 2024-03-30T13:11:36.111 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:11:36.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b7d481640 1 Processor -- start 2024-03-30T13:11:36.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b7d481640 1 -- start start 2024-03-30T13:11:36.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b7d481640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2b780738a0 0x7f2b780af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b7d481640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b780ad490 con 0x7f2b780d0670 2024-03-30T13:11:36.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b7d481640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b780cf790 con 0x7f2b780d0290 2024-03-30T13:11:36.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b7d481640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f2b780ad770 con 0x7f2b780738a0 2024-03-30T13:11:36.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b6ffff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2b780738a0 0x7f2b780af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b777fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f2b780d0670 0x7f2b7815cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:45540/0 (socket says 172.21.15.83:45540) 2024-03-30T13:11:36.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b777fe640 1 -- 172.21.15.83:0/3146915135 learned_addr learned my addr 172.21.15.83:0/3146915135 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:36.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b6ffff640 1 -- 172.21.15.83:0/3146915135 >> v1:172.21.15.153:6789/0 conn(0x7f2b780d0290 legacy=0x7f2b7806d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b6ffff640 1 -- 172.21.15.83:0/3146915135 >> v1:172.21.15.83:6789/0 conn(0x7f2b780d0670 legacy=0x7f2b7815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b767fc640 1 -- 172.21.15.83:0/3146915135 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1236030342 0 0) 0x7f2b780ad490 con 0x7f2b780d0670 2024-03-30T13:11:36.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b6ffff640 1 -- 172.21.15.83:0/3146915135 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b780cfa70 con 0x7f2b780738a0 2024-03-30T13:11:36.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b6ffff640 1 --2- 172.21.15.83:0/3146915135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b780738a0 0x7f2b780af690 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2b600097c0 tx=0x7f2b6001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e49cffd86c6c27 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b767fc640 1 -- 172.21.15.83:0/3146915135 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600ab610 con 0x7f2b780738a0 2024-03-30T13:11:36.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b767fc640 1 -- 172.21.15.83:0/3146915135 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b600b0070 con 0x7f2b780738a0 2024-03-30T13:11:36.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.228+0000 7f2b767fc640 1 -- 172.21.15.83:0/3146915135 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600ab9d0 con 0x7f2b780738a0 2024-03-30T13:11:36.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 -- 172.21.15.83:0/3146915135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b780738a0 msgr2=0x7f2b780af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 --2- 172.21.15.83:0/3146915135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b780738a0 0x7f2b780af690 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2b600097c0 tx=0x7f2b6001c430 comp rx=0 tx=0).stop 2024-03-30T13:11:36.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 -- 172.21.15.83:0/3146915135 shutdown_connections 2024-03-30T13:11:36.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 --2- 172.21.15.83:0/3146915135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b780738a0 0x7f2b780af690 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 -- 172.21.15.83:0/3146915135 >> 172.21.15.83:0/3146915135 conn(0x7f2b780b21d0 msgr2=0x7f2b780b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 -- 172.21.15.83:0/3146915135 shutdown_connections 2024-03-30T13:11:36.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 -- 172.21.15.83:0/3146915135 wait complete. 2024-03-30T13:11:36.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 Processor -- start 2024-03-30T13:11:36.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 -- start start 2024-03-30T13:11:36.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b780738a0 0x7f2b780cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b780d0290 0x7f2b78152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b780d0670 0x7f2b78156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2b780ad230 con 0x7f2b780d0670 2024-03-30T13:11:36.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b780ad0b0 con 0x7f2b780d0290 2024-03-30T13:11:36.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2b780d0aa0 con 0x7f2b780738a0 2024-03-30T13:11:36.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b777fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b780d0670 0x7f2b78156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b777fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b780d0670 0x7f2b78156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43858/0 (socket says 172.21.15.83:43858) 2024-03-30T13:11:36.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b777fe640 1 -- 172.21.15.83:0/360823754 learned_addr learned my addr 172.21.15.83:0/360823754 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:36.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b6ffff640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b780d0290 0x7f2b78152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b76ffd640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b780738a0 0x7f2b780cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b777fe640 1 -- 172.21.15.83:0/360823754 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b780738a0 msgr2=0x7f2b780cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b777fe640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b780738a0 0x7f2b780cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b777fe640 1 -- 172.21.15.83:0/360823754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b780d0290 msgr2=0x7f2b78152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b777fe640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b780d0290 0x7f2b78152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b777fe640 1 -- 172.21.15.83:0/360823754 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b78157430 con 0x7f2b780d0670 2024-03-30T13:11:36.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b6ffff640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b780d0290 0x7f2b78152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:36.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b777fe640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b780d0670 0x7f2b78156ef0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000c7b0 tx=0x7f2b7000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b6f7fe640 1 -- 172.21.15.83:0/360823754 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70018070 con 0x7f2b780d0670 2024-03-30T13:11:36.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b6f7fe640 1 -- 172.21.15.83:0/360823754 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7000a640 con 0x7f2b780d0670 2024-03-30T13:11:36.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b6f7fe640 1 -- 172.21.15.83:0/360823754 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7000aa30 con 0x7f2b780d0670 2024-03-30T13:11:36.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 -- 172.21.15.83:0/360823754 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b780b3270 con 0x7f2b780d0670 2024-03-30T13:11:36.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.232+0000 7f2b7d481640 1 -- 172.21.15.83:0/360823754 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b780b3830 con 0x7f2b780d0670 2024-03-30T13:11:36.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.236+0000 7f2b7d481640 1 -- 172.21.15.83:0/360823754 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b78152ab0 con 0x7f2b780d0670 2024-03-30T13:11:36.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.236+0000 7f2b6f7fe640 1 -- 172.21.15.83:0/360823754 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2b7000abd0 con 0x7f2b780d0670 2024-03-30T13:11:36.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.236+0000 7f2b6f7fe640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2b58067fc0 0x7f2b5806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.236+0000 7f2b6f7fe640 1 -- 172.21.15.83:0/360823754 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f2b70085c50 con 0x7f2b780d0670 2024-03-30T13:11:36.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.236+0000 7f2b76ffd640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2b58067fc0 0x7f2b5806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.236+0000 7f2b6f7fe640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] conn(0x7f2b5806de80 0x7f2b580702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.236+0000 7f2b6f7fe640 1 -- 172.21.15.83:0/360823754 --> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b70006e50 con 0x7f2b5806de80 2024-03-30T13:11:36.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.236+0000 7f2b6f7fe640 1 -- 172.21.15.83:0/360823754 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2b700860e0 con 0x7f2b780d0670 2024-03-30T13:11:36.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.236+0000 7f2b6ffff640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] conn(0x7f2b5806de80 0x7f2b580702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.236+0000 7f2b76ffd640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2b58067fc0 0x7f2b5806a480 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2b68004e30 tx=0x7f2b68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.236+0000 7f2b6ffff640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] conn(0x7f2b5806de80 0x7f2b580702a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.236+0000 7f2b6f7fe640 1 -- 172.21.15.83:0/360823754 <== osd.1 v2:172.21.15.83:6808/2476462919 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2b70006e50 con 0x7f2b5806de80 2024-03-30T13:11:36.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.248+0000 7f2b7d481640 1 -- 172.21.15.83:0/360823754 --> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2b780686c0 con 0x7f2b5806de80 2024-03-30T13:11:36.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.252+0000 7f2b6f7fe640 1 -- 172.21.15.83:0/360823754 <== osd.1 v2:172.21.15.83:6808/2476462919 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2b780686c0 con 0x7f2b5806de80 2024-03-30T13:11:36.259 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:36.259 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:11:36.259 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:36.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.252+0000 7f2b7d481640 1 -- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] conn(0x7f2b5806de80 msgr2=0x7f2b580702a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.252+0000 7f2b7d481640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:6808/2476462919,v1:172.21.15.83:6809/2476462919] conn(0x7f2b5806de80 0x7f2b580702a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.252+0000 7f2b7d481640 1 -- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2b58067fc0 msgr2=0x7f2b5806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.252+0000 7f2b7d481640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f2b58067fc0 0x7f2b5806a480 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2b68004e30 tx=0x7f2b68009040 comp rx=0 tx=0).stop 2024-03-30T13:11:36.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.252+0000 7f2b7d481640 1 -- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b780d0670 msgr2=0x7f2b78156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.252+0000 7f2b7d481640 1 --2- 172.21.15.83:0/360823754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b780d0670 0x7f2b78156ef0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000c7b0 tx=0x7f2b7000cc70 comp rx=0 tx=0).stop 2024-03-30T13:11:36.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.252+0000 7f2b777fe640 1 -- 172.21.15.83:0/360823754 reap_dead start 2024-03-30T13:11:36.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.252+0000 7f2b7d481640 1 -- 172.21.15.83:0/360823754 shutdown_connections 2024-03-30T13:11:36.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.252+0000 7f2b7d481640 1 -- 172.21.15.83:0/360823754 >> 172.21.15.83:0/360823754 conn(0x7f2b780b21d0 msgr2=0x7f2b780b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.252+0000 7f2b7d481640 1 -- 172.21.15.83:0/360823754 shutdown_connections 2024-03-30T13:11:36.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.252+0000 7f2b7d481640 1 -- 172.21.15.83:0/360823754 wait complete. 2024-03-30T13:11:36.274 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-30T13:11:36.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.380+0000 7faed0573640 1 Processor -- start 2024-03-30T13:11:36.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.380+0000 7faed0573640 1 -- start start 2024-03-30T13:11:36.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.380+0000 7faed0573640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faec815b050 0x7faec8073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faed0573640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec80b31e0 con 0x7faec806f860 2024-03-30T13:11:36.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faed0573640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec80ad4f0 con 0x7faec80b3ca0 2024-03-30T13:11:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faed0573640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7faec8073ab0 con 0x7faec815b050 2024-03-30T13:11:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faeceb10640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7faec806f860 0x7faec815b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:45546/0 (socket says 172.21.15.83:45546) 2024-03-30T13:11:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faeceb10640 1 -- 172.21.15.83:0/2938144179 learned_addr learned my addr 172.21.15.83:0/2938144179 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faece30f640 1 --2- 172.21.15.83:0/2938144179 >> v2:172.21.15.153:3300/0 conn(0x7faec815b050 0x7faec8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2276416120 0 0) 0x7faec80b31e0 con 0x7faec806f860 2024-03-30T13:11:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeb4003530 con 0x7faec806f860 2024-03-30T13:11:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3086905117 0 0) 0x7faeb4003530 con 0x7faec806f860 2024-03-30T13:11:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 >> v2:172.21.15.153:3300/0 conn(0x7faec815b050 msgr2=0x7faec8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 --2- 172.21.15.83:0/2938144179 >> v2:172.21.15.153:3300/0 conn(0x7faec815b050 0x7faec8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 >> v1:172.21.15.153:6789/0 conn(0x7faec80b3ca0 legacy=0x7faec806f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec80ad7d0 con 0x7faec806f860 2024-03-30T13:11:36.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7faec0001a20 con 0x7faec806f860 2024-03-30T13:11:36.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 >> v1:172.21.15.83:6789/0 conn(0x7faec806f860 legacy=0x7faec815b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb40039c0 0x7faeb4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faeb4004810 0x7faeb4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 0x7faeb400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7faec8073ab0 con 0x7faeb40051d0 2024-03-30T13:11:36.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faeb400c170 con 0x7faeb40039c0 2024-03-30T13:11:36.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faeb400c370 con 0x7faeb4004810 2024-03-30T13:11:36.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faeceb10640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 0x7faeb400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faece30f640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb40039c0 0x7faeb4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecdb0e640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faeb4004810 0x7faeb4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faeceb10640 1 -- 172.21.15.83:0/2938144179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faeb4004810 msgr2=0x7faeb4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faeceb10640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faeb4004810 0x7faeb4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faeceb10640 1 -- 172.21.15.83:0/2938144179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb40039c0 msgr2=0x7faeb4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faeceb10640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb40039c0 0x7faeb4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faeceb10640 1 -- 172.21.15.83:0/2938144179 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb4003530 con 0x7faeb40051d0 2024-03-30T13:11:36.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faecdb0e640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faeb4004810 0x7faeb4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:36.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.384+0000 7faece30f640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb40039c0 0x7faeb4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:36.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faeceb10640 1 -- 172.21.15.83:0/2938144179 reap_dead start 2024-03-30T13:11:36.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faeceb10640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 0x7faeb400b9d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7faec000a830 tx=0x7faec001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2979f624e636c38a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec000a480 con 0x7faeb40051d0 2024-03-30T13:11:36.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec00aa6f0 con 0x7faeb40051d0 2024-03-30T13:11:36.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faecd30d640 1 -- 172.21.15.83:0/2938144179 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec00aaae0 con 0x7faeb40051d0 2024-03-30T13:11:36.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 -- 172.21.15.83:0/2938144179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 msgr2=0x7faeb400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 0x7faeb400b9d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7faec000a830 tx=0x7faec001faa0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 -- 172.21.15.83:0/2938144179 shutdown_connections 2024-03-30T13:11:36.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 --2- 172.21.15.83:0/2938144179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 0x7faeb400b9d0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 -- 172.21.15.83:0/2938144179 >> 172.21.15.83:0/2938144179 conn(0x7faec806b660 msgr2=0x7faec806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 -- 172.21.15.83:0/2938144179 shutdown_connections 2024-03-30T13:11:36.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 -- 172.21.15.83:0/2938144179 wait complete. 2024-03-30T13:11:36.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 Processor -- start 2024-03-30T13:11:36.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 -- start start 2024-03-30T13:11:36.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 0x7faec81f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faec814e840 0x7faec814ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faec814fab0 0x7faec814ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7faec80b4110 con 0x7faeb40051d0 2024-03-30T13:11:36.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faec80b3780 con 0x7faec814fab0 2024-03-30T13:11:36.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faed0573640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faec80ad1c0 con 0x7faec814e840 2024-03-30T13:11:36.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faece30f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 0x7faec81f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faece30f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 0x7faec81f1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43870/0 (socket says 172.21.15.83:43870) 2024-03-30T13:11:36.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faece30f640 1 -- 172.21.15.83:0/3793295042 learned_addr learned my addr 172.21.15.83:0/3793295042 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:36.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faece30f640 1 -- 172.21.15.83:0/3793295042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faec814e840 msgr2=0x7faec814ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faece30f640 1 --2- 172.21.15.83:0/3793295042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faec814e840 0x7faec814ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faece30f640 1 -- 172.21.15.83:0/3793295042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faec814fab0 msgr2=0x7faec814ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faece30f640 1 --2- 172.21.15.83:0/3793295042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faec814fab0 0x7faec814ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.388+0000 7faece30f640 1 -- 172.21.15.83:0/3793295042 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec8098600 con 0x7faeb40051d0 2024-03-30T13:11:36.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.392+0000 7faece30f640 1 --2- 172.21.15.83:0/3793295042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 0x7faec81f1860 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7faec4009160 tx=0x7faec4011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.392+0000 7faebeffd640 1 -- 172.21.15.83:0/3793295042 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4004220 con 0x7faeb40051d0 2024-03-30T13:11:36.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.392+0000 7faebeffd640 1 -- 172.21.15.83:0/3793295042 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec40043c0 con 0x7faeb40051d0 2024-03-30T13:11:36.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.392+0000 7faed0573640 1 -- 172.21.15.83:0/3793295042 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec80988e0 con 0x7faeb40051d0 2024-03-30T13:11:36.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.392+0000 7faebeffd640 1 -- 172.21.15.83:0/3793295042 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4015890 con 0x7faeb40051d0 2024-03-30T13:11:36.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.392+0000 7faed0573640 1 -- 172.21.15.83:0/3793295042 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec8098ea0 con 0x7faeb40051d0 2024-03-30T13:11:36.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.392+0000 7faed0573640 1 -- 172.21.15.83:0/3793295042 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec8068ba0 con 0x7faeb40051d0 2024-03-30T13:11:36.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.392+0000 7faebeffd640 1 -- 172.21.15.83:0/3793295042 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7faec4015a30 con 0x7faeb40051d0 2024-03-30T13:11:36.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.392+0000 7faebeffd640 1 --2- 172.21.15.83:0/3793295042 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faeac067fc0 0x7faeac06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.392+0000 7faebeffd640 1 -- 172.21.15.83:0/3793295042 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7faec4086840 con 0x7faeb40051d0 2024-03-30T13:11:36.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.392+0000 7faecdb0e640 1 --2- 172.21.15.83:0/3793295042 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faeac067fc0 0x7faeac06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.392+0000 7faecdb0e640 1 --2- 172.21.15.83:0/3793295042 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faeac067fc0 0x7faeac06a480 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faec809cb60 tx=0x7faeb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.396+0000 7faebeffd640 1 -- 172.21.15.83:0/3793295042 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7faec4019030 con 0x7faeb40051d0 2024-03-30T13:11:36.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.556+0000 7faed0573640 1 -- 172.21.15.83:0/3793295042 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7faec809e540 con 0x7faeac067fc0 2024-03-30T13:11:36.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.556+0000 7faebeffd640 1 -- 172.21.15.83:0/3793295042 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faec809e540 con 0x7faeac067fc0 2024-03-30T13:11:36.565 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 1 to deep-scrub 2024-03-30T13:11:36.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.560+0000 7faed0573640 1 -- 172.21.15.83:0/3793295042 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faeac067fc0 msgr2=0x7faeac06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.560+0000 7faed0573640 1 --2- 172.21.15.83:0/3793295042 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faeac067fc0 0x7faeac06a480 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faec809cb60 tx=0x7faeb8009040 comp rx=0 tx=0).stop 2024-03-30T13:11:36.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.560+0000 7faed0573640 1 -- 172.21.15.83:0/3793295042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 msgr2=0x7faec81f1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.560+0000 7faed0573640 1 --2- 172.21.15.83:0/3793295042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 0x7faec81f1860 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7faec4009160 tx=0x7faec4011a60 comp rx=0 tx=0).stop 2024-03-30T13:11:36.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.560+0000 7faed0573640 1 -- 172.21.15.83:0/3793295042 shutdown_connections 2024-03-30T13:11:36.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.560+0000 7faed0573640 1 --2- 172.21.15.83:0/3793295042 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faeac067fc0 0x7faeac06a480 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.560+0000 7faed0573640 1 --2- 172.21.15.83:0/3793295042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faec814fab0 0x7faec814ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.560+0000 7faed0573640 1 --2- 172.21.15.83:0/3793295042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faec814e840 0x7faec814ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.560+0000 7faed0573640 1 --2- 172.21.15.83:0/3793295042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb40051d0 0x7faec81f1860 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.560+0000 7faed0573640 1 -- 172.21.15.83:0/3793295042 >> 172.21.15.83:0/3793295042 conn(0x7faec806b660 msgr2=0x7faec806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.560+0000 7faed0573640 1 -- 172.21.15.83:0/3793295042 shutdown_connections 2024-03-30T13:11:36.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.560+0000 7faed0573640 1 -- 172.21.15.83:0/3793295042 wait complete. 2024-03-30T13:11:36.583 INFO:tasks.ceph:Scrubbing osd.2 2024-03-30T13:11:36.583 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:11:36.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a47da640 1 Processor -- start 2024-03-30T13:11:36.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a47da640 1 -- start start 2024-03-30T13:11:36.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a47da640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff39c15b3d0 0x7ff39c0b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a47da640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c071f10 con 0x7ff39c0d0290 2024-03-30T13:11:36.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a47da640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c0b43c0 con 0x7ff39c0b5150 2024-03-30T13:11:36.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a47da640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff39c0ade80 con 0x7ff39c15b3d0 2024-03-30T13:11:36.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a2576640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff39c0d0290 0x7ff39c0d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:45548/0 (socket says 172.21.15.83:45548) 2024-03-30T13:11:36.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a2576640 1 -- 172.21.15.83:0/1709145560 learned_addr learned my addr 172.21.15.83:0/1709145560 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:36.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1d75640 1 --2- 172.21.15.83:0/1709145560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff39c15b3d0 0x7ff39c0b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2910715900 0 0) 0x7ff39c071f10 con 0x7ff39c0d0290 2024-03-30T13:11:36.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff388003530 con 0x7ff39c0d0290 2024-03-30T13:11:36.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1225015339 0 0) 0x7ff388003530 con 0x7ff39c0d0290 2024-03-30T13:11:36.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff39c15b3d0 msgr2=0x7ff39c0b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 --2- 172.21.15.83:0/1709145560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff39c15b3d0 0x7ff39c0b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 >> v1:172.21.15.153:6789/0 conn(0x7ff39c0b5150 legacy=0x7ff39c071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c0ae160 con 0x7ff39c0d0290 2024-03-30T13:11:36.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7ff398001680 con 0x7ff39c0d0290 2024-03-30T13:11:36.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 >> v1:172.21.15.83:6789/0 conn(0x7ff39c0d0290 legacy=0x7ff39c0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 --2- 172.21.15.83:0/1709145560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff39c15b3d0 0x7ff3880039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 --2- 172.21.15.83:0/1709145560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff388003f70 0x7ff388004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 --2- 172.21.15.83:0/1709145560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff388004d50 0x7ff3880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c0ade80 con 0x7ff388003f70 2024-03-30T13:11:36.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff38800bb60 con 0x7ff388004d50 2024-03-30T13:11:36.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff38800bd60 con 0x7ff39c15b3d0 2024-03-30T13:11:36.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1d75640 1 --2- 172.21.15.83:0/1709145560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff388003f70 0x7ff388004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a2d77640 1 --2- 172.21.15.83:0/1709145560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff388004d50 0x7ff3880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1d75640 1 -- 172.21.15.83:0/1709145560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff39c15b3d0 msgr2=0x7ff3880039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1d75640 1 --2- 172.21.15.83:0/1709145560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff39c15b3d0 0x7ff3880039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1d75640 1 -- 172.21.15.83:0/1709145560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff388004d50 msgr2=0x7ff3880051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1d75640 1 --2- 172.21.15.83:0/1709145560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff388004d50 0x7ff3880051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.692+0000 7ff3a1d75640 1 -- 172.21.15.83:0/1709145560 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff388003530 con 0x7ff388003f70 2024-03-30T13:11:36.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a1d75640 1 --2- 172.21.15.83:0/1709145560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff388003f70 0x7ff388004810 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00bd30 tx=0x7ff38c01f340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5b5c4cf2a57a97 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0b3070 con 0x7ff388003f70 2024-03-30T13:11:36.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38c0ae600 con 0x7ff388003f70 2024-03-30T13:11:36.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a1574640 1 -- 172.21.15.83:0/1709145560 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00b930 con 0x7ff388003f70 2024-03-30T13:11:36.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a47da640 1 -- 172.21.15.83:0/1709145560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff388003f70 msgr2=0x7ff388004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a47da640 1 --2- 172.21.15.83:0/1709145560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff388003f70 0x7ff388004810 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00bd30 tx=0x7ff38c01f340 comp rx=0 tx=0).stop 2024-03-30T13:11:36.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a2d77640 1 -- 172.21.15.83:0/1709145560 reap_dead start 2024-03-30T13:11:36.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a47da640 1 -- 172.21.15.83:0/1709145560 shutdown_connections 2024-03-30T13:11:36.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a47da640 1 -- 172.21.15.83:0/1709145560 >> 172.21.15.83:0/1709145560 conn(0x7ff39c0b21d0 msgr2=0x7ff39c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a47da640 1 -- 172.21.15.83:0/1709145560 shutdown_connections 2024-03-30T13:11:36.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a47da640 1 -- 172.21.15.83:0/1709145560 wait complete. 2024-03-30T13:11:36.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a47da640 1 Processor -- start 2024-03-30T13:11:36.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.696+0000 7ff3a47da640 1 -- start start 2024-03-30T13:11:36.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a47da640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff388003f70 0x7ff39c14e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a47da640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff39c15b800 0x7ff39c158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a47da640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff39c159170 0x7ff39c14d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a47da640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c0aed30 con 0x7ff388003f70 2024-03-30T13:11:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a47da640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c0aebb0 con 0x7ff39c159170 2024-03-30T13:11:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a47da640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff39c0aeeb0 con 0x7ff39c15b800 2024-03-30T13:11:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a2576640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff388003f70 0x7ff39c14e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a2576640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff388003f70 0x7ff39c14e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43888/0 (socket says 172.21.15.83:43888) 2024-03-30T13:11:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a2576640 1 -- 172.21.15.83:0/2165476473 learned_addr learned my addr 172.21.15.83:0/2165476473 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a1d75640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff39c15b800 0x7ff39c158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a2576640 1 -- 172.21.15.83:0/2165476473 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff39c15b800 msgr2=0x7ff39c158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a2576640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff39c15b800 0x7ff39c158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a2576640 1 -- 172.21.15.83:0/2165476473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff39c159170 msgr2=0x7ff39c14d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a2d77640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff39c159170 0x7ff39c14d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a2576640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff39c159170 0x7ff39c14d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a2576640 1 -- 172.21.15.83:0/2165476473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c15bc80 con 0x7ff388003f70 2024-03-30T13:11:36.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a2576640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff388003f70 0x7ff39c14e200 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7ff39800c730 tx=0x7ff39800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff392ffd640 1 -- 172.21.15.83:0/2165476473 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398018070 con 0x7ff388003f70 2024-03-30T13:11:36.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff392ffd640 1 -- 172.21.15.83:0/2165476473 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3980072f0 con 0x7ff388003f70 2024-03-30T13:11:36.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a47da640 1 -- 172.21.15.83:0/2165476473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39c15e640 con 0x7ff388003f70 2024-03-30T13:11:36.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff392ffd640 1 -- 172.21.15.83:0/2165476473 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3980047f0 con 0x7ff388003f70 2024-03-30T13:11:36.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a47da640 1 -- 172.21.15.83:0/2165476473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39c15e360 con 0x7ff388003f70 2024-03-30T13:11:36.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a47da640 1 -- 172.21.15.83:0/2165476473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff39c0686c0 con 0x7ff388003f70 2024-03-30T13:11:36.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff392ffd640 1 -- 172.21.15.83:0/2165476473 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff39801b070 con 0x7ff388003f70 2024-03-30T13:11:36.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff392ffd640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff380067fc0 0x7ff38006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff392ffd640 1 -- 172.21.15.83:0/2165476473 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7ff398085f80 con 0x7ff388003f70 2024-03-30T13:11:36.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a1d75640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff380067fc0 0x7ff38006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff392ffd640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] conn(0x7ff38006de80 0x7ff3800702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff392ffd640 1 -- 172.21.15.83:0/2165476473 --> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff398020ec0 con 0x7ff38006de80 2024-03-30T13:11:36.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff392ffd640 1 -- 172.21.15.83:0/2165476473 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff398086410 con 0x7ff388003f70 2024-03-30T13:11:36.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a2d77640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] conn(0x7ff38006de80 0x7ff3800702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a1d75640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff380067fc0 0x7ff38006a480 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00bd30 tx=0x7ff38c0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.700+0000 7ff3a2d77640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] conn(0x7ff38006de80 0x7ff3800702a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.704+0000 7ff392ffd640 1 -- 172.21.15.83:0/2165476473 <== osd.2 v2:172.21.15.83:6800/75156071 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff398020ec0 con 0x7ff38006de80 2024-03-30T13:11:36.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff3a47da640 1 -- 172.21.15.83:0/2165476473 --> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff39c0719a0 con 0x7ff38006de80 2024-03-30T13:11:36.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff392ffd640 1 -- 172.21.15.83:0/2165476473 <== osd.2 v2:172.21.15.83:6800/75156071 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff39c0719a0 con 0x7ff38006de80 2024-03-30T13:11:36.723 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:36.723 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:11:36.723 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:36.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff3a47da640 1 -- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] conn(0x7ff38006de80 msgr2=0x7ff3800702a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff3a47da640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:6800/75156071,v1:172.21.15.83:6801/75156071] conn(0x7ff38006de80 0x7ff3800702a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff3a47da640 1 -- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff380067fc0 msgr2=0x7ff38006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff3a47da640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7ff380067fc0 0x7ff38006a480 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00bd30 tx=0x7ff38c0046d0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff3a47da640 1 -- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff388003f70 msgr2=0x7ff39c14e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff3a47da640 1 --2- 172.21.15.83:0/2165476473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff388003f70 0x7ff39c14e200 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7ff39800c730 tx=0x7ff39800cbf0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff3a2d77640 1 -- 172.21.15.83:0/2165476473 reap_dead start 2024-03-30T13:11:36.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff3a47da640 1 -- 172.21.15.83:0/2165476473 shutdown_connections 2024-03-30T13:11:36.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff3a47da640 1 -- 172.21.15.83:0/2165476473 >> 172.21.15.83:0/2165476473 conn(0x7ff39c0b21d0 msgr2=0x7ff39c154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff3a47da640 1 -- 172.21.15.83:0/2165476473 shutdown_connections 2024-03-30T13:11:36.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.716+0000 7ff3a47da640 1 -- 172.21.15.83:0/2165476473 wait complete. 2024-03-30T13:11:36.737 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-30T13:11:36.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f74142ce640 1 Processor -- start 2024-03-30T13:11:36.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f74142ce640 1 -- start start 2024-03-30T13:11:36.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f74142ce640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f740c15b050 0x7f740c073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f74142ce640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f740c06f860 0x7f740c15b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f74142ce640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f740c0b31e0 con 0x7f740c0b3ca0 2024-03-30T13:11:36.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f74142ce640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f740c073ab0 con 0x7f740c06f860 2024-03-30T13:11:36.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f74142ce640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f740c0ad4f0 con 0x7f740c15b050 2024-03-30T13:11:36.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f741286b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f740c06f860 0x7f740c15b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f741286b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f740c06f860 0x7f740c15b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59088/0 (socket says 172.21.15.83:59088) 2024-03-30T13:11:36.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f741286b640 1 -- 172.21.15.83:0/2734100554 learned_addr learned my addr 172.21.15.83:0/2734100554 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:36.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f741206a640 1 --2- 172.21.15.83:0/2734100554 >> v2:172.21.15.153:3300/0 conn(0x7f740c15b050 0x7f740c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f741286b640 1 -- 172.21.15.83:0/2734100554 >> v2:172.21.15.153:3300/0 conn(0x7f740c15b050 msgr2=0x7f740c073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f741286b640 1 --2- 172.21.15.83:0/2734100554 >> v2:172.21.15.153:3300/0 conn(0x7f740c15b050 0x7f740c073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f741286b640 1 -- 172.21.15.83:0/2734100554 >> v1:172.21.15.153:6789/0 conn(0x7f740c0b3ca0 legacy=0x7f740c06f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.832+0000 7f741286b640 1 -- 172.21.15.83:0/2734100554 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740c0ad7d0 con 0x7f740c06f860 2024-03-30T13:11:36.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f741286b640 1 --2- 172.21.15.83:0/2734100554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f740c06f860 0x7f740c15b430 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f740c06d8d0 tx=0x7f740401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d658277716b40 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f7411068640 1 -- 172.21.15.83:0/2734100554 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74040a57f0 con 0x7f740c06f860 2024-03-30T13:11:36.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f7411068640 1 -- 172.21.15.83:0/2734100554 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74040a5990 con 0x7f740c06f860 2024-03-30T13:11:36.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f7411068640 1 -- 172.21.15.83:0/2734100554 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74040a5d60 con 0x7f740c06f860 2024-03-30T13:11:36.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 -- 172.21.15.83:0/2734100554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f740c06f860 msgr2=0x7f740c15b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 --2- 172.21.15.83:0/2734100554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f740c06f860 0x7f740c15b430 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f740c06d8d0 tx=0x7f740401c930 comp rx=0 tx=0).stop 2024-03-30T13:11:36.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 -- 172.21.15.83:0/2734100554 shutdown_connections 2024-03-30T13:11:36.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 --2- 172.21.15.83:0/2734100554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f740c06f860 0x7f740c15b430 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 --2- 172.21.15.83:0/2734100554 >> v2:172.21.15.153:3300/0 conn(0x7f740c15b050 0x7f740c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 -- 172.21.15.83:0/2734100554 >> 172.21.15.83:0/2734100554 conn(0x7f740c06b660 msgr2=0x7f740c06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 -- 172.21.15.83:0/2734100554 shutdown_connections 2024-03-30T13:11:36.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 -- 172.21.15.83:0/2734100554 wait complete. 2024-03-30T13:11:36.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 Processor -- start 2024-03-30T13:11:36.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 -- start start 2024-03-30T13:11:36.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f740c06f860 0x7f740c15c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f740c0b3ca0 0x7f740c09a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f740c15b050 0x7f740c09a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f740c0b4230 con 0x7f740c0b3ca0 2024-03-30T13:11:36.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f740c0b40b0 con 0x7f740c06f860 2024-03-30T13:11:36.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f74142ce640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f740c0b4c10 con 0x7f740c15b050 2024-03-30T13:11:36.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f7411869640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f740c0b3ca0 0x7f740c09a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f7411869640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f740c0b3ca0 0x7f740c09a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59094/0 (socket says 172.21.15.83:59094) 2024-03-30T13:11:36.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f7411869640 1 -- 172.21.15.83:0/1518550766 learned_addr learned my addr 172.21.15.83:0/1518550766 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:36.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f741206a640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f740c06f860 0x7f740c15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f7411869640 1 -- 172.21.15.83:0/1518550766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f740c15b050 msgr2=0x7f740c09a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f741286b640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f740c15b050 0x7f740c09a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f7411869640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f740c15b050 0x7f740c09a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f7411869640 1 -- 172.21.15.83:0/1518550766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f740c06f860 msgr2=0x7f740c15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f7411869640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f740c06f860 0x7f740c15c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.836+0000 7f7411869640 1 -- 172.21.15.83:0/1518550766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740c15caf0 con 0x7f740c0b3ca0 2024-03-30T13:11:36.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.840+0000 7f7411869640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f740c0b3ca0 0x7f740c09a2d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00c400 tx=0x7f73fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.840+0000 7f7402ffd640 1 -- 172.21.15.83:0/1518550766 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc017070 con 0x7f740c0b3ca0 2024-03-30T13:11:36.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.840+0000 7f7402ffd640 1 -- 172.21.15.83:0/1518550766 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73fc005310 con 0x7f740c0b3ca0 2024-03-30T13:11:36.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.840+0000 7f74142ce640 1 -- 172.21.15.83:0/1518550766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740c15cdd0 con 0x7f740c0b3ca0 2024-03-30T13:11:36.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.840+0000 7f7402ffd640 1 -- 172.21.15.83:0/1518550766 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0054c0 con 0x7f740c0b3ca0 2024-03-30T13:11:36.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.840+0000 7f74142ce640 1 -- 172.21.15.83:0/1518550766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f740c15d390 con 0x7f740c0b3ca0 2024-03-30T13:11:36.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.840+0000 7f74142ce640 1 -- 172.21.15.83:0/1518550766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f740c09e540 con 0x7f740c0b3ca0 2024-03-30T13:11:36.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.840+0000 7f7402ffd640 1 -- 172.21.15.83:0/1518550766 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f73fc01a070 con 0x7f740c0b3ca0 2024-03-30T13:11:36.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.840+0000 7f7402ffd640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f73f0067fc0 0x7f73f006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.840+0000 7f741206a640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f73f0067fc0 0x7f73f006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.840+0000 7f7402ffd640 1 -- 172.21.15.83:0/1518550766 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f73fc085430 con 0x7f740c0b3ca0 2024-03-30T13:11:36.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.840+0000 7f741206a640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f73f0067fc0 0x7f73f006a480 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f74080096f0 tx=0x7f7408008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.844+0000 7f7402ffd640 1 -- 172.21.15.83:0/1518550766 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f73fc055920 con 0x7f740c0b3ca0 2024-03-30T13:11:36.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.992+0000 7f74142ce640 1 -- 172.21.15.83:0/1518550766 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f740c04f9e0 con 0x7f73f0067fc0 2024-03-30T13:11:37.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.992+0000 7f7402ffd640 1 -- 172.21.15.83:0/1518550766 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f740c04f9e0 con 0x7f73f0067fc0 2024-03-30T13:11:37.000 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 2 to deep-scrub 2024-03-30T13:11:37.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.992+0000 7f74142ce640 1 -- 172.21.15.83:0/1518550766 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f73f0067fc0 msgr2=0x7f73f006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.992+0000 7f74142ce640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f73f0067fc0 0x7f73f006a480 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f74080096f0 tx=0x7f7408008040 comp rx=0 tx=0).stop 2024-03-30T13:11:37.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.992+0000 7f74142ce640 1 -- 172.21.15.83:0/1518550766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f740c0b3ca0 msgr2=0x7f740c09a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.992+0000 7f74142ce640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f740c0b3ca0 0x7f740c09a2d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00c400 tx=0x7f73fc00c8c0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.992+0000 7f74142ce640 1 -- 172.21.15.83:0/1518550766 shutdown_connections 2024-03-30T13:11:37.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.996+0000 7f74142ce640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f73f0067fc0 0x7f73f006a480 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.996+0000 7f74142ce640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f740c15b050 0x7f740c09a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.996+0000 7f74142ce640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f740c0b3ca0 0x7f740c09a2d0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.996+0000 7f74142ce640 1 --2- 172.21.15.83:0/1518550766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f740c06f860 0x7f740c15c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.996+0000 7f74142ce640 1 -- 172.21.15.83:0/1518550766 >> 172.21.15.83:0/1518550766 conn(0x7f740c06b660 msgr2=0x7f740c06e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.996+0000 7f74142ce640 1 -- 172.21.15.83:0/1518550766 shutdown_connections 2024-03-30T13:11:37.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:36.996+0000 7f74142ce640 1 -- 172.21.15.83:0/1518550766 wait complete. 2024-03-30T13:11:37.017 INFO:tasks.ceph:Scrubbing osd.3 2024-03-30T13:11:37.017 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:11:37.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6bed237640 1 Processor -- start 2024-03-30T13:11:37.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6bed237640 1 -- start start 2024-03-30T13:11:37.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6bed237640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6be80d0290 0x7f6be80af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6bed237640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be80ad490 con 0x7f6be80d0670 2024-03-30T13:11:37.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6bed237640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be80cf790 con 0x7f6be80738a0 2024-03-30T13:11:37.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6bed237640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6be80ad770 con 0x7f6be80d0290 2024-03-30T13:11:37.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be759e640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f6be80d0670 0x7f6be815cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:51570/0 (socket says 172.21.15.83:51570) 2024-03-30T13:11:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be759e640 1 -- 172.21.15.83:0/869480261 learned_addr learned my addr 172.21.15.83:0/869480261 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be6d9d640 1 --2- 172.21.15.83:0/869480261 >> v2:172.21.15.153:3300/0 conn(0x7f6be80d0290 0x7f6be80af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701294094 0 0) 0x7f6be80ad490 con 0x7f6be80d0670 2024-03-30T13:11:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bd4003530 con 0x7f6be80d0670 2024-03-30T13:11:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2781524316 0 0) 0x7f6bd4003530 con 0x7f6be80d0670 2024-03-30T13:11:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 >> v2:172.21.15.153:3300/0 conn(0x7f6be80d0290 msgr2=0x7f6be80af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 --2- 172.21.15.83:0/869480261 >> v2:172.21.15.153:3300/0 conn(0x7f6be80d0290 0x7f6be80af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 >> v1:172.21.15.153:6789/0 conn(0x7f6be80738a0 legacy=0x7f6be806d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be80cfa70 con 0x7f6be80d0670 2024-03-30T13:11:37.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f6be0001a00 con 0x7f6be80d0670 2024-03-30T13:11:37.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 >> v1:172.21.15.83:6789/0 conn(0x7f6be80d0670 legacy=0x7f6be815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 --2- 172.21.15.83:0/869480261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6bd40039c0 0x7f6bd4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 --2- 172.21.15.83:0/869480261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bd4004810 0x7f6bd4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 --2- 172.21.15.83:0/869480261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bd40051d0 0x7f6bd400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6be80ad770 con 0x7f6bd40039c0 2024-03-30T13:11:37.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd400c070 con 0x7f6bd4004810 2024-03-30T13:11:37.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd400c270 con 0x7f6bd40051d0 2024-03-30T13:11:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be6d9d640 1 --2- 172.21.15.83:0/869480261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6bd40039c0 0x7f6bd4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be659c640 1 --2- 172.21.15.83:0/869480261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bd4004810 0x7f6bd4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be759e640 1 --2- 172.21.15.83:0/869480261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bd40051d0 0x7f6bd400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be6d9d640 1 -- 172.21.15.83:0/869480261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bd40051d0 msgr2=0x7f6bd400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be6d9d640 1 --2- 172.21.15.83:0/869480261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bd40051d0 0x7f6bd400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be6d9d640 1 -- 172.21.15.83:0/869480261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bd4004810 msgr2=0x7f6bd4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be6d9d640 1 --2- 172.21.15.83:0/869480261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bd4004810 0x7f6bd4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be6d9d640 1 -- 172.21.15.83:0/869480261 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd4003530 con 0x7f6bd40039c0 2024-03-30T13:11:37.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.136+0000 7f6be759e640 1 -- 172.21.15.83:0/869480261 reap_dead start 2024-03-30T13:11:37.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6be6d9d640 1 --2- 172.21.15.83:0/869480261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6bd40039c0 0x7f6bd4003de0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009ae0 tx=0x7f6bd001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214989f7c0dc2d7c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00b2070 con 0x7f6bd40039c0 2024-03-30T13:11:37.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd00a55b0 con 0x7f6bd40039c0 2024-03-30T13:11:37.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6be5d9b640 1 -- 172.21.15.83:0/869480261 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00096b0 con 0x7f6bd40039c0 2024-03-30T13:11:37.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 -- 172.21.15.83:0/869480261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6bd40039c0 msgr2=0x7f6bd4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 --2- 172.21.15.83:0/869480261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6bd40039c0 0x7f6bd4003de0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009ae0 tx=0x7f6bd001ca40 comp rx=0 tx=0).stop 2024-03-30T13:11:37.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 -- 172.21.15.83:0/869480261 shutdown_connections 2024-03-30T13:11:37.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 --2- 172.21.15.83:0/869480261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6bd40039c0 0x7f6bd4003de0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 -- 172.21.15.83:0/869480261 >> 172.21.15.83:0/869480261 conn(0x7f6be80b21d0 msgr2=0x7f6be80b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 -- 172.21.15.83:0/869480261 shutdown_connections 2024-03-30T13:11:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 -- 172.21.15.83:0/869480261 wait complete. 2024-03-30T13:11:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 Processor -- start 2024-03-30T13:11:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 -- start start 2024-03-30T13:11:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bd40039c0 0x7f6be815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6be8145580 0x7f6be8145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be815d730 0x7f6be815dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6be80ad0b0 con 0x7f6be8145580 2024-03-30T13:11:37.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6be80afaa0 con 0x7f6be815d730 2024-03-30T13:11:37.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.140+0000 7f6bed237640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6be80ad230 con 0x7f6bd40039c0 2024-03-30T13:11:37.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6be8145580 0x7f6be8145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be6d9d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bd40039c0 0x7f6be815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6be8145580 0x7f6be8145a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59112/0 (socket says 172.21.15.83:59112) 2024-03-30T13:11:37.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be659c640 1 -- 172.21.15.83:0/3099824016 learned_addr learned my addr 172.21.15.83:0/3099824016 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:37.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be759e640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be815d730 0x7f6be815dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be659c640 1 -- 172.21.15.83:0/3099824016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bd40039c0 msgr2=0x7f6be815b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be659c640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6bd40039c0 0x7f6be815b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be659c640 1 -- 172.21.15.83:0/3099824016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be815d730 msgr2=0x7f6be815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be659c640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be815d730 0x7f6be815dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be659c640 1 -- 172.21.15.83:0/3099824016 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be815e460 con 0x7f6be8145580 2024-03-30T13:11:37.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be659c640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6be8145580 0x7f6be8145a00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800e490 tx=0x7f6bd800e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6bdf7fe640 1 -- 172.21.15.83:0/3099824016 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80052e0 con 0x7f6be8145580 2024-03-30T13:11:37.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6bdf7fe640 1 -- 172.21.15.83:0/3099824016 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd8018070 con 0x7f6be8145580 2024-03-30T13:11:37.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6bed237640 1 -- 172.21.15.83:0/3099824016 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be815e740 con 0x7f6be8145580 2024-03-30T13:11:37.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6bdf7fe640 1 -- 172.21.15.83:0/3099824016 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8005480 con 0x7f6be8145580 2024-03-30T13:11:37.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6bed237640 1 -- 172.21.15.83:0/3099824016 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be815ed00 con 0x7f6be8145580 2024-03-30T13:11:37.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6bed237640 1 -- 172.21.15.83:0/3099824016 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6be80686c0 con 0x7f6be8145580 2024-03-30T13:11:37.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6bdf7fe640 1 -- 172.21.15.83:0/3099824016 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6bd8003820 con 0x7f6be8145580 2024-03-30T13:11:37.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6bdf7fe640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6bc8067fc0 0x7f6bc806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be6d9d640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6bc8067fc0 0x7f6bc806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6bdf7fe640 1 -- 172.21.15.83:0/3099824016 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f6bd80868a0 con 0x7f6be8145580 2024-03-30T13:11:37.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6bdf7fe640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] conn(0x7f6bc806de80 0x7f6bc80702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6bdf7fe640 1 -- 172.21.15.83:0/3099824016 --> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6bd8003e50 con 0x7f6bc806de80 2024-03-30T13:11:37.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6bdf7fe640 1 -- 172.21.15.83:0/3099824016 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6bd8086d30 con 0x7f6be8145580 2024-03-30T13:11:37.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be759e640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] conn(0x7f6bc806de80 0x7f6bc80702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be6d9d640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6bc8067fc0 0x7f6bc806a480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00af000 tx=0x7f6bd00046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.144+0000 7f6be759e640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] conn(0x7f6bc806de80 0x7f6bc80702a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.148+0000 7f6bdf7fe640 1 -- 172.21.15.83:0/3099824016 <== osd.3 v2:172.21.15.83:6816/3821265814 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6bd8003e50 con 0x7f6bc806de80 2024-03-30T13:11:37.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6bed237640 1 -- 172.21.15.83:0/3099824016 --> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6be8073130 con 0x7f6bc806de80 2024-03-30T13:11:37.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6bdf7fe640 1 -- 172.21.15.83:0/3099824016 <== osd.3 v2:172.21.15.83:6816/3821265814 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6be8073130 con 0x7f6bc806de80 2024-03-30T13:11:37.167 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:37.167 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:11:37.167 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:37.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6bed237640 1 -- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] conn(0x7f6bc806de80 msgr2=0x7f6bc80702a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6bed237640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:6816/3821265814,v1:172.21.15.83:6817/3821265814] conn(0x7f6bc806de80 0x7f6bc80702a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6bed237640 1 -- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6bc8067fc0 msgr2=0x7f6bc806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6bed237640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6bc8067fc0 0x7f6bc806a480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00af000 tx=0x7f6bd00046d0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6bed237640 1 -- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6be8145580 msgr2=0x7f6be8145a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6bed237640 1 --2- 172.21.15.83:0/3099824016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6be8145580 0x7f6be8145a00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800e490 tx=0x7f6bd800e950 comp rx=0 tx=0).stop 2024-03-30T13:11:37.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6be759e640 1 -- 172.21.15.83:0/3099824016 reap_dead start 2024-03-30T13:11:37.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6bed237640 1 -- 172.21.15.83:0/3099824016 shutdown_connections 2024-03-30T13:11:37.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6bed237640 1 -- 172.21.15.83:0/3099824016 >> 172.21.15.83:0/3099824016 conn(0x7f6be80b21d0 msgr2=0x7f6be80afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6bed237640 1 -- 172.21.15.83:0/3099824016 shutdown_connections 2024-03-30T13:11:37.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.160+0000 7f6bed237640 1 -- 172.21.15.83:0/3099824016 wait complete. 2024-03-30T13:11:37.182 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-30T13:11:37.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb36c0a640 1 Processor -- start 2024-03-30T13:11:37.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb36c0a640 1 -- start start 2024-03-30T13:11:37.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb36c0a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300d1510 0x7fdb300cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb36c0a640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb300d2a60 0x7fdb300cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb36c0a640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb300d2f60 con 0x7fdb3015e710 2024-03-30T13:11:37.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb36c0a640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdb3006c880 con 0x7fdb300d2a60 2024-03-30T13:11:37.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb36c0a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb300d1c50 con 0x7fdb300d1510 2024-03-30T13:11:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb349a6640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fdb3015e710 0x7fdb300d0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:51586/0 (socket says 172.21.15.83:51586) 2024-03-30T13:11:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb349a6640 1 -- 172.21.15.83:0/2576303886 learned_addr learned my addr 172.21.15.83:0/2576303886 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2ffff640 1 --2- 172.21.15.83:0/2576303886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300d1510 0x7fdb300cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb351a7640 1 --2- 172.21.15.83:0/2576303886 >> v2:172.21.15.153:3300/0 conn(0x7fdb300d2a60 0x7fdb300cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3425980393 0 0) 0x7fdb300d2f60 con 0x7fdb3015e710 2024-03-30T13:11:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb18003530 con 0x7fdb3015e710 2024-03-30T13:11:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1489731976 0 0) 0x7fdb18003530 con 0x7fdb3015e710 2024-03-30T13:11:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300d1510 msgr2=0x7fdb300cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 --2- 172.21.15.83:0/2576303886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300d1510 0x7fdb300cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 >> v2:172.21.15.153:3300/0 conn(0x7fdb300d2a60 msgr2=0x7fdb300cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 --2- 172.21.15.83:0/2576303886 >> v2:172.21.15.153:3300/0 conn(0x7fdb300d2a60 0x7fdb300cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb300d3240 con 0x7fdb3015e710 2024-03-30T13:11:37.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fdb20001a00 con 0x7fdb3015e710 2024-03-30T13:11:37.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb351a7640 1 --2- 172.21.15.83:0/2576303886 >> v2:172.21.15.153:3300/0 conn(0x7fdb300d2a60 0x7fdb300cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:37.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 >> v1:172.21.15.83:6789/0 conn(0x7fdb3015e710 legacy=0x7fdb300d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 --2- 172.21.15.83:0/2576303886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300d1510 0x7fdb180039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 --2- 172.21.15.83:0/2576303886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18003f40 0x7fdb18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 --2- 172.21.15.83:0/2576303886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb18004d50 0x7fdb180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3006c880 con 0x7fdb18004d50 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb300d1c50 con 0x7fdb18003f40 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb1800bab0 con 0x7fdb300d1510 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb351a7640 1 --2- 172.21.15.83:0/2576303886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb18004d50 0x7fdb180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb2ffff640 1 --2- 172.21.15.83:0/2576303886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18003f40 0x7fdb18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb351a7640 1 -- 172.21.15.83:0/2576303886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300d1510 msgr2=0x7fdb180039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb349a6640 1 --2- 172.21.15.83:0/2576303886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300d1510 0x7fdb180039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb351a7640 1 --2- 172.21.15.83:0/2576303886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300d1510 0x7fdb180039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb351a7640 1 -- 172.21.15.83:0/2576303886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18003f40 msgr2=0x7fdb18004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb351a7640 1 --2- 172.21.15.83:0/2576303886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18003f40 0x7fdb18004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.280+0000 7fdb351a7640 1 -- 172.21.15.83:0/2576303886 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb18003530 con 0x7fdb18004d50 2024-03-30T13:11:37.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.284+0000 7fdb351a7640 1 --2- 172.21.15.83:0/2576303886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb18004d50 0x7fdb180051d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fdb280098a0 tx=0x7fdb2801c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f28428f5bb37010 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.284+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb280ac070 con 0x7fdb18004d50 2024-03-30T13:11:37.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.284+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb280a6620 con 0x7fdb18004d50 2024-03-30T13:11:37.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.284+0000 7fdb2f7fe640 1 -- 172.21.15.83:0/2576303886 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800f040 con 0x7fdb18004d50 2024-03-30T13:11:37.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.284+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2576303886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb18004d50 msgr2=0x7fdb180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.284+0000 7fdb36c0a640 1 --2- 172.21.15.83:0/2576303886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb18004d50 0x7fdb180051d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fdb280098a0 tx=0x7fdb2801c610 comp rx=0 tx=0).stop 2024-03-30T13:11:37.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.284+0000 7fdb351a7640 1 -- 172.21.15.83:0/2576303886 reap_dead start 2024-03-30T13:11:37.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.284+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2576303886 shutdown_connections 2024-03-30T13:11:37.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.284+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2576303886 >> 172.21.15.83:0/2576303886 conn(0x7fdb300d4480 msgr2=0x7fdb300d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.284+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2576303886 shutdown_connections 2024-03-30T13:11:37.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.284+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2576303886 wait complete. 2024-03-30T13:11:37.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb36c0a640 1 Processor -- start 2024-03-30T13:11:37.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb36c0a640 1 -- start start 2024-03-30T13:11:37.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb36c0a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb3014f470 0x7fdb30151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb36c0a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb300b74f0 0x7fdb300b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb36c0a640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300a0910 0x7fdb300a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb36c0a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3015eaf0 con 0x7fdb3014f470 2024-03-30T13:11:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb36c0a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3006c510 con 0x7fdb300b74f0 2024-03-30T13:11:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb36c0a640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3006dd20 con 0x7fdb300a0910 2024-03-30T13:11:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb349a6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb3014f470 0x7fdb30151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb349a6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb3014f470 0x7fdb30151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59134/0 (socket says 172.21.15.83:59134) 2024-03-30T13:11:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb349a6640 1 -- 172.21.15.83:0/2737766011 learned_addr learned my addr 172.21.15.83:0/2737766011 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb2ffff640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb300b74f0 0x7fdb300b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb351a7640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300a0910 0x7fdb300a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb349a6640 1 -- 172.21.15.83:0/2737766011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300a0910 msgr2=0x7fdb300a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb349a6640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300a0910 0x7fdb300a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb349a6640 1 -- 172.21.15.83:0/2737766011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb300b74f0 msgr2=0x7fdb300b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb349a6640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb300b74f0 0x7fdb300b7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb349a6640 1 -- 172.21.15.83:0/2737766011 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb300b8060 con 0x7fdb3014f470 2024-03-30T13:11:37.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb351a7640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300a0910 0x7fdb300a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:37.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb349a6640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb3014f470 0x7fdb30151c40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fdb20002190 tx=0x7fdb2000b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb2d7fa640 1 -- 172.21.15.83:0/2737766011 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20019070 con 0x7fdb3014f470 2024-03-30T13:11:37.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb2d7fa640 1 -- 172.21.15.83:0/2737766011 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb20004d70 con 0x7fdb3014f470 2024-03-30T13:11:37.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2737766011 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb300b8340 con 0x7fdb3014f470 2024-03-30T13:11:37.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb2d7fa640 1 -- 172.21.15.83:0/2737766011 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb200072f0 con 0x7fdb3014f470 2024-03-30T13:11:37.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2737766011 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb300b8900 con 0x7fdb3014f470 2024-03-30T13:11:37.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2737766011 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb300a23d0 con 0x7fdb3014f470 2024-03-30T13:11:37.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb2d7fa640 1 -- 172.21.15.83:0/2737766011 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fdb2001c070 con 0x7fdb3014f470 2024-03-30T13:11:37.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb2d7fa640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdb1c067fc0 0x7fdb1c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb2ffff640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdb1c067fc0 0x7fdb1c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.288+0000 7fdb2d7fa640 1 -- 172.21.15.83:0/2737766011 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fdb200863a0 con 0x7fdb3014f470 2024-03-30T13:11:37.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.292+0000 7fdb2ffff640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdb1c067fc0 0x7fdb1c06a480 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdb300a1560 tx=0x7fdb24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.292+0000 7fdb2d7fa640 1 -- 172.21.15.83:0/2737766011 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fdb20056e50 con 0x7fdb3014f470 2024-03-30T13:11:37.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.440+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2737766011 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fdb3004f9e0 con 0x7fdb1c067fc0 2024-03-30T13:11:37.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb2d7fa640 1 -- 172.21.15.83:0/2737766011 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdb3004f9e0 con 0x7fdb1c067fc0 2024-03-30T13:11:37.450 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 3 to deep-scrub 2024-03-30T13:11:37.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2737766011 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdb1c067fc0 msgr2=0x7fdb1c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb36c0a640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdb1c067fc0 0x7fdb1c06a480 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdb300a1560 tx=0x7fdb24008040 comp rx=0 tx=0).stop 2024-03-30T13:11:37.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2737766011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb3014f470 msgr2=0x7fdb30151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb36c0a640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb3014f470 0x7fdb30151c40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fdb20002190 tx=0x7fdb2000b560 comp rx=0 tx=0).stop 2024-03-30T13:11:37.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2737766011 shutdown_connections 2024-03-30T13:11:37.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb36c0a640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdb1c067fc0 0x7fdb1c06a480 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb36c0a640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb300a0910 0x7fdb300a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb36c0a640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb300b74f0 0x7fdb300b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb36c0a640 1 --2- 172.21.15.83:0/2737766011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb3014f470 0x7fdb30151c40 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2737766011 >> 172.21.15.83:0/2737766011 conn(0x7fdb300d4480 msgr2=0x7fdb300b67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2737766011 shutdown_connections 2024-03-30T13:11:37.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.444+0000 7fdb36c0a640 1 -- 172.21.15.83:0/2737766011 wait complete. 2024-03-30T13:11:37.468 INFO:tasks.ceph:Scrubbing osd.4 2024-03-30T13:11:37.468 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:11:37.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd23a27b640 1 Processor -- start 2024-03-30T13:11:37.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd23a27b640 1 -- start start 2024-03-30T13:11:37.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd23a27b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2340d0290 0x7fd2340d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd23a27b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2340b5150 0x7fd234071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd23a27b640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2340d0bb0 con 0x7fd23415b3d0 2024-03-30T13:11:37.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd23a27b640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fd2340b43c0 con 0x7fd2340b5150 2024-03-30T13:11:37.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd23a27b640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd2340ade80 con 0x7fd2340d0290 2024-03-30T13:11:37.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd238818640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2340b5150 0x7fd234071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd238818640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2340b5150 0x7fd234071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59144/0 (socket says 172.21.15.83:59144) 2024-03-30T13:11:37.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd238818640 1 -- 172.21.15.83:0/681967361 learned_addr learned my addr 172.21.15.83:0/681967361 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:37.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd233fff640 1 --2- 172.21.15.83:0/681967361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2340d0290 0x7fd2340d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd238818640 1 -- 172.21.15.83:0/681967361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2340d0290 msgr2=0x7fd2340d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd238818640 1 --2- 172.21.15.83:0/681967361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2340d0290 0x7fd2340d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd238818640 1 -- 172.21.15.83:0/681967361 >> v1:172.21.15.153:6789/0 conn(0x7fd23415b3d0 legacy=0x7fd2340b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.584+0000 7fd238818640 1 -- 172.21.15.83:0/681967361 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2340ae160 con 0x7fd2340b5150 2024-03-30T13:11:37.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd238818640 1 --2- 172.21.15.83:0/681967361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2340b5150 0x7fd234071800 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd22400bb10 tx=0x7fd22401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f55e74e6433602b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd232ffd640 1 -- 172.21.15.83:0/681967361 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2240b4070 con 0x7fd2340b5150 2024-03-30T13:11:37.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd232ffd640 1 -- 172.21.15.83:0/681967361 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2240a7b00 con 0x7fd2340b5150 2024-03-30T13:11:37.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd232ffd640 1 -- 172.21.15.83:0/681967361 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2240af440 con 0x7fd2340b5150 2024-03-30T13:11:37.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd23a27b640 1 -- 172.21.15.83:0/681967361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2340b5150 msgr2=0x7fd234071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd23a27b640 1 --2- 172.21.15.83:0/681967361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2340b5150 0x7fd234071800 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd22400bb10 tx=0x7fd22401eb60 comp rx=0 tx=0).stop 2024-03-30T13:11:37.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd23a27b640 1 -- 172.21.15.83:0/681967361 shutdown_connections 2024-03-30T13:11:37.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd23a27b640 1 --2- 172.21.15.83:0/681967361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2340b5150 0x7fd234071800 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd23a27b640 1 --2- 172.21.15.83:0/681967361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2340d0290 0x7fd2340d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd23a27b640 1 -- 172.21.15.83:0/681967361 >> 172.21.15.83:0/681967361 conn(0x7fd2340b21d0 msgr2=0x7fd2340b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd23a27b640 1 -- 172.21.15.83:0/681967361 shutdown_connections 2024-03-30T13:11:37.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd23a27b640 1 -- 172.21.15.83:0/681967361 wait complete. 2024-03-30T13:11:37.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd23a27b640 1 Processor -- start 2024-03-30T13:11:37.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.588+0000 7fd23a27b640 1 -- start start 2024-03-30T13:11:37.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd23a27b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2340b5150 0x7fd2341456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd23a27b640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2340d0290 0x7fd234165020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd23a27b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23415b3d0 0x7fd234156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd23a27b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd23406d860 con 0x7fd23415b3d0 2024-03-30T13:11:37.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd23a27b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd234071f50 con 0x7fd2340b5150 2024-03-30T13:11:37.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd23a27b640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd23406d9e0 con 0x7fd2340d0290 2024-03-30T13:11:37.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd238818640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23415b3d0 0x7fd234156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd238818640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23415b3d0 0x7fd234156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59148/0 (socket says 172.21.15.83:59148) 2024-03-30T13:11:37.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd238818640 1 -- 172.21.15.83:0/2726456 learned_addr learned my addr 172.21.15.83:0/2726456 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:37.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd2337fe640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2340d0290 0x7fd234165020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd238818640 1 -- 172.21.15.83:0/2726456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2340d0290 msgr2=0x7fd234165020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd238818640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2340d0290 0x7fd234165020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd233fff640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2340b5150 0x7fd2341456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd238818640 1 -- 172.21.15.83:0/2726456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2340b5150 msgr2=0x7fd2341456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd238818640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2340b5150 0x7fd2341456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd238818640 1 -- 172.21.15.83:0/2726456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd234145c20 con 0x7fd23415b3d0 2024-03-30T13:11:37.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd238818640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23415b3d0 0x7fd234156a40 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fd22401d210 tx=0x7fd22401b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd230ff9640 1 -- 172.21.15.83:0/2726456 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2240b4030 con 0x7fd23415b3d0 2024-03-30T13:11:37.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd230ff9640 1 -- 172.21.15.83:0/2726456 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2240b6070 con 0x7fd23415b3d0 2024-03-30T13:11:37.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd230ff9640 1 -- 172.21.15.83:0/2726456 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2240ad790 con 0x7fd23415b3d0 2024-03-30T13:11:37.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd23a27b640 1 -- 172.21.15.83:0/2726456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd234165970 con 0x7fd23415b3d0 2024-03-30T13:11:37.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd23a27b640 1 -- 172.21.15.83:0/2726456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd234148340 con 0x7fd23415b3d0 2024-03-30T13:11:37.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd23a27b640 1 -- 172.21.15.83:0/2726456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd2340686c0 con 0x7fd23415b3d0 2024-03-30T13:11:37.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd230ff9640 1 -- 172.21.15.83:0/2726456 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fd2240c1060 con 0x7fd23415b3d0 2024-03-30T13:11:37.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd230ff9640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd220067fc0 0x7fd22006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd230ff9640 1 -- 172.21.15.83:0/2726456 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fd224120d90 con 0x7fd23415b3d0 2024-03-30T13:11:37.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd233fff640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd220067fc0 0x7fd22006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd230ff9640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] conn(0x7fd22006de80 0x7fd2200702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd230ff9640 1 -- 172.21.15.83:0/2726456 --> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd224008e50 con 0x7fd22006de80 2024-03-30T13:11:37.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd230ff9640 1 -- 172.21.15.83:0/2726456 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd224121220 con 0x7fd23415b3d0 2024-03-30T13:11:37.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd233fff640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd220067fc0 0x7fd22006a480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd22c008ef0 tx=0x7fd22c008440 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.592+0000 7fd2337fe640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] conn(0x7fd22006de80 0x7fd2200702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.596+0000 7fd2337fe640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] conn(0x7fd22006de80 0x7fd2200702a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.596+0000 7fd230ff9640 1 -- 172.21.15.83:0/2726456 <== osd.4 v2:172.21.15.153:6824/258447987 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd224008e50 con 0x7fd22006de80 2024-03-30T13:11:37.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd23a27b640 1 -- 172.21.15.83:0/2726456 --> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd2340b2850 con 0x7fd22006de80 2024-03-30T13:11:37.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd230ff9640 1 -- 172.21.15.83:0/2726456 <== osd.4 v2:172.21.15.153:6824/258447987 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd2340b2850 con 0x7fd22006de80 2024-03-30T13:11:37.617 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:37.617 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:11:37.617 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:37.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd23a27b640 1 -- 172.21.15.83:0/2726456 >> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] conn(0x7fd22006de80 msgr2=0x7fd2200702a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd23a27b640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.153:6824/258447987,v1:172.21.15.153:6825/258447987] conn(0x7fd22006de80 0x7fd2200702a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd23a27b640 1 -- 172.21.15.83:0/2726456 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd220067fc0 msgr2=0x7fd22006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd23a27b640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fd220067fc0 0x7fd22006a480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd22c008ef0 tx=0x7fd22c008440 comp rx=0 tx=0).stop 2024-03-30T13:11:37.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd23a27b640 1 -- 172.21.15.83:0/2726456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23415b3d0 msgr2=0x7fd234156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd23a27b640 1 --2- 172.21.15.83:0/2726456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23415b3d0 0x7fd234156a40 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fd22401d210 tx=0x7fd22401b900 comp rx=0 tx=0).stop 2024-03-30T13:11:37.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd238818640 1 -- 172.21.15.83:0/2726456 reap_dead start 2024-03-30T13:11:37.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd23a27b640 1 -- 172.21.15.83:0/2726456 shutdown_connections 2024-03-30T13:11:37.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd23a27b640 1 -- 172.21.15.83:0/2726456 >> 172.21.15.83:0/2726456 conn(0x7fd2340b21d0 msgr2=0x7fd2340720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd23a27b640 1 -- 172.21.15.83:0/2726456 shutdown_connections 2024-03-30T13:11:37.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.608+0000 7fd23a27b640 1 -- 172.21.15.83:0/2726456 wait complete. 2024-03-30T13:11:37.632 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-30T13:11:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3eb607640 1 Processor -- start 2024-03-30T13:11:37.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3eb607640 1 -- start start 2024-03-30T13:11:37.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3eb607640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3e40b4680 0x7fb3e415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3eb607640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb3e415d200 0x7fb3e4165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3eb607640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e40ae040 con 0x7fb3e415c8e0 2024-03-30T13:11:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3eb607640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb3e40b31e0 con 0x7fb3e415d200 2024-03-30T13:11:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3eb607640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb3e40ae320 con 0x7fb3e40b4680 2024-03-30T13:11:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3e9ba4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb3e415d200 0x7fb3e4165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3e93a3640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fb3e415c8e0 0x7fb3e40ad580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:51588/0 (socket says 172.21.15.83:51588) 2024-03-30T13:11:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3e9ba4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb3e415d200 0x7fb3e4165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59164/0 (socket says 172.21.15.83:59164) 2024-03-30T13:11:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3e93a3640 1 -- 172.21.15.83:0/457908077 learned_addr learned my addr 172.21.15.83:0/457908077 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3e8ba2640 1 --2- 172.21.15.83:0/457908077 >> v2:172.21.15.153:3300/0 conn(0x7fb3e40b4680 0x7fb3e415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3e9ba4640 1 -- 172.21.15.83:0/457908077 >> v2:172.21.15.153:3300/0 conn(0x7fb3e40b4680 msgr2=0x7fb3e415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3e9ba4640 1 --2- 172.21.15.83:0/457908077 >> v2:172.21.15.153:3300/0 conn(0x7fb3e40b4680 0x7fb3e415ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3e9ba4640 1 -- 172.21.15.83:0/457908077 >> v1:172.21.15.83:6789/0 conn(0x7fb3e415c8e0 legacy=0x7fb3e40ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3e3fff640 1 -- 172.21.15.83:0/457908077 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1751736780 0 0) 0x7fb3e40ae040 con 0x7fb3e415c8e0 2024-03-30T13:11:37.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.736+0000 7fb3e9ba4640 1 -- 172.21.15.83:0/457908077 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e40ae600 con 0x7fb3e415d200 2024-03-30T13:11:37.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3e9ba4640 1 --2- 172.21.15.83:0/457908077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e415d200 0x7fb3e4165e90 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40afd20 tx=0x7fb3dc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb7772305000942 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3e3fff640 1 -- 172.21.15.83:0/457908077 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0b2070 con 0x7fb3e415d200 2024-03-30T13:11:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3e3fff640 1 -- 172.21.15.83:0/457908077 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3dc0a5900 con 0x7fb3e415d200 2024-03-30T13:11:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3e3fff640 1 -- 172.21.15.83:0/457908077 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0a5cd0 con 0x7fb3e415d200 2024-03-30T13:11:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 -- 172.21.15.83:0/457908077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e415d200 msgr2=0x7fb3e4165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 --2- 172.21.15.83:0/457908077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e415d200 0x7fb3e4165e90 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40afd20 tx=0x7fb3dc01c930 comp rx=0 tx=0).stop 2024-03-30T13:11:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 -- 172.21.15.83:0/457908077 shutdown_connections 2024-03-30T13:11:37.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 --2- 172.21.15.83:0/457908077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e415d200 0x7fb3e4165e90 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 --2- 172.21.15.83:0/457908077 >> v2:172.21.15.153:3300/0 conn(0x7fb3e40b4680 0x7fb3e415ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 -- 172.21.15.83:0/457908077 >> 172.21.15.83:0/457908077 conn(0x7fb3e406b660 msgr2=0x7fb3e406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 -- 172.21.15.83:0/457908077 shutdown_connections 2024-03-30T13:11:37.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 -- 172.21.15.83:0/457908077 wait complete. 2024-03-30T13:11:37.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 Processor -- start 2024-03-30T13:11:37.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 -- start start 2024-03-30T13:11:37.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e40b4680 0x7fb3e4149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3e415c8e0 0x7fb3e4144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e415d200 0x7fb3e4143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e40adc90 con 0x7fb3e415d200 2024-03-30T13:11:37.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e4168bf0 con 0x7fb3e40b4680 2024-03-30T13:11:37.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3eb607640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e40b13b0 con 0x7fb3e415c8e0 2024-03-30T13:11:37.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3e9ba4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e415d200 0x7fb3e4143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3e9ba4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e415d200 0x7fb3e4143500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59176/0 (socket says 172.21.15.83:59176) 2024-03-30T13:11:37.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.740+0000 7fb3e9ba4640 1 -- 172.21.15.83:0/3320186767 learned_addr learned my addr 172.21.15.83:0/3320186767 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:37.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e93a3640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e40b4680 0x7fb3e4149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e8ba2640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3e415c8e0 0x7fb3e4144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e9ba4640 1 -- 172.21.15.83:0/3320186767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3e415c8e0 msgr2=0x7fb3e4144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e9ba4640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3e415c8e0 0x7fb3e4144270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e9ba4640 1 -- 172.21.15.83:0/3320186767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e40b4680 msgr2=0x7fb3e4149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e9ba4640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e40b4680 0x7fb3e4149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e9ba4640 1 -- 172.21.15.83:0/3320186767 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e40b1690 con 0x7fb3e415d200 2024-03-30T13:11:37.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e8ba2640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3e415c8e0 0x7fb3e4144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:37.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e93a3640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e40b4680 0x7fb3e4149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:37.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e9ba4640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e415d200 0x7fb3e4143500 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0b0040 tx=0x7fb3dc0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e1ffb640 1 -- 172.21.15.83:0/3320186767 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0bd020 con 0x7fb3e415d200 2024-03-30T13:11:37.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e1ffb640 1 -- 172.21.15.83:0/3320186767 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3dc0ad6c0 con 0x7fb3e415d200 2024-03-30T13:11:37.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e1ffb640 1 -- 172.21.15.83:0/3320186767 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0b2040 con 0x7fb3e415d200 2024-03-30T13:11:37.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3eb607640 1 -- 172.21.15.83:0/3320186767 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e40b1970 con 0x7fb3e415d200 2024-03-30T13:11:37.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3eb607640 1 -- 172.21.15.83:0/3320186767 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e41447b0 con 0x7fb3e415d200 2024-03-30T13:11:37.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3eb607640 1 -- 172.21.15.83:0/3320186767 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e40b1b70 con 0x7fb3e415d200 2024-03-30T13:11:37.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e1ffb640 1 -- 172.21.15.83:0/3320186767 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb3dc0c0020 con 0x7fb3e415d200 2024-03-30T13:11:37.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e1ffb640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb3d0067fc0 0x7fb3d006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e93a3640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb3d0067fc0 0x7fb3d006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e1ffb640 1 -- 172.21.15.83:0/3320186767 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fb3dc1213d0 con 0x7fb3e415d200 2024-03-30T13:11:37.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.744+0000 7fb3e93a3640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb3d0067fc0 0x7fb3d006a480 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4000f70 tx=0x7fb3d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.748+0000 7fb3e1ffb640 1 -- 172.21.15.83:0/3320186767 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb3e40b1b70 con 0x7fb3e415d200 2024-03-30T13:11:37.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 -- 172.21.15.83:0/3320186767 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fb3e415edd0 con 0x7fb3d0067fc0 2024-03-30T13:11:37.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3e1ffb640 1 -- 172.21.15.83:0/3320186767 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb3e415edd0 con 0x7fb3d0067fc0 2024-03-30T13:11:37.907 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 4 to deep-scrub 2024-03-30T13:11:37.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 -- 172.21.15.83:0/3320186767 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb3d0067fc0 msgr2=0x7fb3d006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb3d0067fc0 0x7fb3d006a480 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4000f70 tx=0x7fb3d4009040 comp rx=0 tx=0).stop 2024-03-30T13:11:37.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 -- 172.21.15.83:0/3320186767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e415d200 msgr2=0x7fb3e4143500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e415d200 0x7fb3e4143500 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0b0040 tx=0x7fb3dc0196d0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 -- 172.21.15.83:0/3320186767 shutdown_connections 2024-03-30T13:11:37.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb3d0067fc0 0x7fb3d006a480 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e415d200 0x7fb3e4143500 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3e415c8e0 0x7fb3e4144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 --2- 172.21.15.83:0/3320186767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e40b4680 0x7fb3e4149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 -- 172.21.15.83:0/3320186767 >> 172.21.15.83:0/3320186767 conn(0x7fb3e406b660 msgr2=0x7fb3e4154f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 -- 172.21.15.83:0/3320186767 shutdown_connections 2024-03-30T13:11:37.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:37.900+0000 7fb3eb607640 1 -- 172.21.15.83:0/3320186767 wait complete. 2024-03-30T13:11:37.924 INFO:tasks.ceph:Scrubbing osd.5 2024-03-30T13:11:37.924 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:11:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31695ec640 1 Processor -- start 2024-03-30T13:11:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31695ec640 1 -- start start 2024-03-30T13:11:38.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31695ec640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31640c8eb0 0x7f316409ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31695ec640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f31640c7150 0x7f316409b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31695ec640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31640d0440 con 0x7f316415c940 2024-03-30T13:11:38.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31695ec640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f31640d0a50 con 0x7f31640c7150 2024-03-30T13:11:38.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31695ec640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f316415d4a0 con 0x7f31640c8eb0 2024-03-30T13:11:38.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31637fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f316415c940 0x7f316415cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:51590/0 (socket says 172.21.15.83:51590) 2024-03-30T13:11:38.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31637fe640 1 -- 172.21.15.83:0/3142405455 learned_addr learned my addr 172.21.15.83:0/3142405455 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:38.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31627fc640 1 --2- 172.21.15.83:0/3142405455 >> v2:172.21.15.83:3300/0 conn(0x7f31640c7150 0x7f316409b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f3162ffd640 1 --2- 172.21.15.83:0/3142405455 >> v2:172.21.15.153:3300/0 conn(0x7f31640c8eb0 0x7f316409ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31627fc640 1 -- 172.21.15.83:0/3142405455 >> v2:172.21.15.153:3300/0 conn(0x7f31640c8eb0 msgr2=0x7f316409ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31627fc640 1 --2- 172.21.15.83:0/3142405455 >> v2:172.21.15.153:3300/0 conn(0x7f31640c8eb0 0x7f316409ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31627fc640 1 -- 172.21.15.83:0/3142405455 >> v1:172.21.15.83:6789/0 conn(0x7f316415c940 legacy=0x7f316415cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f3161ffb640 1 -- 172.21.15.83:0/3142405455 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3329319061 0 0) 0x7f31640d0440 con 0x7f316415c940 2024-03-30T13:11:38.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.036+0000 7f31627fc640 1 -- 172.21.15.83:0/3142405455 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316409b8d0 con 0x7f31640c7150 2024-03-30T13:11:38.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f31627fc640 1 --2- 172.21.15.83:0/3142405455 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31640c7150 0x7f316409b090 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f3164073790 tx=0x7f315801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25480baf24ce9720 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f3161ffb640 1 -- 172.21.15.83:0/3142405455 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31580b1070 con 0x7f31640c7150 2024-03-30T13:11:38.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f3161ffb640 1 -- 172.21.15.83:0/3142405455 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31580ac620 con 0x7f31640c7150 2024-03-30T13:11:38.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f3161ffb640 1 -- 172.21.15.83:0/3142405455 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31580ac9f0 con 0x7f31640c7150 2024-03-30T13:11:38.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f31695ec640 1 -- 172.21.15.83:0/3142405455 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31640c7150 msgr2=0x7f316409b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f31695ec640 1 --2- 172.21.15.83:0/3142405455 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31640c7150 0x7f316409b090 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f3164073790 tx=0x7f315801c3c0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f31695ec640 1 -- 172.21.15.83:0/3142405455 shutdown_connections 2024-03-30T13:11:38.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f31695ec640 1 --2- 172.21.15.83:0/3142405455 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31640c7150 0x7f316409b090 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f31695ec640 1 --2- 172.21.15.83:0/3142405455 >> v2:172.21.15.153:3300/0 conn(0x7f31640c8eb0 0x7f316409ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f31695ec640 1 -- 172.21.15.83:0/3142405455 >> 172.21.15.83:0/3142405455 conn(0x7f31640d22b0 msgr2=0x7f31640d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f31695ec640 1 -- 172.21.15.83:0/3142405455 shutdown_connections 2024-03-30T13:11:38.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f31695ec640 1 -- 172.21.15.83:0/3142405455 wait complete. 2024-03-30T13:11:38.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f31695ec640 1 Processor -- start 2024-03-30T13:11:38.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.040+0000 7f31695ec640 1 -- start start 2024-03-30T13:11:38.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31695ec640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31640c7150 0x7f31640b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31695ec640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31640c8eb0 0x7f31641567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31695ec640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f316415c940 0x7f31640af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31695ec640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f31640d1850 con 0x7f316415c940 2024-03-30T13:11:38.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31695ec640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f31640d16d0 con 0x7f31640c7150 2024-03-30T13:11:38.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31695ec640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f31640d19d0 con 0x7f31640c8eb0 2024-03-30T13:11:38.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31637fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f316415c940 0x7f31640af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31637fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f316415c940 0x7f31640af810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59192/0 (socket says 172.21.15.83:59192) 2024-03-30T13:11:38.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31637fe640 1 -- 172.21.15.83:0/435981775 learned_addr learned my addr 172.21.15.83:0/435981775 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:38.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31627fc640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31640c8eb0 0x7f31641567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f3162ffd640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31640c7150 0x7f31640b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31637fe640 1 -- 172.21.15.83:0/435981775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31640c8eb0 msgr2=0x7f31641567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31637fe640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31640c8eb0 0x7f31641567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31637fe640 1 -- 172.21.15.83:0/435981775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31640c7150 msgr2=0x7f31640b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31637fe640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31640c7150 0x7f31640b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31637fe640 1 -- 172.21.15.83:0/435981775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31640b11c0 con 0x7f316415c940 2024-03-30T13:11:38.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31627fc640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f31640c8eb0 0x7f31641567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:38.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31637fe640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f316415c940 0x7f31640af810 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f315c00c700 tx=0x7f315c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f314b7fe640 1 -- 172.21.15.83:0/435981775 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c018070 con 0x7f316415c940 2024-03-30T13:11:38.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f314b7fe640 1 -- 172.21.15.83:0/435981775 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f315c00ce10 con 0x7f316415c940 2024-03-30T13:11:38.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f314b7fe640 1 -- 172.21.15.83:0/435981775 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c00a860 con 0x7f316415c940 2024-03-30T13:11:38.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31695ec640 1 -- 172.21.15.83:0/435981775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3164158610 con 0x7f316415c940 2024-03-30T13:11:38.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31695ec640 1 -- 172.21.15.83:0/435981775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31640af2f0 con 0x7f316415c940 2024-03-30T13:11:38.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f31695ec640 1 -- 172.21.15.83:0/435981775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3164068dd0 con 0x7f316415c940 2024-03-30T13:11:38.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f314b7fe640 1 -- 172.21.15.83:0/435981775 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f315c01b070 con 0x7f316415c940 2024-03-30T13:11:38.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f314b7fe640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3150067fc0 0x7f315006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f3162ffd640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3150067fc0 0x7f315006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f314b7fe640 1 -- 172.21.15.83:0/435981775 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f315c085c40 con 0x7f316415c940 2024-03-30T13:11:38.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f314b7fe640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] conn(0x7f315006de80 0x7f31500702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f314b7fe640 1 -- 172.21.15.83:0/435981775 --> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3150070950 con 0x7f315006de80 2024-03-30T13:11:38.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f314b7fe640 1 -- 172.21.15.83:0/435981775 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f315c0860d0 con 0x7f316415c940 2024-03-30T13:11:38.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.044+0000 7f3162ffd640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3150067fc0 0x7f315006a480 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f31640cd9f0 tx=0x7f3154008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.048+0000 7f31627fc640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] conn(0x7f315006de80 0x7f31500702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.048+0000 7f31627fc640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] conn(0x7f315006de80 0x7f31500702a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.048+0000 7f314b7fe640 1 -- 172.21.15.83:0/435981775 <== osd.5 v2:172.21.15.153:6806/2082548959 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3150070950 con 0x7f315006de80 2024-03-30T13:11:38.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.060+0000 7f31695ec640 1 -- 172.21.15.83:0/435981775 --> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f316406fe70 con 0x7f315006de80 2024-03-30T13:11:38.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.064+0000 7f314b7fe640 1 -- 172.21.15.83:0/435981775 <== osd.5 v2:172.21.15.153:6806/2082548959 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f316406fe70 con 0x7f315006de80 2024-03-30T13:11:38.070 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:38.070 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:11:38.070 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:38.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.064+0000 7f31695ec640 1 -- 172.21.15.83:0/435981775 >> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] conn(0x7f315006de80 msgr2=0x7f31500702a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.064+0000 7f31695ec640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.153:6806/2082548959,v1:172.21.15.153:6809/2082548959] conn(0x7f315006de80 0x7f31500702a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.064+0000 7f31695ec640 1 -- 172.21.15.83:0/435981775 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3150067fc0 msgr2=0x7f315006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.064+0000 7f31695ec640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f3150067fc0 0x7f315006a480 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f31640cd9f0 tx=0x7f3154008040 comp rx=0 tx=0).stop 2024-03-30T13:11:38.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.064+0000 7f31695ec640 1 -- 172.21.15.83:0/435981775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f316415c940 msgr2=0x7f31640af810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.064+0000 7f31695ec640 1 --2- 172.21.15.83:0/435981775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f316415c940 0x7f31640af810 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f315c00c700 tx=0x7f315c00cbc0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.064+0000 7f31637fe640 1 -- 172.21.15.83:0/435981775 reap_dead start 2024-03-30T13:11:38.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.064+0000 7f31695ec640 1 -- 172.21.15.83:0/435981775 shutdown_connections 2024-03-30T13:11:38.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.064+0000 7f31695ec640 1 -- 172.21.15.83:0/435981775 >> 172.21.15.83:0/435981775 conn(0x7f31640d22b0 msgr2=0x7f31640b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.064+0000 7f31695ec640 1 -- 172.21.15.83:0/435981775 shutdown_connections 2024-03-30T13:11:38.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.064+0000 7f31695ec640 1 -- 172.21.15.83:0/435981775 wait complete. 2024-03-30T13:11:38.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-30T13:11:38.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f950cba3640 1 Processor -- start 2024-03-30T13:11:38.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f950cba3640 1 -- start start 2024-03-30T13:11:38.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f950cba3640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f95080b3de0 0x7f95080b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f950cba3640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f950815c870 0x7f950815cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f950cba3640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f950815d610 con 0x7f9508159ca0 2024-03-30T13:11:38.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f950cba3640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f95080d0fe0 con 0x7f95080b3de0 2024-03-30T13:11:38.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f950cba3640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f95080d12c0 con 0x7f950815c870 2024-03-30T13:11:38.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f9505d9b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f95080b3de0 0x7f95080b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f9506d9d640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f950815c870 0x7f950815cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f950659c640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9508159ca0 0x7f95080d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:45890/0 (socket says 172.21.15.83:45890) 2024-03-30T13:11:38.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f950659c640 1 -- 172.21.15.83:0/2115952478 learned_addr learned my addr 172.21.15.83:0/2115952478 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:38.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f9505d9b640 1 -- 172.21.15.83:0/2115952478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f950815c870 msgr2=0x7f950815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f9505d9b640 1 --2- 172.21.15.83:0/2115952478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f950815c870 0x7f950815cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f9505d9b640 1 -- 172.21.15.83:0/2115952478 >> v1:172.21.15.153:6789/0 conn(0x7f9508159ca0 legacy=0x7f95080d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f9505d9b640 1 -- 172.21.15.83:0/2115952478 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95080d15a0 con 0x7f95080b3de0 2024-03-30T13:11:38.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.192+0000 7f9506d9d640 1 --2- 172.21.15.83:0/2115952478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f950815c870 0x7f950815cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:38.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f9505d9b640 1 --2- 172.21.15.83:0/2115952478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95080b3de0 0x7f95080b4270 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f94f00097c0 tx=0x7f94f001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de99a238766f42a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f950559a640 1 -- 172.21.15.83:0/2115952478 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f00b1070 con 0x7f95080b3de0 2024-03-30T13:11:38.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f950559a640 1 -- 172.21.15.83:0/2115952478 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f00ac410 con 0x7f95080b3de0 2024-03-30T13:11:38.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f950559a640 1 -- 172.21.15.83:0/2115952478 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f00ac7e0 con 0x7f95080b3de0 2024-03-30T13:11:38.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f950cba3640 1 -- 172.21.15.83:0/2115952478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95080b3de0 msgr2=0x7f95080b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f950cba3640 1 --2- 172.21.15.83:0/2115952478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95080b3de0 0x7f95080b4270 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f94f00097c0 tx=0x7f94f001c4a0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f950cba3640 1 -- 172.21.15.83:0/2115952478 shutdown_connections 2024-03-30T13:11:38.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f950cba3640 1 --2- 172.21.15.83:0/2115952478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f950815c870 0x7f950815cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f950cba3640 1 --2- 172.21.15.83:0/2115952478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95080b3de0 0x7f95080b4270 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f950cba3640 1 -- 172.21.15.83:0/2115952478 >> 172.21.15.83:0/2115952478 conn(0x7f95080b7670 msgr2=0x7f95080b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f950cba3640 1 -- 172.21.15.83:0/2115952478 shutdown_connections 2024-03-30T13:11:38.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f950cba3640 1 -- 172.21.15.83:0/2115952478 wait complete. 2024-03-30T13:11:38.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.196+0000 7f950cba3640 1 Processor -- start 2024-03-30T13:11:38.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950cba3640 1 -- start start 2024-03-30T13:11:38.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950cba3640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95080b3de0 0x7f950815a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950cba3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9508159ca0 0x7f9508147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950cba3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950815c870 0x7f950814f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950cba3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f95080b5f50 con 0x7f9508159ca0 2024-03-30T13:11:38.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950cba3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95080b5dd0 con 0x7f950815c870 2024-03-30T13:11:38.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950cba3640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f95080b60d0 con 0x7f95080b3de0 2024-03-30T13:11:38.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f9505d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9508159ca0 0x7f9508147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f9505d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9508159ca0 0x7f9508147fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59194/0 (socket says 172.21.15.83:59194) 2024-03-30T13:11:38.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f9505d9b640 1 -- 172.21.15.83:0/810370806 learned_addr learned my addr 172.21.15.83:0/810370806 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:38.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f9506d9d640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950815c870 0x7f950814f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950659c640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95080b3de0 0x7f950815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f9505d9b640 1 -- 172.21.15.83:0/810370806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95080b3de0 msgr2=0x7f950815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f9505d9b640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95080b3de0 0x7f950815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f9505d9b640 1 -- 172.21.15.83:0/810370806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950815c870 msgr2=0x7f950814f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f9505d9b640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950815c870 0x7f950814f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f9505d9b640 1 -- 172.21.15.83:0/810370806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950814fa10 con 0x7f9508159ca0 2024-03-30T13:11:38.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950659c640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95080b3de0 0x7f950815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:38.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f9505d9b640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9508159ca0 0x7f9508147fd0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f94f00af040 tx=0x7f94f0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f94feffd640 1 -- 172.21.15.83:0/810370806 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f00b1040 con 0x7f9508159ca0 2024-03-30T13:11:38.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f94feffd640 1 -- 172.21.15.83:0/810370806 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f00acd70 con 0x7f9508159ca0 2024-03-30T13:11:38.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950cba3640 1 -- 172.21.15.83:0/810370806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9508154660 con 0x7f9508159ca0 2024-03-30T13:11:38.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f94feffd640 1 -- 172.21.15.83:0/810370806 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0006e20 con 0x7f9508159ca0 2024-03-30T13:11:38.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950cba3640 1 -- 172.21.15.83:0/810370806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9508154c20 con 0x7f9508159ca0 2024-03-30T13:11:38.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950cba3640 1 -- 172.21.15.83:0/810370806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9508070ec0 con 0x7f9508159ca0 2024-03-30T13:11:38.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f94feffd640 1 -- 172.21.15.83:0/810370806 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f94f00bd020 con 0x7f9508159ca0 2024-03-30T13:11:38.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f94feffd640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f94e8067fc0 0x7f94e806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f94feffd640 1 -- 172.21.15.83:0/810370806 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f94f011f3c0 con 0x7f9508159ca0 2024-03-30T13:11:38.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.200+0000 7f950659c640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f94e8067fc0 0x7f94e806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.204+0000 7f950659c640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f94e8067fc0 0x7f94e806a480 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f94f8005c10 tx=0x7f94f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.204+0000 7f94feffd640 1 -- 172.21.15.83:0/810370806 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f94f00c4020 con 0x7f9508159ca0 2024-03-30T13:11:38.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.356+0000 7f950cba3640 1 -- 172.21.15.83:0/810370806 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f9508166fd0 con 0x7f94e8067fc0 2024-03-30T13:11:38.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.356+0000 7f94feffd640 1 -- 172.21.15.83:0/810370806 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9508166fd0 con 0x7f94e8067fc0 2024-03-30T13:11:38.366 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 5 to deep-scrub 2024-03-30T13:11:38.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.360+0000 7f950cba3640 1 -- 172.21.15.83:0/810370806 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f94e8067fc0 msgr2=0x7f94e806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.360+0000 7f950cba3640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f94e8067fc0 0x7f94e806a480 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f94f8005c10 tx=0x7f94f8009040 comp rx=0 tx=0).stop 2024-03-30T13:11:38.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.360+0000 7f950cba3640 1 -- 172.21.15.83:0/810370806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9508159ca0 msgr2=0x7f9508147fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.360+0000 7f950cba3640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9508159ca0 0x7f9508147fd0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f94f00af040 tx=0x7f94f0019240 comp rx=0 tx=0).stop 2024-03-30T13:11:38.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.360+0000 7f950cba3640 1 -- 172.21.15.83:0/810370806 shutdown_connections 2024-03-30T13:11:38.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.360+0000 7f950cba3640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f94e8067fc0 0x7f94e806a480 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.360+0000 7f950cba3640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950815c870 0x7f950814f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.360+0000 7f950cba3640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9508159ca0 0x7f9508147fd0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.360+0000 7f950cba3640 1 --2- 172.21.15.83:0/810370806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95080b3de0 0x7f950815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.360+0000 7f950cba3640 1 -- 172.21.15.83:0/810370806 >> 172.21.15.83:0/810370806 conn(0x7f95080b7670 msgr2=0x7f95080b6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.360+0000 7f950cba3640 1 -- 172.21.15.83:0/810370806 shutdown_connections 2024-03-30T13:11:38.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.360+0000 7f950cba3640 1 -- 172.21.15.83:0/810370806 wait complete. 2024-03-30T13:11:38.382 INFO:tasks.ceph:Scrubbing osd.6 2024-03-30T13:11:38.383 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:11:38.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f3450cb1640 1 Processor -- start 2024-03-30T13:11:38.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f3450cb1640 1 -- start start 2024-03-30T13:11:38.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f3450cb1640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f344c15b460 0x7f344c0b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f3450cb1640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f344c0d1520 0x7f344c165090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f3450cb1640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f344c0b03a0 con 0x7f344c0aff10 2024-03-30T13:11:38.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f3450cb1640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f344c0afb80 con 0x7f344c15b460 2024-03-30T13:11:38.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f3450cb1640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f344c0af2e0 con 0x7f344c0d1520 2024-03-30T13:11:38.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f344a59c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f344c15b460 0x7f344c0b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f344a59c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f344c15b460 0x7f344c0b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59200/0 (socket says 172.21.15.83:59200) 2024-03-30T13:11:38.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f344a59c640 1 -- 172.21.15.83:0/2894500316 learned_addr learned my addr 172.21.15.83:0/2894500316 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:38.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f344ad9d640 1 --2- 172.21.15.83:0/2894500316 >> v2:172.21.15.153:3300/0 conn(0x7f344c0d1520 0x7f344c165090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f344a59c640 1 -- 172.21.15.83:0/2894500316 >> v2:172.21.15.153:3300/0 conn(0x7f344c0d1520 msgr2=0x7f344c165090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f344a59c640 1 --2- 172.21.15.83:0/2894500316 >> v2:172.21.15.153:3300/0 conn(0x7f344c0d1520 0x7f344c165090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f344a59c640 1 -- 172.21.15.83:0/2894500316 >> v1:172.21.15.153:6789/0 conn(0x7f344c0aff10 legacy=0x7f344c0d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.500+0000 7f344a59c640 1 -- 172.21.15.83:0/2894500316 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c0af5c0 con 0x7f344c15b460 2024-03-30T13:11:38.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f344a59c640 1 --2- 172.21.15.83:0/2894500316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f344c15b460 0x7f344c0b6d10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f344c0cd5c0 tx=0x7f344401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b327e232b249ff0e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f344959a640 1 -- 172.21.15.83:0/2894500316 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34440a56f0 con 0x7f344c15b460 2024-03-30T13:11:38.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f344959a640 1 -- 172.21.15.83:0/2894500316 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34440a5890 con 0x7f344c15b460 2024-03-30T13:11:38.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f344959a640 1 -- 172.21.15.83:0/2894500316 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34440a5c60 con 0x7f344c15b460 2024-03-30T13:11:38.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 -- 172.21.15.83:0/2894500316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f344c15b460 msgr2=0x7f344c0b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 --2- 172.21.15.83:0/2894500316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f344c15b460 0x7f344c0b6d10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f344c0cd5c0 tx=0x7f344401d380 comp rx=0 tx=0).stop 2024-03-30T13:11:38.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 -- 172.21.15.83:0/2894500316 shutdown_connections 2024-03-30T13:11:38.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 --2- 172.21.15.83:0/2894500316 >> v2:172.21.15.153:3300/0 conn(0x7f344c0d1520 0x7f344c165090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 --2- 172.21.15.83:0/2894500316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f344c15b460 0x7f344c0b6d10 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 -- 172.21.15.83:0/2894500316 >> 172.21.15.83:0/2894500316 conn(0x7f344c09aa50 msgr2=0x7f344c0b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 -- 172.21.15.83:0/2894500316 shutdown_connections 2024-03-30T13:11:38.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 -- 172.21.15.83:0/2894500316 wait complete. 2024-03-30T13:11:38.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 Processor -- start 2024-03-30T13:11:38.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 -- start start 2024-03-30T13:11:38.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f344c0aff10 0x7f344c0cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f344c0d1520 0x7f344c1f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f344c15b460 0x7f344c1f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f344c0b0dd0 con 0x7f344c15b460 2024-03-30T13:11:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f344c0b0c50 con 0x7f344c0aff10 2024-03-30T13:11:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.504+0000 7f3450cb1640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f344c167df0 con 0x7f344c0d1520 2024-03-30T13:11:38.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f344ad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f344c15b460 0x7f344c1f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f344ad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f344c15b460 0x7f344c1f65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59206/0 (socket says 172.21.15.83:59206) 2024-03-30T13:11:38.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f344ad9d640 1 -- 172.21.15.83:0/1187874034 learned_addr learned my addr 172.21.15.83:0/1187874034 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:38.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f344a59c640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f344c0aff10 0x7f344c0cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3449d9b640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f344c0d1520 0x7f344c1f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f344ad9d640 1 -- 172.21.15.83:0/1187874034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f344c0d1520 msgr2=0x7f344c1f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f344ad9d640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f344c0d1520 0x7f344c1f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f344ad9d640 1 -- 172.21.15.83:0/1187874034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f344c0aff10 msgr2=0x7f344c0cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f344ad9d640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f344c0aff10 0x7f344c0cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f344ad9d640 1 -- 172.21.15.83:0/1187874034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c15bae0 con 0x7f344c15b460 2024-03-30T13:11:38.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f344ad9d640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f344c15b460 0x7f344c1f65a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f343c00c820 tx=0x7f343c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3442ffd640 1 -- 172.21.15.83:0/1187874034 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c015070 con 0x7f344c15b460 2024-03-30T13:11:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3442ffd640 1 -- 172.21.15.83:0/1187874034 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f343c004220 con 0x7f344c15b460 2024-03-30T13:11:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3450cb1640 1 -- 172.21.15.83:0/1187874034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f344c0ce620 con 0x7f344c15b460 2024-03-30T13:11:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3442ffd640 1 -- 172.21.15.83:0/1187874034 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c00ce10 con 0x7f344c15b460 2024-03-30T13:11:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3450cb1640 1 -- 172.21.15.83:0/1187874034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f344c0cebe0 con 0x7f344c15b460 2024-03-30T13:11:38.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3450cb1640 1 -- 172.21.15.83:0/1187874034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f344c068dd0 con 0x7f344c15b460 2024-03-30T13:11:38.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3442ffd640 1 -- 172.21.15.83:0/1187874034 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f343c007830 con 0x7f344c15b460 2024-03-30T13:11:38.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3442ffd640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f342c067fc0 0x7f342c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3442ffd640 1 -- 172.21.15.83:0/1187874034 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f343c086550 con 0x7f344c15b460 2024-03-30T13:11:38.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f344a59c640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f342c067fc0 0x7f342c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3442ffd640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] conn(0x7f342c06de80 0x7f342c0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3442ffd640 1 -- 172.21.15.83:0/1187874034 --> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f343c01ce50 con 0x7f342c06de80 2024-03-30T13:11:38.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3442ffd640 1 -- 172.21.15.83:0/1187874034 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f343c0869e0 con 0x7f344c15b460 2024-03-30T13:11:38.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f344a59c640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f342c067fc0 0x7f342c06a480 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f34440ae000 tx=0x7f3444004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.508+0000 7f3449d9b640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] conn(0x7f342c06de80 0x7f342c0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.512+0000 7f3449d9b640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] conn(0x7f342c06de80 0x7f342c0702a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.512+0000 7f3442ffd640 1 -- 172.21.15.83:0/1187874034 <== osd.6 v2:172.21.15.153:6801/3641147652 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f343c01ce50 con 0x7f342c06de80 2024-03-30T13:11:38.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.524+0000 7f3450cb1640 1 -- 172.21.15.83:0/1187874034 --> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f344c0cedb0 con 0x7f342c06de80 2024-03-30T13:11:38.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.524+0000 7f3442ffd640 1 -- 172.21.15.83:0/1187874034 <== osd.6 v2:172.21.15.153:6801/3641147652 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f344c0cedb0 con 0x7f342c06de80 2024-03-30T13:11:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:38.534 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:11:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.524+0000 7f3450cb1640 1 -- 172.21.15.83:0/1187874034 >> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] conn(0x7f342c06de80 msgr2=0x7f342c0702a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.524+0000 7f3450cb1640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.153:6801/3641147652,v1:172.21.15.153:6802/3641147652] conn(0x7f342c06de80 0x7f342c0702a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.528+0000 7f3450cb1640 1 -- 172.21.15.83:0/1187874034 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f342c067fc0 msgr2=0x7f342c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.528+0000 7f3450cb1640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f342c067fc0 0x7f342c06a480 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f34440ae000 tx=0x7f3444004ac0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.528+0000 7f3450cb1640 1 -- 172.21.15.83:0/1187874034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f344c15b460 msgr2=0x7f344c1f65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.528+0000 7f3450cb1640 1 --2- 172.21.15.83:0/1187874034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f344c15b460 0x7f344c1f65a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f343c00c820 tx=0x7f343c00cce0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.528+0000 7f344ad9d640 1 -- 172.21.15.83:0/1187874034 reap_dead start 2024-03-30T13:11:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.528+0000 7f3450cb1640 1 -- 172.21.15.83:0/1187874034 shutdown_connections 2024-03-30T13:11:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.528+0000 7f3450cb1640 1 -- 172.21.15.83:0/1187874034 >> 172.21.15.83:0/1187874034 conn(0x7f344c09aa50 msgr2=0x7f344c0b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.528+0000 7f3450cb1640 1 -- 172.21.15.83:0/1187874034 shutdown_connections 2024-03-30T13:11:38.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.528+0000 7f3450cb1640 1 -- 172.21.15.83:0/1187874034 wait complete. 2024-03-30T13:11:38.550 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-30T13:11:38.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f4874e6c640 1 Processor -- start 2024-03-30T13:11:38.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f4874e6c640 1 -- start start 2024-03-30T13:11:38.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f4874e6c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f487009ba50 0x7f487006e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f4874e6c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f487009aa50 0x7f487009aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f4874e6c640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48700d03b0 con 0x7f4870161df0 2024-03-30T13:11:38.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f4874e6c640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f48700d06e0 con 0x7f487009aa50 2024-03-30T13:11:38.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f4874e6c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4870070550 con 0x7f487009ba50 2024-03-30T13:11:38.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486e59c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f4870161df0 0x7f487006c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:51594/0 (socket says 172.21.15.83:51594) 2024-03-30T13:11:38.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486e59c640 1 -- 172.21.15.83:0/3004188003 learned_addr learned my addr 172.21.15.83:0/3004188003 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:38.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486ed9d640 1 --2- 172.21.15.83:0/3004188003 >> v2:172.21.15.153:3300/0 conn(0x7f487009aa50 0x7f487009aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486dd9b640 1 --2- 172.21.15.83:0/3004188003 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f487009ba50 0x7f487006e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192162219 0 0) 0x7f48700d03b0 con 0x7f4870161df0 2024-03-30T13:11:38.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4858003530 con 0x7f4870161df0 2024-03-30T13:11:38.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2174338007 0 0) 0x7f4858003530 con 0x7f4870161df0 2024-03-30T13:11:38.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f487009ba50 msgr2=0x7f487006e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 --2- 172.21.15.83:0/3004188003 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f487009ba50 0x7f487006e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 >> v2:172.21.15.153:3300/0 conn(0x7f487009aa50 msgr2=0x7f487009aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 --2- 172.21.15.83:0/3004188003 >> v2:172.21.15.153:3300/0 conn(0x7f487009aa50 0x7f487009aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4870070830 con 0x7f4870161df0 2024-03-30T13:11:38.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f4860001680 con 0x7f4870161df0 2024-03-30T13:11:38.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 >> v1:172.21.15.83:6789/0 conn(0x7f4870161df0 legacy=0x7f487006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 --2- 172.21.15.83:0/3004188003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48580039c0 0x7f4858003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 --2- 172.21.15.83:0/3004188003 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f487009ba50 0x7f4858004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 --2- 172.21.15.83:0/3004188003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4858004d50 0x7f48580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f48700d06e0 con 0x7f4858004d50 2024-03-30T13:11:38.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4870070550 con 0x7f48580039c0 2024-03-30T13:11:38.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f485800b9d0 con 0x7f487009ba50 2024-03-30T13:11:38.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486ed9d640 1 --2- 172.21.15.83:0/3004188003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4858004d50 0x7f48580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486e59c640 1 --2- 172.21.15.83:0/3004188003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48580039c0 0x7f4858003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486ed9d640 1 -- 172.21.15.83:0/3004188003 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f487009ba50 msgr2=0x7f4858004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486ed9d640 1 --2- 172.21.15.83:0/3004188003 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f487009ba50 0x7f4858004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486ed9d640 1 -- 172.21.15.83:0/3004188003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48580039c0 msgr2=0x7f4858003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486ed9d640 1 --2- 172.21.15.83:0/3004188003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48580039c0 0x7f4858003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.652+0000 7f486ed9d640 1 -- 172.21.15.83:0/3004188003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4858003530 con 0x7f4858004d50 2024-03-30T13:11:38.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f486ed9d640 1 --2- 172.21.15.83:0/3004188003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4858004d50 0x7f48580051d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4868009fc0 tx=0x7f486801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a71552a035975b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48680b2070 con 0x7f4858004d50 2024-03-30T13:11:38.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48680a5cd0 con 0x7f4858004d50 2024-03-30T13:11:38.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f486d59a640 1 -- 172.21.15.83:0/3004188003 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868009c10 con 0x7f4858004d50 2024-03-30T13:11:38.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 -- 172.21.15.83:0/3004188003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4858004d50 msgr2=0x7f48580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 --2- 172.21.15.83:0/3004188003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4858004d50 0x7f48580051d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4868009fc0 tx=0x7f486801ccc0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f486ed9d640 1 -- 172.21.15.83:0/3004188003 reap_dead start 2024-03-30T13:11:38.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 -- 172.21.15.83:0/3004188003 shutdown_connections 2024-03-30T13:11:38.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 -- 172.21.15.83:0/3004188003 >> 172.21.15.83:0/3004188003 conn(0x7f48700d2290 msgr2=0x7f48700d26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 -- 172.21.15.83:0/3004188003 shutdown_connections 2024-03-30T13:11:38.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 -- 172.21.15.83:0/3004188003 wait complete. 2024-03-30T13:11:38.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 Processor -- start 2024-03-30T13:11:38.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 -- start start 2024-03-30T13:11:38.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48701ebbe0 0x7f48700b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f487015e090 0x7f48700c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48701ebfc0 0x7f48700ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f487006e350 con 0x7f487015e090 2024-03-30T13:11:38.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f48700d2000 con 0x7f48701ebbe0 2024-03-30T13:11:38.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f4874e6c640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f487006e4d0 con 0x7f48701ebfc0 2024-03-30T13:11:38.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f486dd9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f487015e090 0x7f48700c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f486dd9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f487015e090 0x7f48700c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59234/0 (socket says 172.21.15.83:59234) 2024-03-30T13:11:38.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.656+0000 7f486dd9b640 1 -- 172.21.15.83:0/3547709977 learned_addr learned my addr 172.21.15.83:0/3547709977 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:38.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f486ed9d640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48701ebfc0 0x7f48700ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f486e59c640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48701ebbe0 0x7f48700b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f486dd9b640 1 -- 172.21.15.83:0/3547709977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48701ebfc0 msgr2=0x7f48700ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f486dd9b640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48701ebfc0 0x7f48700ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f486dd9b640 1 -- 172.21.15.83:0/3547709977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48701ebbe0 msgr2=0x7f48700b7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f486dd9b640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48701ebbe0 0x7f48700b7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f486dd9b640 1 -- 172.21.15.83:0/3547709977 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48700c8c20 con 0x7f487015e090 2024-03-30T13:11:38.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f486dd9b640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f487015e090 0x7f48700c8160 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f486400e7c0 tx=0x7f486400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f485effd640 1 -- 172.21.15.83:0/3547709977 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864017070 con 0x7f487015e090 2024-03-30T13:11:38.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f485effd640 1 -- 172.21.15.83:0/3547709977 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486400c8c0 con 0x7f487015e090 2024-03-30T13:11:38.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f4874e6c640 1 -- 172.21.15.83:0/3547709977 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48700b4e70 con 0x7f487015e090 2024-03-30T13:11:38.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f485effd640 1 -- 172.21.15.83:0/3547709977 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486400cc90 con 0x7f487015e090 2024-03-30T13:11:38.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f4874e6c640 1 -- 172.21.15.83:0/3547709977 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48700c8940 con 0x7f487015e090 2024-03-30T13:11:38.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f4874e6c640 1 -- 172.21.15.83:0/3547709977 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48700a0460 con 0x7f487015e090 2024-03-30T13:11:38.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f485effd640 1 -- 172.21.15.83:0/3547709977 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f486401a070 con 0x7f487015e090 2024-03-30T13:11:38.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f485effd640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4850067fc0 0x7f485006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f486e59c640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4850067fc0 0x7f485006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f485effd640 1 -- 172.21.15.83:0/3547709977 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f4864086030 con 0x7f487015e090 2024-03-30T13:11:38.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.660+0000 7f486e59c640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4850067fc0 0x7f485006a480 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4860001060 tx=0x7f4860001120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.664+0000 7f485effd640 1 -- 172.21.15.83:0/3547709977 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f4864056b70 con 0x7f487015e090 2024-03-30T13:11:38.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.812+0000 7f4874e6c640 1 -- 172.21.15.83:0/3547709977 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f48700711e0 con 0x7f4850067fc0 2024-03-30T13:11:38.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.812+0000 7f485effd640 1 -- 172.21.15.83:0/3547709977 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f48700711e0 con 0x7f4850067fc0 2024-03-30T13:11:38.821 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 6 to deep-scrub 2024-03-30T13:11:38.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.816+0000 7f4874e6c640 1 -- 172.21.15.83:0/3547709977 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4850067fc0 msgr2=0x7f485006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.816+0000 7f4874e6c640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4850067fc0 0x7f485006a480 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4860001060 tx=0x7f4860001120 comp rx=0 tx=0).stop 2024-03-30T13:11:38.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.816+0000 7f4874e6c640 1 -- 172.21.15.83:0/3547709977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f487015e090 msgr2=0x7f48700c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.816+0000 7f4874e6c640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f487015e090 0x7f48700c8160 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f486400e7c0 tx=0x7f486400ec80 comp rx=0 tx=0).stop 2024-03-30T13:11:38.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.816+0000 7f4874e6c640 1 -- 172.21.15.83:0/3547709977 shutdown_connections 2024-03-30T13:11:38.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.816+0000 7f4874e6c640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f4850067fc0 0x7f485006a480 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.816+0000 7f4874e6c640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f48701ebfc0 0x7f48700ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.816+0000 7f4874e6c640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f487015e090 0x7f48700c8160 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.816+0000 7f4874e6c640 1 --2- 172.21.15.83:0/3547709977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48701ebbe0 0x7f48700b7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.816+0000 7f4874e6c640 1 -- 172.21.15.83:0/3547709977 >> 172.21.15.83:0/3547709977 conn(0x7f48700d2290 msgr2=0x7f48700d1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.816+0000 7f4874e6c640 1 -- 172.21.15.83:0/3547709977 shutdown_connections 2024-03-30T13:11:38.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.816+0000 7f4874e6c640 1 -- 172.21.15.83:0/3547709977 wait complete. 2024-03-30T13:11:38.838 INFO:tasks.ceph:Scrubbing osd.7 2024-03-30T13:11:38.838 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:11:38.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.952+0000 7fb283a37640 1 Processor -- start 2024-03-30T13:11:38.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.952+0000 7fb283a37640 1 -- start start 2024-03-30T13:11:38.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.952+0000 7fb283a37640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb27c15e580 0x7fb27c15e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.952+0000 7fb283a37640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb27c0b3a80 0x7fb27c0b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.952+0000 7fb283a37640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb27c06f1b0 con 0x7fb27c1550d0 2024-03-30T13:11:38.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.952+0000 7fb283a37640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb27c072920 con 0x7fb27c15e580 2024-03-30T13:11:38.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.952+0000 7fb283a37640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb27c15ef00 con 0x7fb27c0b3a80 2024-03-30T13:11:38.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.952+0000 7fb281fd4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb27c0b3a80 0x7fb27c0b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.952+0000 7fb280fd2640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb27c15e580 0x7fb27c15e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.952+0000 7fb2817d3640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb27c1550d0 0x7fb27c072210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.83:45904/0 (socket says 172.21.15.83:45904) 2024-03-30T13:11:38.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.952+0000 7fb2817d3640 1 -- 172.21.15.83:0/92324178 learned_addr learned my addr 172.21.15.83:0/92324178 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:38.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb273fff640 1 -- 172.21.15.83:0/92324178 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1721305804 0 0) 0x7fb27c06f1b0 con 0x7fb27c1550d0 2024-03-30T13:11:38.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb273fff640 1 -- 172.21.15.83:0/92324178 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb268003530 con 0x7fb27c1550d0 2024-03-30T13:11:38.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb281fd4640 1 -- 172.21.15.83:0/92324178 >> v2:172.21.15.153:3300/0 conn(0x7fb27c15e580 msgr2=0x7fb27c15e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb281fd4640 1 --2- 172.21.15.83:0/92324178 >> v2:172.21.15.153:3300/0 conn(0x7fb27c15e580 0x7fb27c15e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb281fd4640 1 -- 172.21.15.83:0/92324178 >> v1:172.21.15.153:6789/0 conn(0x7fb27c1550d0 legacy=0x7fb27c072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb281fd4640 1 -- 172.21.15.83:0/92324178 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27c15f350 con 0x7fb27c0b3a80 2024-03-30T13:11:38.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb281fd4640 1 --2- 172.21.15.83:0/92324178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb27c0b3a80 0x7fb27c0b3f10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb274009d90 tx=0x7fb27401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9424ce862854a83c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb273fff640 1 -- 172.21.15.83:0/92324178 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740b2070 con 0x7fb27c0b3a80 2024-03-30T13:11:38.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb273fff640 1 -- 172.21.15.83:0/92324178 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2740a5790 con 0x7fb27c0b3a80 2024-03-30T13:11:38.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb273fff640 1 -- 172.21.15.83:0/92324178 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740a5b40 con 0x7fb27c0b3a80 2024-03-30T13:11:38.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb283a37640 1 -- 172.21.15.83:0/92324178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb27c0b3a80 msgr2=0x7fb27c0b3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb283a37640 1 --2- 172.21.15.83:0/92324178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb27c0b3a80 0x7fb27c0b3f10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb274009d90 tx=0x7fb27401c970 comp rx=0 tx=0).stop 2024-03-30T13:11:38.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb283a37640 1 -- 172.21.15.83:0/92324178 shutdown_connections 2024-03-30T13:11:38.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb283a37640 1 --2- 172.21.15.83:0/92324178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb27c0b3a80 0x7fb27c0b3f10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb283a37640 1 --2- 172.21.15.83:0/92324178 >> v2:172.21.15.153:3300/0 conn(0x7fb27c15e580 0x7fb27c15e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb283a37640 1 -- 172.21.15.83:0/92324178 >> 172.21.15.83:0/92324178 conn(0x7fb27c0b21d0 msgr2=0x7fb27c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb283a37640 1 -- 172.21.15.83:0/92324178 shutdown_connections 2024-03-30T13:11:38.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.956+0000 7fb283a37640 1 -- 172.21.15.83:0/92324178 wait complete. 2024-03-30T13:11:38.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb283a37640 1 Processor -- start 2024-03-30T13:11:38.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb283a37640 1 -- start start 2024-03-30T13:11:38.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb283a37640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb27c0b3a80 0x7fb27c14de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb283a37640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb27c1550d0 0x7fb27c1f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb283a37640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27c15e580 0x7fb27c1542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb283a37640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c06e270 con 0x7fb27c15e580 2024-03-30T13:11:38.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb283a37640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c06ee40 con 0x7fb27c1550d0 2024-03-30T13:11:38.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb283a37640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb27c0b4450 con 0x7fb27c0b3a80 2024-03-30T13:11:38.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb281fd4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27c15e580 0x7fb27c1542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb281fd4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27c15e580 0x7fb27c1542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59244/0 (socket says 172.21.15.83:59244) 2024-03-30T13:11:38.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb281fd4640 1 -- 172.21.15.83:0/1043795152 learned_addr learned my addr 172.21.15.83:0/1043795152 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:38.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb2817d3640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb27c0b3a80 0x7fb27c14de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb280fd2640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb27c1550d0 0x7fb27c1f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb281fd4640 1 -- 172.21.15.83:0/1043795152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb27c0b3a80 msgr2=0x7fb27c14de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb281fd4640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb27c0b3a80 0x7fb27c14de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb281fd4640 1 -- 172.21.15.83:0/1043795152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb27c1550d0 msgr2=0x7fb27c1f4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb281fd4640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb27c1550d0 0x7fb27c1f4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb281fd4640 1 -- 172.21.15.83:0/1043795152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27c0cdec0 con 0x7fb27c15e580 2024-03-30T13:11:38.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb281fd4640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27c15e580 0x7fb27c1542d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb2740b0040 tx=0x7fb274019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb271ffb640 1 -- 172.21.15.83:0/1043795152 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740b2070 con 0x7fb27c15e580 2024-03-30T13:11:38.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb271ffb640 1 -- 172.21.15.83:0/1043795152 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2740bc070 con 0x7fb27c15e580 2024-03-30T13:11:38.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb283a37640 1 -- 172.21.15.83:0/1043795152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27c0ce160 con 0x7fb27c15e580 2024-03-30T13:11:38.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb271ffb640 1 -- 172.21.15.83:0/1043795152 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740a5d70 con 0x7fb27c15e580 2024-03-30T13:11:38.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb283a37640 1 -- 172.21.15.83:0/1043795152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27c0cea00 con 0x7fb27c15e580 2024-03-30T13:11:38.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.960+0000 7fb283a37640 1 -- 172.21.15.83:0/1043795152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb27c0ce550 con 0x7fb27c15e580 2024-03-30T13:11:38.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.964+0000 7fb271ffb640 1 -- 172.21.15.83:0/1043795152 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb274004040 con 0x7fb27c15e580 2024-03-30T13:11:38.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.964+0000 7fb271ffb640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb260067fc0 0x7fb26006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.964+0000 7fb271ffb640 1 -- 172.21.15.83:0/1043795152 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fb274121530 con 0x7fb27c15e580 2024-03-30T13:11:38.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.964+0000 7fb2817d3640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb260067fc0 0x7fb26006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.964+0000 7fb271ffb640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] conn(0x7fb26006de80 0x7fb2600702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.964+0000 7fb271ffb640 1 -- 172.21.15.83:0/1043795152 --> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2740b6e50 con 0x7fb26006de80 2024-03-30T13:11:38.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.964+0000 7fb271ffb640 1 -- 172.21.15.83:0/1043795152 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fb2741219c0 con 0x7fb27c15e580 2024-03-30T13:11:38.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.964+0000 7fb2817d3640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb260067fc0 0x7fb26006a480 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb278005890 tx=0x7fb278009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.964+0000 7fb280fd2640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] conn(0x7fb26006de80 0x7fb2600702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.964+0000 7fb280fd2640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] conn(0x7fb26006de80 0x7fb2600702a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.964+0000 7fb271ffb640 1 -- 172.21.15.83:0/1043795152 <== osd.7 v2:172.21.15.153:6800/1008345868 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb2740b6e50 con 0x7fb26006de80 2024-03-30T13:11:38.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb283a37640 1 -- 172.21.15.83:0/1043795152 --> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb27c0686c0 con 0x7fb26006de80 2024-03-30T13:11:38.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb271ffb640 1 -- 172.21.15.83:0/1043795152 <== osd.7 v2:172.21.15.153:6800/1008345868 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb27c0686c0 con 0x7fb26006de80 2024-03-30T13:11:38.987 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-03-30T13:11:38.988 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:11:38.988 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-03-30T13:11:38.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb283a37640 1 -- 172.21.15.83:0/1043795152 >> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] conn(0x7fb26006de80 msgr2=0x7fb2600702a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb283a37640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.153:6800/1008345868,v1:172.21.15.153:6803/1008345868] conn(0x7fb26006de80 0x7fb2600702a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb283a37640 1 -- 172.21.15.83:0/1043795152 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb260067fc0 msgr2=0x7fb26006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb283a37640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fb260067fc0 0x7fb26006a480 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb278005890 tx=0x7fb278009040 comp rx=0 tx=0).stop 2024-03-30T13:11:38.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb283a37640 1 -- 172.21.15.83:0/1043795152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27c15e580 msgr2=0x7fb27c1542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb283a37640 1 --2- 172.21.15.83:0/1043795152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27c15e580 0x7fb27c1542d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb2740b0040 tx=0x7fb274019710 comp rx=0 tx=0).stop 2024-03-30T13:11:38.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb281fd4640 1 -- 172.21.15.83:0/1043795152 reap_dead start 2024-03-30T13:11:38.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb283a37640 1 -- 172.21.15.83:0/1043795152 shutdown_connections 2024-03-30T13:11:38.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb283a37640 1 -- 172.21.15.83:0/1043795152 >> 172.21.15.83:0/1043795152 conn(0x7fb27c0b21d0 msgr2=0x7fb27c15c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb283a37640 1 -- 172.21.15.83:0/1043795152 shutdown_connections 2024-03-30T13:11:38.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:38.980+0000 7fb283a37640 1 -- 172.21.15.83:0/1043795152 wait complete. 2024-03-30T13:11:39.004 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-30T13:11:39.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc99ebe640 1 Processor -- start 2024-03-30T13:11:39.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc99ebe640 1 -- start start 2024-03-30T13:11:39.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc99ebe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc9415e840 0x7fdc940d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc99ebe640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc940d51f0 con 0x7fdc940d1540 2024-03-30T13:11:39.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc99ebe640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc940d2140 con 0x7fdc940cfc10 2024-03-30T13:11:39.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc99ebe640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9415ec20 con 0x7fdc9415e840 2024-03-30T13:11:39.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc93fff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fdc940d1540 0x7fdc9406c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:51598/0 (socket says 172.21.15.83:51598) 2024-03-30T13:11:39.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc93fff640 1 -- 172.21.15.83:0/2872569340 learned_addr learned my addr 172.21.15.83:0/2872569340 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:39.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc937fe640 1 --2- 172.21.15.83:0/2872569340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc9415e840 0x7fdc940d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 64321060 0 0) 0x7fdc8c0014a0 con 0x7fdc940d1540 2024-03-30T13:11:39.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc7c003530 con 0x7fdc940d1540 2024-03-30T13:11:39.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 619929452 0 0) 0x7fdc7c003530 con 0x7fdc940d1540 2024-03-30T13:11:39.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc9415e840 msgr2=0x7fdc940d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 --2- 172.21.15.83:0/2872569340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc9415e840 0x7fdc940d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 >> v1:172.21.15.153:6789/0 conn(0x7fdc940cfc10 legacy=0x7fdc940d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc940d2420 con 0x7fdc940d1540 2024-03-30T13:11:39.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7fdc8c001bd0 con 0x7fdc940d1540 2024-03-30T13:11:39.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 >> v1:172.21.15.83:6789/0 conn(0x7fdc940d1540 legacy=0x7fdc9406c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 --2- 172.21.15.83:0/2872569340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc7c0039f0 0x7fdc7c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 --2- 172.21.15.83:0/2872569340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc9415e840 0x7fdc7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 --2- 172.21.15.83:0/2872569340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc7c004d50 0x7fdc7c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c00bb60 con 0x7fdc7c0039f0 2024-03-30T13:11:39.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c00bce0 con 0x7fdc7c004d50 2024-03-30T13:11:39.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7c00bee0 con 0x7fdc9415e840 2024-03-30T13:11:39.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc937fe640 1 --2- 172.21.15.83:0/2872569340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc7c0039f0 0x7fdc7c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc93fff640 1 --2- 172.21.15.83:0/2872569340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc7c004d50 0x7fdc7c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc92ffd640 1 --2- 172.21.15.83:0/2872569340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc9415e840 0x7fdc7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc937fe640 1 -- 172.21.15.83:0/2872569340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc9415e840 msgr2=0x7fdc7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc937fe640 1 --2- 172.21.15.83:0/2872569340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc9415e840 0x7fdc7c004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc937fe640 1 -- 172.21.15.83:0/2872569340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc7c004d50 msgr2=0x7fdc7c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc937fe640 1 --2- 172.21.15.83:0/2872569340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc7c004d50 0x7fdc7c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.112+0000 7fdc937fe640 1 -- 172.21.15.83:0/2872569340 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c003530 con 0x7fdc7c0039f0 2024-03-30T13:11:39.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc937fe640 1 --2- 172.21.15.83:0/2872569340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc7c0039f0 0x7fdc7c003e10 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009ae0 tx=0x7fdc8801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8adffeeec50130 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc880096b0 con 0x7fdc7c0039f0 2024-03-30T13:11:39.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc880a6450 con 0x7fdc7c0039f0 2024-03-30T13:11:39.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc927fc640 1 -- 172.21.15.83:0/2872569340 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc880a6840 con 0x7fdc7c0039f0 2024-03-30T13:11:39.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2872569340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc7c0039f0 msgr2=0x7fdc7c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 --2- 172.21.15.83:0/2872569340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc7c0039f0 0x7fdc7c003e10 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009ae0 tx=0x7fdc8801ca70 comp rx=0 tx=0).stop 2024-03-30T13:11:39.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc93fff640 1 -- 172.21.15.83:0/2872569340 reap_dead start 2024-03-30T13:11:39.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2872569340 shutdown_connections 2024-03-30T13:11:39.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2872569340 >> 172.21.15.83:0/2872569340 conn(0x7fdc9409d7f0 msgr2=0x7fdc940d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:39.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2872569340 shutdown_connections 2024-03-30T13:11:39.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2872569340 wait complete. 2024-03-30T13:11:39.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 Processor -- start 2024-03-30T13:11:39.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 -- start start 2024-03-30T13:11:39.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc7c0039f0 0x7fdc9415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc94165d60 0x7fdc941661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc94160710 0x7fdc94160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9416a770 con 0x7fdc94165d60 2024-03-30T13:11:39.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9416a5f0 con 0x7fdc94160710 2024-03-30T13:11:39.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.116+0000 7fdc99ebe640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9416a8f0 con 0x7fdc7c0039f0 2024-03-30T13:11:39.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc92ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc94165d60 0x7fdc941661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc92ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc94165d60 0x7fdc941661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59272/0 (socket says 172.21.15.83:59272) 2024-03-30T13:11:39.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc92ffd640 1 -- 172.21.15.83:0/2934784237 learned_addr learned my addr 172.21.15.83:0/2934784237 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:39.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc92ffd640 1 -- 172.21.15.83:0/2934784237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc7c0039f0 msgr2=0x7fdc9415a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc92ffd640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc7c0039f0 0x7fdc9415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc92ffd640 1 -- 172.21.15.83:0/2934784237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc94160710 msgr2=0x7fdc94160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc93fff640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc94160710 0x7fdc94160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc92ffd640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc94160710 0x7fdc94160ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc92ffd640 1 -- 172.21.15.83:0/2934784237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc940a1f90 con 0x7fdc94165d60 2024-03-30T13:11:39.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc92ffd640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc94165d60 0x7fdc941661c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400d570 tx=0x7fdc8400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc7bfff640 1 -- 172.21.15.83:0/2934784237 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84005480 con 0x7fdc94165d60 2024-03-30T13:11:39.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc7bfff640 1 -- 172.21.15.83:0/2934784237 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc84017070 con 0x7fdc94165d60 2024-03-30T13:11:39.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2934784237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc94168cd0 con 0x7fdc94165d60 2024-03-30T13:11:39.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc7bfff640 1 -- 172.21.15.83:0/2934784237 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84003820 con 0x7fdc94165d60 2024-03-30T13:11:39.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2934784237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc940a1cb0 con 0x7fdc94165d60 2024-03-30T13:11:39.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2934784237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc940a23d0 con 0x7fdc94165d60 2024-03-30T13:11:39.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc7bfff640 1 -- 172.21.15.83:0/2934784237 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fdc840039c0 con 0x7fdc94165d60 2024-03-30T13:11:39.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc7bfff640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdc80067fc0 0x7fdc8006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc7bfff640 1 -- 172.21.15.83:0/2934784237 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fdc84085fd0 con 0x7fdc94165d60 2024-03-30T13:11:39.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc937fe640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdc80067fc0 0x7fdc8006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.120+0000 7fdc937fe640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdc80067fc0 0x7fdc8006a480 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdc880ad000 tx=0x7fdc88004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.124+0000 7fdc7bfff640 1 -- 172.21.15.83:0/2934784237 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fdc84056b10 con 0x7fdc94165d60 2024-03-30T13:11:39.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.276+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2934784237 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fdc9404f9e0 con 0x7fdc80067fc0 2024-03-30T13:11:39.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.276+0000 7fdc7bfff640 1 -- 172.21.15.83:0/2934784237 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdc9404f9e0 con 0x7fdc80067fc0 2024-03-30T13:11:39.284 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 7 to deep-scrub 2024-03-30T13:11:39.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.276+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2934784237 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdc80067fc0 msgr2=0x7fdc8006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.276+0000 7fdc99ebe640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdc80067fc0 0x7fdc8006a480 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdc880ad000 tx=0x7fdc88004740 comp rx=0 tx=0).stop 2024-03-30T13:11:39.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.276+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2934784237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc94165d60 msgr2=0x7fdc941661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.276+0000 7fdc99ebe640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc94165d60 0x7fdc941661c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400d570 tx=0x7fdc8400da30 comp rx=0 tx=0).stop 2024-03-30T13:11:39.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.276+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2934784237 shutdown_connections 2024-03-30T13:11:39.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.276+0000 7fdc99ebe640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7fdc80067fc0 0x7fdc8006a480 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.276+0000 7fdc99ebe640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc94160710 0x7fdc94160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.276+0000 7fdc99ebe640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc94165d60 0x7fdc941661c0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.276+0000 7fdc99ebe640 1 --2- 172.21.15.83:0/2934784237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdc7c0039f0 0x7fdc9415a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.276+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2934784237 >> 172.21.15.83:0/2934784237 conn(0x7fdc9409d7f0 msgr2=0x7fdc94162240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:39.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.280+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2934784237 shutdown_connections 2024-03-30T13:11:39.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.280+0000 7fdc99ebe640 1 -- 172.21.15.83:0/2934784237 wait complete. 2024-03-30T13:11:39.302 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:11:39.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.408+0000 7f9f495ab640 1 Processor -- start 2024-03-30T13:11:39.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.408+0000 7f9f495ab640 1 -- start start 2024-03-30T13:11:39.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.408+0000 7f9f495ab640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f4406f140 0x7f9f4406f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.408+0000 7f9f495ab640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f440734c0 con 0x7f9f440b4bb0 2024-03-30T13:11:39.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.408+0000 7f9f495ab640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f4415c2a0 con 0x7f9f440730e0 2024-03-30T13:11:39.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.408+0000 7f9f495ab640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4406faf0 con 0x7f9f4406f140 2024-03-30T13:11:39.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f427fc640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f9f440b4bb0 0x7f9f4415f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:51610/0 (socket says 172.21.15.83:51610) 2024-03-30T13:11:39.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f427fc640 1 -- 172.21.15.83:0/882848152 learned_addr learned my addr 172.21.15.83:0/882848152 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-03-30T13:11:39.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f437fe640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f4406f140 0x7f9f4406f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 <== mon.0 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 105634227 0 0) 0x7f9f440734c0 con 0x7f9f440b4bb0 2024-03-30T13:11:39.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f2c005740 con 0x7f9f440b4bb0 2024-03-30T13:11:39.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 <== mon.0 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 753267662 0 0) 0x7f9f2c005740 con 0x7f9f440b4bb0 2024-03-30T13:11:39.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f4406f140 msgr2=0x7f9f4406f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f4406f140 0x7f9f4406f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 >> v1:172.21.15.153:6789/0 conn(0x7f9f440730e0 legacy=0x7f9f4415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4415c580 con 0x7f9f440b4bb0 2024-03-30T13:11:39.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 <== mon.0 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1078685196 0 0) 0x7f9f38001680 con 0x7f9f440b4bb0 2024-03-30T13:11:39.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 >> v1:172.21.15.83:6789/0 conn(0x7f9f440b4bb0 legacy=0x7f9f4415f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2c005c00 0x7f9f2c006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f4406f140 0x7f9f2c006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f2c006f60 0x7f9f2c0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4406faf0 con 0x7f9f2c005c00 2024-03-30T13:11:39.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c00dc90 con 0x7f9f2c006f60 2024-03-30T13:11:39.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2c00de90 con 0x7f9f4406f140 2024-03-30T13:11:39.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f42ffd640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2c005c00 0x7f9f2c006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f437fe640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f2c006f60 0x7f9f2c0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f427fc640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f4406f140 0x7f9f2c006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f42ffd640 1 -- 172.21.15.83:0/882848152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f4406f140 msgr2=0x7f9f2c006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f42ffd640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f4406f140 0x7f9f2c006a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f42ffd640 1 -- 172.21.15.83:0/882848152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f2c006f60 msgr2=0x7f9f2c0073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f42ffd640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f2c006f60 0x7f9f2c0073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f42ffd640 1 -- 172.21.15.83:0/882848152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c005740 con 0x7f9f2c005c00 2024-03-30T13:11:39.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f437fe640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f2c006f60 0x7f9f2c0073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:39.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f42ffd640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2c005c00 0x7f9f2c006020 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f9f34001750 tx=0x7f9f3401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c55e06282a79f77 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f340013a0 con 0x7f9f2c005c00 2024-03-30T13:11:39.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f340052f0 con 0x7f9f2c005c00 2024-03-30T13:11:39.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.412+0000 7f9f41ffb640 1 -- 172.21.15.83:0/882848152 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34003840 con 0x7f9f2c005c00 2024-03-30T13:11:39.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 -- 172.21.15.83:0/882848152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2c005c00 msgr2=0x7f9f2c006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 --2- 172.21.15.83:0/882848152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2c005c00 0x7f9f2c006020 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f9f34001750 tx=0x7f9f3401c3e0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f437fe640 1 -- 172.21.15.83:0/882848152 reap_dead start 2024-03-30T13:11:39.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 -- 172.21.15.83:0/882848152 shutdown_connections 2024-03-30T13:11:39.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 -- 172.21.15.83:0/882848152 >> 172.21.15.83:0/882848152 conn(0x7f9f440b1d60 msgr2=0x7f9f440b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:39.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 -- 172.21.15.83:0/882848152 shutdown_connections 2024-03-30T13:11:39.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 -- 172.21.15.83:0/882848152 wait complete. 2024-03-30T13:11:39.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 Processor -- start 2024-03-30T13:11:39.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 -- start start 2024-03-30T13:11:39.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2c005c00 0x7f9f4414c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f44153b20 0x7f9f44153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f441509f0 0x7f9f44150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9f440b3870 con 0x7f9f2c005c00 2024-03-30T13:11:39.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4415fed0 con 0x7f9f44153b20 2024-03-30T13:11:39.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9f440b39f0 con 0x7f9f441509f0 2024-03-30T13:11:39.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f42ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2c005c00 0x7f9f4414c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f42ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2c005c00 0x7f9f4414c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59280/0 (socket says 172.21.15.83:59280) 2024-03-30T13:11:39.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f42ffd640 1 -- 172.21.15.83:0/3929978887 learned_addr learned my addr 172.21.15.83:0/3929978887 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:39.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f42ffd640 1 -- 172.21.15.83:0/3929978887 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f441509f0 msgr2=0x7f9f44150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f42ffd640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f441509f0 0x7f9f44150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f427fc640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f44153b20 0x7f9f44153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f42ffd640 1 -- 172.21.15.83:0/3929978887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f44153b20 msgr2=0x7f9f44153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f42ffd640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f44153b20 0x7f9f44153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f42ffd640 1 -- 172.21.15.83:0/3929978887 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f44154670 con 0x7f9f2c005c00 2024-03-30T13:11:39.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f42ffd640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2c005c00 0x7f9f4414c6c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f9f34001750 tx=0x7f9f2c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f2b7fe640 1 -- 172.21.15.83:0/3929978887 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f340ba020 con 0x7f9f2c005c00 2024-03-30T13:11:39.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f2b7fe640 1 -- 172.21.15.83:0/3929978887 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f34000ee0 con 0x7f9f2c005c00 2024-03-30T13:11:39.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 -- 172.21.15.83:0/3929978887 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f44154950 con 0x7f9f2c005c00 2024-03-30T13:11:39.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f2b7fe640 1 -- 172.21.15.83:0/3929978887 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34007a40 con 0x7f9f2c005c00 2024-03-30T13:11:39.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 -- 172.21.15.83:0/3929978887 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f44154f10 con 0x7f9f2c005c00 2024-03-30T13:11:39.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.416+0000 7f9f495ab640 1 -- 172.21.15.83:0/3929978887 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f440686c0 con 0x7f9f2c005c00 2024-03-30T13:11:39.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.420+0000 7f9f2b7fe640 1 -- 172.21.15.83:0/3929978887 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9f340bd070 con 0x7f9f2c005c00 2024-03-30T13:11:39.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.420+0000 7f9f2b7fe640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f30067fc0 0x7f9f3006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.420+0000 7f9f2b7fe640 1 -- 172.21.15.83:0/3929978887 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f9f3411f940 con 0x7f9f2c005c00 2024-03-30T13:11:39.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.420+0000 7f9f427fc640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f30067fc0 0x7f9f3006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.420+0000 7f9f427fc640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f30067fc0 0x7f9f3006a480 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9f38001210 tx=0x7f9f38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.424+0000 7f9f2b7fe640 1 -- 172.21.15.83:0/3929978887 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9f340160f0 con 0x7f9f2c005c00 2024-03-30T13:11:39.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.580+0000 7f9f495ab640 1 -- 172.21.15.83:0/3929978887 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f4406da70 con 0x7f9f30067fc0 2024-03-30T13:11:39.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f2b7fe640 1 -- 172.21.15.83:0/3929978887 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13426 (secure 0 0 0) 0x7f9f4406da70 con 0x7f9f30067fc0 2024-03-30T13:11:39.591 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:39.591 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:11:39.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f495ab640 1 -- 172.21.15.83:0/3929978887 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f30067fc0 msgr2=0x7f9f3006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f495ab640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f30067fc0 0x7f9f3006a480 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9f38001210 tx=0x7f9f38009040 comp rx=0 tx=0).stop 2024-03-30T13:11:39.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f495ab640 1 -- 172.21.15.83:0/3929978887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2c005c00 msgr2=0x7f9f4414c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f495ab640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2c005c00 0x7f9f4414c6c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f9f34001750 tx=0x7f9f2c007a50 comp rx=0 tx=0).stop 2024-03-30T13:11:39.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f495ab640 1 -- 172.21.15.83:0/3929978887 shutdown_connections 2024-03-30T13:11:39.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f495ab640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9f30067fc0 0x7f9f3006a480 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f495ab640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f441509f0 0x7f9f44150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f495ab640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f44153b20 0x7f9f44153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f495ab640 1 --2- 172.21.15.83:0/3929978887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f2c005c00 0x7f9f4414c6c0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f495ab640 1 -- 172.21.15.83:0/3929978887 >> 172.21.15.83:0/3929978887 conn(0x7f9f440b1d60 msgr2=0x7f9f440b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:39.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f495ab640 1 -- 172.21.15.83:0/3929978887 shutdown_connections 2024-03-30T13:11:39.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:39.584+0000 7f9f495ab640 1 -- 172.21.15.83:0/3929978887 wait complete. 2024-03-30T13:11:39.610 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-03-30T13:11:38.198695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":250056,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754724664,"statfs":{"total":773094113280,"available":772838055936,"internally_reserved":0,"allocated":4857856,"data_stored":2663208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-176538623,"num_objects":-116,"num_object_clones":0,"num_object_copies":-232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-116,"num_whiteouts":0,"num_read":-110,"num_read_kb":-23,"num_write":-909,"num_write_kb":-175158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001492"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":206,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-30T13:11:31.978415+0000","last_change":"2024-03-30T13:08:13.347295+0000","last_active":"2024-03-30T13:11:31.978415+0000","last_peered":"2024-03-30T13:11:31.978415+0000","last_clean":"2024-03-30T13:11:31.978415+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:11:31.978415+0000","last_undegraded":"2024-03-30T13:11:31.978415+0000","last_fullsized":"2024-03-30T13:11:31.978415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:08:11.180770+0000","last_clean_scrub_stamp":"2024-03-30T13:08:11.180770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:33.755920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":775677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":775677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31636,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31628,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:11:39.613 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-30T13:08:11.180770+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=30, tm_hour=13, tm_min=8, tm_sec=11, tm_wday=5, tm_yday=90, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=30, tm_hour=13, tm_min=11, tm_sec=34, tm_wday=5, tm_yday=90, tm_isdst=0) 2024-03-30T13:11:39.613 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-30T13:11:55.186 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:11:55.189 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:11:59.614 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:11:59.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.740+0000 7f6d77bdd640 1 Processor -- start 2024-03-30T13:11:59.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d77bdd640 1 -- start start 2024-03-30T13:11:59.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d77bdd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6d7015e7b0 0x7f6d700d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d77bdd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6d700cfe10 0x7f6d700d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d77bdd640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d700d3210 con 0x7f6d7015eb90 2024-03-30T13:11:59.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d77bdd640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f6d700cf100 con 0x7f6d700cfe10 2024-03-30T13:11:59.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d77bdd640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6d700d34f0 con 0x7f6d7015e7b0 2024-03-30T13:11:59.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d7617a640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6d700cfe10 0x7f6d700d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d7617a640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6d700cfe10 0x7f6d700d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57736/0 (socket says 172.21.15.83:57736) 2024-03-30T13:11:59.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d7617a640 1 -- 172.21.15.83:0/183921786 learned_addr learned my addr 172.21.15.83:0/183921786 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:59.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d75979640 1 --2- 172.21.15.83:0/183921786 >> v2:172.21.15.153:3300/0 conn(0x7f6d7015e7b0 0x7f6d700d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d7617a640 1 -- 172.21.15.83:0/183921786 >> v2:172.21.15.153:3300/0 conn(0x7f6d7015e7b0 msgr2=0x7f6d700d2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:59.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d7617a640 1 --2- 172.21.15.83:0/183921786 >> v2:172.21.15.153:3300/0 conn(0x7f6d7015e7b0 0x7f6d700d2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d7617a640 1 -- 172.21.15.83:0/183921786 >> v1:172.21.15.153:6789/0 conn(0x7f6d7015eb90 legacy=0x7f6d700d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:59.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d7617a640 1 -- 172.21.15.83:0/183921786 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d700cf330 con 0x7f6d700cfe10 2024-03-30T13:11:59.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.744+0000 7f6d7617a640 1 --2- 172.21.15.83:0/183921786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d700cfe10 0x7f6d700d0c20 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f6d7008c7c0 tx=0x7f6d6801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e42d745d37c631c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:59.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d74977640 1 -- 172.21.15.83:0/183921786 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d680a5840 con 0x7f6d700cfe10 2024-03-30T13:11:59.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d74977640 1 -- 172.21.15.83:0/183921786 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d680a59e0 con 0x7f6d700cfe10 2024-03-30T13:11:59.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d74977640 1 -- 172.21.15.83:0/183921786 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d680a5db0 con 0x7f6d700cfe10 2024-03-30T13:11:59.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 -- 172.21.15.83:0/183921786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d700cfe10 msgr2=0x7f6d700d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 --2- 172.21.15.83:0/183921786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d700cfe10 0x7f6d700d0c20 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f6d7008c7c0 tx=0x7f6d6801c980 comp rx=0 tx=0).stop 2024-03-30T13:11:59.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 -- 172.21.15.83:0/183921786 shutdown_connections 2024-03-30T13:11:59.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 --2- 172.21.15.83:0/183921786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d700cfe10 0x7f6d700d0c20 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 --2- 172.21.15.83:0/183921786 >> v2:172.21.15.153:3300/0 conn(0x7f6d7015e7b0 0x7f6d700d2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 -- 172.21.15.83:0/183921786 >> 172.21.15.83:0/183921786 conn(0x7f6d7008bfe0 msgr2=0x7f6d700d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:59.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 -- 172.21.15.83:0/183921786 shutdown_connections 2024-03-30T13:11:59.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 -- 172.21.15.83:0/183921786 wait complete. 2024-03-30T13:11:59.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 Processor -- start 2024-03-30T13:11:59.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 -- start start 2024-03-30T13:11:59.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d700cfe10 0x7f6d7014d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d7015e7b0 0x7f6d7014da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d7015eb90 0x7f6d700b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6d700d1570 con 0x7f6d700cfe10 2024-03-30T13:11:59.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6d700b1a70 con 0x7f6d7015eb90 2024-03-30T13:11:59.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d77bdd640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6d7016b7b0 con 0x7f6d7015e7b0 2024-03-30T13:11:59.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d75979640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d700cfe10 0x7f6d7014d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d75979640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d700cfe10 0x7f6d7014d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57740/0 (socket says 172.21.15.83:57740) 2024-03-30T13:11:59.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d75979640 1 -- 172.21.15.83:0/1746253670 learned_addr learned my addr 172.21.15.83:0/1746253670 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:11:59.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d75178640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d7015e7b0 0x7f6d7014da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.748+0000 7f6d7617a640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d7015eb90 0x7f6d700b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d75979640 1 -- 172.21.15.83:0/1746253670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d7015e7b0 msgr2=0x7f6d7014da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d75979640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d7015e7b0 0x7f6d7014da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d75979640 1 -- 172.21.15.83:0/1746253670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d7015eb90 msgr2=0x7f6d700b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d75979640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d7015eb90 0x7f6d700b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d75979640 1 -- 172.21.15.83:0/1746253670 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7014ebd0 con 0x7f6d700cfe10 2024-03-30T13:11:59.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d7617a640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d7015eb90 0x7f6d700b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:59.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d75979640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d700cfe10 0x7f6d7014d4d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00c820 tx=0x7f6d6c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:59.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d667fc640 1 -- 172.21.15.83:0/1746253670 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c015070 con 0x7f6d700cfe10 2024-03-30T13:11:59.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d667fc640 1 -- 172.21.15.83:0/1746253670 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d6c004020 con 0x7f6d700cfe10 2024-03-30T13:11:59.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d667fc640 1 -- 172.21.15.83:0/1746253670 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c004410 con 0x7f6d700cfe10 2024-03-30T13:11:59.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d77bdd640 1 -- 172.21.15.83:0/1746253670 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d7014eeb0 con 0x7f6d700cfe10 2024-03-30T13:11:59.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d77bdd640 1 -- 172.21.15.83:0/1746253670 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d70158400 con 0x7f6d700cfe10 2024-03-30T13:11:59.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d77bdd640 1 -- 172.21.15.83:0/1746253670 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d70158720 con 0x7f6d700cfe10 2024-03-30T13:11:59.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d667fc640 1 -- 172.21.15.83:0/1746253670 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6d6c007830 con 0x7f6d700cfe10 2024-03-30T13:11:59.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d667fc640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6d54067fc0 0x7f6d5406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d75178640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6d54067fc0 0x7f6d5406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d667fc640 1 -- 172.21.15.83:0/1746253670 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f6d6c086050 con 0x7f6d700cfe10 2024-03-30T13:11:59.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.752+0000 7f6d75178640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6d54067fc0 0x7f6d5406a480 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6d70169520 tx=0x7f6d60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:59.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.756+0000 7f6d667fc640 1 -- 172.21.15.83:0/1746253670 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6d6c056b00 con 0x7f6d700cfe10 2024-03-30T13:11:59.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.912+0000 7f6d77bdd640 1 -- 172.21.15.83:0/1746253670 --> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d700686c0 con 0x7f6d54067fc0 2024-03-30T13:11:59.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d667fc640 1 -- 172.21.15.83:0/1746253670 <== mgr.4104 v2:172.21.15.83:6832/1589047293 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13359 (secure 0 0 0) 0x7f6d700686c0 con 0x7f6d54067fc0 2024-03-30T13:11:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:11:59.919 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-03-30T13:11:59.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d77bdd640 1 -- 172.21.15.83:0/1746253670 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6d54067fc0 msgr2=0x7f6d5406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d77bdd640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6d54067fc0 0x7f6d5406a480 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6d70169520 tx=0x7f6d60008040 comp rx=0 tx=0).stop 2024-03-30T13:11:59.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d77bdd640 1 -- 172.21.15.83:0/1746253670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d700cfe10 msgr2=0x7f6d7014d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d77bdd640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d700cfe10 0x7f6d7014d4d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00c820 tx=0x7f6d6c00cce0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d77bdd640 1 -- 172.21.15.83:0/1746253670 shutdown_connections 2024-03-30T13:11:59.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d77bdd640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f6d54067fc0 0x7f6d5406a480 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d77bdd640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d7015eb90 0x7f6d700b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d77bdd640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d7015e7b0 0x7f6d7014da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d77bdd640 1 --2- 172.21.15.83:0/1746253670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d700cfe10 0x7f6d7014d4d0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d77bdd640 1 -- 172.21.15.83:0/1746253670 >> 172.21.15.83:0/1746253670 conn(0x7f6d7008bfe0 msgr2=0x7f6d700b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:59.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d77bdd640 1 -- 172.21.15.83:0/1746253670 shutdown_connections 2024-03-30T13:11:59.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:11:59.916+0000 7f6d77bdd640 1 -- 172.21.15.83:0/1746253670 wait complete. 2024-03-30T13:11:59.937 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-03-30T13:11:58.203670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":250040,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754724680,"statfs":{"total":773094113280,"available":772838072320,"internally_reserved":0,"allocated":4857856,"data_stored":2663208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003025"},"pg_stats":[{"pgid":"1.0","version":"40'119","reported_seq":217,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-30T13:11:39.633654+0000","last_change":"2024-03-30T13:11:39.633727+0000","last_active":"2024-03-30T13:11:39.633654+0000","last_peered":"2024-03-30T13:11:39.633654+0000","last_clean":"2024-03-30T13:11:39.633654+0000","last_became_active":"2024-03-30T13:08:13.344794+0000","last_became_peered":"2024-03-30T13:08:13.344794+0000","last_unstale":"2024-03-30T13:11:39.633654+0000","last_undegraded":"2024-03-30T13:11:39.633654+0000","last_fullsized":"2024-03-30T13:11:39.633654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'119","last_scrub_stamp":"2024-03-30T13:11:39.633478+0000","last_deep_scrub":"40'119","last_deep_scrub_stamp":"2024-03-30T13:11:39.633478+0000","last_clean_scrub_stamp":"2024-03-30T13:11:39.633478+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:02:17.119126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1052672,"data_stored":775677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509488,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1052672,"data_stored":775677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31636,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31628,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":458752,"data_stored":185309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:11:59.938 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-30T13:12:00.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c47355640 1 Processor -- start 2024-03-30T13:12:00.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c47355640 1 -- start start 2024-03-30T13:12:00.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c47355640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9c40155710 0x7f9c400b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c47355640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9c40155af0 0x7f9c400b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c47355640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c400b40d0 con 0x7f9c4015c2a0 2024-03-30T13:12:00.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c47355640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f9c400b43b0 con 0x7f9c40155af0 2024-03-30T13:12:00.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c47355640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9c400b4690 con 0x7f9c40155710 2024-03-30T13:12:00.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c448f0640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9c40155af0 0x7f9c400b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c448f0640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9c40155af0 0x7f9c400b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57748/0 (socket says 172.21.15.83:57748) 2024-03-30T13:12:00.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c448f0640 1 -- 172.21.15.83:0/3232530810 learned_addr learned my addr 172.21.15.83:0/3232530810 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:12:00.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c450f1640 1 --2- 172.21.15.83:0/3232530810 >> v2:172.21.15.153:3300/0 conn(0x7f9c40155710 0x7f9c400b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c448f0640 1 -- 172.21.15.83:0/3232530810 >> v2:172.21.15.153:3300/0 conn(0x7f9c40155710 msgr2=0x7f9c400b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:00.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c448f0640 1 --2- 172.21.15.83:0/3232530810 >> v2:172.21.15.153:3300/0 conn(0x7f9c40155710 0x7f9c400b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c448f0640 1 -- 172.21.15.83:0/3232530810 >> v1:172.21.15.153:6789/0 conn(0x7f9c4015c2a0 legacy=0x7f9c4006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:00.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.060+0000 7f9c448f0640 1 -- 172.21.15.83:0/3232530810 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c400b4970 con 0x7f9c40155af0 2024-03-30T13:12:00.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c448f0640 1 --2- 172.21.15.83:0/3232530810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c40155af0 0x7f9c400b4f30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f9c400d09a0 tx=0x7f9c3001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674b4d4a6453293c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:00.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c37fff640 1 -- 172.21.15.83:0/3232530810 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c300b2070 con 0x7f9c40155af0 2024-03-30T13:12:00.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c37fff640 1 -- 172.21.15.83:0/3232530810 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c300ad640 con 0x7f9c40155af0 2024-03-30T13:12:00.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c37fff640 1 -- 172.21.15.83:0/3232530810 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c300ada10 con 0x7f9c40155af0 2024-03-30T13:12:00.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 -- 172.21.15.83:0/3232530810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c40155af0 msgr2=0x7f9c400b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 --2- 172.21.15.83:0/3232530810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c40155af0 0x7f9c400b4f30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f9c400d09a0 tx=0x7f9c3001c4e0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 -- 172.21.15.83:0/3232530810 shutdown_connections 2024-03-30T13:12:00.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 --2- 172.21.15.83:0/3232530810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c40155af0 0x7f9c400b4f30 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 --2- 172.21.15.83:0/3232530810 >> v2:172.21.15.153:3300/0 conn(0x7f9c40155710 0x7f9c400b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 -- 172.21.15.83:0/3232530810 >> 172.21.15.83:0/3232530810 conn(0x7f9c40072ec0 msgr2=0x7f9c4006b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:00.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 -- 172.21.15.83:0/3232530810 shutdown_connections 2024-03-30T13:12:00.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 -- 172.21.15.83:0/3232530810 wait complete. 2024-03-30T13:12:00.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 Processor -- start 2024-03-30T13:12:00.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 -- start start 2024-03-30T13:12:00.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c40155710 0x7f9c40143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c4015c2a0 0x7f9c400a9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c40158a70 0x7f9c4006b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9c400d0350 con 0x7f9c4015c2a0 2024-03-30T13:12:00.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4006fb70 con 0x7f9c40155710 2024-03-30T13:12:00.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c47355640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9c400d04d0 con 0x7f9c40158a70 2024-03-30T13:12:00.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c448f0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c4015c2a0 0x7f9c400a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c448f0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c4015c2a0 0x7f9c400a9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57752/0 (socket says 172.21.15.83:57752) 2024-03-30T13:12:00.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c448f0640 1 -- 172.21.15.83:0/496678126 learned_addr learned my addr 172.21.15.83:0/496678126 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:12:00.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c450f1640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c40155710 0x7f9c40143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c458f2640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c40158a70 0x7f9c4006b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c448f0640 1 -- 172.21.15.83:0/496678126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c40158a70 msgr2=0x7f9c4006b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c448f0640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c40158a70 0x7f9c4006b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c448f0640 1 -- 172.21.15.83:0/496678126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c40155710 msgr2=0x7f9c40143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c448f0640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c40155710 0x7f9c40143340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c448f0640 1 -- 172.21.15.83:0/496678126 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c400aa0f0 con 0x7f9c4015c2a0 2024-03-30T13:12:00.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c450f1640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c40155710 0x7f9c40143340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:00.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.064+0000 7f9c448f0640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c4015c2a0 0x7f9c400a9980 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f9c30000c10 tx=0x7f9c30019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:00.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.068+0000 7f9c35ffb640 1 -- 172.21.15.83:0/496678126 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c300bd070 con 0x7f9c4015c2a0 2024-03-30T13:12:00.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.068+0000 7f9c35ffb640 1 -- 172.21.15.83:0/496678126 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c300b6750 con 0x7f9c4015c2a0 2024-03-30T13:12:00.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.068+0000 7f9c47355640 1 -- 172.21.15.83:0/496678126 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c400aa3d0 con 0x7f9c4015c2a0 2024-03-30T13:12:00.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.068+0000 7f9c35ffb640 1 -- 172.21.15.83:0/496678126 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c300b2070 con 0x7f9c4015c2a0 2024-03-30T13:12:00.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.068+0000 7f9c47355640 1 -- 172.21.15.83:0/496678126 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c400aa990 con 0x7f9c4015c2a0 2024-03-30T13:12:00.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.068+0000 7f9c47355640 1 -- 172.21.15.83:0/496678126 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c40073790 con 0x7f9c4015c2a0 2024-03-30T13:12:00.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.068+0000 7f9c35ffb640 1 -- 172.21.15.83:0/496678126 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9c300c0070 con 0x7f9c4015c2a0 2024-03-30T13:12:00.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.068+0000 7f9c35ffb640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9c24067fc0 0x7f9c2406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.068+0000 7f9c35ffb640 1 -- 172.21.15.83:0/496678126 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f9c30120780 con 0x7f9c4015c2a0 2024-03-30T13:12:00.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.068+0000 7f9c450f1640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9c24067fc0 0x7f9c2406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.068+0000 7f9c450f1640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9c24067fc0 0x7f9c2406a480 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c007a70 tx=0x7f9c3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:00.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.072+0000 7f9c35ffb640 1 -- 172.21.15.83:0/496678126 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9c300c7070 con 0x7f9c4015c2a0 2024-03-30T13:12:00.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.232+0000 7f9c47355640 1 -- 172.21.15.83:0/496678126 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f9c400a9760 con 0x7f9c4015c2a0 2024-03-30T13:12:00.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c35ffb640 1 -- 172.21.15.83:0/496678126 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f9c300160d0 con 0x7f9c4015c2a0 2024-03-30T13:12:00.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c35ffb640 1 -- 172.21.15.83:0/496678126 <== mon.0 v2:172.21.15.83:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9c300f1310 con 0x7f9c4015c2a0 2024-03-30T13:12:00.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c47355640 1 -- 172.21.15.83:0/496678126 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9c24067fc0 msgr2=0x7f9c2406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c47355640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9c24067fc0 0x7f9c2406a480 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c007a70 tx=0x7f9c3c008040 comp rx=0 tx=0).stop 2024-03-30T13:12:00.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c47355640 1 -- 172.21.15.83:0/496678126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c4015c2a0 msgr2=0x7f9c400a9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c47355640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c4015c2a0 0x7f9c400a9980 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f9c30000c10 tx=0x7f9c30019280 comp rx=0 tx=0).stop 2024-03-30T13:12:00.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c47355640 1 -- 172.21.15.83:0/496678126 shutdown_connections 2024-03-30T13:12:00.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c47355640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7f9c24067fc0 0x7f9c2406a480 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c47355640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c40158a70 0x7f9c4006b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c47355640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c4015c2a0 0x7f9c400a9980 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c47355640 1 --2- 172.21.15.83:0/496678126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c40155710 0x7f9c40143340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c47355640 1 -- 172.21.15.83:0/496678126 >> 172.21.15.83:0/496678126 conn(0x7f9c40072ec0 msgr2=0x7f9c400b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:00.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c47355640 1 -- 172.21.15.83:0/496678126 shutdown_connections 2024-03-30T13:12:00.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.236+0000 7f9c47355640 1 -- 172.21.15.83:0/496678126 wait complete. 2024-03-30T13:12:00.257 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T13:12:00.258 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:12:00.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.364+0000 7faf8f4b4640 1 Processor -- start 2024-03-30T13:12:00.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.364+0000 7faf8f4b4640 1 -- start start 2024-03-30T13:12:00.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8f4b4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faf8815c460 0x7faf8806b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8f4b4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faf8809aa50 0x7faf8806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8f4b4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf880ae380 con 0x7faf8815fec0 2024-03-30T13:12:00.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8f4b4640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7faf8815c840 con 0x7faf8815c460 2024-03-30T13:12:00.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8f4b4640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7faf880b0310 con 0x7faf8809aa50 2024-03-30T13:12:00.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8d250640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faf8815c460 0x7faf8806b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8d250640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faf8815c460 0x7faf8806b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57764/0 (socket says 172.21.15.83:57764) 2024-03-30T13:12:00.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8d250640 1 -- 172.21.15.83:0/2914387286 learned_addr learned my addr 172.21.15.83:0/2914387286 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:12:00.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8ca4f640 1 --2- 172.21.15.83:0/2914387286 >> v2:172.21.15.153:3300/0 conn(0x7faf8809aa50 0x7faf8806bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8d250640 1 -- 172.21.15.83:0/2914387286 >> v2:172.21.15.153:3300/0 conn(0x7faf8809aa50 msgr2=0x7faf8806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:00.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8d250640 1 --2- 172.21.15.83:0/2914387286 >> v2:172.21.15.153:3300/0 conn(0x7faf8809aa50 0x7faf8806bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8d250640 1 -- 172.21.15.83:0/2914387286 >> v1:172.21.15.153:6789/0 conn(0x7faf8815fec0 legacy=0x7faf88160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8d250640 1 -- 172.21.15.83:0/2914387286 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf880b38e0 con 0x7faf8815c460 2024-03-30T13:12:00.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.368+0000 7faf8d250640 1 --2- 172.21.15.83:0/2914387286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf8815c460 0x7faf8806b660 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7faf880b0490 tx=0x7faf8401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6f3012bdc01ae9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:00.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf7ffff640 1 -- 172.21.15.83:0/2914387286 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840ab660 con 0x7faf8815c460 2024-03-30T13:12:00.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf7ffff640 1 -- 172.21.15.83:0/2914387286 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faf840b0070 con 0x7faf8815c460 2024-03-30T13:12:00.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf7ffff640 1 -- 172.21.15.83:0/2914387286 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840aba40 con 0x7faf8815c460 2024-03-30T13:12:00.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 -- 172.21.15.83:0/2914387286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf8815c460 msgr2=0x7faf8806b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 --2- 172.21.15.83:0/2914387286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf8815c460 0x7faf8806b660 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7faf880b0490 tx=0x7faf8401c460 comp rx=0 tx=0).stop 2024-03-30T13:12:00.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 -- 172.21.15.83:0/2914387286 shutdown_connections 2024-03-30T13:12:00.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 --2- 172.21.15.83:0/2914387286 >> v2:172.21.15.153:3300/0 conn(0x7faf8809aa50 0x7faf8806bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 --2- 172.21.15.83:0/2914387286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf8815c460 0x7faf8806b660 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 -- 172.21.15.83:0/2914387286 >> 172.21.15.83:0/2914387286 conn(0x7faf880b68c0 msgr2=0x7faf880b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:00.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 -- 172.21.15.83:0/2914387286 shutdown_connections 2024-03-30T13:12:00.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 -- 172.21.15.83:0/2914387286 wait complete. 2024-03-30T13:12:00.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 Processor -- start 2024-03-30T13:12:00.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 -- start start 2024-03-30T13:12:00.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf8809aa50 0x7faf8813e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf8815c460 0x7faf8815e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf8815fec0 0x7faf8815e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7faf88073010 con 0x7faf8809aa50 2024-03-30T13:12:00.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf880b3590 con 0x7faf8815c460 2024-03-30T13:12:00.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faf88073190 con 0x7faf8815fec0 2024-03-30T13:12:00.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8d250640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf8809aa50 0x7faf8813e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8d250640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf8809aa50 0x7faf8813e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57766/0 (socket says 172.21.15.83:57766) 2024-03-30T13:12:00.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8d250640 1 -- 172.21.15.83:0/1418765015 learned_addr learned my addr 172.21.15.83:0/1418765015 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-03-30T13:12:00.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8ca4f640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf8815c460 0x7faf8815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8d250640 1 -- 172.21.15.83:0/1418765015 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf8815fec0 msgr2=0x7faf8815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8da51640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf8815fec0 0x7faf8815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8d250640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf8815fec0 0x7faf8815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8d250640 1 -- 172.21.15.83:0/1418765015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf8815c460 msgr2=0x7faf8815e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8d250640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf8815c460 0x7faf8815e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8d250640 1 -- 172.21.15.83:0/1418765015 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf881f5910 con 0x7faf8809aa50 2024-03-30T13:12:00.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8ca4f640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf8815c460 0x7faf8815e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:00.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8da51640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf8815fec0 0x7faf8815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:00.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8d250640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf8809aa50 0x7faf8813e8f0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7faf84019070 tx=0x7faf8401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:00.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf7dffb640 1 -- 172.21.15.83:0/1418765015 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840b4800 con 0x7faf8809aa50 2024-03-30T13:12:00.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf7dffb640 1 -- 172.21.15.83:0/1418765015 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faf840abe50 con 0x7faf8809aa50 2024-03-30T13:12:00.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 -- 172.21.15.83:0/1418765015 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf88154160 con 0x7faf8809aa50 2024-03-30T13:12:00.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf7dffb640 1 -- 172.21.15.83:0/1418765015 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840b4c20 con 0x7faf8809aa50 2024-03-30T13:12:00.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.372+0000 7faf8f4b4640 1 -- 172.21.15.83:0/1418765015 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf88154720 con 0x7faf8809aa50 2024-03-30T13:12:00.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.376+0000 7faf8f4b4640 1 -- 172.21.15.83:0/1418765015 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf881560a0 con 0x7faf8809aa50 2024-03-30T13:12:00.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.376+0000 7faf7dffb640 1 -- 172.21.15.83:0/1418765015 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7faf840c7390 con 0x7faf8809aa50 2024-03-30T13:12:00.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.376+0000 7faf7dffb640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faf6c067fc0 0x7faf6c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.376+0000 7faf7dffb640 1 -- 172.21.15.83:0/1418765015 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7faf84120c30 con 0x7faf8809aa50 2024-03-30T13:12:00.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.376+0000 7faf8ca4f640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faf6c067fc0 0x7faf6c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.376+0000 7faf8ca4f640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faf6c067fc0 0x7faf6c06a480 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faf88153f50 tx=0x7faf78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:00.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.380+0000 7faf7dffb640 1 -- 172.21.15.83:0/1418765015 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7faf881560a0 con 0x7faf8809aa50 2024-03-30T13:12:00.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 -- 172.21.15.83:0/1418765015 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf88068dd0 con 0x7faf8809aa50 2024-03-30T13:12:00.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf7dffb640 1 -- 172.21.15.83:0/1418765015 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+3869 (secure 0 0 0) 0x7faf840c4060 con 0x7faf8809aa50 2024-03-30T13:12:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-03-30T13:12:00.575 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2103427036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2103427036},{"type":"v1","addr":"172.21.15.153:6833","nonce":2103427036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/718325648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":718325648},{"type":"v1","addr":"172.21.15.153:6835","nonce":718325648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2547254149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2547254149},{"type":"v1","addr":"172.21.15.83:6836","nonce":2547254149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":6555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/323229716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":323229716},{"type":"v1","addr":"172.21.15.83:6837","nonce":323229716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[]} 2024-03-30T13:12:00.575 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-03-30T13:12:00.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 -- 172.21.15.83:0/1418765015 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faf6c067fc0 msgr2=0x7faf6c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faf6c067fc0 0x7faf6c06a480 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faf88153f50 tx=0x7faf78008040 comp rx=0 tx=0).stop 2024-03-30T13:12:00.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 -- 172.21.15.83:0/1418765015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf8809aa50 msgr2=0x7faf8813e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf8809aa50 0x7faf8813e8f0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7faf84019070 tx=0x7faf8401aca0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 -- 172.21.15.83:0/1418765015 shutdown_connections 2024-03-30T13:12:00.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.83:6832/1589047293,v1:172.21.15.83:6833/1589047293] conn(0x7faf6c067fc0 0x7faf6c06a480 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf8815fec0 0x7faf8815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf8815c460 0x7faf8815e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 --2- 172.21.15.83:0/1418765015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf8809aa50 0x7faf8813e8f0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 -- 172.21.15.83:0/1418765015 >> 172.21.15.83:0/1418765015 conn(0x7faf880b68c0 msgr2=0x7faf880d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:00.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 -- 172.21.15.83:0/1418765015 shutdown_connections 2024-03-30T13:12:00.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-03-30T13:12:00.572+0000 7faf8f4b4640 1 -- 172.21.15.83:0/1418765015 wait complete. 2024-03-30T13:12:00.592 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-30T13:12:00.592 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-30T13:12:00.593 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-30T13:12:00.593 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:00.602 INFO:tasks.ceph.mds.a:Stopped 2024-03-30T13:12:00.602 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-30T13:12:00.602 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:00.655 INFO:tasks.ceph.mds.c:Stopped 2024-03-30T13:12:00.656 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-30T13:12:00.656 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:00.674 INFO:tasks.ceph.mds.b:Stopped 2024-03-30T13:12:00.675 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-30T13:12:00.675 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:00.731 INFO:tasks.ceph.mds.d:Stopped 2024-03-30T13:12:00.731 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-30T13:12:00.731 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-30T13:12:00.732 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:00.807 INFO:tasks.ceph.osd.0:Stopped 2024-03-30T13:12:00.808 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-30T13:12:00.808 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:00.888 INFO:tasks.ceph.osd.1:Stopped 2024-03-30T13:12:00.888 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-30T13:12:00.889 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:03.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-30T13:12:06.990 INFO:tasks.ceph.osd.2:Stopped 2024-03-30T13:12:06.991 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-30T13:12:06.991 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:07.056 INFO:tasks.ceph.osd.3:Stopped 2024-03-30T13:12:07.056 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-30T13:12:07.057 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:07.128 INFO:tasks.ceph.osd.4:Stopped 2024-03-30T13:12:07.129 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-30T13:12:07.129 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:07.230 INFO:tasks.ceph.osd.5:Stopped 2024-03-30T13:12:07.230 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-30T13:12:07.230 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:07.305 INFO:tasks.ceph.osd.6:Stopped 2024-03-30T13:12:07.306 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-30T13:12:07.306 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:08.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-30T13:12:08.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-30T13:12:13.408 INFO:tasks.ceph.osd.7:Stopped 2024-03-30T13:12:13.408 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-30T13:12:13.408 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-30T13:12:13.409 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:13.438 INFO:tasks.ceph.mgr.y:Stopped 2024-03-30T13:12:13.439 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-30T13:12:13.439 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:13.467 INFO:tasks.ceph.mgr.x:Stopped 2024-03-30T13:12:13.467 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-30T13:12:13.467 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-30T13:12:13.467 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:13.496 INFO:tasks.ceph.mon.a:Stopped 2024-03-30T13:12:13.496 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-30T13:12:13.496 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:13.526 INFO:tasks.ceph.mon.b:Stopped 2024-03-30T13:12:13.526 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-30T13:12:13.526 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:12:13.586 INFO:tasks.ceph.mon.c:Stopped 2024-03-30T13:12:13.587 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-30T13:12:13.587 DEBUG:teuthology.orchestra.run.smithi083:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-03-30T13:12:13.604 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:12:13.604 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-30T13:12:13.715 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-30T13:12:13.955 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:12:13.955 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-30T13:12:14.213 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:12:14.213 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-30T13:12:14.413 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:12:14.414 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-30T13:12:14.613 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:12:14.614 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-30T13:12:15.038 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:12:15.038 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-30T13:12:15.239 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:12:15.239 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-30T13:12:15.423 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:12:15.423 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-30T13:12:15.590 INFO:tasks.ceph:Archiving mon data... 2024-03-30T13:12:15.592 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144/data/mon.a.tgz 2024-03-30T13:12:15.592 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-03-30T13:12:15.598 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.CYtH8JeZSR 2024-03-30T13:12:15.598 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.CYtH8JeZSR 2024-03-30T13:12:15.718 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.CYtH8JeZSR 2024-03-30T13:12:15.783 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.CYtH8JeZSR is 326KB 2024-03-30T13:12:15.844 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.CYtH8JeZSR 2024-03-30T13:12:15.850 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144/data/mon.b.tgz 2024-03-30T13:12:15.850 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-03-30T13:12:15.856 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.ahoDhespa2 2024-03-30T13:12:15.856 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ahoDhespa2 2024-03-30T13:12:16.002 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.ahoDhespa2 2024-03-30T13:12:16.066 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.ahoDhespa2 is 431KB 2024-03-30T13:12:16.166 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.ahoDhespa2 2024-03-30T13:12:16.171 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144/data/mon.c.tgz 2024-03-30T13:12:16.171 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-03-30T13:12:16.221 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.sXYJufnsd6 2024-03-30T13:12:16.221 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.sXYJufnsd6 2024-03-30T13:12:16.367 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.sXYJufnsd6 2024-03-30T13:12:16.427 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.sXYJufnsd6 is 431KB 2024-03-30T13:12:16.494 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.sXYJufnsd6 2024-03-30T13:12:16.500 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-30T13:12:16.501 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-30T13:12:16.503 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-30T13:12:16.562 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-30T13:12:16.604 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-30T13:12:16.605 INFO:tasks.ceph:Archiving crash dumps... 2024-03-30T13:12:16.606 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144/remote/smithi083/crash 2024-03-30T13:12:16.607 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-30T13:12:16.620 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144/remote/smithi153/crash 2024-03-30T13:12:16.621 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-30T13:12:16.660 INFO:tasks.ceph:Shutting down logrotate 2024-03-30T13:12:16.660 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:16.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:16.746 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:16.759 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:16.797 INFO:tasks.ceph:Compressing logs... 2024-03-30T13:12:16.797 DEBUG:teuthology.orchestra.run.smithi083:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-30T13:12:16.803 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-30T13:12:16.826 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41989.log 2024-03-30T13:12:16.827 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36705.log 2024-03-30T13:12:16.827 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27764.log 2024-03-30T13:12:16.827 INFO:teuthology.orchestra.run.smithi083.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41989.log.gz 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35202.log 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi083.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36705.log.gz 2024-03-30T13:12:16.831 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.27764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37324.log 2024-03-30T13:12:16.831 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38343.log 2024-03-30T13:12:16.831 INFO:teuthology.orchestra.run.smithi083.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27764.log.gz 2024-03-30T13:12:16.831 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37324.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35202.log.gz 2024-03-30T13:12:16.831 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38049.log 2024-03-30T13:12:16.831 INFO:teuthology.orchestra.run.smithi083.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37324.log.gz 2024-03-30T13:12:16.831 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36255.log 2024-03-30T13:12:16.832 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38049.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-30T13:12:16.832 INFO:teuthology.orchestra.run.smithi083.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38343.log.gz 2024-03-30T13:12:16.832 INFO:teuthology.orchestra.run.smithi083.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38049.log.gz 2024-03-30T13:12:16.832 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35066.log 2024-03-30T13:12:16.832 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36255.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37681.log 2024-03-30T13:12:16.832 INFO:teuthology.orchestra.run.smithi083.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36255.log.gz 2024-03-30T13:12:16.832 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.2.35066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41302.log 2024-03-30T13:12:16.832 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41328.log 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi083.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37681.log.gz 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36679.log 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi083.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.2.35066.log.gz 2024-03-30T13:12:16.838 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41328.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41302.log.gz 2024-03-30T13:12:16.838 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34348.log 2024-03-30T13:12:16.838 INFO:teuthology.orchestra.run.smithi083.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41328.log.gz 2024-03-30T13:12:16.838 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40901.log 2024-03-30T13:12:16.838 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41807.log 2024-03-30T13:12:16.838 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34348.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36679.log.gz 2024-03-30T13:12:16.838 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40901.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.34348.log.gz -5 2024-03-30T13:12:16.838 INFO:teuthology.orchestra.run.smithi083.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33198.log 2024-03-30T13:12:16.839 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40901.log.gz 2024-03-30T13:12:16.839 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27652.log 2024-03-30T13:12:16.839 INFO:teuthology.orchestra.run.smithi083.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41807.log.gz 2024-03-30T13:12:16.839 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36549.log 2024-03-30T13:12:16.839 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33198.log: /var/log/ceph/ceph-client.admin.27652.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-30T13:12:16.839 INFO:teuthology.orchestra.run.smithi083.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33198.log.gz 2024-03-30T13:12:16.839 INFO:teuthology.orchestra.run.smithi083.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27652.log.gz 2024-03-30T13:12:16.839 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34712.log 2024-03-30T13:12:16.839 INFO:teuthology.orchestra.run.smithi083.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36549.log.gz 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5/var/log/ceph/ceph-osd.0.log: --verbose -- /var/log/ceph/ceph-client.admin.36125.log 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34921.log 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi083.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34712.log.gz 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33360.log 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40655.log 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi083.stderr: 88.8%/var/log/ceph/ceph-client.0.34921.log: -- replaced with /var/log/ceph/ceph-client.admin.36125.log.gz 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36151.log 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi083.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33360.log.gz 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33278.log 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi083.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.34921.log.gz 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33750.log 2024-03-30T13:12:16.855 INFO:teuthology.orchestra.run.smithi083.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36151.log.gz 2024-03-30T13:12:16.855 INFO:teuthology.orchestra.run.smithi083.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40655.log.gz 2024-03-30T13:12:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39343.log 2024-03-30T13:12:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33278.log: /var/log/ceph/ceph-client.admin.33750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40455.log 2024-03-30T13:12:16.855 INFO:teuthology.orchestra.run.smithi083.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33278.log.gz 2024-03-30T13:12:16.856 INFO:teuthology.orchestra.run.smithi083.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33750.log.gz 2024-03-30T13:12:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40927.log 2024-03-30T13:12:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36203.log 2024-03-30T13:12:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40455.log: /var/log/ceph/ceph-client.admin.40927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39393.log 2024-03-30T13:12:16.856 INFO:teuthology.orchestra.run.smithi083.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40927.log.gz 2024-03-30T13:12:16.856 INFO:teuthology.orchestra.run.smithi083.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.39343.log.gz 2024-03-30T13:12:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34608.log 2024-03-30T13:12:16.856 INFO:teuthology.orchestra.run.smithi083.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40455.log.gz 2024-03-30T13:12:16.857 INFO:teuthology.orchestra.run.smithi083.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36203.log.gz 2024-03-30T13:12:16.857 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32929.log 2024-03-30T13:12:16.857 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39393.log: /var/log/ceph/ceph-client.admin.34608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36229.log 2024-03-30T13:12:16.857 INFO:teuthology.orchestra.run.smithi083.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34608.log.gz 2024-03-30T13:12:16.857 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40105.log 2024-03-30T13:12:16.857 INFO:teuthology.orchestra.run.smithi083.stderr: 91.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.39393.log.gz 2024-03-30T13:12:16.857 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42041.log 2024-03-30T13:12:16.857 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36229.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32929.log.gz 2024-03-30T13:12:16.857 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41354.log 2024-03-30T13:12:16.858 INFO:teuthology.orchestra.run.smithi083.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36229.log.gz 2024-03-30T13:12:16.858 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39582.log 2024-03-30T13:12:16.858 INFO:teuthology.orchestra.run.smithi083.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40105.log.gz 2024-03-30T13:12:16.858 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41354.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42041.log.gz 2024-03-30T13:12:16.858 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41859.log 2024-03-30T13:12:16.858 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39582.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41354.log.gz 2024-03-30T13:12:16.858 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38943.log 2024-03-30T13:12:16.858 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41859.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.39582.log.gz 2024-03-30T13:12:16.859 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36627.log 2024-03-30T13:12:16.859 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33334.log 2024-03-30T13:12:16.859 INFO:teuthology.orchestra.run.smithi083.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41859.log.gz 2024-03-30T13:12:16.859 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32995.log 2024-03-30T13:12:16.859 INFO:teuthology.orchestra.run.smithi083.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36627.log.gz 2024-03-30T13:12:16.859 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33334.log: 91.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.38943.log.gz 2024-03-30T13:12:16.859 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33386.log 2024-03-30T13:12:16.859 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32995.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33334.log.gz 2024-03-30T13:12:16.859 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22734.log 2024-03-30T13:12:16.860 INFO:teuthology.orchestra.run.smithi083.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32995.log.gz 2024-03-30T13:12:16.860 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37651.log 2024-03-30T13:12:16.860 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33386.log: /var/log/ceph/ceph.tmp-client.admin.22734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35436.log 2024-03-30T13:12:16.860 INFO:teuthology.orchestra.run.smithi083.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33386.log.gz 2024-03-30T13:12:16.860 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22734.log.gz 2024-03-30T13:12:16.860 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35488.log 2024-03-30T13:12:16.860 INFO:teuthology.orchestra.run.smithi083.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37651.log.gz 2024-03-30T13:12:16.860 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41144.log 2024-03-30T13:12:16.861 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35488.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35436.log.gz 2024-03-30T13:12:16.861 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40806.log 2024-03-30T13:12:16.861 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35488.log.gz 2024-03-30T13:12:16.861 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36099.log 2024-03-30T13:12:16.861 INFO:teuthology.orchestra.run.smithi083.stderr: 88.8%/var/log/ceph/ceph-client.admin.40806.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.41144.log.gz 2024-03-30T13:12:16.861 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35306.log 2024-03-30T13:12:16.861 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36099.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40806.log.gz 2024-03-30T13:12:16.861 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-30T13:12:16.861 INFO:teuthology.orchestra.run.smithi083.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36099.log.gz 2024-03-30T13:12:16.862 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36575.log 2024-03-30T13:12:16.862 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35306.log.gz 2024-03-30T13:12:16.862 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33412.log 2024-03-30T13:12:16.862 INFO:teuthology.orchestra.run.smithi083.stderr:gzip/var/log/ceph/ceph-client.admin.36575.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36966.log 2024-03-30T13:12:16.862 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33412.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36575.log.gz 2024-03-30T13:12:16.862 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41250.log 2024-03-30T13:12:16.862 INFO:teuthology.orchestra.run.smithi083.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33412.log.gz 2024-03-30T13:12:16.862 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35886.log/var/log/ceph/ceph-client.admin.36966.log: 2024-03-30T13:12:16.863 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41833.log 2024-03-30T13:12:16.863 INFO:teuthology.orchestra.run.smithi083.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36966.log.gz 2024-03-30T13:12:16.863 INFO:teuthology.orchestra.run.smithi083.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41250.log.gz 2024-03-30T13:12:16.863 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36861.log 2024-03-30T13:12:16.863 INFO:teuthology.orchestra.run.smithi083.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35886.log.gz 2024-03-30T13:12:16.863 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33119.log 2024-03-30T13:12:16.863 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36861.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41833.log.gz 2024-03-30T13:12:16.863 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41118.log 2024-03-30T13:12:16.863 INFO:teuthology.orchestra.run.smithi083.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36861.log.gz 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi083.stderr:gzip/var/log/ceph/ceph-client.admin.33119.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33953.log 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35384.log 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi083.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33119.log.gz 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33953.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41118.log.gz 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40605.log 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi083.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33953.log.gz 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34556.log 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37180.log 2024-03-30T13:12:16.865 INFO:teuthology.orchestra.run.smithi083.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35384.log.gz 2024-03-30T13:12:16.865 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34504.log 2024-03-30T13:12:16.896 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32899.log 2024-03-30T13:12:16.896 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27807.log 2024-03-30T13:12:16.896 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.1.32899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27783.log 2024-03-30T13:12:16.896 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.27807.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-30T13:12:16.896 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-30T13:12:16.896 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.27783.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27807.log.gz 2024-03-30T13:12:16.896 INFO:teuthology.orchestra.run.smithi153.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.1.32899.log.gz 2024-03-30T13:12:16.897 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33195.log 2024-03-30T13:12:16.897 INFO:teuthology.orchestra.run.smithi153.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27783.log.gz 2024-03-30T13:12:16.897 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-30T13:12:16.897 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.1.33195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27711.log 2024-03-30T13:12:16.897 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27639.log 2024-03-30T13:12:16.897 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.27711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27759.log 2024-03-30T13:12:16.897 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27711.log.gz 2024-03-30T13:12:16.897 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.27639.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-30T13:12:16.897 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.27759.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27639.log.gz 2024-03-30T13:12:16.898 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-30T13:12:16.898 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27759.log.gz 2024-03-30T13:12:16.898 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27663.log 2024-03-30T13:12:16.898 INFO:teuthology.orchestra.run.smithi153.stderr:gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27687.log 2024-03-30T13:12:16.898 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.27663.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-30T13:12:16.898 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27663.log.gz 2024-03-30T13:12:16.898 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.27687.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-30T13:12:16.898 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.c.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27687.log.gz 2024-03-30T13:12:16.899 INFO:teuthology.orchestra.run.smithi153.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-30T13:12:16.899 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-30T13:12:16.899 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27735.log 2024-03-30T13:12:16.899 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.d.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-30T13:12:16.899 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33018.log 2024-03-30T13:12:16.899 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.27735.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-30T13:12:16.899 INFO:teuthology.orchestra.run.smithi153.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27735.log.gz 2024-03-30T13:12:16.899 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-30T13:12:16.899 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.3.33018.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-30T13:12:16.900 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.b.log: 90.7% -- replaced with /var/log/ceph/ceph-client.3.33018.log.gz 2024-03-30T13:12:16.900 INFO:teuthology.orchestra.run.smithi153.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-30T13:12:16.900 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-30T13:12:16.903 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 93.6% -- replaced with /var/log/ceph/ceph-client.1.33195.log.gz 2024-03-30T13:12:16.909 INFO:teuthology.orchestra.run.smithi153.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-30T13:12:16.923 INFO:teuthology.orchestra.run.smithi083.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40605.log.gz 2024-03-30T13:12:16.923 INFO:teuthology.orchestra.run.smithi083.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34556.log.gz 2024-03-30T13:12:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34634.log 2024-03-30T13:12:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:gzip/var/log/ceph/ceph-client.admin.34504.log: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-30T13:12:16.923 INFO:teuthology.orchestra.run.smithi083.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37180.log.gz 2024-03-30T13:12:16.924 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34634.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41781.log 2024-03-30T13:12:16.924 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34504.log.gz 2024-03-30T13:12:16.924 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mon.a.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34634.log.gz 2024-03-30T13:12:16.924 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34161.log 2024-03-30T13:12:16.924 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36940.log 2024-03-30T13:12:16.924 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34161.log: gzip -5 88.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.41781.log.gz /var/log/ceph/ceph-client.admin.40705.log 2024-03-30T13:12:16.924 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-03-30T13:12:16.924 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36940.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34161.log.gz 2024-03-30T13:12:16.925 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34793.log 2024-03-30T13:12:16.925 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40705.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36940.log.gz 2024-03-30T13:12:16.925 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36387.log 2024-03-30T13:12:16.925 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34582.log 2024-03-30T13:12:16.925 INFO:teuthology.orchestra.run.smithi083.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40705.log.gz/var/log/ceph/ceph-client.admin.36387.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34793.log.gz 2024-03-30T13:12:16.925 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-03-30T13:12:16.925 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33250.log 2024-03-30T13:12:16.925 INFO:teuthology.orchestra.run.smithi083.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36387.log.gz 2024-03-30T13:12:16.926 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35644.log 2024-03-30T13:12:16.926 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34582.log: /var/log/ceph/ceph-client.admin.33250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35592.log 2024-03-30T13:12:16.926 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34162.log 2024-03-30T13:12:16.926 INFO:teuthology.orchestra.run.smithi083.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33250.log.gz 2024-03-30T13:12:16.926 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34582.log.gz 2024-03-30T13:12:16.926 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35592.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35644.log.gz 2024-03-30T13:12:16.926 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39293.log 2024-03-30T13:12:16.926 INFO:teuthology.orchestra.run.smithi083.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35592.log.gz 2024-03-30T13:12:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38220.log 2024-03-30T13:12:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34162.log: /var/log/ceph/ceph-client.admin.39293.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41573.log 2024-03-30T13:12:16.927 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34162.log.gz 2024-03-30T13:12:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34738.log 2024-03-30T13:12:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37245.log 2024-03-30T13:12:16.927 INFO:teuthology.orchestra.run.smithi083.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39293.log.gz 2024-03-30T13:12:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41573.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.38220.log.gz 2024-03-30T13:12:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34738.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41573.log.gz 2024-03-30T13:12:16.927 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39193.log 2024-03-30T13:12:16.928 INFO:teuthology.orchestra.run.smithi083.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34738.log.gz 2024-03-30T13:12:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41677.log 2024-03-30T13:12:16.928 INFO:teuthology.orchestra.run.smithi083.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37245.log.gz 2024-03-30T13:12:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37863.log 2024-03-30T13:12:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36809.log 2024-03-30T13:12:16.928 INFO:teuthology.orchestra.run.smithi083.stderr: 88.0%/var/log/ceph/ceph-client.admin.37863.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.39193.log.gz 2024-03-30T13:12:16.928 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41677.log.gz 2024-03-30T13:12:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35859.log 2024-03-30T13:12:16.928 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33746.log 2024-03-30T13:12:16.929 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36809.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.37863.log.gz/var/log/ceph/ceph-client.admin.35859.log: 2024-03-30T13:12:16.929 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34165.log 2024-03-30T13:12:16.929 INFO:teuthology.orchestra.run.smithi083.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36809.log.gz 2024-03-30T13:12:16.929 INFO:teuthology.orchestra.run.smithi083.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35859.log.gz 2024-03-30T13:12:16.929 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33746.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33746.log.gz 2024-03-30T13:12:16.929 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33672.log 2024-03-30T13:12:16.929 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36913.log 2024-03-30T13:12:16.929 INFO:teuthology.orchestra.run.smithi083.stderr: 87.9%/var/log/ceph/ceph-client.admin.33672.log: -- replaced with /var/log/ceph/ceph-client.admin.34165.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39805.log 2024-03-30T13:12:16.929 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-03-30T13:12:16.930 INFO:teuthology.orchestra.run.smithi083.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33672.log.gz 2024-03-30T13:12:16.930 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37404.log 2024-03-30T13:12:16.930 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41963.log 2024-03-30T13:12:16.930 INFO:teuthology.orchestra.run.smithi083.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36913.log.gz 2024-03-30T13:12:16.930 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39805.log: /var/log/ceph/ceph-client.admin.37404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35755.log 2024-03-30T13:12:16.930 INFO:teuthology.orchestra.run.smithi083.stderr: 89.2%/var/log/ceph/ceph-client.admin.41963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41063.log 2024-03-30T13:12:16.930 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37404.log.gz 2024-03-30T13:12:16.930 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35755.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41963.log.gz 2024-03-30T13:12:16.931 INFO:teuthology.orchestra.run.smithi083.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39805.log.gz 2024-03-30T13:12:16.931 INFO:teuthology.orchestra.run.smithi083.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35755.log.gz 2024-03-30T13:12:16.931 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35280.log 2024-03-30T13:12:16.931 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41937.log 2024-03-30T13:12:16.931 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4%/var/log/ceph/ceph-client.admin.35280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39093.log 2024-03-30T13:12:16.931 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41063.log.gz 2024-03-30T13:12:16.931 INFO:teuthology.orchestra.run.smithi083.stderr: 88.8%/var/log/ceph/ceph-client.admin.41937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36492.log 2024-03-30T13:12:16.931 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35280.log.gz 2024-03-30T13:12:16.932 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39093.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41937.log.gz -5 2024-03-30T13:12:16.932 INFO:teuthology.orchestra.run.smithi083.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35116.log 2024-03-30T13:12:16.932 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40875.log 2024-03-30T13:12:16.932 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36492.log: /var/log/ceph/ceph-client.admin.35116.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.39093.log.gz 2024-03-30T13:12:16.932 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40355.log 2024-03-30T13:12:16.932 INFO:teuthology.orchestra.run.smithi083.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36492.log.gz 2024-03-30T13:12:16.932 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40875.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35116.log.gz 2024-03-30T13:12:16.932 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36283.log 2024-03-30T13:12:16.932 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40555.log 2024-03-30T13:12:16.933 INFO:teuthology.orchestra.run.smithi083.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40875.log.gz 2024-03-30T13:12:16.933 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39755.log 2024-03-30T13:12:16.933 INFO:teuthology.orchestra.run.smithi083.stderr: 91.3%/var/log/ceph/ceph-client.admin.40555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33172.log 2024-03-30T13:12:16.933 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40355.log.gz 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36283.log.gz 2024-03-30T13:12:16.933 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-03-30T13:12:16.933 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39755.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40555.log.gz 2024-03-30T13:12:16.933 INFO:teuthology.orchestra.run.smithi083.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39755.log.gz 2024-03-30T13:12:16.933 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37096.log 2024-03-30T13:12:16.933 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36653.log 2024-03-30T13:12:16.934 INFO:teuthology.orchestra.run.smithi083.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33172.log.gz 2024-03-30T13:12:16.934 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37018.log 2024-03-30T13:12:16.934 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37096.log.gz 2024-03-30T13:12:16.934 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38393.log 2024-03-30T13:12:16.934 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37018.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-30T13:12:16.934 INFO:teuthology.orchestra.run.smithi083.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36653.log.gz 2024-03-30T13:12:16.934 INFO:teuthology.orchestra.run.smithi083.stderr: 88.6%/var/log/ceph/ceph-client.admin.38393.log: -- replaced with /var/log/ceph/ceph-client.admin.37018.log.gz 2024-03-30T13:12:16.934 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38843.log 2024-03-30T13:12:16.935 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37148.log 2024-03-30T13:12:16.935 INFO:teuthology.orchestra.run.smithi083.stderr: 91.0%/var/log/ceph/ceph-osd.3.log: -- replaced with /var/log/ceph/ceph-client.admin.38393.log.gz 2024-03-30T13:12:16.935 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34140.log 2024-03-30T13:12:16.935 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37148.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.38843.log.gz 88.7% 2024-03-30T13:12:16.935 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37148.log.gz 2024-03-30T13:12:16.935 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-03-30T13:12:16.935 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36309.log 2024-03-30T13:12:16.935 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4%/var/log/ceph/ceph-client.admin.41089.log: -- replaced with /var/log/ceph/ceph-client.admin.34140.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36835.log 2024-03-30T13:12:16.936 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-03-30T13:12:16.936 INFO:teuthology.orchestra.run.smithi083.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz/var/log/ceph/ceph-client.admin.36309.log: 2024-03-30T13:12:16.936 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33594.log 2024-03-30T13:12:16.936 INFO:teuthology.orchestra.run.smithi083.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36309.log.gz 2024-03-30T13:12:16.936 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36835.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36835.log.gz 2024-03-30T13:12:16.936 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41011.log 2024-03-30T13:12:16.936 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35462.log 2024-03-30T13:12:16.936 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41011.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40505.log 2024-03-30T13:12:16.937 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33594.log.gz 2024-03-30T13:12:16.937 INFO:teuthology.orchestra.run.smithi083.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41011.log.gz 2024-03-30T13:12:16.937 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38693.log 2024-03-30T13:12:16.937 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34163.log 2024-03-30T13:12:16.937 INFO:teuthology.orchestra.run.smithi083.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35462.log.gz 2024-03-30T13:12:16.937 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35990.log 2024-03-30T13:12:16.937 INFO:teuthology.orchestra.run.smithi083.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40505.log.gz 2024-03-30T13:12:16.937 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34163.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38693.log.gz 2024-03-30T13:12:16.938 INFO:teuthology.orchestra.run.smithi083.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34163.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38493.log 2024-03-30T13:12:16.938 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-03-30T13:12:16.938 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33955.log 2024-03-30T13:12:16.938 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35807.log 89.4% 2024-03-30T13:12:16.938 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35990.log.gz 2024-03-30T13:12:16.938 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35540.log 2024-03-30T13:12:16.938 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33955.log: /var/log/ceph/ceph-client.admin.35807.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.38493.log.gz 2024-03-30T13:12:16.938 INFO:teuthology.orchestra.run.smithi083.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33955.log.gz 2024-03-30T13:12:16.938 INFO:teuthology.orchestra.run.smithi083.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35807.log.gz 2024-03-30T13:12:16.939 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33748.log 2024-03-30T13:12:16.939 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35540.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-30T13:12:16.939 INFO:teuthology.orchestra.run.smithi083.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-30T13:12:16.939 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5%/var/log/ceph/ceph-client.admin.33748.log: -- replaced with /var/log/ceph/ceph-client.admin.35540.log.gz 2024-03-30T13:12:16.939 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40055.log 2024-03-30T13:12:16.939 INFO:teuthology.orchestra.run.smithi083.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33748.log.gz 2024-03-30T13:12:16.939 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37599.log 2024-03-30T13:12:16.939 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.40055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36177.log 2024-03-30T13:12:16.939 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38023.log 2024-03-30T13:12:16.940 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36177.log: 91.0% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40055.log.gz 2024-03-30T13:12:16.940 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37599.log.gz 2024-03-30T13:12:16.940 INFO:teuthology.orchestra.run.smithi083.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36177.log.gz 2024-03-30T13:12:16.940 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38443.log 2024-03-30T13:12:16.940 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37297.log 2024-03-30T13:12:16.940 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38443.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.38023.log.gz 2024-03-30T13:12:16.940 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35566.log 2024-03-30T13:12:16.940 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35938.log 2024-03-30T13:12:16.941 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37297.log: /var/log/ceph/ceph-client.admin.35566.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.38443.log.gz 2024-03-30T13:12:16.941 INFO:teuthology.orchestra.run.smithi083.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37297.log.gz 2024-03-30T13:12:16.941 INFO:teuthology.orchestra.run.smithi083.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35566.log.gz 2024-03-30T13:12:16.941 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34686.log 2024-03-30T13:12:16.941 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37785.log 2024-03-30T13:12:16.941 INFO:teuthology.orchestra.run.smithi083.stderr: 88.1%/var/log/ceph/ceph-client.admin.34686.log: -- replaced with /var/log/ceph/ceph-client.admin.35938.log.gzgzip 2024-03-30T13:12:16.941 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40849.log 2024-03-30T13:12:16.941 INFO:teuthology.orchestra.run.smithi083.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34686.log.gz 2024-03-30T13:12:16.941 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41529.log 2024-03-30T13:12:16.942 INFO:teuthology.orchestra.run.smithi083.stderr: 88.0%/var/log/ceph/ceph-client.admin.40849.log: -- replaced with /var/log/ceph/ceph-client.admin.37785.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41755.log 2024-03-30T13:12:16.942 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-03-30T13:12:16.942 INFO:teuthology.orchestra.run.smithi083.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40849.log.gz 2024-03-30T13:12:16.942 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35912.log 2024-03-30T13:12:16.942 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41529.log.gz 2024-03-30T13:12:16.942 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33490.log 2024-03-30T13:12:16.942 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35912.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35670.log 2024-03-30T13:12:16.942 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41755.log.gz 2024-03-30T13:12:16.943 INFO:teuthology.orchestra.run.smithi083.stderr: 89.1%/var/log/ceph/ceph-client.admin.33490.log: -- replaced with /var/log/ceph/ceph-client.admin.35912.log.gz 2024-03-30T13:12:16.943 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36783.log 2024-03-30T13:12:16.943 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41477.log 2024-03-30T13:12:16.943 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36783.log: 88.8% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33490.log.gz -- replaced with /var/log/ceph/ceph-client.admin.35670.log.gz 2024-03-30T13:12:16.943 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-03-30T13:12:16.943 INFO:teuthology.orchestra.run.smithi083.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41703.log 2024-03-30T13:12:16.943 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36783.log.gz 2024-03-30T13:12:16.943 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33028.log 2024-03-30T13:12:16.944 INFO:teuthology.orchestra.run.smithi083.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37430.log 2024-03-30T13:12:16.944 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41477.log.gz 2024-03-30T13:12:16.944 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41703.log: /var/log/ceph/ceph-client.admin.33028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37564.log 2024-03-30T13:12:16.944 INFO:teuthology.orchestra.run.smithi083.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41703.log.gz 2024-03-30T13:12:16.944 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4%/var/log/ceph/ceph-client.admin.37430.log: -- replaced with /var/log/ceph/ceph-client.admin.33028.log.gz 2024-03-30T13:12:16.944 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37352.log 2024-03-30T13:12:16.944 INFO:teuthology.orchestra.run.smithi083.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37430.log.gz 2024-03-30T13:12:16.944 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37837.log 2024-03-30T13:12:16.944 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37352.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37564.log.gz 2024-03-30T13:12:16.945 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37969.log 2024-03-30T13:12:16.945 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35176.log 2024-03-30T13:12:16.945 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37352.log.gz 2024-03-30T13:12:16.945 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37837.log: /var/log/ceph/ceph-client.0.37969.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37837.log.gz 2024-03-30T13:12:16.945 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41625.log 2024-03-30T13:12:16.945 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37070.log 2024-03-30T13:12:16.945 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41625.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35176.log.gz 2024-03-30T13:12:16.945 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41625.log.gz 2024-03-30T13:12:16.946 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38993.log 2024-03-30T13:12:16.946 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42123.log 2024-03-30T13:12:16.946 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37070.log.gz 2024-03-30T13:12:16.946 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36073.log 2024-03-30T13:12:16.946 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42123.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38993.log.gz 2024-03-30T13:12:16.946 INFO:teuthology.orchestra.run.smithi083.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42123.log.gz 2024-03-30T13:12:16.946 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35514.log 2024-03-30T13:12:16.946 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36466.log 2024-03-30T13:12:16.947 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36073.log: /var/log/ceph/ceph-client.admin.35514.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36073.log.gz 2024-03-30T13:12:16.947 INFO:teuthology.orchestra.run.smithi083.stderr: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.35514.log.gz 2024-03-30T13:12:16.947 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35332.log 2024-03-30T13:12:16.947 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33308.log 2024-03-30T13:12:16.947 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36466.log: /var/log/ceph/ceph-client.admin.35332.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36466.log.gz 2024-03-30T13:12:16.947 INFO:teuthology.orchestra.run.smithi083.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35332.log.gz 2024-03-30T13:12:16.947 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35833.log 2024-03-30T13:12:16.947 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42093.log 2024-03-30T13:12:16.947 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35833.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33308.log.gz 2024-03-30T13:12:16.948 INFO:teuthology.orchestra.run.smithi083.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35833.log.gz 2024-03-30T13:12:16.948 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35964.log 2024-03-30T13:12:16.948 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42093.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-30T13:12:16.948 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35964.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42093.log.gz 2024-03-30T13:12:16.948 INFO:teuthology.orchestra.run.smithi083.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35964.log.gz 2024-03-30T13:12:16.948 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41406.log 2024-03-30T13:12:16.948 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37536.log 2024-03-30T13:12:16.948 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41406.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41406.log.gz 2024-03-30T13:12:16.949 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36335.log 2024-03-30T13:12:16.949 INFO:teuthology.orchestra.run.smithi083.stderr: 85.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-30T13:12:16.949 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37536.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37536.log.gz 2024-03-30T13:12:16.949 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41911.log 2024-03-30T13:12:16.949 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41451.log 2024-03-30T13:12:16.949 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41911.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36335.log.gz 2024-03-30T13:12:16.949 INFO:teuthology.orchestra.run.smithi083.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41911.log.gz 2024-03-30T13:12:16.949 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42067.log 2024-03-30T13:12:16.949 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27543.log 2024-03-30T13:12:16.950 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42067.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41451.log.gz 2024-03-30T13:12:16.950 INFO:teuthology.orchestra.run.smithi083.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42067.log.gz 2024-03-30T13:12:16.950 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37456.log 2024-03-30T13:12:16.950 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.27543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38167.log 2024-03-30T13:12:16.950 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37456.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27543.log.gz 2024-03-30T13:12:16.950 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37456.log.gz 2024-03-30T13:12:16.950 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35410.log 2024-03-30T13:12:16.951 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37811.log 2024-03-30T13:12:16.951 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35410.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35410.log.gz 2024-03-30T13:12:16.951 INFO:teuthology.orchestra.run.smithi083.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38167.log.gz 2024-03-30T13:12:16.951 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33960.log 2024-03-30T13:12:16.951 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log 2024-03-30T13:12:16.951 INFO:teuthology.orchestra.run.smithi083.stderr: 88.0%/var/log/ceph/ceph-client.admin.33960.log: -- replaced with /var/log/ceph/ceph-client.admin.37811.log.gz 2024-03-30T13:12:16.951 INFO:teuthology.orchestra.run.smithi083.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33960.log.gz 2024-03-30T13:12:16.951 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37044.log 2024-03-30T13:12:16.970 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41503.log 2024-03-30T13:12:16.971 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37044.log: 89.2% 91.2% -- replaced with /var/log/ceph/ceph-client.admin.37044.log.gz 2024-03-30T13:12:16.971 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40255.log.gz 2024-03-30T13:12:16.971 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36021.log 2024-03-30T13:12:16.971 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34168.log 2024-03-30T13:12:16.971 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36021.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41503.log.gz 2024-03-30T13:12:16.971 INFO:teuthology.orchestra.run.smithi083.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36021.log.gz 2024-03-30T13:12:16.971 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41224.log 2024-03-30T13:12:16.971 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34158.log 2024-03-30T13:12:16.972 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41224.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34168.log.gz 2024-03-30T13:12:16.972 INFO:teuthology.orchestra.run.smithi083.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41224.log.gz 2024-03-30T13:12:16.972 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36731.log 2024-03-30T13:12:16.972 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35358.log 2024-03-30T13:12:16.972 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36731.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34158.log.gz 2024-03-30T13:12:16.972 INFO:teuthology.orchestra.run.smithi083.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36731.log.gz 2024-03-30T13:12:16.972 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33744.log 2024-03-30T13:12:16.972 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34530.log 2024-03-30T13:12:16.972 INFO:teuthology.orchestra.run.smithi083.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35358.log.gz/var/log/ceph/ceph-client.admin.33744.log: 2024-03-30T13:12:16.973 INFO:teuthology.orchestra.run.smithi083.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33744.log.gz 2024-03-30T13:12:16.973 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35722.log 2024-03-30T13:12:16.973 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36440.log 2024-03-30T13:12:16.973 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35722.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34530.log.gz 2024-03-30T13:12:16.973 INFO:teuthology.orchestra.run.smithi083.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.35722.log.gz 2024-03-30T13:12:16.973 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42015.log 2024-03-30T13:12:16.973 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33751.log 2024-03-30T13:12:16.973 INFO:teuthology.orchestra.run.smithi083.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36440.log.gz/var/log/ceph/ceph-client.admin.42015.log: 2024-03-30T13:12:16.974 INFO:teuthology.orchestra.run.smithi083.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42015.log.gz 2024-03-30T13:12:16.974 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33438.log 2024-03-30T13:12:16.974 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39143.log 2024-03-30T13:12:16.974 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33751.log: /var/log/ceph/ceph-client.admin.33438.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33751.log.gz 2024-03-30T13:12:16.974 INFO:teuthology.orchestra.run.smithi083.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33438.log.gz 2024-03-30T13:12:16.974 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38893.log 2024-03-30T13:12:16.974 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38077.log 2024-03-30T13:12:16.974 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39143.log: /var/log/ceph/ceph-client.admin.38893.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.39143.log.gz 2024-03-30T13:12:16.974 INFO:teuthology.orchestra.run.smithi083.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38893.log.gz 2024-03-30T13:12:16.975 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33958.log 2024-03-30T13:12:16.975 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34374.log 2024-03-30T13:12:16.975 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38077.log: /var/log/ceph/ceph-client.admin.33958.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38077.log.gz 2024-03-30T13:12:16.975 INFO:teuthology.orchestra.run.smithi083.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33958.log.gz 2024-03-30T13:12:16.975 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40405.log 2024-03-30T13:12:16.975 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34374.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34374.log.gz 2024-03-30T13:12:16.975 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34452.log 2024-03-30T13:12:16.975 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36992.log 2024-03-30T13:12:16.976 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40405.log: /var/log/ceph/ceph-client.admin.34452.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34452.log.gz 2024-03-30T13:12:16.976 INFO:teuthology.orchestra.run.smithi083.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.40405.log.gz 2024-03-30T13:12:16.976 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36361.log 2024-03-30T13:12:16.976 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39043.log 2024-03-30T13:12:16.976 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36992.log: /var/log/ceph/ceph-client.admin.36361.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36992.log.gz 2024-03-30T13:12:16.976 INFO:teuthology.orchestra.run.smithi083.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36361.log.gz 2024-03-30T13:12:16.976 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-30T13:12:16.976 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-30T13:12:16.976 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39043.log: /var/log/ceph/ceph.audit.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39043.log.gz 2024-03-30T13:12:16.977 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34971.log 2024-03-30T13:12:16.977 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mds.c.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-30T13:12:16.977 INFO:teuthology.orchestra.run.smithi083.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-30T13:12:16.977 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37122.log 2024-03-30T13:12:16.977 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33093.log 2024-03-30T13:12:16.977 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34971.log: /var/log/ceph/ceph-client.admin.37122.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34971.log.gz 2024-03-30T13:12:16.977 INFO:teuthology.orchestra.run.smithi083.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37122.log.gz 2024-03-30T13:12:16.977 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-30T13:12:16.977 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log 2024-03-30T13:12:16.978 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33093.log: /var/log/ceph/ceph-mds.a.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33093.log.gz 2024-03-30T13:12:16.978 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41729.log 2024-03-30T13:12:16.978 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40985.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40985.log.gz 2024-03-30T13:12:16.978 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40755.log 2024-03-30T13:12:16.978 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41729.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41729.log.gz 2024-03-30T13:12:16.978 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41276.log 2024-03-30T13:12:16.978 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40755.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40755.log.gz 2024-03-30T13:12:16.978 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33224.log 2024-03-30T13:12:16.979 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41276.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41276.log.gz 2024-03-30T13:12:16.979 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36757.log 2024-03-30T13:12:16.979 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33224.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33224.log.gz 2024-03-30T13:12:16.979 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35142.log 2024-03-30T13:12:16.979 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36757.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36757.log.gz 2024-03-30T13:12:16.979 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37759.log 2024-03-30T13:12:16.979 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35142.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35142.log.gz 2024-03-30T13:12:16.979 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39480.log 2024-03-30T13:12:16.979 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37759.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37759.log.gz 2024-03-30T13:12:16.980 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39243.log 2024-03-30T13:12:16.980 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39480.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.39480.log.gz 2024-03-30T13:12:16.980 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34164.log 2024-03-30T13:12:16.980 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39243.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39243.log.gz 2024-03-30T13:12:16.980 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40205.log 2024-03-30T13:12:16.980 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34164.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34164.log.gz 2024-03-30T13:12:16.980 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41198.log 2024-03-30T13:12:16.980 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40205.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.40205.log.gz 2024-03-30T13:12:16.980 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37913.log 2024-03-30T13:12:16.981 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41198.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41198.log.gz 2024-03-30T13:12:16.981 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34660.log 2024-03-30T13:12:16.981 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37913.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37913.log.gz 2024-03-30T13:12:16.981 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38543.log 2024-03-30T13:12:16.981 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34660.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34660.log.gz 2024-03-30T13:12:16.981 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33698.log 2024-03-30T13:12:16.987 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38543.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38543.log.gz 2024-03-30T13:12:16.987 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38643.log 2024-03-30T13:12:16.987 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33698.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33698.log.gz 2024-03-30T13:12:16.987 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33959.log 2024-03-30T13:12:16.987 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38643.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.38643.log.gz 2024-03-30T13:12:16.987 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39955.log 2024-03-30T13:12:16.987 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33959.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33959.log.gz 2024-03-30T13:12:16.987 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38743.log 2024-03-30T13:12:16.988 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39955.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39955.log.gz 2024-03-30T13:12:16.988 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34400.log 2024-03-30T13:12:16.988 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38743.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38743.log.gz 2024-03-30T13:12:16.988 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33568.log 2024-03-30T13:12:16.988 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34400.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34400.log.gz 2024-03-30T13:12:16.988 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40005.log 2024-03-30T13:12:16.988 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33568.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33568.log.gz 2024-03-30T13:12:16.988 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33516.log 2024-03-30T13:12:16.989 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40005.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40005.log.gz 2024-03-30T13:12:16.989 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41037.log 2024-03-30T13:12:16.989 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33516.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33516.log.gz 2024-03-30T13:12:16.989 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37482.log 2024-03-30T13:12:16.989 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41037.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41037.log.gz 2024-03-30T13:12:16.989 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33940.log 2024-03-30T13:12:16.991 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37482.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37482.log.gz 2024-03-30T13:12:16.991 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39655.log 2024-03-30T13:12:16.991 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33940.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33940.log.gz 2024-03-30T13:12:16.992 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33542.log 2024-03-30T13:12:16.992 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39655.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.39655.log.gz 2024-03-30T13:12:16.992 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35254.log 2024-03-30T13:12:16.992 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33542.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33542.log.gz 2024-03-30T13:12:16.993 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35781.log 2024-03-30T13:12:16.993 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35254.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35254.log.gz 2024-03-30T13:12:16.993 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35228.log 2024-03-30T13:12:16.994 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35781.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35781.log.gz 2024-03-30T13:12:16.994 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37707.log 2024-03-30T13:12:16.999 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35228.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35228.log.gz 2024-03-30T13:12:16.999 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33646.log 2024-03-30T13:12:17.000 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37707.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37707.log.gz 2024-03-30T13:12:17.000 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36518.log 2024-03-30T13:12:17.000 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33646.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.33646.log.gz 2024-03-30T13:12:17.000 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36601.log 2024-03-30T13:12:17.000 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36518.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36518.log.gz 2024-03-30T13:12:17.001 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33956.log 2024-03-30T13:12:17.001 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36601.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36601.log.gz 2024-03-30T13:12:17.001 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41599.log 2024-03-30T13:12:17.002 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33956.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33956.log.gz 2024-03-30T13:12:17.002 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33738.log 2024-03-30T13:12:17.003 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41599.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41599.log.gz 2024-03-30T13:12:17.004 INFO:teuthology.orchestra.run.smithi153.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-30T13:12:17.004 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33620.log 2024-03-30T13:12:17.005 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33738.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33738.log.gz 2024-03-30T13:12:17.005 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36047.log 2024-03-30T13:12:17.006 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33620.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33620.log.gz 2024-03-30T13:12:17.006 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33752.log 2024-03-30T13:12:17.007 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36047.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36047.log.gz 2024-03-30T13:12:17.007 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42147.log 2024-03-30T13:12:17.008 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33752.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33752.log.gz 2024-03-30T13:12:17.009 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39530.log 2024-03-30T13:12:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42147.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42147.log.gz 2024-03-30T13:12:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38593.log 2024-03-30T13:12:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39530.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.39530.log.gz 2024-03-30T13:12:17.012 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38293.log 2024-03-30T13:12:17.013 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38593.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.38593.log.gz 2024-03-30T13:12:17.013 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37378.log 2024-03-30T13:12:17.015 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38293.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38293.log.gz 2024-03-30T13:12:17.015 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40953.log 2024-03-30T13:12:17.016 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37378.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37378.log.gz 2024-03-30T13:12:17.016 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38117.log 2024-03-30T13:12:17.017 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40953.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40953.log.gz 2024-03-30T13:12:17.018 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40305.log 2024-03-30T13:12:17.019 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38117.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38117.log.gz 2024-03-30T13:12:17.019 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41651.log 2024-03-30T13:12:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40305.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40305.log.gz 2024-03-30T13:12:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34426.log 2024-03-30T13:12:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41651.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41651.log.gz 2024-03-30T13:12:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39705.log 2024-03-30T13:12:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34426.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34426.log.gz 2024-03-30T13:12:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37271.log 2024-03-30T13:12:17.025 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39705.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39705.log.gz 2024-03-30T13:12:17.025 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40155.log 2024-03-30T13:12:17.026 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37271.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37271.log.gz 2024-03-30T13:12:17.026 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38793.log 2024-03-30T13:12:17.028 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40155.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40155.log.gz 2024-03-30T13:12:17.028 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34478.log 2024-03-30T13:12:17.029 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38793.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.38793.log.gz 2024-03-30T13:12:17.030 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39855.log 2024-03-30T13:12:17.031 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.34478.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34478.log.gz 2024-03-30T13:12:17.031 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37508.log 2024-03-30T13:12:17.032 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39855.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39855.log.gz 2024-03-30T13:12:17.033 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39444.log 2024-03-30T13:12:17.034 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37508.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37508.log.gz 2024-03-30T13:12:17.034 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37733.log 2024-03-30T13:12:17.035 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39444.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39444.log.gz 2024-03-30T13:12:17.035 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36887.log 2024-03-30T13:12:17.036 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37733.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37733.log.gz 2024-03-30T13:12:17.036 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41380.log 2024-03-30T13:12:17.037 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36887.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36887.log.gz 2024-03-30T13:12:17.038 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33146.log 2024-03-30T13:12:17.039 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41380.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41380.log.gz 2024-03-30T13:12:17.039 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36414.log 2024-03-30T13:12:17.040 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33146.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33146.log.gz 2024-03-30T13:12:17.040 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33749.log 2024-03-30T13:12:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36414.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36414.log.gz 2024-03-30T13:12:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41885.log 2024-03-30T13:12:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33749.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33749.log.gz 2024-03-30T13:12:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35696.log 2024-03-30T13:12:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41885.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41885.log.gz 2024-03-30T13:12:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35618.log 2024-03-30T13:12:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35696.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35696.log.gz 2024-03-30T13:12:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42173.log 2024-03-30T13:12:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35618.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35618.log.gz 2024-03-30T13:12:17.047 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37625.log 2024-03-30T13:12:17.048 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42173.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42173.log.gz 2024-03-30T13:12:17.048 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39905.log 2024-03-30T13:12:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37625.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37625.log.gz 2024-03-30T13:12:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41170.log 2024-03-30T13:12:17.051 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39905.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.39905.log.gz 2024-03-30T13:12:17.051 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33950.log 2024-03-30T13:12:17.052 INFO:teuthology.orchestra.run.smithi153.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-30T13:12:17.053 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41170.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41170.log.gz 2024-03-30T13:12:17.053 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33464.log 2024-03-30T13:12:17.053 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33950.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33950.log.gz 2024-03-30T13:12:17.054 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33464.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33464.log.gz 2024-03-30T13:12:17.064 INFO:teuthology.orchestra.run.smithi153.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-30T13:12:17.079 INFO:teuthology.orchestra.run.smithi083.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-30T13:12:17.081 INFO:teuthology.orchestra.run.smithi083.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-30T13:12:17.131 INFO:teuthology.orchestra.run.smithi153.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-30T13:12:17.143 INFO:teuthology.orchestra.run.smithi153.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-30T13:12:17.173 INFO:teuthology.orchestra.run.smithi153.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-30T13:12:17.175 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-03-30T13:12:17.175 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m0.329s 2024-03-30T13:12:17.175 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m1.304s 2024-03-30T13:12:17.175 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m0.069s 2024-03-30T13:12:17.202 INFO:teuthology.orchestra.run.smithi083.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-30T13:12:17.210 INFO:teuthology.orchestra.run.smithi083.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-30T13:12:17.214 INFO:teuthology.orchestra.run.smithi083.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-30T13:12:17.751 INFO:teuthology.orchestra.run.smithi083.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-30T13:12:18.421 INFO:teuthology.orchestra.run.smithi083.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.0.37969.log.gz 2024-03-30T13:12:18.423 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-03-30T13:12:18.423 INFO:teuthology.orchestra.run.smithi083.stderr:real 0m1.618s 2024-03-30T13:12:18.423 INFO:teuthology.orchestra.run.smithi083.stderr:user 0m4.004s 2024-03-30T13:12:18.423 INFO:teuthology.orchestra.run.smithi083.stderr:sys 0m0.256s 2024-03-30T13:12:18.424 INFO:tasks.ceph:Archiving logs... 2024-03-30T13:12:18.424 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144/remote/smithi083/log 2024-03-30T13:12:18.425 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T13:12:19.058 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144/remote/smithi153/log 2024-03-30T13:12:19.059 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T13:12:19.211 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-30T13:12:19.228 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-30T13:12:19.229 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-30T13:12:19.232 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-30T13:12:19.304 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-30T13:12:19.313 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-30T13:12:19.314 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:12:19.316 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:12:19.327 INFO:teuthology.orchestra.run.smithi083.stdout: remote refid st t when poll reach delay offset jitter 2024-03-30T13:12:19.327 INFO:teuthology.orchestra.run.smithi083.stdout:============================================================================== 2024-03-30T13:12:19.327 INFO:teuthology.orchestra.run.smithi083.stdout:*hv01.front.sepi 44.4.53.2 2 u 9 64 377 0.104 -1.281 0.795 2024-03-30T13:12:19.327 INFO:teuthology.orchestra.run.smithi083.stdout:+hv02.front.sepi 63.231.80.2 3 u 7 64 377 0.158 -1.043 0.795 2024-03-30T13:12:19.327 INFO:teuthology.orchestra.run.smithi083.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.103 -1.393 0.745 2024-03-30T13:12:19.327 INFO:teuthology.orchestra.run.smithi083.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T13:12:19.329 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-03-30T13:12:19.330 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-03-30T13:12:19.330 INFO:teuthology.orchestra.run.smithi153.stdout:*hv01.front.sepi 44.4.53.2 2 u 8 64 377 0.094 -0.690 0.499 2024-03-30T13:12:19.330 INFO:teuthology.orchestra.run.smithi153.stdout:+hv02.front.sepi 63.231.80.2 3 u 7 64 377 0.109 -0.430 0.419 2024-03-30T13:12:19.330 INFO:teuthology.orchestra.run.smithi153.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.080 -0.807 0.427 2024-03-30T13:12:19.330 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T13:12:19.331 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-30T13:12:19.341 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-30T13:12:19.341 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-30T13:12:19.352 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-30T13:12:19.361 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-30T13:12:19.372 INFO:teuthology.task.internal:Duration was 901.346825 seconds 2024-03-30T13:12:19.373 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-30T13:12:19.384 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-30T13:12:19.384 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T13:12:19.387 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T13:12:19.423 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-30T13:12:19.423 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2024-03-30T13:12:19.423 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T13:12:19.479 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-03-30T13:12:19.479 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T13:12:19.490 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-30T13:12:19.490 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T13:12:19.523 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T13:12:19.556 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-30T13:12:19.556 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T13:12:19.595 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T13:12:19.656 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-30T13:12:19.667 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-30T13:12:19.668 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T13:12:19.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T13:12:19.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-30T13:12:19.700 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T13:12:19.723 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T13:12:19.731 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2024-03-30T13:12:19.743 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-03-30T13:12:19.758 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T13:12:19.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:12:19.790 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T13:12:19.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:12:19.803 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-30T13:12:19.813 INFO:teuthology.task.internal:Transferring archived files... 2024-03-30T13:12:19.814 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144/remote/smithi083 2024-03-30T13:12:19.814 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T13:12:19.854 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144/remote/smithi153 2024-03-30T13:12:19.855 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T13:12:19.874 INFO:teuthology.task.internal:Removing archive directory... 2024-03-30T13:12:19.874 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T13:12:19.895 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T13:12:19.916 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-30T13:12:19.930 INFO:teuthology.task.internal:Not uploading archives. 2024-03-30T13:12:19.930 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-30T13:12:19.940 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-30T13:12:19.941 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T13:12:19.943 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T13:12:19.946 INFO:teuthology.orchestra.run.smithi083.stdout: 658625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 13:12 /home/ubuntu/cephtest 2024-03-30T13:12:19.964 INFO:teuthology.orchestra.run.smithi153.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 13:12 /home/ubuntu/cephtest 2024-03-30T13:12:19.965 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-30T13:12:19.976 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-30T13:12:19.998 INFO:teuthology.nuke:Checking targets against current locks 2024-03-30T13:12:20.025 DEBUG:teuthology.nuke:shortname: smithi083 2024-03-30T13:12:20.026 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T13:12:20.048 DEBUG:teuthology.nuke:shortname: smithi153 2024-03-30T13:12:20.048 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T13:12:20.052 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 12:47:58.926345', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQncMjdkmL0Ut+RMDCYwSEvn24cR8fWRRWTz8K1umSOkBYIE51wXn7pl5RwzpxAEY0pWqsydHCuujicnV+RJHg='} 2024-03-30T13:12:20.076 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629144', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 12:47:58.925318', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6Jqlo9d8WP5l1R2CMXUOnRdFXhCejeX8yB25T08KHYEYmSpmyU4ZhtZbCU8idUf5sAmoE8u1jhUmhNQLrfol8='} 2024-03-30T13:12:20.100 INFO:teuthology.orchestra.console.smithi083:Power off 2024-03-30T13:12:20.101 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T13:12:20.124 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2024-03-30T13:12:20.125 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:12:20.143 INFO:teuthology.orchestra.console.smithi153:Power off 2024-03-30T13:12:20.143 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T13:12:20.152 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-03-30T13:12:20.169 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2024-03-30T13:12:20.169 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:12:20.193 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-30T13:12:24.153 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:12:24.193 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:12:24.264 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-03-30T13:12:24.305 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-30T13:12:28.266 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:12:28.306 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:12:28.377 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2024-03-30T13:12:28.417 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-30T13:12:28.479 INFO:teuthology.orchestra.console.smithi083:Power off completed 2024-03-30T13:12:32.422 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:12:32.533 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-03-30T13:12:32.634 INFO:teuthology.orchestra.console.smithi153:Power off completed 2024-03-30T13:12:32.739 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/uninlining} duration: 901.3468253612518 failure_reason: 'Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=07875d0cb1b147bf875dd90c403953d7 status: fail success: false 2024-03-30T13:12:32.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T13:12:32.821 INFO:teuthology.run:FAIL